2026-02-24T18:20:14.522 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-24T18:20:14.539 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T18:20:14.615 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68689 branch: wip-yuri3-testing-2026-02-19-1610-tentacle description: rados/verify/{centos_latest ceph clusters/fixed-4 d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/{bluestore/{alloc$/{btree} base mem$/{normal-2} onode-segment$/{none} write$/{random/{compr$/{no$/{no}} random}}}} rados read-affinity/balance tasks/rados_api_tests validater/valgrind} email: null first_in_suite: false flavor: default job_id: '68689' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri3-testing-2026-02-19-1610-tentacle ceph: conf: client: debug monc: 20 debug ms: 1 debug objecter: 20 debug rados: 20 rados replica read policy: balance global: mon client directed command retry: 5 mon election default strategy: 3 ms bind msgr2: false ms inject socket failures: 5000 ms type: async osd heartbeat grace: 160 osd op thread timeout: 150 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osd crush smoke test: false mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub interval: 300 mon warn on pool no app: false paxos service trim min: 10 osd: bdev async discard: true bdev enable discard: true bluestore allocator: btree bluestore block size: 96636764160 bluestore fsck on mount: true bluestore onode segment size: 0 bluestore write v2 random: true bluestore zero block detection: true crush location: root=default host=host-$id debug bluefs: 1 debug bluestore: 1 debug monc: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd class default list: '*' osd class load list: '*' osd client watch timeout: 240 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd fast shutdown: false osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd mclock skip benchmark: true osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - reached quota - overall HEALTH_ - \(CACHE_POOL_NO_HIT_SET\) - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(SLOW_OPS\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(OBJECT_MISPLACED\) - slow request - overall HEALTH_ - \(PG_ - \(MON_DOWN\) - \(SLOW_OPS\) - slow request - OSD bench result - OSD_DOWN mon_bind_msgr2: false sha1: 36d388f27052dd940bdbaf543bb05bdba0acc155 stop-daemons-timeout: 1200 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes osd: - --tool=memcheck ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: debuginfo: true flavor: default sha1: 36d388f27052dd940bdbaf543bb05bdba0acc155 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri3-testing-2026-02-19-1610-tentacle sha1: 36d388f27052dd940bdbaf543bb05bdba0acc155 owner: scheduled_jayaprakash@soko04.front.sepia.ceph.com priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - osd.0 - osd.4 - osd.8 - osd.12 - - mon.b - osd.1 - osd.5 - osd.9 - osd.13 - - mon.c - osd.2 - osd.6 - osd.10 - osd.14 - - mgr.x - osd.3 - osd.7 - osd.11 - osd.15 - client.0 seed: 6877 sha1: 36d388f27052dd940bdbaf543bb05bdba0acc155 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri3-testing-2026-02-19-1610-tentacle suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_36d388f27052dd940bdbaf543bb05bdba0acc155/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 36d388f27052dd940bdbaf543bb05bdba0acc155 targets: trial014.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEUziiRjBQ1cILcOI2uOUvy1ubzob1BZdgOIoPIkwqpA2IXAJogLkMVQEbFgvtBxFKO44YOycy5loFF8H1XYxvM= trial044.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBL5D7O7r2d+Ktb7M4R0omsY7nyb4JfZj7bV2T/t59h4n69VWQIGzcgCsgNvwKeWH9tHkhvLl0zTEPMyuj5AoqU= trial170.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIOjlSQitrhMfOj2aGeYZ/E5/55CbgHub8fqPVxpD1+FBeCWmNl0evsYukAcxqc/0sI179zjVdAsDvNbUpypEfY= trial195.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK0cjOXAWZ+cMmau4pm7oPp5k/OMQluyIBO6RU4wa1GoJsnskJOLkQtGEMBcYhclHsdis4WVIWdF1QxuuAKg4qs= tasks: - install: null - ceph: null - workunit: clients: client.0: - rados/test.sh env: ALLOW_TIMEOUTS: '1' timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - '-- Don''t run this test on tiny clusters if py_len(yaml.roles) < 4 then reject() end ' teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-24_16:27:17 tube: trial user: jayaprakash verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.904699 2026-02-24T18:20:14.615 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_36d388f27052dd940bdbaf543bb05bdba0acc155/qa; will attempt to use it 2026-02-24T18:20:14.615 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_36d388f27052dd940bdbaf543bb05bdba0acc155/qa/tasks 2026-02-24T18:20:14.616 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-24T18:20:14.617 INFO:teuthology.task.internal:Checking packages... 2026-02-24T18:20:14.617 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '36d388f27052dd940bdbaf543bb05bdba0acc155' 2026-02-24T18:20:14.617 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-24T18:20:14.617 INFO:teuthology.packaging:ref: None 2026-02-24T18:20:14.617 INFO:teuthology.packaging:tag: None 2026-02-24T18:20:14.617 INFO:teuthology.packaging:branch: wip-yuri3-testing-2026-02-19-1610-tentacle 2026-02-24T18:20:14.617 INFO:teuthology.packaging:sha1: 36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-24T18:20:14.617 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri3-testing-2026-02-19-1610-tentacle 2026-02-24T18:20:14.734 INFO:teuthology.task.internal:Found packages for ceph version 20.2.0-681.g36d388f2 2026-02-24T18:20:14.735 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-24T18:20:14.747 INFO:teuthology.task.internal:no buildpackages task found 2026-02-24T18:20:14.747 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-24T18:20:14.759 INFO:teuthology.task.internal:Saving configuration 2026-02-24T18:20:14.772 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-24T18:20:14.786 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-24T18:20:14.863 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial014.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68689', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-24 18:16:40.422526', 'locked_by': 'scheduled_jayaprakash@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEUziiRjBQ1cILcOI2uOUvy1ubzob1BZdgOIoPIkwqpA2IXAJogLkMVQEbFgvtBxFKO44YOycy5loFF8H1XYxvM='} 2026-02-24T18:20:14.918 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial044.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68689', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-24 18:16:40.422172', 'locked_by': 'scheduled_jayaprakash@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBL5D7O7r2d+Ktb7M4R0omsY7nyb4JfZj7bV2T/t59h4n69VWQIGzcgCsgNvwKeWH9tHkhvLl0zTEPMyuj5AoqU='} 2026-02-24T18:20:14.972 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial170.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68689', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-24 18:16:40.421612', 'locked_by': 'scheduled_jayaprakash@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIOjlSQitrhMfOj2aGeYZ/E5/55CbgHub8fqPVxpD1+FBeCWmNl0evsYukAcxqc/0sI179zjVdAsDvNbUpypEfY='} 2026-02-24T18:20:15.026 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial195.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68689', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-24 18:16:40.422855', 'locked_by': 'scheduled_jayaprakash@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK0cjOXAWZ+cMmau4pm7oPp5k/OMQluyIBO6RU4wa1GoJsnskJOLkQtGEMBcYhclHsdis4WVIWdF1QxuuAKg4qs='} 2026-02-24T18:20:15.026 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-24T18:20:15.041 INFO:teuthology.task.internal:roles: ubuntu@trial014.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'] 2026-02-24T18:20:15.041 INFO:teuthology.task.internal:roles: ubuntu@trial044.front.sepia.ceph.com - ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'] 2026-02-24T18:20:15.041 INFO:teuthology.task.internal:roles: ubuntu@trial170.front.sepia.ceph.com - ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'] 2026-02-24T18:20:15.041 INFO:teuthology.task.internal:roles: ubuntu@trial195.front.sepia.ceph.com - ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0'] 2026-02-24T18:20:15.041 INFO:teuthology.run_tasks:Running task console_log... 2026-02-24T18:20:15.283 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x773f9469afc0>, signals=[15]) 2026-02-24T18:20:15.284 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-24T18:20:15.295 INFO:teuthology.task.internal:Opening connections... 2026-02-24T18:20:15.295 DEBUG:teuthology.task.internal:connecting to ubuntu@trial014.front.sepia.ceph.com 2026-02-24T18:20:15.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial014.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:20:15.361 DEBUG:teuthology.task.internal:connecting to ubuntu@trial044.front.sepia.ceph.com 2026-02-24T18:20:15.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:20:15.422 DEBUG:teuthology.task.internal:connecting to ubuntu@trial170.front.sepia.ceph.com 2026-02-24T18:20:15.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:20:15.485 DEBUG:teuthology.task.internal:connecting to ubuntu@trial195.front.sepia.ceph.com 2026-02-24T18:20:15.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:20:15.548 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-24T18:20:15.559 DEBUG:teuthology.orchestra.run.trial014:> uname -m 2026-02-24T18:20:15.575 INFO:teuthology.orchestra.run.trial014.stdout:x86_64 2026-02-24T18:20:15.575 DEBUG:teuthology.orchestra.run.trial014:> cat /etc/os-release 2026-02-24T18:20:15.632 INFO:teuthology.orchestra.run.trial014.stdout:NAME="CentOS Stream" 2026-02-24T18:20:15.632 INFO:teuthology.orchestra.run.trial014.stdout:VERSION="9" 2026-02-24T18:20:15.632 INFO:teuthology.orchestra.run.trial014.stdout:ID="centos" 2026-02-24T18:20:15.632 INFO:teuthology.orchestra.run.trial014.stdout:ID_LIKE="rhel fedora" 2026-02-24T18:20:15.632 INFO:teuthology.orchestra.run.trial014.stdout:VERSION_ID="9" 2026-02-24T18:20:15.632 INFO:teuthology.orchestra.run.trial014.stdout:PLATFORM_ID="platform:el9" 2026-02-24T18:20:15.632 INFO:teuthology.orchestra.run.trial014.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-24T18:20:15.632 INFO:teuthology.orchestra.run.trial014.stdout:ANSI_COLOR="0;31" 2026-02-24T18:20:15.632 INFO:teuthology.orchestra.run.trial014.stdout:LOGO="fedora-logo-icon" 2026-02-24T18:20:15.632 INFO:teuthology.orchestra.run.trial014.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-24T18:20:15.632 INFO:teuthology.orchestra.run.trial014.stdout:HOME_URL="https://centos.org/" 2026-02-24T18:20:15.632 INFO:teuthology.orchestra.run.trial014.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-24T18:20:15.633 INFO:teuthology.orchestra.run.trial014.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-24T18:20:15.633 INFO:teuthology.orchestra.run.trial014.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-24T18:20:15.633 INFO:teuthology.lock.ops:Updating trial014.front.sepia.ceph.com on lock server 2026-02-24T18:20:15.709 DEBUG:teuthology.orchestra.run.trial044:> uname -m 2026-02-24T18:20:15.724 INFO:teuthology.orchestra.run.trial044.stdout:x86_64 2026-02-24T18:20:15.724 DEBUG:teuthology.orchestra.run.trial044:> cat /etc/os-release 2026-02-24T18:20:15.780 INFO:teuthology.orchestra.run.trial044.stdout:NAME="CentOS Stream" 2026-02-24T18:20:15.780 INFO:teuthology.orchestra.run.trial044.stdout:VERSION="9" 2026-02-24T18:20:15.780 INFO:teuthology.orchestra.run.trial044.stdout:ID="centos" 2026-02-24T18:20:15.780 INFO:teuthology.orchestra.run.trial044.stdout:ID_LIKE="rhel fedora" 2026-02-24T18:20:15.780 INFO:teuthology.orchestra.run.trial044.stdout:VERSION_ID="9" 2026-02-24T18:20:15.780 INFO:teuthology.orchestra.run.trial044.stdout:PLATFORM_ID="platform:el9" 2026-02-24T18:20:15.780 INFO:teuthology.orchestra.run.trial044.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-24T18:20:15.780 INFO:teuthology.orchestra.run.trial044.stdout:ANSI_COLOR="0;31" 2026-02-24T18:20:15.780 INFO:teuthology.orchestra.run.trial044.stdout:LOGO="fedora-logo-icon" 2026-02-24T18:20:15.780 INFO:teuthology.orchestra.run.trial044.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-24T18:20:15.780 INFO:teuthology.orchestra.run.trial044.stdout:HOME_URL="https://centos.org/" 2026-02-24T18:20:15.780 INFO:teuthology.orchestra.run.trial044.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-24T18:20:15.780 INFO:teuthology.orchestra.run.trial044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-24T18:20:15.781 INFO:teuthology.orchestra.run.trial044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-24T18:20:15.781 INFO:teuthology.lock.ops:Updating trial044.front.sepia.ceph.com on lock server 2026-02-24T18:20:15.886 DEBUG:teuthology.orchestra.run.trial170:> uname -m 2026-02-24T18:20:15.901 INFO:teuthology.orchestra.run.trial170.stdout:x86_64 2026-02-24T18:20:15.902 DEBUG:teuthology.orchestra.run.trial170:> cat /etc/os-release 2026-02-24T18:20:15.957 INFO:teuthology.orchestra.run.trial170.stdout:NAME="CentOS Stream" 2026-02-24T18:20:15.957 INFO:teuthology.orchestra.run.trial170.stdout:VERSION="9" 2026-02-24T18:20:15.957 INFO:teuthology.orchestra.run.trial170.stdout:ID="centos" 2026-02-24T18:20:15.957 INFO:teuthology.orchestra.run.trial170.stdout:ID_LIKE="rhel fedora" 2026-02-24T18:20:15.957 INFO:teuthology.orchestra.run.trial170.stdout:VERSION_ID="9" 2026-02-24T18:20:15.957 INFO:teuthology.orchestra.run.trial170.stdout:PLATFORM_ID="platform:el9" 2026-02-24T18:20:15.957 INFO:teuthology.orchestra.run.trial170.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-24T18:20:15.957 INFO:teuthology.orchestra.run.trial170.stdout:ANSI_COLOR="0;31" 2026-02-24T18:20:15.957 INFO:teuthology.orchestra.run.trial170.stdout:LOGO="fedora-logo-icon" 2026-02-24T18:20:15.957 INFO:teuthology.orchestra.run.trial170.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-24T18:20:15.957 INFO:teuthology.orchestra.run.trial170.stdout:HOME_URL="https://centos.org/" 2026-02-24T18:20:15.957 INFO:teuthology.orchestra.run.trial170.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-24T18:20:15.957 INFO:teuthology.orchestra.run.trial170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-24T18:20:15.957 INFO:teuthology.orchestra.run.trial170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-24T18:20:15.958 INFO:teuthology.lock.ops:Updating trial170.front.sepia.ceph.com on lock server 2026-02-24T18:20:16.036 DEBUG:teuthology.orchestra.run.trial195:> uname -m 2026-02-24T18:20:16.052 INFO:teuthology.orchestra.run.trial195.stdout:x86_64 2026-02-24T18:20:16.052 DEBUG:teuthology.orchestra.run.trial195:> cat /etc/os-release 2026-02-24T18:20:16.108 INFO:teuthology.orchestra.run.trial195.stdout:NAME="CentOS Stream" 2026-02-24T18:20:16.108 INFO:teuthology.orchestra.run.trial195.stdout:VERSION="9" 2026-02-24T18:20:16.108 INFO:teuthology.orchestra.run.trial195.stdout:ID="centos" 2026-02-24T18:20:16.109 INFO:teuthology.orchestra.run.trial195.stdout:ID_LIKE="rhel fedora" 2026-02-24T18:20:16.109 INFO:teuthology.orchestra.run.trial195.stdout:VERSION_ID="9" 2026-02-24T18:20:16.109 INFO:teuthology.orchestra.run.trial195.stdout:PLATFORM_ID="platform:el9" 2026-02-24T18:20:16.109 INFO:teuthology.orchestra.run.trial195.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-24T18:20:16.109 INFO:teuthology.orchestra.run.trial195.stdout:ANSI_COLOR="0;31" 2026-02-24T18:20:16.109 INFO:teuthology.orchestra.run.trial195.stdout:LOGO="fedora-logo-icon" 2026-02-24T18:20:16.109 INFO:teuthology.orchestra.run.trial195.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-24T18:20:16.109 INFO:teuthology.orchestra.run.trial195.stdout:HOME_URL="https://centos.org/" 2026-02-24T18:20:16.109 INFO:teuthology.orchestra.run.trial195.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-24T18:20:16.109 INFO:teuthology.orchestra.run.trial195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-24T18:20:16.109 INFO:teuthology.orchestra.run.trial195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-24T18:20:16.110 INFO:teuthology.lock.ops:Updating trial195.front.sepia.ceph.com on lock server 2026-02-24T18:20:16.177 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-24T18:20:16.190 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-24T18:20:16.204 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-24T18:20:16.204 DEBUG:teuthology.orchestra.run.trial014:> test '!' -e /home/ubuntu/cephtest 2026-02-24T18:20:16.206 DEBUG:teuthology.orchestra.run.trial044:> test '!' -e /home/ubuntu/cephtest 2026-02-24T18:20:16.207 DEBUG:teuthology.orchestra.run.trial170:> test '!' -e /home/ubuntu/cephtest 2026-02-24T18:20:16.209 DEBUG:teuthology.orchestra.run.trial195:> test '!' -e /home/ubuntu/cephtest 2026-02-24T18:20:16.223 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-24T18:20:16.234 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-24T18:20:16.234 DEBUG:teuthology.orchestra.run.trial014:> test -z $(ls -A /var/lib/ceph) 2026-02-24T18:20:16.260 DEBUG:teuthology.orchestra.run.trial044:> test -z $(ls -A /var/lib/ceph) 2026-02-24T18:20:16.263 DEBUG:teuthology.orchestra.run.trial170:> test -z $(ls -A /var/lib/ceph) 2026-02-24T18:20:16.264 DEBUG:teuthology.orchestra.run.trial195:> test -z $(ls -A /var/lib/ceph) 2026-02-24T18:20:16.280 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-24T18:20:16.561 INFO:teuthology.run_tasks:Running task kernel... 2026-02-24T18:20:16.581 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-24T18:20:16.581 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-24T18:20:16.581 DEBUG:teuthology.orchestra.run.trial014:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-24T18:20:16.582 DEBUG:teuthology.orchestra.run.trial044:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-24T18:20:16.582 DEBUG:teuthology.orchestra.run.trial170:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-24T18:20:16.582 DEBUG:teuthology.orchestra.run.trial195:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-24T18:20:16.597 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T18:20:16.597 DEBUG:teuthology.orchestra.run.trial014:> uname -r 2026-02-24T18:20:16.597 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T18:20:16.597 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T18:20:16.598 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T18:20:16.598 DEBUG:teuthology.orchestra.run.trial170:> uname -r 2026-02-24T18:20:16.598 DEBUG:teuthology.orchestra.run.trial195:> uname -r 2026-02-24T18:20:16.598 DEBUG:teuthology.orchestra.run.trial044:> uname -r 2026-02-24T18:20:16.653 INFO:teuthology.orchestra.run.trial014.stdout:5.14.0-681.el9.x86_64 2026-02-24T18:20:16.653 INFO:teuthology.task.kernel:Running kernel on trial014: 5.14.0-681.el9.x86_64 2026-02-24T18:20:16.654 DEBUG:teuthology.orchestra.run.trial014:> sudo yum install -y kernel 2026-02-24T18:20:16.655 INFO:teuthology.orchestra.run.trial170.stdout:5.14.0-681.el9.x86_64 2026-02-24T18:20:16.655 INFO:teuthology.orchestra.run.trial195.stdout:5.14.0-681.el9.x86_64 2026-02-24T18:20:16.655 INFO:teuthology.orchestra.run.trial044.stdout:5.14.0-681.el9.x86_64 2026-02-24T18:20:16.655 INFO:teuthology.task.kernel:Running kernel on trial170: 5.14.0-681.el9.x86_64 2026-02-24T18:20:16.655 DEBUG:teuthology.orchestra.run.trial170:> sudo yum install -y kernel 2026-02-24T18:20:16.655 INFO:teuthology.task.kernel:Running kernel on trial195: 5.14.0-681.el9.x86_64 2026-02-24T18:20:16.656 DEBUG:teuthology.orchestra.run.trial195:> sudo yum install -y kernel 2026-02-24T18:20:16.656 INFO:teuthology.task.kernel:Running kernel on trial044: 5.14.0-681.el9.x86_64 2026-02-24T18:20:16.656 DEBUG:teuthology.orchestra.run.trial044:> sudo yum install -y kernel 2026-02-24T18:20:17.850 INFO:teuthology.orchestra.run.trial044.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.9 MB 00:00 2026-02-24T18:20:17.850 INFO:teuthology.orchestra.run.trial014.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.9 MB 00:00 2026-02-24T18:20:18.030 INFO:teuthology.orchestra.run.trial170.stdout:CentOS Stream 9 - BaseOS 9.0 MB/s | 8.9 MB 00:00 2026-02-24T18:20:18.700 INFO:teuthology.orchestra.run.trial014.stdout:CentOS Stream 9 - AppStream 85 MB/s | 27 MB 00:00 2026-02-24T18:20:21.537 INFO:teuthology.orchestra.run.trial170.stdout:CentOS Stream 9 - AppStream 9.1 MB/s | 27 MB 00:02 2026-02-24T18:20:21.584 INFO:teuthology.orchestra.run.trial195.stdout:CentOS Stream 9 - BaseOS 2.0 MB/s | 8.9 MB 00:04 2026-02-24T18:20:22.601 INFO:teuthology.orchestra.run.trial044.stdout:CentOS Stream 9 - AppStream 6.4 MB/s | 27 MB 00:04 2026-02-24T18:20:22.667 INFO:teuthology.orchestra.run.trial014.stdout:CentOS Stream 9 - CRB 5.1 MB/s | 8.0 MB 00:01 2026-02-24T18:20:23.845 INFO:teuthology.orchestra.run.trial014.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 20 kB 00:00 2026-02-24T18:20:24.127 INFO:teuthology.orchestra.run.trial014.stdout:Extra Packages for Enterprise Linux 92 MB/s | 20 MB 00:00 2026-02-24T18:20:24.347 INFO:teuthology.orchestra.run.trial170.stdout:CentOS Stream 9 - CRB 18 MB/s | 8.0 MB 00:00 2026-02-24T18:20:25.206 INFO:teuthology.orchestra.run.trial195.stdout:CentOS Stream 9 - AppStream 8.7 MB/s | 27 MB 00:03 2026-02-24T18:20:25.945 INFO:teuthology.orchestra.run.trial170.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 20 kB 00:00 2026-02-24T18:20:26.469 INFO:teuthology.orchestra.run.trial170.stdout:Extra Packages for Enterprise Linux 44 MB/s | 20 MB 00:00 2026-02-24T18:20:27.324 INFO:teuthology.orchestra.run.trial014.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-24T18:20:28.341 INFO:teuthology.orchestra.run.trial014.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-24T18:20:28.342 INFO:teuthology.orchestra.run.trial014.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-24T18:20:28.362 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T18:20:28.363 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:20:28.363 INFO:teuthology.orchestra.run.trial014.stdout: Package Architecture Version Repository Size 2026-02-24T18:20:28.364 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:20:28.364 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T18:20:28.364 INFO:teuthology.orchestra.run.trial014.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-24T18:20:28.364 INFO:teuthology.orchestra.run.trial014.stdout:Installing dependencies: 2026-02-24T18:20:28.364 INFO:teuthology.orchestra.run.trial014.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-24T18:20:28.364 INFO:teuthology.orchestra.run.trial014.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-24T18:20:28.364 INFO:teuthology.orchestra.run.trial014.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-24T18:20:28.364 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:20:28.364 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T18:20:28.364 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:20:28.364 INFO:teuthology.orchestra.run.trial014.stdout:Install 4 Packages 2026-02-24T18:20:28.365 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:20:28.365 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 89 M 2026-02-24T18:20:28.365 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 135 M 2026-02-24T18:20:28.365 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T18:20:29.339 INFO:teuthology.orchestra.run.trial014.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 989 kB/s | 901 kB 00:00 2026-02-24T18:20:29.525 INFO:teuthology.orchestra.run.trial195.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 8.0 MB 00:01 2026-02-24T18:20:29.651 INFO:teuthology.orchestra.run.trial170.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-24T18:20:29.798 INFO:teuthology.orchestra.run.trial014.stdout:(2/4): kernel-core-5.14.0-686.el9.x86_64.rpm 13 MB/s | 17 MB 00:01 2026-02-24T18:20:30.311 INFO:teuthology.orchestra.run.trial014.stdout:(3/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 21 MB/s | 40 MB 00:01 2026-02-24T18:20:30.670 INFO:teuthology.orchestra.run.trial170.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-24T18:20:30.670 INFO:teuthology.orchestra.run.trial170.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-24T18:20:30.690 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T18:20:30.691 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:20:30.691 INFO:teuthology.orchestra.run.trial170.stdout: Package Architecture Version Repository Size 2026-02-24T18:20:30.692 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:20:30.692 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T18:20:30.692 INFO:teuthology.orchestra.run.trial170.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-24T18:20:30.692 INFO:teuthology.orchestra.run.trial170.stdout:Installing dependencies: 2026-02-24T18:20:30.692 INFO:teuthology.orchestra.run.trial170.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-24T18:20:30.692 INFO:teuthology.orchestra.run.trial170.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-24T18:20:30.692 INFO:teuthology.orchestra.run.trial170.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-24T18:20:30.692 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:20:30.692 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T18:20:30.692 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:20:30.693 INFO:teuthology.orchestra.run.trial170.stdout:Install 4 Packages 2026-02-24T18:20:30.693 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:20:30.693 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 89 M 2026-02-24T18:20:30.693 INFO:teuthology.orchestra.run.trial170.stdout:Installed size: 135 M 2026-02-24T18:20:30.693 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T18:20:31.076 INFO:teuthology.orchestra.run.trial014.stdout:(4/4): kernel-modules-core-5.14.0-686.el9.x86_6 18 MB/s | 31 MB 00:01 2026-02-24T18:20:31.077 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:20:31.077 INFO:teuthology.orchestra.run.trial014.stdout:Total 33 MB/s | 89 MB 00:02 2026-02-24T18:20:31.197 INFO:teuthology.orchestra.run.trial044.stdout:CentOS Stream 9 - CRB 1.3 MB/s | 8.0 MB 00:06 2026-02-24T18:20:31.265 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T18:20:31.470 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T18:20:31.470 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T18:20:31.600 INFO:teuthology.orchestra.run.trial170.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 1.3 MB/s | 901 kB 00:00 2026-02-24T18:20:31.753 INFO:teuthology.orchestra.run.trial195.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 20 kB 00:01 2026-02-24T18:20:31.853 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T18:20:31.853 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T18:20:32.164 INFO:teuthology.orchestra.run.trial170.stdout:(2/4): kernel-core-5.14.0-686.el9.x86_64.rpm 14 MB/s | 17 MB 00:01 2026-02-24T18:20:32.285 INFO:teuthology.orchestra.run.trial195.stdout:Extra Packages for Enterprise Linux 43 MB/s | 20 MB 00:00 2026-02-24T18:20:32.695 INFO:teuthology.orchestra.run.trial170.stdout:(3/4): kernel-modules-core-5.14.0-686.el9.x86_6 28 MB/s | 31 MB 00:01 2026-02-24T18:20:32.753 INFO:teuthology.orchestra.run.trial044.stdout:CentOS Stream 9 - Extras packages 25 kB/s | 20 kB 00:00 2026-02-24T18:20:32.859 INFO:teuthology.orchestra.run.trial170.stdout:(4/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 21 MB/s | 40 MB 00:01 2026-02-24T18:20:32.859 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:20:32.859 INFO:teuthology.orchestra.run.trial170.stdout:Total 41 MB/s | 89 MB 00:02 2026-02-24T18:20:32.969 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T18:20:33.051 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T18:20:33.255 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T18:20:33.255 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T18:20:33.258 INFO:teuthology.orchestra.run.trial014.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-24T18:20:33.280 INFO:teuthology.orchestra.run.trial014.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:20:33.435 INFO:teuthology.orchestra.run.trial044.stdout:Extra Packages for Enterprise Linux 33 MB/s | 20 MB 00:00 2026-02-24T18:20:33.639 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T18:20:33.639 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T18:20:34.748 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T18:20:35.038 INFO:teuthology.orchestra.run.trial170.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-24T18:20:35.060 INFO:teuthology.orchestra.run.trial170.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:20:35.449 INFO:teuthology.orchestra.run.trial195.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-24T18:20:35.839 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:20:35.871 INFO:teuthology.orchestra.run.trial014.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:20:36.458 INFO:teuthology.orchestra.run.trial195.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-24T18:20:36.458 INFO:teuthology.orchestra.run.trial195.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-24T18:20:36.478 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T18:20:36.479 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:20:36.479 INFO:teuthology.orchestra.run.trial195.stdout: Package Architecture Version Repository Size 2026-02-24T18:20:36.479 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:20:36.480 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T18:20:36.480 INFO:teuthology.orchestra.run.trial195.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-24T18:20:36.480 INFO:teuthology.orchestra.run.trial195.stdout:Installing dependencies: 2026-02-24T18:20:36.480 INFO:teuthology.orchestra.run.trial195.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-24T18:20:36.480 INFO:teuthology.orchestra.run.trial195.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-24T18:20:36.480 INFO:teuthology.orchestra.run.trial195.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-24T18:20:36.480 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:20:36.480 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T18:20:36.480 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:20:36.480 INFO:teuthology.orchestra.run.trial195.stdout:Install 4 Packages 2026-02-24T18:20:36.480 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:20:36.481 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 89 M 2026-02-24T18:20:36.481 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 135 M 2026-02-24T18:20:36.481 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T18:20:36.577 INFO:teuthology.orchestra.run.trial195.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 30 MB/s | 901 kB 00:00 2026-02-24T18:20:36.585 INFO:teuthology.orchestra.run.trial044.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-24T18:20:36.712 INFO:teuthology.orchestra.run.trial195.stdout:(2/4): kernel-core-5.14.0-686.el9.x86_64.rpm 104 MB/s | 17 MB 00:00 2026-02-24T18:20:36.919 INFO:teuthology.orchestra.run.trial195.stdout:(3/4): kernel-modules-core-5.14.0-686.el9.x86_6 91 MB/s | 31 MB 00:00 2026-02-24T18:20:37.037 INFO:teuthology.orchestra.run.trial195.stdout:(4/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 81 MB/s | 40 MB 00:00 2026-02-24T18:20:37.037 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:20:37.037 INFO:teuthology.orchestra.run.trial195.stdout:Total 160 MB/s | 89 MB 00:00 2026-02-24T18:20:37.227 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T18:20:37.432 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T18:20:37.432 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T18:20:37.601 INFO:teuthology.orchestra.run.trial044.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-24T18:20:37.602 INFO:teuthology.orchestra.run.trial044.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-24T18:20:37.621 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T18:20:37.622 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:20:37.623 INFO:teuthology.orchestra.run.trial044.stdout: Package Architecture Version Repository Size 2026-02-24T18:20:37.623 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:20:37.623 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T18:20:37.623 INFO:teuthology.orchestra.run.trial044.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-24T18:20:37.623 INFO:teuthology.orchestra.run.trial044.stdout:Installing dependencies: 2026-02-24T18:20:37.623 INFO:teuthology.orchestra.run.trial044.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-24T18:20:37.623 INFO:teuthology.orchestra.run.trial044.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-24T18:20:37.623 INFO:teuthology.orchestra.run.trial044.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-24T18:20:37.624 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:20:37.624 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T18:20:37.624 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:20:37.624 INFO:teuthology.orchestra.run.trial044.stdout:Install 4 Packages 2026-02-24T18:20:37.624 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:20:37.624 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 89 M 2026-02-24T18:20:37.624 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 135 M 2026-02-24T18:20:37.624 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T18:20:37.628 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:20:37.661 INFO:teuthology.orchestra.run.trial170.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:20:37.814 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T18:20:37.814 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T18:20:38.910 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:20:38.917 INFO:teuthology.orchestra.run.trial014.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:38.933 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T18:20:39.228 INFO:teuthology.orchestra.run.trial195.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-24T18:20:39.250 INFO:teuthology.orchestra.run.trial195.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:20:39.502 INFO:teuthology.orchestra.run.trial044.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 572 kB/s | 901 kB 00:01 2026-02-24T18:20:40.694 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:20:40.701 INFO:teuthology.orchestra.run.trial170.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:41.837 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:20:41.870 INFO:teuthology.orchestra.run.trial195.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:20:42.033 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:43.754 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:44.004 INFO:teuthology.orchestra.run.trial044.stdout:(2/4): kernel-core-5.14.0-686.el9.x86_64.rpm 2.8 MB/s | 17 MB 00:06 2026-02-24T18:20:44.858 INFO:teuthology.orchestra.run.trial044.stdout:(3/4): kernel-modules-core-5.14.0-686.el9.x86_6 5.8 MB/s | 31 MB 00:05 2026-02-24T18:20:44.903 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:20:44.910 INFO:teuthology.orchestra.run.trial195.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:44.999 INFO:teuthology.orchestra.run.trial044.stdout:(4/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 5.6 MB/s | 40 MB 00:07 2026-02-24T18:20:45.000 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:20:45.001 INFO:teuthology.orchestra.run.trial044.stdout:Total 12 MB/s | 89 MB 00:07 2026-02-24T18:20:45.192 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T18:20:45.398 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T18:20:45.398 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T18:20:45.781 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T18:20:45.781 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T18:20:46.893 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T18:20:47.181 INFO:teuthology.orchestra.run.trial044.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-24T18:20:47.203 INFO:teuthology.orchestra.run.trial044.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:20:47.962 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:49.794 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:20:49.827 INFO:teuthology.orchestra.run.trial044.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:20:52.867 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:20:52.873 INFO:teuthology.orchestra.run.trial044.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:56.151 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:59.785 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:59.807 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:59.994 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:59.995 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-24T18:20:59.995 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:20:59.995 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:21:00.051 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:21:00.051 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:21:00.051 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T18:21:00.052 INFO:teuthology.orchestra.run.trial014.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-24T18:21:00.052 INFO:teuthology.orchestra.run.trial014.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-24T18:21:00.052 INFO:teuthology.orchestra.run.trial014.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-24T18:21:00.052 INFO:teuthology.orchestra.run.trial014.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-24T18:21:00.052 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:21:00.052 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T18:21:00.111 DEBUG:teuthology.orchestra.run.trial014:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T18:21:00.141 INFO:teuthology.orchestra.run.trial014.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T18:21:00.141 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T18:21:00.141 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-24T18:21:00.141 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-24T18:21:00.142 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-24T18:21:00.142 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-24T18:21:00.142 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial014.front.sepia.ceph.com, path=None, version=distro) 2026-02-24T18:21:00.142 DEBUG:teuthology.orchestra.run.trial014:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T18:21:00.209 INFO:teuthology.orchestra.run.trial014.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T18:21:00.209 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T18:21:00.210 DEBUG:teuthology.orchestra.run.trial014:> sudo rpm -qi grub2-tools 2026-02-24T18:21:00.279 INFO:teuthology.orchestra.run.trial014.stdout:Name : grub2-tools 2026-02-24T18:21:00.280 INFO:teuthology.orchestra.run.trial014.stdout:Epoch : 1 2026-02-24T18:21:00.280 INFO:teuthology.orchestra.run.trial014.stdout:Version : 2.06 2026-02-24T18:21:00.280 INFO:teuthology.orchestra.run.trial014.stdout:Release : 120.el9 2026-02-24T18:21:00.280 INFO:teuthology.orchestra.run.trial014.stdout:Architecture: x86_64 2026-02-24T18:21:00.280 INFO:teuthology.orchestra.run.trial014.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-24T18:21:00.280 INFO:teuthology.orchestra.run.trial014.stdout:Group : Unspecified 2026-02-24T18:21:00.280 INFO:teuthology.orchestra.run.trial014.stdout:Size : 9108611 2026-02-24T18:21:00.280 INFO:teuthology.orchestra.run.trial014.stdout:License : GPLv3+ 2026-02-24T18:21:00.281 INFO:teuthology.orchestra.run.trial014.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-24T18:21:00.281 INFO:teuthology.orchestra.run.trial014.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-24T18:21:00.281 INFO:teuthology.orchestra.run.trial014.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-24T18:21:00.281 INFO:teuthology.orchestra.run.trial014.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-24T18:21:00.281 INFO:teuthology.orchestra.run.trial014.stdout:Packager : builder@centos.org 2026-02-24T18:21:00.281 INFO:teuthology.orchestra.run.trial014.stdout:Vendor : CentOS 2026-02-24T18:21:00.281 INFO:teuthology.orchestra.run.trial014.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-24T18:21:00.281 INFO:teuthology.orchestra.run.trial014.stdout:Summary : Support tools for GRUB. 2026-02-24T18:21:00.281 INFO:teuthology.orchestra.run.trial014.stdout:Description : 2026-02-24T18:21:00.281 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:21:00.281 INFO:teuthology.orchestra.run.trial014.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-24T18:21:00.282 INFO:teuthology.orchestra.run.trial014.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-24T18:21:00.282 INFO:teuthology.orchestra.run.trial014.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-24T18:21:00.282 INFO:teuthology.orchestra.run.trial014.stdout:hardware devices. 2026-02-24T18:21:00.282 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:21:00.282 INFO:teuthology.orchestra.run.trial014.stdout:This subpackage provides tools for support of all platforms. 2026-02-24T18:21:00.283 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-24T18:21:00.284 INFO:teuthology.task.kernel:Updating grub on trial014 to boot 5.14.0-686.el9.x86_64 2026-02-24T18:21:00.284 DEBUG:teuthology.orchestra.run.trial014:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-24T18:21:00.347 INFO:teuthology.orchestra.run.trial014.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-24T18:21:00.349 DEBUG:teuthology.orchestra.run.trial014:> sudo command -v grubby && echo yes || echo no 2026-02-24T18:21:00.412 INFO:teuthology.orchestra.run.trial014.stdout:/sbin/grubby 2026-02-24T18:21:00.413 INFO:teuthology.orchestra.run.trial014.stdout:yes 2026-02-24T18:21:00.413 DEBUG:teuthology.orchestra.run.trial014:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-24T18:21:00.478 INFO:teuthology.orchestra.run.trial014.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-24T18:21:00.480 DEBUG:teuthology.orchestra.run.trial014:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-24T18:21:00.553 DEBUG:teuthology.orchestra.run.trial014:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-24T18:21:00.762 INFO:teuthology.orchestra.run.trial014.stderr:Generating grub configuration file ... 2026-02-24T18:21:00.830 INFO:teuthology.orchestra.run.trial014.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-24T18:21:00.837 INFO:teuthology.orchestra.run.trial014.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-24T18:21:01.091 INFO:teuthology.orchestra.run.trial014.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-24T18:21:01.098 INFO:teuthology.orchestra.run.trial014.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-24T18:21:01.109 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:21:01.131 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:21:01.132 INFO:teuthology.orchestra.run.trial014.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-24T18:21:01.138 INFO:teuthology.orchestra.run.trial014.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-24T18:21:01.170 INFO:teuthology.orchestra.run.trial014.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-24T18:21:01.177 INFO:teuthology.orchestra.run.trial014.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-24T18:21:01.200 INFO:teuthology.orchestra.run.trial014.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-24T18:21:01.206 INFO:teuthology.orchestra.run.trial014.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-24T18:21:01.295 INFO:teuthology.orchestra.run.trial014.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-24T18:21:01.303 INFO:teuthology.orchestra.run.trial014.stderr:done 2026-02-24T18:21:01.305 DEBUG:teuthology.orchestra.run.trial014:> test -d /sys/firmware/efi 2026-02-24T18:21:01.319 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:21:01.320 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-24T18:21:01.320 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:21:01.320 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:21:01.322 DEBUG:teuthology.orchestra.run.trial014:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-24T18:21:01.377 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:21:01.377 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:21:01.378 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T18:21:01.378 INFO:teuthology.orchestra.run.trial170.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-24T18:21:01.378 INFO:teuthology.orchestra.run.trial170.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-24T18:21:01.378 INFO:teuthology.orchestra.run.trial170.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-24T18:21:01.378 INFO:teuthology.orchestra.run.trial170.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-24T18:21:01.378 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:21:01.378 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T18:21:01.388 INFO:teuthology.orchestra.run.trial014.stdout:/boot/efi/EFI/BOOT 2026-02-24T18:21:01.388 INFO:teuthology.orchestra.run.trial014.stdout:/boot/efi/EFI/centos 2026-02-24T18:21:01.390 DEBUG:teuthology.orchestra.run.trial014:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-24T18:21:01.440 DEBUG:teuthology.orchestra.run.trial170:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T18:21:01.456 INFO:teuthology.orchestra.run.trial014.stdout:no 2026-02-24T18:21:01.456 DEBUG:teuthology.orchestra.run.trial014:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-24T18:21:01.468 INFO:teuthology.orchestra.run.trial170.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T18:21:01.470 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T18:21:01.470 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-24T18:21:01.470 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-24T18:21:01.470 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-24T18:21:01.471 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2026-02-24T18:21:01.471 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial170.front.sepia.ceph.com, path=None, version=distro) 2026-02-24T18:21:01.471 DEBUG:teuthology.orchestra.run.trial170:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T18:21:01.522 INFO:teuthology.orchestra.run.trial014.stdout:yes 2026-02-24T18:21:01.522 DEBUG:teuthology.orchestra.run.trial014:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-24T18:21:01.537 INFO:teuthology.orchestra.run.trial170.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T18:21:01.538 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T18:21:01.538 DEBUG:teuthology.orchestra.run.trial170:> sudo rpm -qi grub2-tools 2026-02-24T18:21:01.587 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial014 2026-02-24T18:21:01.588 DEBUG:teuthology.orchestra.run.trial014:> sudo bash -c ' 2026-02-24T18:21:01.588 DEBUG:teuthology.orchestra.run.trial014:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-24T18:21:01.588 DEBUG:teuthology.orchestra.run.trial014:> ' 2026-02-24T18:21:01.607 INFO:teuthology.orchestra.run.trial170.stdout:Name : grub2-tools 2026-02-24T18:21:01.607 INFO:teuthology.orchestra.run.trial170.stdout:Epoch : 1 2026-02-24T18:21:01.607 INFO:teuthology.orchestra.run.trial170.stdout:Version : 2.06 2026-02-24T18:21:01.607 INFO:teuthology.orchestra.run.trial170.stdout:Release : 120.el9 2026-02-24T18:21:01.607 INFO:teuthology.orchestra.run.trial170.stdout:Architecture: x86_64 2026-02-24T18:21:01.607 INFO:teuthology.orchestra.run.trial170.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-24T18:21:01.607 INFO:teuthology.orchestra.run.trial170.stdout:Group : Unspecified 2026-02-24T18:21:01.607 INFO:teuthology.orchestra.run.trial170.stdout:Size : 9108611 2026-02-24T18:21:01.607 INFO:teuthology.orchestra.run.trial170.stdout:License : GPLv3+ 2026-02-24T18:21:01.607 INFO:teuthology.orchestra.run.trial170.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-24T18:21:01.608 INFO:teuthology.orchestra.run.trial170.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-24T18:21:01.608 INFO:teuthology.orchestra.run.trial170.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-24T18:21:01.608 INFO:teuthology.orchestra.run.trial170.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-24T18:21:01.608 INFO:teuthology.orchestra.run.trial170.stdout:Packager : builder@centos.org 2026-02-24T18:21:01.608 INFO:teuthology.orchestra.run.trial170.stdout:Vendor : CentOS 2026-02-24T18:21:01.608 INFO:teuthology.orchestra.run.trial170.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-24T18:21:01.608 INFO:teuthology.orchestra.run.trial170.stdout:Summary : Support tools for GRUB. 2026-02-24T18:21:01.608 INFO:teuthology.orchestra.run.trial170.stdout:Description : 2026-02-24T18:21:01.608 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:21:01.608 INFO:teuthology.orchestra.run.trial170.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-24T18:21:01.608 INFO:teuthology.orchestra.run.trial170.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-24T18:21:01.608 INFO:teuthology.orchestra.run.trial170.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-24T18:21:01.609 INFO:teuthology.orchestra.run.trial170.stdout:hardware devices. 2026-02-24T18:21:01.609 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:21:01.609 INFO:teuthology.orchestra.run.trial170.stdout:This subpackage provides tools for support of all platforms. 2026-02-24T18:21:01.610 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-24T18:21:01.610 INFO:teuthology.task.kernel:Updating grub on trial170 to boot 5.14.0-686.el9.x86_64 2026-02-24T18:21:01.610 DEBUG:teuthology.orchestra.run.trial170:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-24T18:21:01.675 INFO:teuthology.orchestra.run.trial170.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-24T18:21:01.676 DEBUG:teuthology.orchestra.run.trial170:> sudo command -v grubby && echo yes || echo no 2026-02-24T18:21:01.739 INFO:teuthology.orchestra.run.trial170.stdout:/sbin/grubby 2026-02-24T18:21:01.741 INFO:teuthology.orchestra.run.trial170.stdout:yes 2026-02-24T18:21:01.741 DEBUG:teuthology.orchestra.run.trial170:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-24T18:21:01.806 INFO:teuthology.orchestra.run.trial170.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-24T18:21:01.807 DEBUG:teuthology.orchestra.run.trial170:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-24T18:21:01.880 DEBUG:teuthology.orchestra.run.trial170:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-24T18:21:02.089 INFO:teuthology.orchestra.run.trial170.stderr:Generating grub configuration file ... 2026-02-24T18:21:02.157 INFO:teuthology.orchestra.run.trial170.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-24T18:21:02.164 INFO:teuthology.orchestra.run.trial170.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-24T18:21:02.415 INFO:teuthology.orchestra.run.trial170.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-24T18:21:02.422 INFO:teuthology.orchestra.run.trial170.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-24T18:21:02.456 INFO:teuthology.orchestra.run.trial170.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-24T18:21:02.463 INFO:teuthology.orchestra.run.trial170.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-24T18:21:02.494 INFO:teuthology.orchestra.run.trial170.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-24T18:21:02.500 INFO:teuthology.orchestra.run.trial170.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-24T18:21:02.523 INFO:teuthology.orchestra.run.trial170.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-24T18:21:02.530 INFO:teuthology.orchestra.run.trial170.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-24T18:21:02.616 INFO:teuthology.orchestra.run.trial170.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-24T18:21:02.624 INFO:teuthology.orchestra.run.trial170.stderr:done 2026-02-24T18:21:02.626 DEBUG:teuthology.orchestra.run.trial170:> test -d /sys/firmware/efi 2026-02-24T18:21:02.642 DEBUG:teuthology.orchestra.run.trial170:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-24T18:21:02.707 INFO:teuthology.orchestra.run.trial170.stdout:/boot/efi/EFI/BOOT 2026-02-24T18:21:02.708 INFO:teuthology.orchestra.run.trial170.stdout:/boot/efi/EFI/centos 2026-02-24T18:21:02.709 DEBUG:teuthology.orchestra.run.trial170:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-24T18:21:02.776 INFO:teuthology.orchestra.run.trial170.stdout:no 2026-02-24T18:21:02.776 DEBUG:teuthology.orchestra.run.trial170:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-24T18:21:02.850 INFO:teuthology.orchestra.run.trial170.stdout:yes 2026-02-24T18:21:02.850 DEBUG:teuthology.orchestra.run.trial170:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-24T18:21:02.922 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial170 2026-02-24T18:21:02.922 DEBUG:teuthology.orchestra.run.trial170:> sudo bash -c ' 2026-02-24T18:21:02.922 DEBUG:teuthology.orchestra.run.trial170:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-24T18:21:02.922 DEBUG:teuthology.orchestra.run.trial170:> ' 2026-02-24T18:21:05.434 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:21:05.456 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:21:05.646 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:21:05.646 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-24T18:21:05.647 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:21:05.647 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:21:05.703 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:21:05.704 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:21:05.704 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T18:21:05.704 INFO:teuthology.orchestra.run.trial195.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-24T18:21:05.704 INFO:teuthology.orchestra.run.trial195.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-24T18:21:05.704 INFO:teuthology.orchestra.run.trial195.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-24T18:21:05.704 INFO:teuthology.orchestra.run.trial195.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-24T18:21:05.704 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:21:05.704 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T18:21:05.766 DEBUG:teuthology.orchestra.run.trial195:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T18:21:05.796 INFO:teuthology.orchestra.run.trial195.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T18:21:05.797 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T18:21:05.797 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-24T18:21:05.797 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-24T18:21:05.797 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-24T18:21:05.797 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2026-02-24T18:21:05.797 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial195.front.sepia.ceph.com, path=None, version=distro) 2026-02-24T18:21:05.797 DEBUG:teuthology.orchestra.run.trial195:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T18:21:05.864 INFO:teuthology.orchestra.run.trial195.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T18:21:05.864 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T18:21:05.864 DEBUG:teuthology.orchestra.run.trial195:> sudo rpm -qi grub2-tools 2026-02-24T18:21:05.933 INFO:teuthology.orchestra.run.trial195.stdout:Name : grub2-tools 2026-02-24T18:21:05.933 INFO:teuthology.orchestra.run.trial195.stdout:Epoch : 1 2026-02-24T18:21:05.933 INFO:teuthology.orchestra.run.trial195.stdout:Version : 2.06 2026-02-24T18:21:05.933 INFO:teuthology.orchestra.run.trial195.stdout:Release : 120.el9 2026-02-24T18:21:05.933 INFO:teuthology.orchestra.run.trial195.stdout:Architecture: x86_64 2026-02-24T18:21:05.933 INFO:teuthology.orchestra.run.trial195.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-24T18:21:05.933 INFO:teuthology.orchestra.run.trial195.stdout:Group : Unspecified 2026-02-24T18:21:05.933 INFO:teuthology.orchestra.run.trial195.stdout:Size : 9108611 2026-02-24T18:21:05.934 INFO:teuthology.orchestra.run.trial195.stdout:License : GPLv3+ 2026-02-24T18:21:05.934 INFO:teuthology.orchestra.run.trial195.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-24T18:21:05.934 INFO:teuthology.orchestra.run.trial195.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-24T18:21:05.934 INFO:teuthology.orchestra.run.trial195.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-24T18:21:05.934 INFO:teuthology.orchestra.run.trial195.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-24T18:21:05.934 INFO:teuthology.orchestra.run.trial195.stdout:Packager : builder@centos.org 2026-02-24T18:21:05.934 INFO:teuthology.orchestra.run.trial195.stdout:Vendor : CentOS 2026-02-24T18:21:05.934 INFO:teuthology.orchestra.run.trial195.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-24T18:21:05.934 INFO:teuthology.orchestra.run.trial195.stdout:Summary : Support tools for GRUB. 2026-02-24T18:21:05.934 INFO:teuthology.orchestra.run.trial195.stdout:Description : 2026-02-24T18:21:05.934 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:21:05.935 INFO:teuthology.orchestra.run.trial195.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-24T18:21:05.935 INFO:teuthology.orchestra.run.trial195.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-24T18:21:05.935 INFO:teuthology.orchestra.run.trial195.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-24T18:21:05.935 INFO:teuthology.orchestra.run.trial195.stdout:hardware devices. 2026-02-24T18:21:05.935 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:21:05.935 INFO:teuthology.orchestra.run.trial195.stdout:This subpackage provides tools for support of all platforms. 2026-02-24T18:21:05.936 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-24T18:21:05.936 INFO:teuthology.task.kernel:Updating grub on trial195 to boot 5.14.0-686.el9.x86_64 2026-02-24T18:21:05.937 DEBUG:teuthology.orchestra.run.trial195:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-24T18:21:06.000 INFO:teuthology.orchestra.run.trial195.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-24T18:21:06.001 DEBUG:teuthology.orchestra.run.trial195:> sudo command -v grubby && echo yes || echo no 2026-02-24T18:21:06.064 INFO:teuthology.orchestra.run.trial195.stdout:/sbin/grubby 2026-02-24T18:21:06.065 INFO:teuthology.orchestra.run.trial195.stdout:yes 2026-02-24T18:21:06.066 DEBUG:teuthology.orchestra.run.trial195:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-24T18:21:06.130 INFO:teuthology.orchestra.run.trial195.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-24T18:21:06.130 DEBUG:teuthology.orchestra.run.trial195:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-24T18:21:06.203 DEBUG:teuthology.orchestra.run.trial195:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-24T18:21:06.408 INFO:teuthology.orchestra.run.trial195.stderr:Generating grub configuration file ... 2026-02-24T18:21:06.476 INFO:teuthology.orchestra.run.trial195.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-24T18:21:06.483 INFO:teuthology.orchestra.run.trial195.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-24T18:21:06.738 INFO:teuthology.orchestra.run.trial195.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-24T18:21:06.745 INFO:teuthology.orchestra.run.trial195.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-24T18:21:06.780 INFO:teuthology.orchestra.run.trial195.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-24T18:21:06.786 INFO:teuthology.orchestra.run.trial195.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-24T18:21:06.819 INFO:teuthology.orchestra.run.trial195.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-24T18:21:06.825 INFO:teuthology.orchestra.run.trial195.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-24T18:21:06.849 INFO:teuthology.orchestra.run.trial195.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-24T18:21:06.855 INFO:teuthology.orchestra.run.trial195.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-24T18:21:06.940 INFO:teuthology.orchestra.run.trial195.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-24T18:21:06.948 INFO:teuthology.orchestra.run.trial195.stderr:done 2026-02-24T18:21:06.950 DEBUG:teuthology.orchestra.run.trial195:> test -d /sys/firmware/efi 2026-02-24T18:21:06.966 DEBUG:teuthology.orchestra.run.trial195:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-24T18:21:07.031 INFO:teuthology.orchestra.run.trial195.stdout:/boot/efi/EFI/BOOT 2026-02-24T18:21:07.031 INFO:teuthology.orchestra.run.trial195.stdout:/boot/efi/EFI/centos 2026-02-24T18:21:07.033 DEBUG:teuthology.orchestra.run.trial195:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-24T18:21:07.098 INFO:teuthology.orchestra.run.trial195.stdout:no 2026-02-24T18:21:07.099 DEBUG:teuthology.orchestra.run.trial195:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-24T18:21:07.162 INFO:teuthology.orchestra.run.trial195.stdout:yes 2026-02-24T18:21:07.163 DEBUG:teuthology.orchestra.run.trial195:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-24T18:21:07.228 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial195 2026-02-24T18:21:07.228 DEBUG:teuthology.orchestra.run.trial195:> sudo bash -c ' 2026-02-24T18:21:07.228 DEBUG:teuthology.orchestra.run.trial195:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-24T18:21:07.228 DEBUG:teuthology.orchestra.run.trial195:> ' 2026-02-24T18:21:13.632 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:21:13.653 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:21:13.842 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:21:13.842 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-24T18:21:13.842 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:21:13.842 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:21:13.899 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:21:13.899 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:21:13.899 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T18:21:13.899 INFO:teuthology.orchestra.run.trial044.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-24T18:21:13.899 INFO:teuthology.orchestra.run.trial044.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-24T18:21:13.899 INFO:teuthology.orchestra.run.trial044.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-24T18:21:13.899 INFO:teuthology.orchestra.run.trial044.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-24T18:21:13.899 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:21:13.900 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T18:21:13.960 DEBUG:teuthology.orchestra.run.trial044:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T18:21:13.989 INFO:teuthology.orchestra.run.trial044.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T18:21:13.990 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T18:21:13.991 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-24T18:21:13.991 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-24T18:21:13.991 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-24T18:21:13.991 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-24T18:21:13.991 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial044.front.sepia.ceph.com, path=None, version=distro) 2026-02-24T18:21:13.991 DEBUG:teuthology.orchestra.run.trial044:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T18:21:14.056 INFO:teuthology.orchestra.run.trial044.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T18:21:14.057 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T18:21:14.057 DEBUG:teuthology.orchestra.run.trial044:> sudo rpm -qi grub2-tools 2026-02-24T18:21:14.125 INFO:teuthology.orchestra.run.trial044.stdout:Name : grub2-tools 2026-02-24T18:21:14.125 INFO:teuthology.orchestra.run.trial044.stdout:Epoch : 1 2026-02-24T18:21:14.126 INFO:teuthology.orchestra.run.trial044.stdout:Version : 2.06 2026-02-24T18:21:14.126 INFO:teuthology.orchestra.run.trial044.stdout:Release : 120.el9 2026-02-24T18:21:14.126 INFO:teuthology.orchestra.run.trial044.stdout:Architecture: x86_64 2026-02-24T18:21:14.126 INFO:teuthology.orchestra.run.trial044.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-24T18:21:14.126 INFO:teuthology.orchestra.run.trial044.stdout:Group : Unspecified 2026-02-24T18:21:14.126 INFO:teuthology.orchestra.run.trial044.stdout:Size : 9108611 2026-02-24T18:21:14.126 INFO:teuthology.orchestra.run.trial044.stdout:License : GPLv3+ 2026-02-24T18:21:14.126 INFO:teuthology.orchestra.run.trial044.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-24T18:21:14.126 INFO:teuthology.orchestra.run.trial044.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-24T18:21:14.126 INFO:teuthology.orchestra.run.trial044.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-24T18:21:14.126 INFO:teuthology.orchestra.run.trial044.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-24T18:21:14.126 INFO:teuthology.orchestra.run.trial044.stdout:Packager : builder@centos.org 2026-02-24T18:21:14.127 INFO:teuthology.orchestra.run.trial044.stdout:Vendor : CentOS 2026-02-24T18:21:14.127 INFO:teuthology.orchestra.run.trial044.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-24T18:21:14.127 INFO:teuthology.orchestra.run.trial044.stdout:Summary : Support tools for GRUB. 2026-02-24T18:21:14.127 INFO:teuthology.orchestra.run.trial044.stdout:Description : 2026-02-24T18:21:14.127 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:21:14.127 INFO:teuthology.orchestra.run.trial044.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-24T18:21:14.127 INFO:teuthology.orchestra.run.trial044.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-24T18:21:14.127 INFO:teuthology.orchestra.run.trial044.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-24T18:21:14.127 INFO:teuthology.orchestra.run.trial044.stdout:hardware devices. 2026-02-24T18:21:14.127 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:21:14.127 INFO:teuthology.orchestra.run.trial044.stdout:This subpackage provides tools for support of all platforms. 2026-02-24T18:21:14.128 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-24T18:21:14.129 INFO:teuthology.task.kernel:Updating grub on trial044 to boot 5.14.0-686.el9.x86_64 2026-02-24T18:21:14.129 DEBUG:teuthology.orchestra.run.trial044:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-24T18:21:14.193 INFO:teuthology.orchestra.run.trial044.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-24T18:21:14.194 DEBUG:teuthology.orchestra.run.trial044:> sudo command -v grubby && echo yes || echo no 2026-02-24T18:21:14.257 INFO:teuthology.orchestra.run.trial044.stdout:/sbin/grubby 2026-02-24T18:21:14.259 INFO:teuthology.orchestra.run.trial044.stdout:yes 2026-02-24T18:21:14.259 DEBUG:teuthology.orchestra.run.trial044:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-24T18:21:14.324 INFO:teuthology.orchestra.run.trial044.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-24T18:21:14.324 DEBUG:teuthology.orchestra.run.trial044:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-24T18:21:14.396 DEBUG:teuthology.orchestra.run.trial044:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-24T18:21:14.601 INFO:teuthology.orchestra.run.trial044.stderr:Generating grub configuration file ... 2026-02-24T18:21:14.670 INFO:teuthology.orchestra.run.trial044.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-24T18:21:14.676 INFO:teuthology.orchestra.run.trial044.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-24T18:21:14.925 INFO:teuthology.orchestra.run.trial044.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-24T18:21:14.932 INFO:teuthology.orchestra.run.trial044.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-24T18:21:14.966 INFO:teuthology.orchestra.run.trial044.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-24T18:21:14.972 INFO:teuthology.orchestra.run.trial044.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-24T18:21:15.004 INFO:teuthology.orchestra.run.trial044.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-24T18:21:15.010 INFO:teuthology.orchestra.run.trial044.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-24T18:21:15.033 INFO:teuthology.orchestra.run.trial044.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-24T18:21:15.039 INFO:teuthology.orchestra.run.trial044.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-24T18:21:15.125 INFO:teuthology.orchestra.run.trial044.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-24T18:21:15.134 INFO:teuthology.orchestra.run.trial044.stderr:done 2026-02-24T18:21:15.136 DEBUG:teuthology.orchestra.run.trial044:> test -d /sys/firmware/efi 2026-02-24T18:21:15.153 DEBUG:teuthology.orchestra.run.trial044:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-24T18:21:15.218 INFO:teuthology.orchestra.run.trial044.stdout:/boot/efi/EFI/BOOT 2026-02-24T18:21:15.218 INFO:teuthology.orchestra.run.trial044.stdout:/boot/efi/EFI/centos 2026-02-24T18:21:15.220 DEBUG:teuthology.orchestra.run.trial044:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-24T18:21:15.284 INFO:teuthology.orchestra.run.trial044.stdout:no 2026-02-24T18:21:15.284 DEBUG:teuthology.orchestra.run.trial044:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-24T18:21:15.348 INFO:teuthology.orchestra.run.trial044.stdout:yes 2026-02-24T18:21:15.349 DEBUG:teuthology.orchestra.run.trial044:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-24T18:21:15.413 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial044 2026-02-24T18:21:15.414 DEBUG:teuthology.orchestra.run.trial044:> sudo bash -c ' 2026-02-24T18:21:15.414 DEBUG:teuthology.orchestra.run.trial044:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-24T18:21:15.414 DEBUG:teuthology.orchestra.run.trial044:> ' 2026-02-24T18:21:31.630 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-24T18:21:31.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial014.front.sepia.ceph.com' 2026-02-24T18:21:31.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial014.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:21:32.971 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-24T18:21:32.972 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial170.front.sepia.ceph.com' 2026-02-24T18:21:32.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:21:37.272 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2026-02-24T18:21:37.272 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial195.front.sepia.ceph.com' 2026-02-24T18:21:37.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:21:45.457 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-24T18:21:45.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial044.front.sepia.ceph.com' 2026-02-24T18:21:45.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:22:31.678 DEBUG:teuthology.orchestra.remote:timed out 2026-02-24T18:22:32.977 DEBUG:teuthology.orchestra.remote:timed out 2026-02-24T18:22:37.279 DEBUG:teuthology.orchestra.remote:timed out 2026-02-24T18:22:40.681 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial014.front.sepia.ceph.com' 2026-02-24T18:22:40.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial014.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:22:40.815 DEBUG:teuthology.orchestra.run.trial014:> true 2026-02-24T18:22:40.969 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial014.front.sepia.ceph.com' 2026-02-24T18:22:40.970 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-686.el9.x86_64"... 2026-02-24T18:22:40.970 DEBUG:teuthology.orchestra.run.trial014:> uname -r 2026-02-24T18:22:41.025 INFO:teuthology.orchestra.run.trial014.stdout:5.14.0-686.el9.x86_64 2026-02-24T18:22:41.025 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-24T18:22:41.025 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-24T18:22:41.025 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-24T18:22:41.977 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial170.front.sepia.ceph.com' 2026-02-24T18:22:41.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:22:42.069 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-24T18:22:42.069 DEBUG:teuthology.orchestra.run.trial014:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-24T18:22:42.092 DEBUG:teuthology.orchestra.run.trial170:> true 2026-02-24T18:22:42.102 INFO:teuthology.orchestra.run.trial014.stdout:ttyS1 2026-02-24T18:22:42.133 DEBUG:teuthology.parallel:result is None 2026-02-24T18:22:42.250 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial170.front.sepia.ceph.com' 2026-02-24T18:22:42.250 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-686.el9.x86_64"... 2026-02-24T18:22:42.250 DEBUG:teuthology.orchestra.run.trial170:> uname -r 2026-02-24T18:22:42.307 INFO:teuthology.orchestra.run.trial170.stdout:5.14.0-686.el9.x86_64 2026-02-24T18:22:42.307 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-24T18:22:42.308 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-24T18:22:42.308 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-24T18:22:43.308 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2026-02-24T18:22:43.309 DEBUG:teuthology.orchestra.run.trial170:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-24T18:22:43.338 INFO:teuthology.orchestra.run.trial170.stdout:ttyS1 2026-02-24T18:22:43.362 DEBUG:teuthology.parallel:result is None 2026-02-24T18:22:45.459 DEBUG:teuthology.orchestra.remote:timed out 2026-02-24T18:22:46.280 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial195.front.sepia.ceph.com' 2026-02-24T18:22:46.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:22:46.378 DEBUG:teuthology.orchestra.run.trial195:> true 2026-02-24T18:22:46.555 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial195.front.sepia.ceph.com' 2026-02-24T18:22:46.555 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-686.el9.x86_64"... 2026-02-24T18:22:46.556 DEBUG:teuthology.orchestra.run.trial195:> uname -r 2026-02-24T18:22:46.611 INFO:teuthology.orchestra.run.trial195.stdout:5.14.0-686.el9.x86_64 2026-02-24T18:22:46.612 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-24T18:22:46.612 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-24T18:22:46.612 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-24T18:22:47.613 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2026-02-24T18:22:47.613 DEBUG:teuthology.orchestra.run.trial195:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-24T18:22:47.642 INFO:teuthology.orchestra.run.trial195.stdout:ttyS1 2026-02-24T18:22:47.668 DEBUG:teuthology.parallel:result is None 2026-02-24T18:22:54.460 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial044.front.sepia.ceph.com' 2026-02-24T18:22:54.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:22:54.592 DEBUG:teuthology.orchestra.run.trial044:> true 2026-02-24T18:22:54.756 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial044.front.sepia.ceph.com' 2026-02-24T18:22:54.756 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-686.el9.x86_64"... 2026-02-24T18:22:54.757 DEBUG:teuthology.orchestra.run.trial044:> uname -r 2026-02-24T18:22:54.813 INFO:teuthology.orchestra.run.trial044.stdout:5.14.0-686.el9.x86_64 2026-02-24T18:22:54.813 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-24T18:22:54.813 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-24T18:22:54.813 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-24T18:22:55.814 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2026-02-24T18:22:55.814 DEBUG:teuthology.orchestra.run.trial044:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-24T18:22:55.845 INFO:teuthology.orchestra.run.trial044.stdout:ttyS1 2026-02-24T18:22:55.865 DEBUG:teuthology.parallel:result is None 2026-02-24T18:22:55.865 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-24T18:22:55.876 INFO:teuthology.task.internal:Creating test directory... 2026-02-24T18:22:55.877 DEBUG:teuthology.orchestra.run.trial014:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-24T18:22:55.879 DEBUG:teuthology.orchestra.run.trial044:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-24T18:22:55.907 DEBUG:teuthology.orchestra.run.trial170:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-24T18:22:55.909 DEBUG:teuthology.orchestra.run.trial195:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-24T18:22:55.926 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-24T18:22:55.937 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-24T18:22:55.951 INFO:teuthology.task.internal:Creating archive directory... 2026-02-24T18:22:55.951 DEBUG:teuthology.orchestra.run.trial014:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-24T18:22:55.953 DEBUG:teuthology.orchestra.run.trial044:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-24T18:22:55.963 DEBUG:teuthology.orchestra.run.trial170:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-24T18:22:55.967 DEBUG:teuthology.orchestra.run.trial195:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-24T18:22:55.991 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-24T18:22:56.002 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-24T18:22:56.002 DEBUG:teuthology.orchestra.run.trial014:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-24T18:22:56.011 DEBUG:teuthology.orchestra.run.trial044:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-24T18:22:56.020 DEBUG:teuthology.orchestra.run.trial170:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-24T18:22:56.024 DEBUG:teuthology.orchestra.run.trial195:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-24T18:22:56.033 INFO:teuthology.orchestra.run.trial014.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T18:22:56.042 INFO:teuthology.orchestra.run.trial014.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T18:22:56.042 INFO:teuthology.orchestra.run.trial044.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T18:22:56.045 INFO:teuthology.orchestra.run.trial170.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T18:22:56.048 INFO:teuthology.orchestra.run.trial195.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T18:22:56.051 INFO:teuthology.orchestra.run.trial044.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T18:22:56.054 INFO:teuthology.orchestra.run.trial170.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T18:22:56.057 INFO:teuthology.orchestra.run.trial195.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T18:22:56.059 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-24T18:22:56.069 INFO:teuthology.task.internal:Configuring sudo... 2026-02-24T18:22:56.069 DEBUG:teuthology.orchestra.run.trial014:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-24T18:22:56.085 DEBUG:teuthology.orchestra.run.trial044:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-24T18:22:56.093 DEBUG:teuthology.orchestra.run.trial170:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-24T18:22:56.097 DEBUG:teuthology.orchestra.run.trial195:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-24T18:22:56.122 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-24T18:22:56.136 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-24T18:22:56.136 DEBUG:teuthology.orchestra.run.trial014:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-24T18:22:56.149 DEBUG:teuthology.orchestra.run.trial044:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-24T18:22:56.157 DEBUG:teuthology.orchestra.run.trial170:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-24T18:22:56.164 DEBUG:teuthology.orchestra.run.trial195:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-24T18:22:56.180 DEBUG:teuthology.orchestra.run.trial014:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T18:22:56.296 DEBUG:teuthology.orchestra.run.trial014:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T18:22:56.321 DEBUG:teuthology.orchestra.run.trial014:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T18:22:56.456 DEBUG:teuthology.orchestra.run.trial014:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T18:22:56.482 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-24T18:22:56.482 DEBUG:teuthology.orchestra.run.trial014:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-24T18:22:56.545 DEBUG:teuthology.orchestra.run.trial044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T18:22:56.663 DEBUG:teuthology.orchestra.run.trial044:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T18:22:56.688 DEBUG:teuthology.orchestra.run.trial044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T18:22:56.809 DEBUG:teuthology.orchestra.run.trial044:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T18:22:56.832 DEBUG:teuthology.orchestra.run.trial044:> set -ex 2026-02-24T18:22:56.832 DEBUG:teuthology.orchestra.run.trial044:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-24T18:22:56.895 DEBUG:teuthology.orchestra.run.trial170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T18:22:56.983 DEBUG:teuthology.orchestra.run.trial170:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T18:22:57.008 DEBUG:teuthology.orchestra.run.trial170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T18:22:57.142 DEBUG:teuthology.orchestra.run.trial170:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T18:22:57.167 DEBUG:teuthology.orchestra.run.trial170:> set -ex 2026-02-24T18:22:57.167 DEBUG:teuthology.orchestra.run.trial170:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-24T18:22:57.230 DEBUG:teuthology.orchestra.run.trial195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T18:22:57.344 DEBUG:teuthology.orchestra.run.trial195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T18:22:57.370 DEBUG:teuthology.orchestra.run.trial195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T18:22:57.515 DEBUG:teuthology.orchestra.run.trial195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T18:22:57.540 DEBUG:teuthology.orchestra.run.trial195:> set -ex 2026-02-24T18:22:57.540 DEBUG:teuthology.orchestra.run.trial195:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-24T18:22:57.604 DEBUG:teuthology.orchestra.run.trial014:> sudo service rsyslog restart 2026-02-24T18:22:57.607 DEBUG:teuthology.orchestra.run.trial044:> sudo service rsyslog restart 2026-02-24T18:22:57.610 DEBUG:teuthology.orchestra.run.trial170:> sudo service rsyslog restart 2026-02-24T18:22:57.612 DEBUG:teuthology.orchestra.run.trial195:> sudo service rsyslog restart 2026-02-24T18:22:57.633 INFO:teuthology.orchestra.run.trial014.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T18:22:57.635 INFO:teuthology.orchestra.run.trial044.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T18:22:57.639 INFO:teuthology.orchestra.run.trial170.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T18:22:57.671 INFO:teuthology.orchestra.run.trial195.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T18:22:58.196 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-24T18:22:58.211 INFO:teuthology.task.internal:Starting timer... 2026-02-24T18:22:58.211 INFO:teuthology.run_tasks:Running task pcp... 2026-02-24T18:22:58.234 INFO:teuthology.run_tasks:Running task selinux... 2026-02-24T18:22:58.254 DEBUG:teuthology.orchestra.run.trial014:> sudo service auditd rotate 2026-02-24T18:22:58.285 INFO:teuthology.orchestra.run.trial014.stdout:Rotating logs: 2026-02-24T18:22:58.286 DEBUG:teuthology.orchestra.run.trial044:> sudo service auditd rotate 2026-02-24T18:22:58.316 INFO:teuthology.orchestra.run.trial044.stdout:Rotating logs: 2026-02-24T18:22:58.317 DEBUG:teuthology.orchestra.run.trial170:> sudo service auditd rotate 2026-02-24T18:22:58.346 INFO:teuthology.orchestra.run.trial170.stdout:Rotating logs: 2026-02-24T18:22:58.348 DEBUG:teuthology.orchestra.run.trial195:> sudo service auditd rotate 2026-02-24T18:22:58.377 INFO:teuthology.orchestra.run.trial195.stdout:Rotating logs: 2026-02-24T18:22:58.379 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-24T18:22:58.379 DEBUG:teuthology.orchestra.run.trial014:> /usr/sbin/getenforce 2026-02-24T18:22:58.396 INFO:teuthology.orchestra.run.trial014.stdout:Permissive 2026-02-24T18:22:58.396 DEBUG:teuthology.orchestra.run.trial044:> /usr/sbin/getenforce 2026-02-24T18:22:58.414 INFO:teuthology.orchestra.run.trial044.stdout:Permissive 2026-02-24T18:22:58.414 DEBUG:teuthology.orchestra.run.trial170:> /usr/sbin/getenforce 2026-02-24T18:22:58.430 INFO:teuthology.orchestra.run.trial170.stdout:Permissive 2026-02-24T18:22:58.430 DEBUG:teuthology.orchestra.run.trial195:> /usr/sbin/getenforce 2026-02-24T18:22:58.447 INFO:teuthology.orchestra.run.trial195.stdout:Permissive 2026-02-24T18:22:58.447 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial014.front.sepia.ceph.com': 'permissive', 'ubuntu@trial044.front.sepia.ceph.com': 'permissive', 'ubuntu@trial170.front.sepia.ceph.com': 'permissive', 'ubuntu@trial195.front.sepia.ceph.com': 'permissive'} 2026-02-24T18:22:58.447 DEBUG:teuthology.orchestra.run.trial014:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T18:22:58.472 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T18:22:58.473 DEBUG:teuthology.orchestra.run.trial044:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T18:22:58.497 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T18:22:58.498 DEBUG:teuthology.orchestra.run.trial170:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T18:22:58.524 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T18:22:58.525 DEBUG:teuthology.orchestra.run.trial195:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T18:22:58.551 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T18:22:58.552 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-24T18:22:58.552 DEBUG:teuthology.orchestra.run.trial014:> sudo /usr/sbin/setenforce permissive 2026-02-24T18:22:58.578 DEBUG:teuthology.orchestra.run.trial044:> sudo /usr/sbin/setenforce permissive 2026-02-24T18:22:58.604 DEBUG:teuthology.orchestra.run.trial170:> sudo /usr/sbin/setenforce permissive 2026-02-24T18:22:58.631 DEBUG:teuthology.orchestra.run.trial195:> sudo /usr/sbin/setenforce permissive 2026-02-24T18:22:58.658 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-24T18:22:58.672 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-24T18:22:58.684 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-24T18:22:58.686 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial014.front.sepia.ceph.com,trial044.front.sepia.ceph.com,trial170.front.sepia.ceph.com,trial195.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-24T18:25:49.710 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial014.front.sepia.ceph.com'), Remote(name='ubuntu@trial044.front.sepia.ceph.com'), Remote(name='ubuntu@trial170.front.sepia.ceph.com'), Remote(name='ubuntu@trial195.front.sepia.ceph.com')] 2026-02-24T18:25:49.711 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial014.front.sepia.ceph.com' 2026-02-24T18:25:49.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial014.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:25:49.798 DEBUG:teuthology.orchestra.run.trial014:> true 2026-02-24T18:25:49.872 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial014.front.sepia.ceph.com' 2026-02-24T18:25:49.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial044.front.sepia.ceph.com' 2026-02-24T18:25:49.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:25:49.955 DEBUG:teuthology.orchestra.run.trial044:> true 2026-02-24T18:25:50.035 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial044.front.sepia.ceph.com' 2026-02-24T18:25:50.036 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial170.front.sepia.ceph.com' 2026-02-24T18:25:50.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:25:50.106 DEBUG:teuthology.orchestra.run.trial170:> true 2026-02-24T18:25:50.180 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial170.front.sepia.ceph.com' 2026-02-24T18:25:50.180 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial195.front.sepia.ceph.com' 2026-02-24T18:25:50.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:25:50.261 DEBUG:teuthology.orchestra.run.trial195:> true 2026-02-24T18:25:50.337 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial195.front.sepia.ceph.com' 2026-02-24T18:25:50.338 INFO:teuthology.run_tasks:Running task clock... 2026-02-24T18:25:50.350 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-24T18:25:50.351 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-24T18:25:50.351 DEBUG:teuthology.orchestra.run.trial014:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T18:25:50.353 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-24T18:25:50.353 DEBUG:teuthology.orchestra.run.trial044:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T18:25:50.389 INFO:teuthology.orchestra.run.trial014.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-24T18:25:50.390 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-24T18:25:50.390 DEBUG:teuthology.orchestra.run.trial170:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T18:25:50.391 INFO:teuthology.orchestra.run.trial014.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-24T18:25:50.392 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-24T18:25:50.392 DEBUG:teuthology.orchestra.run.trial195:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T18:25:50.411 INFO:teuthology.orchestra.run.trial014.stderr:sudo: ntpd: command not found 2026-02-24T18:25:50.417 INFO:teuthology.orchestra.run.trial044.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-24T18:25:50.419 INFO:teuthology.orchestra.run.trial170.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-24T18:25:50.419 INFO:teuthology.orchestra.run.trial195.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-24T18:25:50.420 INFO:teuthology.orchestra.run.trial014.stdout:506 Cannot talk to daemon 2026-02-24T18:25:50.428 INFO:teuthology.orchestra.run.trial044.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-24T18:25:50.431 INFO:teuthology.orchestra.run.trial170.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-24T18:25:50.431 INFO:teuthology.orchestra.run.trial195.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-24T18:25:50.432 INFO:teuthology.orchestra.run.trial014.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-24T18:25:50.444 INFO:teuthology.orchestra.run.trial014.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-24T18:25:50.449 INFO:teuthology.orchestra.run.trial044.stderr:sudo: ntpd: command not found 2026-02-24T18:25:50.452 INFO:teuthology.orchestra.run.trial170.stderr:sudo: ntpd: command not found 2026-02-24T18:25:50.452 INFO:teuthology.orchestra.run.trial195.stderr:sudo: ntpd: command not found 2026-02-24T18:25:50.459 INFO:teuthology.orchestra.run.trial044.stdout:506 Cannot talk to daemon 2026-02-24T18:25:50.462 INFO:teuthology.orchestra.run.trial170.stdout:506 Cannot talk to daemon 2026-02-24T18:25:50.462 INFO:teuthology.orchestra.run.trial195.stdout:506 Cannot talk to daemon 2026-02-24T18:25:50.471 INFO:teuthology.orchestra.run.trial044.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-24T18:25:50.473 INFO:teuthology.orchestra.run.trial170.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-24T18:25:50.474 INFO:teuthology.orchestra.run.trial195.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-24T18:25:50.482 INFO:teuthology.orchestra.run.trial044.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-24T18:25:50.485 INFO:teuthology.orchestra.run.trial170.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-24T18:25:50.486 INFO:teuthology.orchestra.run.trial195.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-24T18:25:50.492 INFO:teuthology.orchestra.run.trial014.stderr:bash: line 1: ntpq: command not found 2026-02-24T18:25:50.518 INFO:teuthology.orchestra.run.trial014.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T18:25:50.518 INFO:teuthology.orchestra.run.trial014.stdout:=============================================================================== 2026-02-24T18:25:50.518 INFO:teuthology.orchestra.run.trial014.stdout:^? 172-233-177-198.ip.linod> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:50.518 INFO:teuthology.orchestra.run.trial014.stdout:^? nyc2.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:50.518 INFO:teuthology.orchestra.run.trial014.stdout:^? beta.kenyonralph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:50.518 INFO:teuthology.orchestra.run.trial014.stdout:^? 216-144-228-179-host.col> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:50.530 INFO:teuthology.orchestra.run.trial170.stderr:bash: line 1: ntpq: command not found 2026-02-24T18:25:50.535 INFO:teuthology.orchestra.run.trial044.stderr:bash: line 1: ntpq: command not found 2026-02-24T18:25:50.538 INFO:teuthology.orchestra.run.trial195.stderr:bash: line 1: ntpq: command not found 2026-02-24T18:25:50.555 INFO:teuthology.orchestra.run.trial170.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T18:25:50.555 INFO:teuthology.orchestra.run.trial170.stdout:=============================================================================== 2026-02-24T18:25:50.555 INFO:teuthology.orchestra.run.trial170.stdout:^? time.cloudflare.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:50.555 INFO:teuthology.orchestra.run.trial170.stdout:^? 149.28.61.105.vultruserc> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:50.555 INFO:teuthology.orchestra.run.trial170.stdout:^? arm1.maxhost.io 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:50.555 INFO:teuthology.orchestra.run.trial170.stdout:^? usmoi.meezy.link 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:50.558 INFO:teuthology.orchestra.run.trial195.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T18:25:50.558 INFO:teuthology.orchestra.run.trial195.stdout:=============================================================================== 2026-02-24T18:25:50.558 INFO:teuthology.orchestra.run.trial195.stdout:^? 170-187-147-56.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:50.558 INFO:teuthology.orchestra.run.trial195.stdout:^? 44.190.5.123 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:50.558 INFO:teuthology.orchestra.run.trial195.stdout:^? 108.61.215.221.vultruser> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:50.558 INFO:teuthology.orchestra.run.trial195.stdout:^? 23.186.168.129 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:50.563 INFO:teuthology.orchestra.run.trial044.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T18:25:50.563 INFO:teuthology.orchestra.run.trial044.stdout:=============================================================================== 2026-02-24T18:25:50.563 INFO:teuthology.orchestra.run.trial044.stdout:^? srcf-ntp.stanford.edu 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:50.563 INFO:teuthology.orchestra.run.trial044.stdout:^? 73.185.182.209 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:50.563 INFO:teuthology.orchestra.run.trial044.stdout:^? lax1.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:50.563 INFO:teuthology.orchestra.run.trial044.stdout:^? frumentum-zeus.infra.fru> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:50.564 INFO:teuthology.run_tasks:Running task install... 2026-02-24T18:25:50.575 DEBUG:teuthology.task.install:project ceph 2026-02-24T18:25:50.575 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155'}} 2026-02-24T18:25:50.575 DEBUG:teuthology.task.install:config {'debuginfo': True, 'flavor': 'default', 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155'} 2026-02-24T18:25:50.575 INFO:teuthology.task.install:Using flavor: default 2026-02-24T18:25:50.580 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2026-02-24T18:25:50.580 INFO:teuthology.task.install:extra packages: [] 2026-02-24T18:25:50.580 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155', 'tag': None, 'wait_for_package': False} 2026-02-24T18:25:50.580 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-24T18:25:50.581 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155', 'tag': None, 'wait_for_package': False} 2026-02-24T18:25:50.582 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-24T18:25:50.582 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155', 'tag': None, 'wait_for_package': False} 2026-02-24T18:25:50.582 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-24T18:25:50.583 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155', 'tag': None, 'wait_for_package': False} 2026-02-24T18:25:50.583 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-24T18:25:50.850 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/ 2026-02-24T18:25:50.850 INFO:teuthology.task.install.rpm:Package version is 20.2.0-681.g36d388f2 2026-02-24T18:25:50.856 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/ 2026-02-24T18:25:50.856 INFO:teuthology.task.install.rpm:Package version is 20.2.0-681.g36d388f2 2026-02-24T18:25:50.857 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/ 2026-02-24T18:25:50.857 INFO:teuthology.task.install.rpm:Package version is 20.2.0-681.g36d388f2 2026-02-24T18:25:50.859 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/ 2026-02-24T18:25:50.859 INFO:teuthology.task.install.rpm:Package version is 20.2.0-681.g36d388f2 2026-02-24T18:25:51.275 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-24T18:25:51.275 DEBUG:teuthology.orchestra.run.trial044:> set -ex 2026-02-24T18:25:51.275 DEBUG:teuthology.orchestra.run.trial044:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-24T18:25:51.283 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-24T18:25:51.283 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-24T18:25:51.283 DEBUG:teuthology.orchestra.run.trial014:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-24T18:25:51.297 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-24T18:25:51.298 DEBUG:teuthology.orchestra.run.trial195:> set -ex 2026-02-24T18:25:51.298 DEBUG:teuthology.orchestra.run.trial195:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-24T18:25:51.300 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-24T18:25:51.301 DEBUG:teuthology.orchestra.run.trial044:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/36d388f27052dd940bdbaf543bb05bdba0acc155/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-24T18:25:51.309 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-24T18:25:51.309 DEBUG:teuthology.orchestra.run.trial014:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/36d388f27052dd940bdbaf543bb05bdba0acc155/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-24T18:25:51.323 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-24T18:25:51.324 DEBUG:teuthology.orchestra.run.trial195:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/36d388f27052dd940bdbaf543bb05bdba0acc155/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-24T18:25:51.339 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-24T18:25:51.339 DEBUG:teuthology.orchestra.run.trial170:> set -ex 2026-02-24T18:25:51.339 DEBUG:teuthology.orchestra.run.trial170:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-24T18:25:51.365 DEBUG:teuthology.orchestra.run.trial044:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-24T18:25:51.366 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-24T18:25:51.366 DEBUG:teuthology.orchestra.run.trial170:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/36d388f27052dd940bdbaf543bb05bdba0acc155/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-24T18:25:51.373 DEBUG:teuthology.orchestra.run.trial014:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-24T18:25:51.388 DEBUG:teuthology.orchestra.run.trial195:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-24T18:25:51.431 DEBUG:teuthology.orchestra.run.trial170:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-24T18:25:51.437 DEBUG:teuthology.orchestra.run.trial044:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-24T18:25:51.447 DEBUG:teuthology.orchestra.run.trial014:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-24T18:25:51.461 DEBUG:teuthology.orchestra.run.trial195:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-24T18:25:51.501 INFO:teuthology.orchestra.run.trial044.stdout:check_obsoletes = 1 2026-02-24T18:25:51.503 DEBUG:teuthology.orchestra.run.trial044:> sudo yum clean all 2026-02-24T18:25:51.504 DEBUG:teuthology.orchestra.run.trial170:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-24T18:25:51.511 INFO:teuthology.orchestra.run.trial014.stdout:check_obsoletes = 1 2026-02-24T18:25:51.513 DEBUG:teuthology.orchestra.run.trial014:> sudo yum clean all 2026-02-24T18:25:51.525 INFO:teuthology.orchestra.run.trial195.stdout:check_obsoletes = 1 2026-02-24T18:25:51.527 DEBUG:teuthology.orchestra.run.trial195:> sudo yum clean all 2026-02-24T18:25:51.570 INFO:teuthology.orchestra.run.trial170.stdout:check_obsoletes = 1 2026-02-24T18:25:51.571 DEBUG:teuthology.orchestra.run.trial170:> sudo yum clean all 2026-02-24T18:25:51.655 INFO:teuthology.orchestra.run.trial044.stdout:41 files removed 2026-02-24T18:25:51.668 INFO:teuthology.orchestra.run.trial014.stdout:41 files removed 2026-02-24T18:25:51.670 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install ceph-radosgw 2026-02-24T18:25:51.677 INFO:teuthology.orchestra.run.trial195.stdout:41 files removed 2026-02-24T18:25:51.682 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install ceph-radosgw 2026-02-24T18:25:51.691 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph-radosgw 2026-02-24T18:25:51.721 INFO:teuthology.orchestra.run.trial170.stdout:41 files removed 2026-02-24T18:25:51.735 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install ceph-radosgw 2026-02-24T18:25:52.464 INFO:teuthology.orchestra.run.trial044.stdout:ceph packages for x86_64 134 kB/s | 87 kB 00:00 2026-02-24T18:25:52.492 INFO:teuthology.orchestra.run.trial195.stdout:ceph packages for x86_64 133 kB/s | 87 kB 00:00 2026-02-24T18:25:52.492 INFO:teuthology.orchestra.run.trial014.stdout:ceph packages for x86_64 131 kB/s | 87 kB 00:00 2026-02-24T18:25:52.541 INFO:teuthology.orchestra.run.trial170.stdout:ceph packages for x86_64 132 kB/s | 87 kB 00:00 2026-02-24T18:25:53.109 INFO:teuthology.orchestra.run.trial044.stdout:ceph noarch packages 29 kB/s | 18 kB 00:00 2026-02-24T18:25:53.134 INFO:teuthology.orchestra.run.trial195.stdout:ceph noarch packages 29 kB/s | 18 kB 00:00 2026-02-24T18:25:53.146 INFO:teuthology.orchestra.run.trial014.stdout:ceph noarch packages 29 kB/s | 18 kB 00:00 2026-02-24T18:25:53.188 INFO:teuthology.orchestra.run.trial170.stdout:ceph noarch packages 29 kB/s | 18 kB 00:00 2026-02-24T18:25:53.696 INFO:teuthology.orchestra.run.trial044.stdout:ceph source packages 3.4 kB/s | 1.9 kB 00:00 2026-02-24T18:25:53.720 INFO:teuthology.orchestra.run.trial195.stdout:ceph source packages 3.5 kB/s | 1.9 kB 00:00 2026-02-24T18:25:53.730 INFO:teuthology.orchestra.run.trial014.stdout:ceph source packages 3.5 kB/s | 1.9 kB 00:00 2026-02-24T18:25:53.775 INFO:teuthology.orchestra.run.trial170.stdout:ceph source packages 3.4 kB/s | 1.9 kB 00:00 2026-02-24T18:25:54.481 INFO:teuthology.orchestra.run.trial170.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-24T18:25:55.113 INFO:teuthology.orchestra.run.trial014.stdout:CentOS Stream 9 - BaseOS 6.5 MB/s | 8.9 MB 00:01 2026-02-24T18:25:55.127 INFO:teuthology.orchestra.run.trial044.stdout:CentOS Stream 9 - BaseOS 6.3 MB/s | 8.9 MB 00:01 2026-02-24T18:25:55.394 INFO:teuthology.orchestra.run.trial170.stdout:CentOS Stream 9 - AppStream 69 MB/s | 27 MB 00:00 2026-02-24T18:25:55.561 INFO:teuthology.orchestra.run.trial195.stdout:CentOS Stream 9 - BaseOS 4.9 MB/s | 8.9 MB 00:01 2026-02-24T18:25:56.487 INFO:teuthology.orchestra.run.trial195.stdout:CentOS Stream 9 - AppStream 68 MB/s | 27 MB 00:00 2026-02-24T18:25:57.947 INFO:teuthology.orchestra.run.trial044.stdout:CentOS Stream 9 - AppStream 12 MB/s | 27 MB 00:02 2026-02-24T18:25:58.329 INFO:teuthology.orchestra.run.trial014.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-24T18:25:59.359 INFO:teuthology.orchestra.run.trial170.stdout:CentOS Stream 9 - CRB 5.0 MB/s | 8.0 MB 00:01 2026-02-24T18:26:00.365 INFO:teuthology.orchestra.run.trial170.stdout:CentOS Stream 9 - Extras packages 100 kB/s | 20 kB 00:00 2026-02-24T18:26:00.651 INFO:teuthology.orchestra.run.trial170.stdout:Extra Packages for Enterprise Linux 92 MB/s | 20 MB 00:00 2026-02-24T18:26:01.422 INFO:teuthology.orchestra.run.trial044.stdout:CentOS Stream 9 - CRB 7.4 MB/s | 8.0 MB 00:01 2026-02-24T18:26:01.473 INFO:teuthology.orchestra.run.trial195.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 8.0 MB 00:02 2026-02-24T18:26:02.317 INFO:teuthology.orchestra.run.trial014.stdout:CentOS Stream 9 - CRB 5.1 MB/s | 8.0 MB 00:01 2026-02-24T18:26:02.658 INFO:teuthology.orchestra.run.trial195.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 20 kB 00:00 2026-02-24T18:26:03.282 INFO:teuthology.orchestra.run.trial044.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 20 kB 00:01 2026-02-24T18:26:03.524 INFO:teuthology.orchestra.run.trial195.stdout:Extra Packages for Enterprise Linux 25 MB/s | 20 MB 00:00 2026-02-24T18:26:04.020 INFO:teuthology.orchestra.run.trial170.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-24T18:26:04.174 INFO:teuthology.orchestra.run.trial014.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 20 kB 00:01 2026-02-24T18:26:04.275 INFO:teuthology.orchestra.run.trial044.stdout:Extra Packages for Enterprise Linux 22 MB/s | 20 MB 00:00 2026-02-24T18:26:04.824 INFO:teuthology.orchestra.run.trial014.stdout:Extra Packages for Enterprise Linux 35 MB/s | 20 MB 00:00 2026-02-24T18:26:05.243 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T18:26:05.245 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:26:05.245 INFO:teuthology.orchestra.run.trial170.stdout: Package Arch Version Repository Size 2026-02-24T18:26:05.245 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:26:05.245 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T18:26:05.245 INFO:teuthology.orchestra.run.trial170.stdout: ceph-radosgw x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 M 2026-02-24T18:26:05.246 INFO:teuthology.orchestra.run.trial170.stdout:Upgrading: 2026-02-24T18:26:05.246 INFO:teuthology.orchestra.run.trial170.stdout: librados2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 3.5 M 2026-02-24T18:26:05.246 INFO:teuthology.orchestra.run.trial170.stdout: librbd1 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.8 M 2026-02-24T18:26:05.246 INFO:teuthology.orchestra.run.trial170.stdout:Installing dependencies: 2026-02-24T18:26:05.246 INFO:teuthology.orchestra.run.trial170.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-24T18:26:05.246 INFO:teuthology.orchestra.run.trial170.stdout: ceph-base x86_64 2:20.2.0-681.g36d388f2.el9 ceph 5.9 M 2026-02-24T18:26:05.246 INFO:teuthology.orchestra.run.trial170.stdout: ceph-common x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 M 2026-02-24T18:26:05.246 INFO:teuthology.orchestra.run.trial170.stdout: ceph-selinux x86_64 2:20.2.0-681.g36d388f2.el9 ceph 25 k 2026-02-24T18:26:05.246 INFO:teuthology.orchestra.run.trial170.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-24T18:26:05.246 INFO:teuthology.orchestra.run.trial170.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-24T18:26:05.246 INFO:teuthology.orchestra.run.trial170.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-24T18:26:05.247 INFO:teuthology.orchestra.run.trial170.stdout: libcephfs2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 869 k 2026-02-24T18:26:05.247 INFO:teuthology.orchestra.run.trial170.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-24T18:26:05.247 INFO:teuthology.orchestra.run.trial170.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-24T18:26:05.247 INFO:teuthology.orchestra.run.trial170.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-24T18:26:05.247 INFO:teuthology.orchestra.run.trial170.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-24T18:26:05.247 INFO:teuthology.orchestra.run.trial170.stdout: libradosstriper1 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 250 k 2026-02-24T18:26:05.247 INFO:teuthology.orchestra.run.trial170.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-24T18:26:05.247 INFO:teuthology.orchestra.run.trial170.stdout: librgw2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 6.4 M 2026-02-24T18:26:05.247 INFO:teuthology.orchestra.run.trial170.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-24T18:26:05.247 INFO:teuthology.orchestra.run.trial170.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-24T18:26:05.247 INFO:teuthology.orchestra.run.trial170.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-24T18:26:05.248 INFO:teuthology.orchestra.run.trial170.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-24T18:26:05.248 INFO:teuthology.orchestra.run.trial170.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-24T18:26:05.248 INFO:teuthology.orchestra.run.trial170.stdout: python3-ceph-argparse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 45 k 2026-02-24T18:26:05.248 INFO:teuthology.orchestra.run.trial170.stdout: python3-ceph-common x86_64 2:20.2.0-681.g36d388f2.el9 ceph 175 k 2026-02-24T18:26:05.248 INFO:teuthology.orchestra.run.trial170.stdout: python3-cephfs x86_64 2:20.2.0-681.g36d388f2.el9 ceph 163 k 2026-02-24T18:26:05.248 INFO:teuthology.orchestra.run.trial170.stdout: python3-rados x86_64 2:20.2.0-681.g36d388f2.el9 ceph 323 k 2026-02-24T18:26:05.248 INFO:teuthology.orchestra.run.trial170.stdout: python3-rbd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 306 k 2026-02-24T18:26:05.248 INFO:teuthology.orchestra.run.trial170.stdout: python3-rgw x86_64 2:20.2.0-681.g36d388f2.el9 ceph 99 k 2026-02-24T18:26:05.248 INFO:teuthology.orchestra.run.trial170.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-24T18:26:05.248 INFO:teuthology.orchestra.run.trial170.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-24T18:26:05.248 INFO:teuthology.orchestra.run.trial170.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-24T18:26:05.248 INFO:teuthology.orchestra.run.trial170.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-24T18:26:05.249 INFO:teuthology.orchestra.run.trial170.stdout:Installing weak dependencies: 2026-02-24T18:26:05.249 INFO:teuthology.orchestra.run.trial170.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-24T18:26:05.249 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:26:05.249 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T18:26:05.249 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:26:05.249 INFO:teuthology.orchestra.run.trial170.stdout:Install 32 Packages 2026-02-24T18:26:05.249 INFO:teuthology.orchestra.run.trial170.stdout:Upgrade 2 Packages 2026-02-24T18:26:05.249 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:26:05.250 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 78 M 2026-02-24T18:26:05.250 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T18:26:06.775 INFO:teuthology.orchestra.run.trial195.stdout:lab-extras 2.8 MB/s | 50 kB 00:00 2026-02-24T18:26:07.533 INFO:teuthology.orchestra.run.trial044.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-24T18:26:07.980 INFO:teuthology.orchestra.run.trial014.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-24T18:26:08.000 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T18:26:08.002 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:26:08.002 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repository Size 2026-02-24T18:26:08.002 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:26:08.002 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T18:26:08.003 INFO:teuthology.orchestra.run.trial195.stdout: ceph-radosgw x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 M 2026-02-24T18:26:08.003 INFO:teuthology.orchestra.run.trial195.stdout:Upgrading: 2026-02-24T18:26:08.003 INFO:teuthology.orchestra.run.trial195.stdout: librados2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 3.5 M 2026-02-24T18:26:08.003 INFO:teuthology.orchestra.run.trial195.stdout: librbd1 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.8 M 2026-02-24T18:26:08.003 INFO:teuthology.orchestra.run.trial195.stdout:Installing dependencies: 2026-02-24T18:26:08.003 INFO:teuthology.orchestra.run.trial195.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-24T18:26:08.003 INFO:teuthology.orchestra.run.trial195.stdout: ceph-base x86_64 2:20.2.0-681.g36d388f2.el9 ceph 5.9 M 2026-02-24T18:26:08.003 INFO:teuthology.orchestra.run.trial195.stdout: ceph-common x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 M 2026-02-24T18:26:08.003 INFO:teuthology.orchestra.run.trial195.stdout: ceph-selinux x86_64 2:20.2.0-681.g36d388f2.el9 ceph 25 k 2026-02-24T18:26:08.003 INFO:teuthology.orchestra.run.trial195.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-24T18:26:08.003 INFO:teuthology.orchestra.run.trial195.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-24T18:26:08.003 INFO:teuthology.orchestra.run.trial195.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-24T18:26:08.004 INFO:teuthology.orchestra.run.trial195.stdout: libcephfs2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 869 k 2026-02-24T18:26:08.004 INFO:teuthology.orchestra.run.trial195.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-24T18:26:08.004 INFO:teuthology.orchestra.run.trial195.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-24T18:26:08.004 INFO:teuthology.orchestra.run.trial195.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-24T18:26:08.004 INFO:teuthology.orchestra.run.trial195.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-24T18:26:08.004 INFO:teuthology.orchestra.run.trial195.stdout: libradosstriper1 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 250 k 2026-02-24T18:26:08.004 INFO:teuthology.orchestra.run.trial195.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-24T18:26:08.004 INFO:teuthology.orchestra.run.trial195.stdout: librgw2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 6.4 M 2026-02-24T18:26:08.004 INFO:teuthology.orchestra.run.trial195.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-24T18:26:08.004 INFO:teuthology.orchestra.run.trial195.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-24T18:26:08.004 INFO:teuthology.orchestra.run.trial195.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-24T18:26:08.004 INFO:teuthology.orchestra.run.trial195.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-24T18:26:08.005 INFO:teuthology.orchestra.run.trial195.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-24T18:26:08.005 INFO:teuthology.orchestra.run.trial195.stdout: python3-ceph-argparse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 45 k 2026-02-24T18:26:08.005 INFO:teuthology.orchestra.run.trial195.stdout: python3-ceph-common x86_64 2:20.2.0-681.g36d388f2.el9 ceph 175 k 2026-02-24T18:26:08.005 INFO:teuthology.orchestra.run.trial195.stdout: python3-cephfs x86_64 2:20.2.0-681.g36d388f2.el9 ceph 163 k 2026-02-24T18:26:08.005 INFO:teuthology.orchestra.run.trial195.stdout: python3-rados x86_64 2:20.2.0-681.g36d388f2.el9 ceph 323 k 2026-02-24T18:26:08.005 INFO:teuthology.orchestra.run.trial195.stdout: python3-rbd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 306 k 2026-02-24T18:26:08.005 INFO:teuthology.orchestra.run.trial195.stdout: python3-rgw x86_64 2:20.2.0-681.g36d388f2.el9 ceph 99 k 2026-02-24T18:26:08.005 INFO:teuthology.orchestra.run.trial195.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-24T18:26:08.005 INFO:teuthology.orchestra.run.trial195.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-24T18:26:08.005 INFO:teuthology.orchestra.run.trial195.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-24T18:26:08.005 INFO:teuthology.orchestra.run.trial195.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-24T18:26:08.005 INFO:teuthology.orchestra.run.trial195.stdout:Installing weak dependencies: 2026-02-24T18:26:08.006 INFO:teuthology.orchestra.run.trial195.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-24T18:26:08.006 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:26:08.006 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T18:26:08.006 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:26:08.006 INFO:teuthology.orchestra.run.trial195.stdout:Install 32 Packages 2026-02-24T18:26:08.006 INFO:teuthology.orchestra.run.trial195.stdout:Upgrade 2 Packages 2026-02-24T18:26:08.006 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:26:08.007 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 78 M 2026-02-24T18:26:08.007 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T18:26:08.754 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T18:26:08.756 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:26:08.756 INFO:teuthology.orchestra.run.trial044.stdout: Package Arch Version Repository Size 2026-02-24T18:26:08.756 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:26:08.756 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T18:26:08.756 INFO:teuthology.orchestra.run.trial044.stdout: ceph-radosgw x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 M 2026-02-24T18:26:08.756 INFO:teuthology.orchestra.run.trial044.stdout:Upgrading: 2026-02-24T18:26:08.756 INFO:teuthology.orchestra.run.trial044.stdout: librados2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 3.5 M 2026-02-24T18:26:08.756 INFO:teuthology.orchestra.run.trial044.stdout: librbd1 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.8 M 2026-02-24T18:26:08.756 INFO:teuthology.orchestra.run.trial044.stdout:Installing dependencies: 2026-02-24T18:26:08.757 INFO:teuthology.orchestra.run.trial044.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-24T18:26:08.757 INFO:teuthology.orchestra.run.trial044.stdout: ceph-base x86_64 2:20.2.0-681.g36d388f2.el9 ceph 5.9 M 2026-02-24T18:26:08.757 INFO:teuthology.orchestra.run.trial044.stdout: ceph-common x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 M 2026-02-24T18:26:08.757 INFO:teuthology.orchestra.run.trial044.stdout: ceph-selinux x86_64 2:20.2.0-681.g36d388f2.el9 ceph 25 k 2026-02-24T18:26:08.757 INFO:teuthology.orchestra.run.trial044.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-24T18:26:08.757 INFO:teuthology.orchestra.run.trial044.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-24T18:26:08.757 INFO:teuthology.orchestra.run.trial044.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-24T18:26:08.757 INFO:teuthology.orchestra.run.trial044.stdout: libcephfs2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 869 k 2026-02-24T18:26:08.757 INFO:teuthology.orchestra.run.trial044.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-24T18:26:08.757 INFO:teuthology.orchestra.run.trial044.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-24T18:26:08.757 INFO:teuthology.orchestra.run.trial044.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-24T18:26:08.757 INFO:teuthology.orchestra.run.trial044.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-24T18:26:08.757 INFO:teuthology.orchestra.run.trial044.stdout: libradosstriper1 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 250 k 2026-02-24T18:26:08.758 INFO:teuthology.orchestra.run.trial044.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-24T18:26:08.758 INFO:teuthology.orchestra.run.trial044.stdout: librgw2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 6.4 M 2026-02-24T18:26:08.758 INFO:teuthology.orchestra.run.trial044.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-24T18:26:08.758 INFO:teuthology.orchestra.run.trial044.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-24T18:26:08.758 INFO:teuthology.orchestra.run.trial044.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-24T18:26:08.758 INFO:teuthology.orchestra.run.trial044.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-24T18:26:08.758 INFO:teuthology.orchestra.run.trial044.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-24T18:26:08.758 INFO:teuthology.orchestra.run.trial044.stdout: python3-ceph-argparse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 45 k 2026-02-24T18:26:08.758 INFO:teuthology.orchestra.run.trial044.stdout: python3-ceph-common x86_64 2:20.2.0-681.g36d388f2.el9 ceph 175 k 2026-02-24T18:26:08.758 INFO:teuthology.orchestra.run.trial044.stdout: python3-cephfs x86_64 2:20.2.0-681.g36d388f2.el9 ceph 163 k 2026-02-24T18:26:08.758 INFO:teuthology.orchestra.run.trial044.stdout: python3-rados x86_64 2:20.2.0-681.g36d388f2.el9 ceph 323 k 2026-02-24T18:26:08.758 INFO:teuthology.orchestra.run.trial044.stdout: python3-rbd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 306 k 2026-02-24T18:26:08.758 INFO:teuthology.orchestra.run.trial044.stdout: python3-rgw x86_64 2:20.2.0-681.g36d388f2.el9 ceph 99 k 2026-02-24T18:26:08.759 INFO:teuthology.orchestra.run.trial044.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-24T18:26:08.759 INFO:teuthology.orchestra.run.trial044.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-24T18:26:08.759 INFO:teuthology.orchestra.run.trial044.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-24T18:26:08.759 INFO:teuthology.orchestra.run.trial044.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-24T18:26:08.759 INFO:teuthology.orchestra.run.trial044.stdout:Installing weak dependencies: 2026-02-24T18:26:08.759 INFO:teuthology.orchestra.run.trial044.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-24T18:26:08.759 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:26:08.759 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T18:26:08.759 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:26:08.760 INFO:teuthology.orchestra.run.trial044.stdout:Install 32 Packages 2026-02-24T18:26:08.760 INFO:teuthology.orchestra.run.trial044.stdout:Upgrade 2 Packages 2026-02-24T18:26:08.760 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:26:08.760 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 78 M 2026-02-24T18:26:08.760 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T18:26:09.198 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T18:26:09.199 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:26:09.199 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repository Size 2026-02-24T18:26:09.199 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:26:09.199 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T18:26:09.199 INFO:teuthology.orchestra.run.trial014.stdout: ceph-radosgw x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 M 2026-02-24T18:26:09.199 INFO:teuthology.orchestra.run.trial014.stdout:Upgrading: 2026-02-24T18:26:09.199 INFO:teuthology.orchestra.run.trial014.stdout: librados2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 3.5 M 2026-02-24T18:26:09.199 INFO:teuthology.orchestra.run.trial014.stdout: librbd1 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.8 M 2026-02-24T18:26:09.199 INFO:teuthology.orchestra.run.trial014.stdout:Installing dependencies: 2026-02-24T18:26:09.199 INFO:teuthology.orchestra.run.trial014.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-24T18:26:09.200 INFO:teuthology.orchestra.run.trial014.stdout: ceph-base x86_64 2:20.2.0-681.g36d388f2.el9 ceph 5.9 M 2026-02-24T18:26:09.200 INFO:teuthology.orchestra.run.trial014.stdout: ceph-common x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 M 2026-02-24T18:26:09.200 INFO:teuthology.orchestra.run.trial014.stdout: ceph-selinux x86_64 2:20.2.0-681.g36d388f2.el9 ceph 25 k 2026-02-24T18:26:09.200 INFO:teuthology.orchestra.run.trial014.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-24T18:26:09.200 INFO:teuthology.orchestra.run.trial014.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-24T18:26:09.200 INFO:teuthology.orchestra.run.trial014.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-24T18:26:09.200 INFO:teuthology.orchestra.run.trial014.stdout: libcephfs2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 869 k 2026-02-24T18:26:09.200 INFO:teuthology.orchestra.run.trial014.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-24T18:26:09.200 INFO:teuthology.orchestra.run.trial014.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-24T18:26:09.200 INFO:teuthology.orchestra.run.trial014.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-24T18:26:09.200 INFO:teuthology.orchestra.run.trial014.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-24T18:26:09.200 INFO:teuthology.orchestra.run.trial014.stdout: libradosstriper1 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 250 k 2026-02-24T18:26:09.200 INFO:teuthology.orchestra.run.trial014.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-24T18:26:09.200 INFO:teuthology.orchestra.run.trial014.stdout: librgw2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 6.4 M 2026-02-24T18:26:09.200 INFO:teuthology.orchestra.run.trial014.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-24T18:26:09.200 INFO:teuthology.orchestra.run.trial014.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-24T18:26:09.200 INFO:teuthology.orchestra.run.trial014.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-24T18:26:09.200 INFO:teuthology.orchestra.run.trial014.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-24T18:26:09.200 INFO:teuthology.orchestra.run.trial014.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-24T18:26:09.200 INFO:teuthology.orchestra.run.trial014.stdout: python3-ceph-argparse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 45 k 2026-02-24T18:26:09.200 INFO:teuthology.orchestra.run.trial014.stdout: python3-ceph-common x86_64 2:20.2.0-681.g36d388f2.el9 ceph 175 k 2026-02-24T18:26:09.200 INFO:teuthology.orchestra.run.trial014.stdout: python3-cephfs x86_64 2:20.2.0-681.g36d388f2.el9 ceph 163 k 2026-02-24T18:26:09.200 INFO:teuthology.orchestra.run.trial014.stdout: python3-rados x86_64 2:20.2.0-681.g36d388f2.el9 ceph 323 k 2026-02-24T18:26:09.200 INFO:teuthology.orchestra.run.trial014.stdout: python3-rbd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 306 k 2026-02-24T18:26:09.200 INFO:teuthology.orchestra.run.trial014.stdout: python3-rgw x86_64 2:20.2.0-681.g36d388f2.el9 ceph 99 k 2026-02-24T18:26:09.200 INFO:teuthology.orchestra.run.trial014.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-24T18:26:09.200 INFO:teuthology.orchestra.run.trial014.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-24T18:26:09.200 INFO:teuthology.orchestra.run.trial014.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-24T18:26:09.200 INFO:teuthology.orchestra.run.trial014.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-24T18:26:09.200 INFO:teuthology.orchestra.run.trial014.stdout:Installing weak dependencies: 2026-02-24T18:26:09.200 INFO:teuthology.orchestra.run.trial014.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-24T18:26:09.200 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:26:09.201 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T18:26:09.201 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:26:09.201 INFO:teuthology.orchestra.run.trial014.stdout:Install 32 Packages 2026-02-24T18:26:09.201 INFO:teuthology.orchestra.run.trial014.stdout:Upgrade 2 Packages 2026-02-24T18:26:09.201 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:26:09.201 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 78 M 2026-02-24T18:26:09.201 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T18:26:09.974 INFO:teuthology.orchestra.run.trial170.stdout:(1/34): ceph-base-20.2.0-681.g36d388f2.el9.x86_ 1.4 MB/s | 5.9 MB 00:04 2026-02-24T18:26:10.043 INFO:teuthology.orchestra.run.trial170.stdout:(2/34): ceph-selinux-20.2.0-681.g36d388f2.el9.x 366 kB/s | 25 kB 00:00 2026-02-24T18:26:10.969 INFO:teuthology.orchestra.run.trial170.stdout:(3/34): libcephfs2-20.2.0-681.g36d388f2.el9.x86 939 kB/s | 869 kB 00:00 2026-02-24T18:26:11.292 INFO:teuthology.orchestra.run.trial170.stdout:(4/34): libradosstriper1-20.2.0-681.g36d388f2.e 774 kB/s | 250 kB 00:00 2026-02-24T18:26:11.589 INFO:teuthology.orchestra.run.trial195.stdout:(1/34): ceph-base-20.2.0-681.g36d388f2.el9.x86_ 1.9 MB/s | 5.9 MB 00:03 2026-02-24T18:26:11.658 INFO:teuthology.orchestra.run.trial195.stdout:(2/34): ceph-selinux-20.2.0-681.g36d388f2.el9.x 360 kB/s | 25 kB 00:00 2026-02-24T18:26:11.995 INFO:teuthology.orchestra.run.trial195.stdout:(3/34): libcephfs2-20.2.0-681.g36d388f2.el9.x86 2.5 MB/s | 869 kB 00:00 2026-02-24T18:26:12.123 INFO:teuthology.orchestra.run.trial195.stdout:(4/34): libradosstriper1-20.2.0-681.g36d388f2.e 1.9 MB/s | 250 kB 00:00 2026-02-24T18:26:12.675 INFO:teuthology.orchestra.run.trial014.stdout:(1/34): ceph-base-20.2.0-681.g36d388f2.el9.x86_ 2.0 MB/s | 5.9 MB 00:02 2026-02-24T18:26:12.740 INFO:teuthology.orchestra.run.trial014.stdout:(2/34): ceph-selinux-20.2.0-681.g36d388f2.el9.x 387 kB/s | 25 kB 00:00 2026-02-24T18:26:13.063 INFO:teuthology.orchestra.run.trial014.stdout:(3/34): libcephfs2-20.2.0-681.g36d388f2.el9.x86 2.6 MB/s | 869 kB 00:00 2026-02-24T18:26:13.194 INFO:teuthology.orchestra.run.trial014.stdout:(4/34): libradosstriper1-20.2.0-681.g36d388f2.e 1.9 MB/s | 250 kB 00:00 2026-02-24T18:26:14.183 INFO:teuthology.orchestra.run.trial195.stdout:(5/34): librgw2-20.2.0-681.g36d388f2.el9.x86_64 3.1 MB/s | 6.4 MB 00:02 2026-02-24T18:26:14.250 INFO:teuthology.orchestra.run.trial195.stdout:(6/34): python3-ceph-argparse-20.2.0-681.g36d38 661 kB/s | 45 kB 00:00 2026-02-24T18:26:14.322 INFO:teuthology.orchestra.run.trial195.stdout:(7/34): python3-ceph-common-20.2.0-681.g36d388f 2.4 MB/s | 175 kB 00:00 2026-02-24T18:26:14.394 INFO:teuthology.orchestra.run.trial195.stdout:(8/34): python3-cephfs-20.2.0-681.g36d388f2.el9 2.2 MB/s | 163 kB 00:00 2026-02-24T18:26:14.581 INFO:teuthology.orchestra.run.trial044.stdout:(1/34): ceph-base-20.2.0-681.g36d388f2.el9.x86_ 1.1 MB/s | 5.9 MB 00:05 2026-02-24T18:26:14.595 INFO:teuthology.orchestra.run.trial195.stdout:(9/34): python3-rados-20.2.0-681.g36d388f2.el9. 1.6 MB/s | 323 kB 00:00 2026-02-24T18:26:14.643 INFO:teuthology.orchestra.run.trial044.stdout:(2/34): ceph-selinux-20.2.0-681.g36d388f2.el9.x 398 kB/s | 25 kB 00:00 2026-02-24T18:26:14.793 INFO:teuthology.orchestra.run.trial195.stdout:(10/34): python3-rbd-20.2.0-681.g36d388f2.el9.x 1.5 MB/s | 306 kB 00:00 2026-02-24T18:26:14.863 INFO:teuthology.orchestra.run.trial195.stdout:(11/34): python3-rgw-20.2.0-681.g36d388f2.el9.x 1.4 MB/s | 99 kB 00:00 2026-02-24T18:26:15.261 INFO:teuthology.orchestra.run.trial044.stdout:(3/34): libcephfs2-20.2.0-681.g36d388f2.el9.x86 1.4 MB/s | 869 kB 00:00 2026-02-24T18:26:15.299 INFO:teuthology.orchestra.run.trial195.stdout:(12/34): mailcap-2.1.49-5.el9.noarch.rpm 76 kB/s | 33 kB 00:00 2026-02-24T18:26:15.468 INFO:teuthology.orchestra.run.trial044.stdout:(4/34): libradosstriper1-20.2.0-681.g36d388f2.e 1.2 MB/s | 250 kB 00:00 2026-02-24T18:26:15.475 INFO:teuthology.orchestra.run.trial195.stdout:(13/34): pciutils-3.7.0-7.el9.x86_64.rpm 527 kB/s | 93 kB 00:00 2026-02-24T18:26:15.664 INFO:teuthology.orchestra.run.trial014.stdout:(5/34): librgw2-20.2.0-681.g36d388f2.el9.x86_64 2.6 MB/s | 6.4 MB 00:02 2026-02-24T18:26:15.734 INFO:teuthology.orchestra.run.trial014.stdout:(6/34): python3-ceph-argparse-20.2.0-681.g36d38 647 kB/s | 45 kB 00:00 2026-02-24T18:26:15.805 INFO:teuthology.orchestra.run.trial014.stdout:(7/34): python3-ceph-common-20.2.0-681.g36d388f 2.4 MB/s | 175 kB 00:00 2026-02-24T18:26:15.876 INFO:teuthology.orchestra.run.trial014.stdout:(8/34): python3-cephfs-20.2.0-681.g36d388f2.el9 2.3 MB/s | 163 kB 00:00 2026-02-24T18:26:16.015 INFO:teuthology.orchestra.run.trial014.stdout:(9/34): python3-rados-20.2.0-681.g36d388f2.el9. 2.3 MB/s | 323 kB 00:00 2026-02-24T18:26:16.149 INFO:teuthology.orchestra.run.trial195.stdout:(14/34): boost-program-options-1.75.0-13.el9.x8 155 kB/s | 104 kB 00:00 2026-02-24T18:26:16.154 INFO:teuthology.orchestra.run.trial014.stdout:(10/34): python3-rbd-20.2.0-681.g36d388f2.el9.x 2.1 MB/s | 306 kB 00:00 2026-02-24T18:26:16.228 INFO:teuthology.orchestra.run.trial014.stdout:(11/34): python3-rgw-20.2.0-681.g36d388f2.el9.x 1.3 MB/s | 99 kB 00:00 2026-02-24T18:26:16.666 INFO:teuthology.orchestra.run.trial014.stdout:(12/34): mailcap-2.1.49-5.el9.noarch.rpm 75 kB/s | 33 kB 00:00 2026-02-24T18:26:16.869 INFO:teuthology.orchestra.run.trial195.stdout:(15/34): libnbd-1.20.3-4.el9.x86_64.rpm 228 kB/s | 164 kB 00:00 2026-02-24T18:26:16.885 INFO:teuthology.orchestra.run.trial014.stdout:(13/34): pciutils-3.7.0-7.el9.x86_64.rpm 427 kB/s | 93 kB 00:00 2026-02-24T18:26:17.166 INFO:teuthology.orchestra.run.trial170.stdout:(5/34): ceph-radosgw-20.2.0-681.g36d388f2.el9.x 2.1 MB/s | 24 MB 00:11 2026-02-24T18:26:17.233 INFO:teuthology.orchestra.run.trial170.stdout:(6/34): python3-ceph-argparse-20.2.0-681.g36d38 682 kB/s | 45 kB 00:00 2026-02-24T18:26:17.431 INFO:teuthology.orchestra.run.trial170.stdout:(7/34): python3-ceph-common-20.2.0-681.g36d388f 884 kB/s | 175 kB 00:00 2026-02-24T18:26:17.552 INFO:teuthology.orchestra.run.trial014.stdout:(14/34): boost-program-options-1.75.0-13.el9.x8 156 kB/s | 104 kB 00:00 2026-02-24T18:26:17.568 INFO:teuthology.orchestra.run.trial170.stdout:(8/34): python3-cephfs-20.2.0-681.g36d388f2.el9 1.2 MB/s | 163 kB 00:00 2026-02-24T18:26:17.585 INFO:teuthology.orchestra.run.trial195.stdout:(16/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 223 kB/s | 160 kB 00:00 2026-02-24T18:26:17.849 INFO:teuthology.orchestra.run.trial170.stdout:(9/34): python3-rados-20.2.0-681.g36d388f2.el9. 1.1 MB/s | 323 kB 00:00 2026-02-24T18:26:18.114 INFO:teuthology.orchestra.run.trial170.stdout:(10/34): python3-rbd-20.2.0-681.g36d388f2.el9.x 1.1 MB/s | 306 kB 00:00 2026-02-24T18:26:18.125 INFO:teuthology.orchestra.run.trial014.stdout:(15/34): ceph-radosgw-20.2.0-681.g36d388f2.el9. 2.8 MB/s | 24 MB 00:08 2026-02-24T18:26:18.174 INFO:teuthology.orchestra.run.trial195.stdout:(17/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 77 kB/s | 45 kB 00:00 2026-02-24T18:26:18.209 INFO:teuthology.orchestra.run.trial170.stdout:(11/34): librgw2-20.2.0-681.g36d388f2.el9.x86_6 943 kB/s | 6.4 MB 00:06 2026-02-24T18:26:18.239 INFO:teuthology.orchestra.run.trial170.stdout:(12/34): python3-rgw-20.2.0-681.g36d388f2.el9.x 792 kB/s | 99 kB 00:00 2026-02-24T18:26:18.275 INFO:teuthology.orchestra.run.trial014.stdout:(16/34): libnbd-1.20.3-4.el9.x86_64.rpm 227 kB/s | 164 kB 00:00 2026-02-24T18:26:18.475 INFO:teuthology.orchestra.run.trial170.stdout:(13/34): mailcap-2.1.49-5.el9.noarch.rpm 124 kB/s | 33 kB 00:00 2026-02-24T18:26:18.606 INFO:teuthology.orchestra.run.trial170.stdout:(14/34): boost-program-options-1.75.0-13.el9.x8 798 kB/s | 104 kB 00:00 2026-02-24T18:26:18.628 INFO:teuthology.orchestra.run.trial170.stdout:(15/34): pciutils-3.7.0-7.el9.x86_64.rpm 239 kB/s | 93 kB 00:00 2026-02-24T18:26:18.662 INFO:teuthology.orchestra.run.trial170.stdout:(16/34): libnbd-1.20.3-4.el9.x86_64.rpm 2.9 MB/s | 164 kB 00:00 2026-02-24T18:26:18.688 INFO:teuthology.orchestra.run.trial170.stdout:(17/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.7 MB/s | 45 kB 00:00 2026-02-24T18:26:18.760 INFO:teuthology.orchestra.run.trial170.stdout:(18/34): librdkafka-1.6.1-102.el9.x86_64.rpm 9.0 MB/s | 662 kB 00:00 2026-02-24T18:26:18.768 INFO:teuthology.orchestra.run.trial170.stdout:(19/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 160 kB 00:00 2026-02-24T18:26:18.792 INFO:teuthology.orchestra.run.trial170.stdout:(20/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 9.1 MB/s | 292 kB 00:00 2026-02-24T18:26:18.817 INFO:teuthology.orchestra.run.trial170.stdout:(21/34): qatlib-service-25.08.0-2.el9.x86_64.rp 1.4 MB/s | 37 kB 00:00 2026-02-24T18:26:18.824 INFO:teuthology.orchestra.run.trial170.stdout:(22/34): qatlib-25.08.0-2.el9.x86_64.rpm 4.2 MB/s | 240 kB 00:00 2026-02-24T18:26:18.839 INFO:teuthology.orchestra.run.trial014.stdout:(17/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 224 kB/s | 160 kB 00:00 2026-02-24T18:26:18.843 INFO:teuthology.orchestra.run.trial170.stdout:(23/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.5 MB/s | 66 kB 00:00 2026-02-24T18:26:18.860 INFO:teuthology.orchestra.run.trial014.stdout:(18/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 77 kB/s | 45 kB 00:00 2026-02-24T18:26:19.053 INFO:teuthology.orchestra.run.trial195.stdout:(18/34): librdkafka-1.6.1-102.el9.x86_64.rpm 753 kB/s | 662 kB 00:00 2026-02-24T18:26:19.324 INFO:teuthology.orchestra.run.trial044.stdout:(5/34): librgw2-20.2.0-681.g36d388f2.el9.x86_64 1.7 MB/s | 6.4 MB 00:03 2026-02-24T18:26:19.336 INFO:teuthology.orchestra.run.trial170.stdout:(24/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 601 kB/s | 308 kB 00:00 2026-02-24T18:26:19.395 INFO:teuthology.orchestra.run.trial044.stdout:(6/34): python3-ceph-argparse-20.2.0-681.g36d38 642 kB/s | 45 kB 00:00 2026-02-24T18:26:19.407 INFO:teuthology.orchestra.run.trial170.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 350 kB/s | 25 kB 00:00 2026-02-24T18:26:19.478 INFO:teuthology.orchestra.run.trial170.stdout:(26/34): liboath-2.6.12-1.el9.x86_64.rpm 687 kB/s | 49 kB 00:00 2026-02-24T18:26:19.535 INFO:teuthology.orchestra.run.trial044.stdout:(7/34): python3-ceph-common-20.2.0-681.g36d388f 1.2 MB/s | 175 kB 00:00 2026-02-24T18:26:19.595 INFO:teuthology.orchestra.run.trial170.stdout:(27/34): libunwind-1.6.2-1.el9.x86_64.rpm 578 kB/s | 67 kB 00:00 2026-02-24T18:26:19.626 INFO:teuthology.orchestra.run.trial170.stdout:(28/34): libarrow-9.0.0-15.el9.x86_64.rpm 5.6 MB/s | 4.4 MB 00:00 2026-02-24T18:26:19.644 INFO:teuthology.orchestra.run.trial014.stdout:(19/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 373 kB/s | 292 kB 00:00 2026-02-24T18:26:19.677 INFO:teuthology.orchestra.run.trial044.stdout:(8/34): python3-cephfs-20.2.0-681.g36d388f2.el9 1.1 MB/s | 163 kB 00:00 2026-02-24T18:26:19.709 INFO:teuthology.orchestra.run.trial014.stdout:(20/34): librdkafka-1.6.1-102.el9.x86_64.rpm 761 kB/s | 662 kB 00:00 2026-02-24T18:26:19.740 INFO:teuthology.orchestra.run.trial170.stdout:(29/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 5.6 MB/s | 838 kB 00:00 2026-02-24T18:26:19.805 INFO:teuthology.orchestra.run.trial170.stdout:(30/34): re2-20211101-20.el9.x86_64.rpm 1.0 MB/s | 191 kB 00:00 2026-02-24T18:26:19.836 INFO:teuthology.orchestra.run.trial195.stdout:(19/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 373 kB/s | 292 kB 00:00 2026-02-24T18:26:19.902 INFO:teuthology.orchestra.run.trial170.stdout:(31/34): thrift-0.15.0-4.el9.x86_64.rpm 9.8 MB/s | 1.6 MB 00:00 2026-02-24T18:26:19.952 INFO:teuthology.orchestra.run.trial044.stdout:(9/34): python3-rados-20.2.0-681.g36d388f2.el9. 1.1 MB/s | 323 kB 00:00 2026-02-24T18:26:20.214 INFO:teuthology.orchestra.run.trial044.stdout:(10/34): python3-rbd-20.2.0-681.g36d388f2.el9.x 1.1 MB/s | 306 kB 00:00 2026-02-24T18:26:20.285 INFO:teuthology.orchestra.run.trial014.stdout:(21/34): qatlib-service-25.08.0-2.el9.x86_64.rp 64 kB/s | 37 kB 00:00 2026-02-24T18:26:20.351 INFO:teuthology.orchestra.run.trial044.stdout:(11/34): python3-rgw-20.2.0-681.g36d388f2.el9.x 728 kB/s | 99 kB 00:00 2026-02-24T18:26:20.407 INFO:teuthology.orchestra.run.trial014.stdout:(22/34): qatlib-25.08.0-2.el9.x86_64.rpm 314 kB/s | 240 kB 00:00 2026-02-24T18:26:20.592 INFO:teuthology.orchestra.run.trial195.stdout:(20/34): qatlib-25.08.0-2.el9.x86_64.rpm 317 kB/s | 240 kB 00:00 2026-02-24T18:26:20.866 INFO:teuthology.orchestra.run.trial014.stdout:(23/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 669 kB/s | 308 kB 00:00 2026-02-24T18:26:20.908 INFO:teuthology.orchestra.run.trial044.stdout:(12/34): mailcap-2.1.49-5.el9.noarch.rpm 59 kB/s | 33 kB 00:00 2026-02-24T18:26:20.909 INFO:teuthology.orchestra.run.trial014.stdout:(24/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 106 kB/s | 66 kB 00:00 2026-02-24T18:26:21.120 INFO:teuthology.orchestra.run.trial014.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 117 kB/s | 25 kB 00:00 2026-02-24T18:26:21.161 INFO:teuthology.orchestra.run.trial195.stdout:(21/34): qatlib-service-25.08.0-2.el9.x86_64.rp 65 kB/s | 37 kB 00:00 2026-02-24T18:26:21.223 INFO:teuthology.orchestra.run.trial014.stdout:(26/34): libarrow-9.0.0-15.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2026-02-24T18:26:21.263 INFO:teuthology.orchestra.run.trial014.stdout:(27/34): liboath-2.6.12-1.el9.x86_64.rpm 342 kB/s | 49 kB 00:00 2026-02-24T18:26:21.291 INFO:teuthology.orchestra.run.trial014.stdout:(28/34): libunwind-1.6.2-1.el9.x86_64.rpm 985 kB/s | 67 kB 00:00 2026-02-24T18:26:21.360 INFO:teuthology.orchestra.run.trial014.stdout:(29/34): re2-20211101-20.el9.x86_64.rpm 2.7 MB/s | 191 kB 00:00 2026-02-24T18:26:21.459 INFO:teuthology.orchestra.run.trial014.stdout:(30/34): thrift-0.15.0-4.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2026-02-24T18:26:21.563 INFO:teuthology.orchestra.run.trial044.stdout:(13/34): pciutils-3.7.0-7.el9.x86_64.rpm 142 kB/s | 93 kB 00:00 2026-02-24T18:26:21.584 INFO:teuthology.orchestra.run.trial014.stdout:(31/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 2.6 MB/s | 838 kB 00:00 2026-02-24T18:26:21.788 INFO:teuthology.orchestra.run.trial195.stdout:(22/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 106 kB/s | 66 kB 00:00 2026-02-24T18:26:21.960 INFO:teuthology.orchestra.run.trial044.stdout:(14/34): boost-program-options-1.75.0-13.el9.x8 262 kB/s | 104 kB 00:00 2026-02-24T18:26:22.029 INFO:teuthology.orchestra.run.trial170.stdout:(32/34): librbd1-20.2.0-681.g36d388f2.el9.x86_6 1.3 MB/s | 2.8 MB 00:02 2026-02-24T18:26:22.139 INFO:teuthology.orchestra.run.trial044.stdout:(15/34): libnbd-1.20.3-4.el9.x86_64.rpm 918 kB/s | 164 kB 00:00 2026-02-24T18:26:22.227 INFO:teuthology.orchestra.run.trial195.stdout:(23/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 701 kB/s | 308 kB 00:00 2026-02-24T18:26:22.252 INFO:teuthology.orchestra.run.trial044.stdout:(16/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2026-02-24T18:26:22.339 INFO:teuthology.orchestra.run.trial044.stdout:(17/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 521 kB/s | 45 kB 00:00 2026-02-24T18:26:22.444 INFO:teuthology.orchestra.run.trial170.stdout:(33/34): ceph-common-20.2.0-681.g36d388f2.el9.x 1.4 MB/s | 24 MB 00:16 2026-02-24T18:26:22.562 INFO:teuthology.orchestra.run.trial044.stdout:(18/34): librdkafka-1.6.1-102.el9.x86_64.rpm 2.9 MB/s | 662 kB 00:00 2026-02-24T18:26:22.588 INFO:teuthology.orchestra.run.trial170.stdout:(34/34): librados2-20.2.0-681.g36d388f2.el9.x86 1.3 MB/s | 3.5 MB 00:02 2026-02-24T18:26:22.592 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:26:22.592 INFO:teuthology.orchestra.run.trial170.stdout:Total 4.5 MB/s | 78 MB 00:17 2026-02-24T18:26:22.660 INFO:teuthology.orchestra.run.trial044.stdout:(19/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.9 MB/s | 292 kB 00:00 2026-02-24T18:26:22.682 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T18:26:22.700 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T18:26:22.700 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T18:26:22.755 INFO:teuthology.orchestra.run.trial044.stdout:(20/34): qatlib-25.08.0-2.el9.x86_64.rpm 2.5 MB/s | 240 kB 00:00 2026-02-24T18:26:22.834 INFO:teuthology.orchestra.run.trial044.stdout:(21/34): qatlib-service-25.08.0-2.el9.x86_64.rp 469 kB/s | 37 kB 00:00 2026-02-24T18:26:22.916 INFO:teuthology.orchestra.run.trial044.stdout:(22/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 812 kB/s | 66 kB 00:00 2026-02-24T18:26:22.987 INFO:teuthology.orchestra.run.trial044.stdout:(23/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 4.3 MB/s | 308 kB 00:00 2026-02-24T18:26:22.991 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T18:26:22.991 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T18:26:23.034 INFO:teuthology.orchestra.run.trial044.stdout:(24/34): libarrow-9.0.0-15.el9.x86_64.rpm 93 MB/s | 4.4 MB 00:00 2026-02-24T18:26:23.043 INFO:teuthology.orchestra.run.trial044.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 2.8 MB/s | 25 kB 00:00 2026-02-24T18:26:23.052 INFO:teuthology.orchestra.run.trial044.stdout:(26/34): liboath-2.6.12-1.el9.x86_64.rpm 5.6 MB/s | 49 kB 00:00 2026-02-24T18:26:23.060 INFO:teuthology.orchestra.run.trial044.stdout:(27/34): libunwind-1.6.2-1.el9.x86_64.rpm 7.7 MB/s | 67 kB 00:00 2026-02-24T18:26:23.071 INFO:teuthology.orchestra.run.trial044.stdout:(28/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 80 MB/s | 838 kB 00:00 2026-02-24T18:26:23.080 INFO:teuthology.orchestra.run.trial044.stdout:(29/34): re2-20211101-20.el9.x86_64.rpm 21 MB/s | 191 kB 00:00 2026-02-24T18:26:23.092 INFO:teuthology.orchestra.run.trial044.stdout:(30/34): thrift-0.15.0-4.el9.x86_64.rpm 130 MB/s | 1.6 MB 00:00 2026-02-24T18:26:23.325 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T18:26:23.337 INFO:teuthology.orchestra.run.trial170.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/36 2026-02-24T18:26:23.382 INFO:teuthology.orchestra.run.trial195.stdout:(24/34): libarrow-9.0.0-15.el9.x86_64.rpm 3.8 MB/s | 4.4 MB 00:01 2026-02-24T18:26:23.490 INFO:teuthology.orchestra.run.trial170.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/36 2026-02-24T18:26:23.494 INFO:teuthology.orchestra.run.trial170.stdout: Upgrading : librados2-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-24T18:26:23.523 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: librados2-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-24T18:26:23.560 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 4/36 2026-02-24T18:26:23.561 INFO:teuthology.orchestra.run.trial170.stdout: Installing : libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-24T18:26:23.573 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-24T18:26:23.582 INFO:teuthology.orchestra.run.trial170.stdout: Installing : liboath-2.6.12-1.el9.x86_64 6/36 2026-02-24T18:26:23.585 INFO:teuthology.orchestra.run.trial170.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/36 2026-02-24T18:26:23.590 INFO:teuthology.orchestra.run.trial170.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 8/36 2026-02-24T18:26:23.591 INFO:teuthology.orchestra.run.trial195.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 119 kB/s | 25 kB 00:00 2026-02-24T18:26:23.594 INFO:teuthology.orchestra.run.trial170.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 9/36 2026-02-24T18:26:23.602 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x 10/36 2026-02-24T18:26:23.614 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 11/36 2026-02-24T18:26:23.615 INFO:teuthology.orchestra.run.trial170.stdout: Installing : libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-24T18:26:23.629 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-24T18:26:23.666 INFO:teuthology.orchestra.run.trial170.stdout: Installing : re2-1:20211101-20.el9.x86_64 13/36 2026-02-24T18:26:23.669 INFO:teuthology.orchestra.run.trial170.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 14/36 2026-02-24T18:26:23.675 INFO:teuthology.orchestra.run.trial170.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 15/36 2026-02-24T18:26:23.677 INFO:teuthology.orchestra.run.trial170.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 16/36 2026-02-24T18:26:23.682 INFO:teuthology.orchestra.run.trial170.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 17/36 2026-02-24T18:26:23.805 INFO:teuthology.orchestra.run.trial170.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-24T18:26:23.806 INFO:teuthology.orchestra.run.trial170.stdout: Upgrading : librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 19/36 2026-02-24T18:26:23.834 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 19/36 2026-02-24T18:26:23.837 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 20/36 2026-02-24T18:26:23.844 INFO:teuthology.orchestra.run.trial170.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-24T18:26:23.891 INFO:teuthology.orchestra.run.trial195.stdout:(26/34): ceph-common-20.2.0-681.g36d388f2.el9.x 1.5 MB/s | 24 MB 00:15 2026-02-24T18:26:23.892 INFO:teuthology.orchestra.run.trial195.stdout:(27/34): liboath-2.6.12-1.el9.x86_64.rpm 162 kB/s | 49 kB 00:00 2026-02-24T18:26:24.121 INFO:teuthology.orchestra.run.trial170.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-24T18:26:24.123 INFO:teuthology.orchestra.run.trial170.stdout: Installing : librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 23/36 2026-02-24T18:26:24.141 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 23/36 2026-02-24T18:26:24.145 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 24/36 2026-02-24T18:26:24.149 INFO:teuthology.orchestra.run.trial170.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-24T18:26:24.153 INFO:teuthology.orchestra.run.trial170.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-24T18:26:24.154 INFO:teuthology.orchestra.run.trial170.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-24T18:26:24.171 INFO:teuthology.orchestra.run.trial195.stdout:(28/34): libunwind-1.6.2-1.el9.x86_64.rpm 241 kB/s | 67 kB 00:00 2026-02-24T18:26:24.171 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-24T18:26:24.174 INFO:teuthology.orchestra.run.trial170.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-24T18:26:24.206 INFO:teuthology.orchestra.run.trial170.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-24T18:26:24.208 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86 30/36 2026-02-24T18:26:24.451 INFO:teuthology.orchestra.run.trial195.stdout:(29/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 1.5 MB/s | 838 kB 00:00 2026-02-24T18:26:24.529 INFO:teuthology.orchestra.run.trial195.stdout:(30/34): re2-20211101-20.el9.x86_64.rpm 535 kB/s | 191 kB 00:00 2026-02-24T18:26:25.118 INFO:teuthology.orchestra.run.trial014.stdout:(32/34): librados2-20.2.0-681.g36d388f2.el9.x86 984 kB/s | 3.5 MB 00:03 2026-02-24T18:26:25.143 INFO:teuthology.orchestra.run.trial195.stdout:(31/34): thrift-0.15.0-4.el9.x86_64.rpm 2.3 MB/s | 1.6 MB 00:00 2026-02-24T18:26:25.285 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-24T18:26:25.288 INFO:teuthology.orchestra.run.trial170.stdout: Installing : ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-24T18:26:25.382 INFO:teuthology.orchestra.run.trial044.stdout:(31/34): ceph-radosgw-20.2.0-681.g36d388f2.el9. 1.4 MB/s | 24 MB 00:16 2026-02-24T18:26:25.583 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-24T18:26:25.587 INFO:teuthology.orchestra.run.trial170.stdout: Installing : ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 32/36 2026-02-24T18:26:25.624 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 32/36 2026-02-24T18:26:25.625 INFO:teuthology.orchestra.run.trial170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-24T18:26:25.625 INFO:teuthology.orchestra.run.trial170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-24T18:26:25.625 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:26:25.629 INFO:teuthology.orchestra.run.trial170.stdout: Installing : ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-24T18:26:26.655 INFO:teuthology.orchestra.run.trial014.stdout:(33/34): librbd1-20.2.0-681.g36d388f2.el9.x86_6 574 kB/s | 2.8 MB 00:05 2026-02-24T18:26:26.668 INFO:teuthology.orchestra.run.trial195.stdout:(32/34): librbd1-20.2.0-681.g36d388f2.el9.x86_6 1.9 MB/s | 2.8 MB 00:01 2026-02-24T18:26:26.964 INFO:teuthology.orchestra.run.trial044.stdout:(32/34): librbd1-20.2.0-681.g36d388f2.el9.x86_6 1.8 MB/s | 2.8 MB 00:01 2026-02-24T18:26:27.223 INFO:teuthology.orchestra.run.trial044.stdout:(33/34): ceph-common-20.2.0-681.g36d388f2.el9.x 1.3 MB/s | 24 MB 00:18 2026-02-24T18:26:27.535 INFO:teuthology.orchestra.run.trial195.stdout:(33/34): librados2-20.2.0-681.g36d388f2.el9.x86 1.2 MB/s | 3.5 MB 00:03 2026-02-24T18:26:28.686 INFO:teuthology.orchestra.run.trial044.stdout:(34/34): librados2-20.2.0-681.g36d388f2.el9.x86 644 kB/s | 3.5 MB 00:05 2026-02-24T18:26:28.690 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:26:28.690 INFO:teuthology.orchestra.run.trial044.stdout:Total 3.9 MB/s | 78 MB 00:19 2026-02-24T18:26:28.775 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T18:26:28.792 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T18:26:28.792 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T18:26:29.082 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T18:26:29.082 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T18:26:29.348 INFO:teuthology.orchestra.run.trial014.stdout:(34/34): ceph-common-20.2.0-681.g36d388f2.el9.x 1.2 MB/s | 24 MB 00:19 2026-02-24T18:26:29.350 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:26:29.350 INFO:teuthology.orchestra.run.trial014.stdout:Total 3.8 MB/s | 78 MB 00:20 2026-02-24T18:26:29.415 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T18:26:29.426 INFO:teuthology.orchestra.run.trial044.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/36 2026-02-24T18:26:29.432 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T18:26:29.449 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T18:26:29.449 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T18:26:29.579 INFO:teuthology.orchestra.run.trial044.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/36 2026-02-24T18:26:29.583 INFO:teuthology.orchestra.run.trial044.stdout: Upgrading : librados2-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-24T18:26:29.612 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: librados2-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-24T18:26:29.649 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 4/36 2026-02-24T18:26:29.650 INFO:teuthology.orchestra.run.trial044.stdout: Installing : libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-24T18:26:29.660 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-24T18:26:29.667 INFO:teuthology.orchestra.run.trial044.stdout: Installing : liboath-2.6.12-1.el9.x86_64 6/36 2026-02-24T18:26:29.670 INFO:teuthology.orchestra.run.trial044.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/36 2026-02-24T18:26:29.673 INFO:teuthology.orchestra.run.trial044.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 8/36 2026-02-24T18:26:29.677 INFO:teuthology.orchestra.run.trial044.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 9/36 2026-02-24T18:26:29.686 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x 10/36 2026-02-24T18:26:29.699 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 11/36 2026-02-24T18:26:29.700 INFO:teuthology.orchestra.run.trial044.stdout: Installing : libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-24T18:26:29.713 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-24T18:26:29.739 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T18:26:29.739 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T18:26:29.743 INFO:teuthology.orchestra.run.trial044.stdout: Installing : re2-1:20211101-20.el9.x86_64 13/36 2026-02-24T18:26:29.747 INFO:teuthology.orchestra.run.trial044.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 14/36 2026-02-24T18:26:29.753 INFO:teuthology.orchestra.run.trial044.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 15/36 2026-02-24T18:26:29.755 INFO:teuthology.orchestra.run.trial044.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 16/36 2026-02-24T18:26:29.759 INFO:teuthology.orchestra.run.trial044.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 17/36 2026-02-24T18:26:29.882 INFO:teuthology.orchestra.run.trial044.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-24T18:26:29.883 INFO:teuthology.orchestra.run.trial044.stdout: Upgrading : librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 19/36 2026-02-24T18:26:29.912 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 19/36 2026-02-24T18:26:29.914 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 20/36 2026-02-24T18:26:29.921 INFO:teuthology.orchestra.run.trial044.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-24T18:26:30.072 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T18:26:30.083 INFO:teuthology.orchestra.run.trial014.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/36 2026-02-24T18:26:30.120 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-24T18:26:30.120 INFO:teuthology.orchestra.run.trial170.stdout:skipping the directory /sys 2026-02-24T18:26:30.120 INFO:teuthology.orchestra.run.trial170.stdout:skipping the directory /proc 2026-02-24T18:26:30.120 INFO:teuthology.orchestra.run.trial170.stdout:skipping the directory /mnt 2026-02-24T18:26:30.120 INFO:teuthology.orchestra.run.trial170.stdout:skipping the directory /var/tmp 2026-02-24T18:26:30.120 INFO:teuthology.orchestra.run.trial170.stdout:skipping the directory /home 2026-02-24T18:26:30.120 INFO:teuthology.orchestra.run.trial170.stdout:skipping the directory /root 2026-02-24T18:26:30.120 INFO:teuthology.orchestra.run.trial170.stdout:skipping the directory /tmp 2026-02-24T18:26:30.120 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:26:30.201 INFO:teuthology.orchestra.run.trial044.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-24T18:26:30.202 INFO:teuthology.orchestra.run.trial044.stdout: Installing : librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 23/36 2026-02-24T18:26:30.221 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 23/36 2026-02-24T18:26:30.225 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 24/36 2026-02-24T18:26:30.230 INFO:teuthology.orchestra.run.trial044.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-24T18:26:30.233 INFO:teuthology.orchestra.run.trial044.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-24T18:26:30.233 INFO:teuthology.orchestra.run.trial044.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-24T18:26:30.237 INFO:teuthology.orchestra.run.trial014.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/36 2026-02-24T18:26:30.241 INFO:teuthology.orchestra.run.trial014.stdout: Upgrading : librados2-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-24T18:26:30.252 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-24T18:26:30.256 INFO:teuthology.orchestra.run.trial044.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-24T18:26:30.270 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: librados2-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-24T18:26:30.288 INFO:teuthology.orchestra.run.trial044.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-24T18:26:30.290 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86 30/36 2026-02-24T18:26:30.306 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 4/36 2026-02-24T18:26:30.307 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-24T18:26:30.320 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-24T18:26:30.329 INFO:teuthology.orchestra.run.trial014.stdout: Installing : liboath-2.6.12-1.el9.x86_64 6/36 2026-02-24T18:26:30.332 INFO:teuthology.orchestra.run.trial014.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/36 2026-02-24T18:26:30.336 INFO:teuthology.orchestra.run.trial014.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 8/36 2026-02-24T18:26:30.341 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 9/36 2026-02-24T18:26:30.350 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x 10/36 2026-02-24T18:26:30.362 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 11/36 2026-02-24T18:26:30.363 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-24T18:26:30.375 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-24T18:26:30.409 INFO:teuthology.orchestra.run.trial014.stdout: Installing : re2-1:20211101-20.el9.x86_64 13/36 2026-02-24T18:26:30.413 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 14/36 2026-02-24T18:26:30.419 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 15/36 2026-02-24T18:26:30.421 INFO:teuthology.orchestra.run.trial014.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 16/36 2026-02-24T18:26:30.425 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 17/36 2026-02-24T18:26:30.547 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-24T18:26:30.548 INFO:teuthology.orchestra.run.trial014.stdout: Upgrading : librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 19/36 2026-02-24T18:26:30.573 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 19/36 2026-02-24T18:26:30.575 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 20/36 2026-02-24T18:26:30.582 INFO:teuthology.orchestra.run.trial014.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-24T18:26:30.859 INFO:teuthology.orchestra.run.trial014.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-24T18:26:30.860 INFO:teuthology.orchestra.run.trial014.stdout: Installing : librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 23/36 2026-02-24T18:26:30.875 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 23/36 2026-02-24T18:26:30.879 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 24/36 2026-02-24T18:26:30.884 INFO:teuthology.orchestra.run.trial014.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-24T18:26:30.886 INFO:teuthology.orchestra.run.trial014.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-24T18:26:30.887 INFO:teuthology.orchestra.run.trial014.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-24T18:26:30.904 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-24T18:26:30.907 INFO:teuthology.orchestra.run.trial014.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-24T18:26:30.938 INFO:teuthology.orchestra.run.trial014.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-24T18:26:30.940 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86 30/36 2026-02-24T18:26:31.026 INFO:teuthology.orchestra.run.trial195.stdout:(34/34): ceph-radosgw-20.2.0-681.g36d388f2.el9. 1.1 MB/s | 24 MB 00:22 2026-02-24T18:26:31.027 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:26:31.027 INFO:teuthology.orchestra.run.trial195.stdout:Total 3.4 MB/s | 78 MB 00:23 2026-02-24T18:26:31.111 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T18:26:31.129 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T18:26:31.129 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T18:26:31.142 INFO:teuthology.orchestra.run.trial170.stdout: Installing : ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 34/36 2026-02-24T18:26:31.165 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 34/36 2026-02-24T18:26:31.165 INFO:teuthology.orchestra.run.trial170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:26:31.165 INFO:teuthology.orchestra.run.trial170.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-24T18:26:31.165 INFO:teuthology.orchestra.run.trial170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T18:26:31.165 INFO:teuthology.orchestra.run.trial170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T18:26:31.165 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:26:31.167 INFO:teuthology.orchestra.run.trial170.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-24T18:26:31.178 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-24T18:26:31.178 INFO:teuthology.orchestra.run.trial170.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:26:31.233 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:26:31.234 INFO:teuthology.orchestra.run.trial170.stdout:Creating group 'qat' with GID 992. 2026-02-24T18:26:31.234 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:26:31.371 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-24T18:26:31.373 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-24T18:26:31.421 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T18:26:31.421 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T18:26:31.555 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 1/36 2026-02-24T18:26:31.555 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2/36 2026-02-24T18:26:31.556 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-24T18:26:31.556 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 4/36 2026-02-24T18:26:31.556 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-24T18:26:31.556 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 6/36 2026-02-24T18:26:31.556 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 7/36 2026-02-24T18:26:31.556 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x 8/36 2026-02-24T18:26:31.556 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86 9/36 2026-02-24T18:26:31.556 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 10/36 2026-02-24T18:26:31.556 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 11/36 2026-02-24T18:26:31.556 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-24T18:26:31.556 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 13/36 2026-02-24T18:26:31.556 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-24T18:26:31.557 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-24T18:26:31.557 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-24T18:26:31.557 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-24T18:26:31.557 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-24T18:26:31.557 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-24T18:26:31.557 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-24T18:26:31.557 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-24T18:26:31.557 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-24T18:26:31.557 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-24T18:26:31.557 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-24T18:26:31.557 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-24T18:26:31.557 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-24T18:26:31.557 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-24T18:26:31.558 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-24T18:26:31.558 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-24T18:26:31.558 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-24T18:26:31.558 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-24T18:26:31.558 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-24T18:26:31.558 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : librados2-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-24T18:26:31.558 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-24T18:26:31.558 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 35/36 2026-02-24T18:26:31.626 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:26:31.627 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:26:31.627 INFO:teuthology.orchestra.run.trial170.stdout:Upgraded: 2026-02-24T18:26:31.627 INFO:teuthology.orchestra.run.trial170.stdout: librados2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:31.627 INFO:teuthology.orchestra.run.trial170.stdout: librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:31.627 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T18:26:31.627 INFO:teuthology.orchestra.run.trial170.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-24T18:26:31.627 INFO:teuthology.orchestra.run.trial170.stdout: ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:31.627 INFO:teuthology.orchestra.run.trial170.stdout: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:31.627 INFO:teuthology.orchestra.run.trial170.stdout: ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:31.627 INFO:teuthology.orchestra.run.trial170.stdout: ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:31.627 INFO:teuthology.orchestra.run.trial170.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-24T18:26:31.627 INFO:teuthology.orchestra.run.trial170.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-24T18:26:31.627 INFO:teuthology.orchestra.run.trial170.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-24T18:26:31.628 INFO:teuthology.orchestra.run.trial170.stdout: libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:31.628 INFO:teuthology.orchestra.run.trial170.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-24T18:26:31.628 INFO:teuthology.orchestra.run.trial170.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-24T18:26:31.628 INFO:teuthology.orchestra.run.trial170.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-24T18:26:31.628 INFO:teuthology.orchestra.run.trial170.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-24T18:26:31.628 INFO:teuthology.orchestra.run.trial170.stdout: libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:31.628 INFO:teuthology.orchestra.run.trial170.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-24T18:26:31.628 INFO:teuthology.orchestra.run.trial170.stdout: librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:31.628 INFO:teuthology.orchestra.run.trial170.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-24T18:26:31.628 INFO:teuthology.orchestra.run.trial170.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-24T18:26:31.628 INFO:teuthology.orchestra.run.trial170.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-24T18:26:31.628 INFO:teuthology.orchestra.run.trial170.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-24T18:26:31.628 INFO:teuthology.orchestra.run.trial170.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-24T18:26:31.628 INFO:teuthology.orchestra.run.trial170.stdout: python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:31.628 INFO:teuthology.orchestra.run.trial170.stdout: python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:31.628 INFO:teuthology.orchestra.run.trial170.stdout: python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:31.628 INFO:teuthology.orchestra.run.trial170.stdout: python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:31.628 INFO:teuthology.orchestra.run.trial170.stdout: python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:31.628 INFO:teuthology.orchestra.run.trial170.stdout: python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:31.629 INFO:teuthology.orchestra.run.trial170.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-24T18:26:31.629 INFO:teuthology.orchestra.run.trial170.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-24T18:26:31.629 INFO:teuthology.orchestra.run.trial170.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-24T18:26:31.629 INFO:teuthology.orchestra.run.trial170.stdout: re2-1:20211101-20.el9.x86_64 2026-02-24T18:26:31.629 INFO:teuthology.orchestra.run.trial170.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-24T18:26:31.629 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:26:31.629 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T18:26:31.670 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-24T18:26:31.671 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install ceph-test 2026-02-24T18:26:31.673 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 32/36 2026-02-24T18:26:31.710 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 32/36 2026-02-24T18:26:31.710 INFO:teuthology.orchestra.run.trial044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-24T18:26:31.710 INFO:teuthology.orchestra.run.trial044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-24T18:26:31.711 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:26:31.714 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-24T18:26:31.755 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T18:26:31.766 INFO:teuthology.orchestra.run.trial195.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/36 2026-02-24T18:26:31.930 INFO:teuthology.orchestra.run.trial195.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/36 2026-02-24T18:26:31.933 INFO:teuthology.orchestra.run.trial195.stdout: Upgrading : librados2-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-24T18:26:31.963 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: librados2-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-24T18:26:31.984 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:00:27 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T18:26:32.002 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 4/36 2026-02-24T18:26:32.003 INFO:teuthology.orchestra.run.trial195.stdout: Installing : libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-24T18:26:32.015 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-24T18:26:32.018 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-24T18:26:32.021 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-24T18:26:32.023 INFO:teuthology.orchestra.run.trial195.stdout: Installing : liboath-2.6.12-1.el9.x86_64 6/36 2026-02-24T18:26:32.025 INFO:teuthology.orchestra.run.trial195.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/36 2026-02-24T18:26:32.028 INFO:teuthology.orchestra.run.trial195.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 8/36 2026-02-24T18:26:32.033 INFO:teuthology.orchestra.run.trial195.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 9/36 2026-02-24T18:26:32.042 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x 10/36 2026-02-24T18:26:32.054 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 11/36 2026-02-24T18:26:32.055 INFO:teuthology.orchestra.run.trial195.stdout: Installing : libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-24T18:26:32.067 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T18:26:32.068 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:26:32.068 INFO:teuthology.orchestra.run.trial170.stdout: Package Arch Version Repository Size 2026-02-24T18:26:32.068 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:26:32.068 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T18:26:32.068 INFO:teuthology.orchestra.run.trial170.stdout: ceph-test x86_64 2:20.2.0-681.g36d388f2.el9 ceph 84 M 2026-02-24T18:26:32.068 INFO:teuthology.orchestra.run.trial170.stdout:Installing dependencies: 2026-02-24T18:26:32.069 INFO:teuthology.orchestra.run.trial170.stdout: libcephsqlite x86_64 2:20.2.0-681.g36d388f2.el9 ceph 164 k 2026-02-24T18:26:32.069 INFO:teuthology.orchestra.run.trial170.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-24T18:26:32.069 INFO:teuthology.orchestra.run.trial170.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-24T18:26:32.069 INFO:teuthology.orchestra.run.trial170.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-24T18:26:32.069 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:26:32.069 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T18:26:32.070 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:26:32.070 INFO:teuthology.orchestra.run.trial170.stdout:Install 5 Packages 2026-02-24T18:26:32.070 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:26:32.070 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 85 M 2026-02-24T18:26:32.070 INFO:teuthology.orchestra.run.trial170.stdout:Installed size: 365 M 2026-02-24T18:26:32.070 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T18:26:32.071 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-24T18:26:32.102 INFO:teuthology.orchestra.run.trial195.stdout: Installing : re2-1:20211101-20.el9.x86_64 13/36 2026-02-24T18:26:32.106 INFO:teuthology.orchestra.run.trial195.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 14/36 2026-02-24T18:26:32.112 INFO:teuthology.orchestra.run.trial195.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 15/36 2026-02-24T18:26:32.114 INFO:teuthology.orchestra.run.trial195.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 16/36 2026-02-24T18:26:32.119 INFO:teuthology.orchestra.run.trial195.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 17/36 2026-02-24T18:26:32.251 INFO:teuthology.orchestra.run.trial195.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-24T18:26:32.252 INFO:teuthology.orchestra.run.trial195.stdout: Upgrading : librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 19/36 2026-02-24T18:26:32.279 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 19/36 2026-02-24T18:26:32.281 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 20/36 2026-02-24T18:26:32.288 INFO:teuthology.orchestra.run.trial195.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-24T18:26:32.319 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-24T18:26:32.322 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 32/36 2026-02-24T18:26:32.361 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 32/36 2026-02-24T18:26:32.361 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-24T18:26:32.361 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-24T18:26:32.361 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:26:32.364 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-24T18:26:32.580 INFO:teuthology.orchestra.run.trial195.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-24T18:26:32.581 INFO:teuthology.orchestra.run.trial195.stdout: Installing : librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 23/36 2026-02-24T18:26:32.597 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 23/36 2026-02-24T18:26:32.603 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 24/36 2026-02-24T18:26:32.608 INFO:teuthology.orchestra.run.trial195.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-24T18:26:32.610 INFO:teuthology.orchestra.run.trial195.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-24T18:26:32.611 INFO:teuthology.orchestra.run.trial195.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-24T18:26:32.628 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-24T18:26:32.631 INFO:teuthology.orchestra.run.trial195.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-24T18:26:32.664 INFO:teuthology.orchestra.run.trial195.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-24T18:26:32.665 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86 30/36 2026-02-24T18:26:32.864 INFO:teuthology.orchestra.run.trial170.stdout:(1/5): libcephsqlite-20.2.0-681.g36d388f2.el9.x 339 kB/s | 164 kB 00:00 2026-02-24T18:26:33.133 INFO:teuthology.orchestra.run.trial170.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 309 kB/s | 233 kB 00:00 2026-02-24T18:26:33.232 INFO:teuthology.orchestra.run.trial170.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 641 kB/s | 64 kB 00:00 2026-02-24T18:26:33.676 INFO:teuthology.orchestra.run.trial170.stdout:(4/5): socat-1.7.4.1-8.el9.x86_64.rpm 373 kB/s | 303 kB 00:00 2026-02-24T18:26:33.797 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-24T18:26:33.799 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-24T18:26:34.106 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-24T18:26:34.109 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 32/36 2026-02-24T18:26:34.149 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 32/36 2026-02-24T18:26:34.149 INFO:teuthology.orchestra.run.trial195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-24T18:26:34.150 INFO:teuthology.orchestra.run.trial195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-24T18:26:34.150 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:26:34.153 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-24T18:26:36.200 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-24T18:26:36.200 INFO:teuthology.orchestra.run.trial044.stdout:skipping the directory /sys 2026-02-24T18:26:36.200 INFO:teuthology.orchestra.run.trial044.stdout:skipping the directory /proc 2026-02-24T18:26:36.200 INFO:teuthology.orchestra.run.trial044.stdout:skipping the directory /mnt 2026-02-24T18:26:36.200 INFO:teuthology.orchestra.run.trial044.stdout:skipping the directory /var/tmp 2026-02-24T18:26:36.200 INFO:teuthology.orchestra.run.trial044.stdout:skipping the directory /home 2026-02-24T18:26:36.200 INFO:teuthology.orchestra.run.trial044.stdout:skipping the directory /root 2026-02-24T18:26:36.200 INFO:teuthology.orchestra.run.trial044.stdout:skipping the directory /tmp 2026-02-24T18:26:36.200 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:26:36.825 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-24T18:26:36.825 INFO:teuthology.orchestra.run.trial014.stdout:skipping the directory /sys 2026-02-24T18:26:36.825 INFO:teuthology.orchestra.run.trial014.stdout:skipping the directory /proc 2026-02-24T18:26:36.825 INFO:teuthology.orchestra.run.trial014.stdout:skipping the directory /mnt 2026-02-24T18:26:36.825 INFO:teuthology.orchestra.run.trial014.stdout:skipping the directory /var/tmp 2026-02-24T18:26:36.825 INFO:teuthology.orchestra.run.trial014.stdout:skipping the directory /home 2026-02-24T18:26:36.825 INFO:teuthology.orchestra.run.trial014.stdout:skipping the directory /root 2026-02-24T18:26:36.825 INFO:teuthology.orchestra.run.trial014.stdout:skipping the directory /tmp 2026-02-24T18:26:36.825 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:26:37.224 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 34/36 2026-02-24T18:26:37.248 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 34/36 2026-02-24T18:26:37.248 INFO:teuthology.orchestra.run.trial044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:26:37.248 INFO:teuthology.orchestra.run.trial044.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-24T18:26:37.248 INFO:teuthology.orchestra.run.trial044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T18:26:37.248 INFO:teuthology.orchestra.run.trial044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T18:26:37.248 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:26:37.250 INFO:teuthology.orchestra.run.trial044.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-24T18:26:37.262 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-24T18:26:37.262 INFO:teuthology.orchestra.run.trial044.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:26:37.317 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:26:37.317 INFO:teuthology.orchestra.run.trial044.stdout:Creating group 'qat' with GID 992. 2026-02-24T18:26:37.317 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:26:37.639 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 1/36 2026-02-24T18:26:37.640 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2/36 2026-02-24T18:26:37.640 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-24T18:26:37.640 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 4/36 2026-02-24T18:26:37.640 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-24T18:26:37.640 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 6/36 2026-02-24T18:26:37.640 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 7/36 2026-02-24T18:26:37.640 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x 8/36 2026-02-24T18:26:37.640 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86 9/36 2026-02-24T18:26:37.640 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 10/36 2026-02-24T18:26:37.640 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 11/36 2026-02-24T18:26:37.640 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-24T18:26:37.640 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 13/36 2026-02-24T18:26:37.640 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-24T18:26:37.640 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-24T18:26:37.640 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-24T18:26:37.640 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-24T18:26:37.640 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-24T18:26:37.640 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-24T18:26:37.640 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-24T18:26:37.640 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-24T18:26:37.640 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-24T18:26:37.641 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-24T18:26:37.641 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-24T18:26:37.641 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-24T18:26:37.641 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-24T18:26:37.641 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-24T18:26:37.641 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-24T18:26:37.641 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-24T18:26:37.641 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-24T18:26:37.641 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-24T18:26:37.641 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-24T18:26:37.641 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : librados2-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-24T18:26:37.641 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-24T18:26:37.641 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 35/36 2026-02-24T18:26:37.706 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:26:37.706 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:26:37.706 INFO:teuthology.orchestra.run.trial044.stdout:Upgraded: 2026-02-24T18:26:37.706 INFO:teuthology.orchestra.run.trial044.stdout: librados2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:37.706 INFO:teuthology.orchestra.run.trial044.stdout: librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:37.706 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T18:26:37.706 INFO:teuthology.orchestra.run.trial044.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-24T18:26:37.707 INFO:teuthology.orchestra.run.trial044.stdout: ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:37.707 INFO:teuthology.orchestra.run.trial044.stdout: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:37.707 INFO:teuthology.orchestra.run.trial044.stdout: ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:37.707 INFO:teuthology.orchestra.run.trial044.stdout: ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:37.707 INFO:teuthology.orchestra.run.trial044.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-24T18:26:37.707 INFO:teuthology.orchestra.run.trial044.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-24T18:26:37.707 INFO:teuthology.orchestra.run.trial044.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-24T18:26:37.707 INFO:teuthology.orchestra.run.trial044.stdout: libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:37.707 INFO:teuthology.orchestra.run.trial044.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-24T18:26:37.707 INFO:teuthology.orchestra.run.trial044.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-24T18:26:37.707 INFO:teuthology.orchestra.run.trial044.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-24T18:26:37.708 INFO:teuthology.orchestra.run.trial044.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-24T18:26:37.708 INFO:teuthology.orchestra.run.trial044.stdout: libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:37.708 INFO:teuthology.orchestra.run.trial044.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-24T18:26:37.708 INFO:teuthology.orchestra.run.trial044.stdout: librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:37.708 INFO:teuthology.orchestra.run.trial044.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-24T18:26:37.708 INFO:teuthology.orchestra.run.trial044.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-24T18:26:37.708 INFO:teuthology.orchestra.run.trial044.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-24T18:26:37.708 INFO:teuthology.orchestra.run.trial044.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-24T18:26:37.708 INFO:teuthology.orchestra.run.trial044.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-24T18:26:37.708 INFO:teuthology.orchestra.run.trial044.stdout: python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:37.708 INFO:teuthology.orchestra.run.trial044.stdout: python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:37.708 INFO:teuthology.orchestra.run.trial044.stdout: python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:37.708 INFO:teuthology.orchestra.run.trial044.stdout: python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:37.709 INFO:teuthology.orchestra.run.trial044.stdout: python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:37.709 INFO:teuthology.orchestra.run.trial044.stdout: python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:37.709 INFO:teuthology.orchestra.run.trial044.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-24T18:26:37.709 INFO:teuthology.orchestra.run.trial044.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-24T18:26:37.709 INFO:teuthology.orchestra.run.trial044.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-24T18:26:37.709 INFO:teuthology.orchestra.run.trial044.stdout: re2-1:20211101-20.el9.x86_64 2026-02-24T18:26:37.709 INFO:teuthology.orchestra.run.trial044.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-24T18:26:37.709 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:26:37.709 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T18:26:37.748 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install ceph-test 2026-02-24T18:26:37.856 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 34/36 2026-02-24T18:26:37.880 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 34/36 2026-02-24T18:26:37.880 INFO:teuthology.orchestra.run.trial014.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:26:37.880 INFO:teuthology.orchestra.run.trial014.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-24T18:26:37.880 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T18:26:37.880 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T18:26:37.880 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:26:37.882 INFO:teuthology.orchestra.run.trial014.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-24T18:26:37.895 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-24T18:26:37.895 INFO:teuthology.orchestra.run.trial014.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:26:37.952 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:26:37.952 INFO:teuthology.orchestra.run.trial014.stdout:Creating group 'qat' with GID 992. 2026-02-24T18:26:37.953 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:26:38.067 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:00:31 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:26:38.149 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T18:26:38.150 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:26:38.150 INFO:teuthology.orchestra.run.trial044.stdout: Package Arch Version Repository Size 2026-02-24T18:26:38.151 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:26:38.151 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T18:26:38.151 INFO:teuthology.orchestra.run.trial044.stdout: ceph-test x86_64 2:20.2.0-681.g36d388f2.el9 ceph 84 M 2026-02-24T18:26:38.151 INFO:teuthology.orchestra.run.trial044.stdout:Installing dependencies: 2026-02-24T18:26:38.151 INFO:teuthology.orchestra.run.trial044.stdout: libcephsqlite x86_64 2:20.2.0-681.g36d388f2.el9 ceph 164 k 2026-02-24T18:26:38.151 INFO:teuthology.orchestra.run.trial044.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-24T18:26:38.151 INFO:teuthology.orchestra.run.trial044.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-24T18:26:38.151 INFO:teuthology.orchestra.run.trial044.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-24T18:26:38.151 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:26:38.151 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T18:26:38.152 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:26:38.152 INFO:teuthology.orchestra.run.trial044.stdout:Install 5 Packages 2026-02-24T18:26:38.152 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:26:38.152 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 85 M 2026-02-24T18:26:38.152 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 365 M 2026-02-24T18:26:38.152 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T18:26:38.265 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 1/36 2026-02-24T18:26:38.265 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2/36 2026-02-24T18:26:38.265 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-24T18:26:38.265 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 4/36 2026-02-24T18:26:38.265 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-24T18:26:38.266 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 6/36 2026-02-24T18:26:38.266 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 7/36 2026-02-24T18:26:38.266 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x 8/36 2026-02-24T18:26:38.266 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86 9/36 2026-02-24T18:26:38.266 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 10/36 2026-02-24T18:26:38.266 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 11/36 2026-02-24T18:26:38.266 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-24T18:26:38.266 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 13/36 2026-02-24T18:26:38.266 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-24T18:26:38.266 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-24T18:26:38.266 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-24T18:26:38.266 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-24T18:26:38.267 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-24T18:26:38.267 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-24T18:26:38.267 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-24T18:26:38.267 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-24T18:26:38.267 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-24T18:26:38.267 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-24T18:26:38.267 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-24T18:26:38.267 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-24T18:26:38.267 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-24T18:26:38.267 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-24T18:26:38.267 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-24T18:26:38.267 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-24T18:26:38.268 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-24T18:26:38.268 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-24T18:26:38.268 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-24T18:26:38.268 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : librados2-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-24T18:26:38.268 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-24T18:26:38.268 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 35/36 2026-02-24T18:26:38.330 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:26:38.330 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:26:38.330 INFO:teuthology.orchestra.run.trial014.stdout:Upgraded: 2026-02-24T18:26:38.331 INFO:teuthology.orchestra.run.trial014.stdout: librados2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:38.331 INFO:teuthology.orchestra.run.trial014.stdout: librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:38.331 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T18:26:38.331 INFO:teuthology.orchestra.run.trial014.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-24T18:26:38.331 INFO:teuthology.orchestra.run.trial014.stdout: ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:38.331 INFO:teuthology.orchestra.run.trial014.stdout: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:38.331 INFO:teuthology.orchestra.run.trial014.stdout: ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:38.331 INFO:teuthology.orchestra.run.trial014.stdout: ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:38.331 INFO:teuthology.orchestra.run.trial014.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-24T18:26:38.331 INFO:teuthology.orchestra.run.trial014.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-24T18:26:38.331 INFO:teuthology.orchestra.run.trial014.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-24T18:26:38.331 INFO:teuthology.orchestra.run.trial014.stdout: libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:38.331 INFO:teuthology.orchestra.run.trial014.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-24T18:26:38.331 INFO:teuthology.orchestra.run.trial014.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-24T18:26:38.331 INFO:teuthology.orchestra.run.trial014.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-24T18:26:38.331 INFO:teuthology.orchestra.run.trial014.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-24T18:26:38.331 INFO:teuthology.orchestra.run.trial014.stdout: libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:38.331 INFO:teuthology.orchestra.run.trial014.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-24T18:26:38.331 INFO:teuthology.orchestra.run.trial014.stdout: librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:38.331 INFO:teuthology.orchestra.run.trial014.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-24T18:26:38.331 INFO:teuthology.orchestra.run.trial014.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-24T18:26:38.331 INFO:teuthology.orchestra.run.trial014.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-24T18:26:38.331 INFO:teuthology.orchestra.run.trial014.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-24T18:26:38.332 INFO:teuthology.orchestra.run.trial014.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-24T18:26:38.332 INFO:teuthology.orchestra.run.trial014.stdout: python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:38.332 INFO:teuthology.orchestra.run.trial014.stdout: python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:38.332 INFO:teuthology.orchestra.run.trial014.stdout: python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:38.332 INFO:teuthology.orchestra.run.trial014.stdout: python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:38.332 INFO:teuthology.orchestra.run.trial014.stdout: python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:38.332 INFO:teuthology.orchestra.run.trial014.stdout: python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:38.332 INFO:teuthology.orchestra.run.trial014.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-24T18:26:38.332 INFO:teuthology.orchestra.run.trial014.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-24T18:26:38.332 INFO:teuthology.orchestra.run.trial014.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-24T18:26:38.332 INFO:teuthology.orchestra.run.trial014.stdout: re2-1:20211101-20.el9.x86_64 2026-02-24T18:26:38.332 INFO:teuthology.orchestra.run.trial014.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-24T18:26:38.332 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:26:38.332 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T18:26:38.374 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install ceph-test 2026-02-24T18:26:38.543 INFO:teuthology.orchestra.run.trial044.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 2.7 MB/s | 233 kB 00:00 2026-02-24T18:26:38.590 INFO:teuthology.orchestra.run.trial044.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 6.3 MB/s | 303 kB 00:00 2026-02-24T18:26:38.605 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-24T18:26:38.605 INFO:teuthology.orchestra.run.trial195.stdout:skipping the directory /sys 2026-02-24T18:26:38.605 INFO:teuthology.orchestra.run.trial195.stdout:skipping the directory /proc 2026-02-24T18:26:38.605 INFO:teuthology.orchestra.run.trial195.stdout:skipping the directory /mnt 2026-02-24T18:26:38.605 INFO:teuthology.orchestra.run.trial195.stdout:skipping the directory /var/tmp 2026-02-24T18:26:38.605 INFO:teuthology.orchestra.run.trial195.stdout:skipping the directory /home 2026-02-24T18:26:38.605 INFO:teuthology.orchestra.run.trial195.stdout:skipping the directory /root 2026-02-24T18:26:38.606 INFO:teuthology.orchestra.run.trial195.stdout:skipping the directory /tmp 2026-02-24T18:26:38.606 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:26:38.612 INFO:teuthology.orchestra.run.trial044.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.8 MB/s | 64 kB 00:00 2026-02-24T18:26:38.683 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:00:31 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:26:38.766 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T18:26:38.767 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:26:38.767 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repository Size 2026-02-24T18:26:38.767 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:26:38.767 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T18:26:38.767 INFO:teuthology.orchestra.run.trial014.stdout: ceph-test x86_64 2:20.2.0-681.g36d388f2.el9 ceph 84 M 2026-02-24T18:26:38.767 INFO:teuthology.orchestra.run.trial014.stdout:Installing dependencies: 2026-02-24T18:26:38.767 INFO:teuthology.orchestra.run.trial014.stdout: libcephsqlite x86_64 2:20.2.0-681.g36d388f2.el9 ceph 164 k 2026-02-24T18:26:38.767 INFO:teuthology.orchestra.run.trial014.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-24T18:26:38.768 INFO:teuthology.orchestra.run.trial014.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-24T18:26:38.768 INFO:teuthology.orchestra.run.trial014.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-24T18:26:38.768 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:26:38.768 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T18:26:38.768 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:26:38.768 INFO:teuthology.orchestra.run.trial014.stdout:Install 5 Packages 2026-02-24T18:26:38.768 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:26:38.768 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 85 M 2026-02-24T18:26:38.768 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 365 M 2026-02-24T18:26:38.768 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T18:26:38.948 INFO:teuthology.orchestra.run.trial044.stdout:(4/5): libcephsqlite-20.2.0-681.g36d388f2.el9.x 334 kB/s | 164 kB 00:00 2026-02-24T18:26:39.106 INFO:teuthology.orchestra.run.trial014.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 2.7 MB/s | 233 kB 00:00 2026-02-24T18:26:39.153 INFO:teuthology.orchestra.run.trial014.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 6.3 MB/s | 303 kB 00:00 2026-02-24T18:26:39.175 INFO:teuthology.orchestra.run.trial014.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.8 MB/s | 64 kB 00:00 2026-02-24T18:26:39.498 INFO:teuthology.orchestra.run.trial014.stdout:(4/5): libcephsqlite-20.2.0-681.g36d388f2.el9.x 343 kB/s | 164 kB 00:00 2026-02-24T18:26:39.678 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 34/36 2026-02-24T18:26:39.702 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 34/36 2026-02-24T18:26:39.702 INFO:teuthology.orchestra.run.trial195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:26:39.702 INFO:teuthology.orchestra.run.trial195.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-24T18:26:39.702 INFO:teuthology.orchestra.run.trial195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T18:26:39.702 INFO:teuthology.orchestra.run.trial195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T18:26:39.703 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:26:39.703 INFO:teuthology.orchestra.run.trial195.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-24T18:26:39.715 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-24T18:26:39.715 INFO:teuthology.orchestra.run.trial195.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:26:39.771 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:26:39.771 INFO:teuthology.orchestra.run.trial195.stdout:Creating group 'qat' with GID 992. 2026-02-24T18:26:39.771 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:26:40.096 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 1/36 2026-02-24T18:26:40.096 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2/36 2026-02-24T18:26:40.096 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-24T18:26:40.096 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 4/36 2026-02-24T18:26:40.097 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-24T18:26:40.097 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 6/36 2026-02-24T18:26:40.097 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 7/36 2026-02-24T18:26:40.097 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x 8/36 2026-02-24T18:26:40.097 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86 9/36 2026-02-24T18:26:40.097 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 10/36 2026-02-24T18:26:40.097 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 11/36 2026-02-24T18:26:40.097 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-24T18:26:40.097 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 13/36 2026-02-24T18:26:40.097 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-24T18:26:40.097 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-24T18:26:40.097 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-24T18:26:40.097 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-24T18:26:40.097 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-24T18:26:40.098 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-24T18:26:40.098 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-24T18:26:40.098 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-24T18:26:40.098 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-24T18:26:40.098 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-24T18:26:40.098 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-24T18:26:40.098 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-24T18:26:40.098 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-24T18:26:40.098 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-24T18:26:40.098 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-24T18:26:40.098 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-24T18:26:40.098 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-24T18:26:40.098 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-24T18:26:40.098 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-24T18:26:40.099 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : librados2-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-24T18:26:40.099 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-24T18:26:40.099 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 35/36 2026-02-24T18:26:40.161 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:26:40.161 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:26:40.161 INFO:teuthology.orchestra.run.trial195.stdout:Upgraded: 2026-02-24T18:26:40.161 INFO:teuthology.orchestra.run.trial195.stdout: librados2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:40.162 INFO:teuthology.orchestra.run.trial195.stdout: librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:40.162 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T18:26:40.162 INFO:teuthology.orchestra.run.trial195.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-24T18:26:40.162 INFO:teuthology.orchestra.run.trial195.stdout: ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:40.162 INFO:teuthology.orchestra.run.trial195.stdout: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:40.162 INFO:teuthology.orchestra.run.trial195.stdout: ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:40.162 INFO:teuthology.orchestra.run.trial195.stdout: ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:40.162 INFO:teuthology.orchestra.run.trial195.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-24T18:26:40.162 INFO:teuthology.orchestra.run.trial195.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-24T18:26:40.162 INFO:teuthology.orchestra.run.trial195.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-24T18:26:40.162 INFO:teuthology.orchestra.run.trial195.stdout: libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:40.162 INFO:teuthology.orchestra.run.trial195.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-24T18:26:40.162 INFO:teuthology.orchestra.run.trial195.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-24T18:26:40.162 INFO:teuthology.orchestra.run.trial195.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-24T18:26:40.162 INFO:teuthology.orchestra.run.trial195.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-24T18:26:40.162 INFO:teuthology.orchestra.run.trial195.stdout: libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:40.162 INFO:teuthology.orchestra.run.trial195.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-24T18:26:40.162 INFO:teuthology.orchestra.run.trial195.stdout: librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:40.162 INFO:teuthology.orchestra.run.trial195.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-24T18:26:40.162 INFO:teuthology.orchestra.run.trial195.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-24T18:26:40.162 INFO:teuthology.orchestra.run.trial195.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-24T18:26:40.162 INFO:teuthology.orchestra.run.trial195.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-24T18:26:40.162 INFO:teuthology.orchestra.run.trial195.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-24T18:26:40.162 INFO:teuthology.orchestra.run.trial195.stdout: python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:40.162 INFO:teuthology.orchestra.run.trial195.stdout: python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:40.162 INFO:teuthology.orchestra.run.trial195.stdout: python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:40.162 INFO:teuthology.orchestra.run.trial195.stdout: python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:40.162 INFO:teuthology.orchestra.run.trial195.stdout: python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:40.162 INFO:teuthology.orchestra.run.trial195.stdout: python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:40.162 INFO:teuthology.orchestra.run.trial195.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-24T18:26:40.162 INFO:teuthology.orchestra.run.trial195.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-24T18:26:40.162 INFO:teuthology.orchestra.run.trial195.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-24T18:26:40.162 INFO:teuthology.orchestra.run.trial195.stdout: re2-1:20211101-20.el9.x86_64 2026-02-24T18:26:40.162 INFO:teuthology.orchestra.run.trial195.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-24T18:26:40.162 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:26:40.162 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T18:26:40.204 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph-test 2026-02-24T18:26:40.520 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:00:34 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T18:26:40.604 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T18:26:40.605 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:26:40.606 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repository Size 2026-02-24T18:26:40.606 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:26:40.606 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T18:26:40.606 INFO:teuthology.orchestra.run.trial195.stdout: ceph-test x86_64 2:20.2.0-681.g36d388f2.el9 ceph 84 M 2026-02-24T18:26:40.606 INFO:teuthology.orchestra.run.trial195.stdout:Installing dependencies: 2026-02-24T18:26:40.606 INFO:teuthology.orchestra.run.trial195.stdout: libcephsqlite x86_64 2:20.2.0-681.g36d388f2.el9 ceph 164 k 2026-02-24T18:26:40.606 INFO:teuthology.orchestra.run.trial195.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-24T18:26:40.606 INFO:teuthology.orchestra.run.trial195.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-24T18:26:40.606 INFO:teuthology.orchestra.run.trial195.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-24T18:26:40.606 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:26:40.607 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T18:26:40.607 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:26:40.607 INFO:teuthology.orchestra.run.trial195.stdout:Install 5 Packages 2026-02-24T18:26:40.607 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:26:40.607 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 85 M 2026-02-24T18:26:40.607 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 365 M 2026-02-24T18:26:40.607 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T18:26:41.379 INFO:teuthology.orchestra.run.trial195.stdout:(1/5): libcephsqlite-20.2.0-681.g36d388f2.el9.x 353 kB/s | 164 kB 00:00 2026-02-24T18:26:41.671 INFO:teuthology.orchestra.run.trial195.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 308 kB/s | 233 kB 00:00 2026-02-24T18:26:41.771 INFO:teuthology.orchestra.run.trial195.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 640 kB/s | 64 kB 00:00 2026-02-24T18:26:42.200 INFO:teuthology.orchestra.run.trial195.stdout:(4/5): socat-1.7.4.1-8.el9.x86_64.rpm 369 kB/s | 303 kB 00:00 2026-02-24T18:27:03.822 INFO:teuthology.orchestra.run.trial014.stdout:(5/5): ceph-test-20.2.0-681.g36d388f2.el9.x86_6 3.4 MB/s | 84 MB 00:24 2026-02-24T18:27:03.823 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:03.823 INFO:teuthology.orchestra.run.trial014.stdout:Total 3.4 MB/s | 85 MB 00:25 2026-02-24T18:27:03.848 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T18:27:03.859 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T18:27:03.860 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T18:27:04.148 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T18:27:04.149 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T18:27:04.463 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T18:27:04.468 INFO:teuthology.orchestra.run.trial014.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-24T18:27:04.472 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-24T18:27:04.480 INFO:teuthology.orchestra.run.trial014.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-24T18:27:04.481 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 4/5 2026-02-24T18:27:08.197 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 4/5 2026-02-24T18:27:08.216 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 5/5 2026-02-24T18:27:08.557 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 5/5 2026-02-24T18:27:08.558 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 1/5 2026-02-24T18:27:08.558 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 2/5 2026-02-24T18:27:08.558 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-24T18:27:08.558 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-24T18:27:08.615 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-24T18:27:08.615 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:08.615 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T18:27:08.615 INFO:teuthology.orchestra.run.trial014.stdout: ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:08.615 INFO:teuthology.orchestra.run.trial014.stdout: libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:08.615 INFO:teuthology.orchestra.run.trial014.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-24T18:27:08.615 INFO:teuthology.orchestra.run.trial014.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-24T18:27:08.616 INFO:teuthology.orchestra.run.trial014.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-24T18:27:08.616 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:08.616 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T18:27:08.652 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install ceph 2026-02-24T18:27:08.964 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:01:01 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:27:09.048 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T18:27:09.049 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:09.049 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repository Size 2026-02-24T18:27:09.049 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:09.049 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T18:27:09.050 INFO:teuthology.orchestra.run.trial014.stdout: ceph x86_64 2:20.2.0-681.g36d388f2.el9 ceph 6.5 k 2026-02-24T18:27:09.050 INFO:teuthology.orchestra.run.trial014.stdout:Installing dependencies: 2026-02-24T18:27:09.050 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mds x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.3 M 2026-02-24T18:27:09.050 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr x86_64 2:20.2.0-681.g36d388f2.el9 ceph 961 k 2026-02-24T18:27:09.050 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-modules-core noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 290 k 2026-02-24T18:27:09.050 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mon x86_64 2:20.2.0-681.g36d388f2.el9 ceph 5.1 M 2026-02-24T18:27:09.050 INFO:teuthology.orchestra.run.trial014.stdout: ceph-osd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 17 M 2026-02-24T18:27:09.050 INFO:teuthology.orchestra.run.trial014.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-24T18:27:09.050 INFO:teuthology.orchestra.run.trial014.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-24T18:27:09.050 INFO:teuthology.orchestra.run.trial014.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-24T18:27:09.050 INFO:teuthology.orchestra.run.trial014.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-24T18:27:09.050 INFO:teuthology.orchestra.run.trial014.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-24T18:27:09.051 INFO:teuthology.orchestra.run.trial014.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-24T18:27:09.051 INFO:teuthology.orchestra.run.trial014.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-24T18:27:09.051 INFO:teuthology.orchestra.run.trial014.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-24T18:27:09.051 INFO:teuthology.orchestra.run.trial014.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-24T18:27:09.051 INFO:teuthology.orchestra.run.trial014.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-24T18:27:09.051 INFO:teuthology.orchestra.run.trial014.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-24T18:27:09.051 INFO:teuthology.orchestra.run.trial014.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-24T18:27:09.051 INFO:teuthology.orchestra.run.trial014.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-24T18:27:09.051 INFO:teuthology.orchestra.run.trial014.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-24T18:27:09.051 INFO:teuthology.orchestra.run.trial014.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-24T18:27:09.051 INFO:teuthology.orchestra.run.trial014.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-24T18:27:09.051 INFO:teuthology.orchestra.run.trial014.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-24T18:27:09.052 INFO:teuthology.orchestra.run.trial014.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-24T18:27:09.052 INFO:teuthology.orchestra.run.trial014.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-24T18:27:09.052 INFO:teuthology.orchestra.run.trial014.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-24T18:27:09.052 INFO:teuthology.orchestra.run.trial014.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-24T18:27:09.052 INFO:teuthology.orchestra.run.trial014.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-24T18:27:09.052 INFO:teuthology.orchestra.run.trial014.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-24T18:27:09.052 INFO:teuthology.orchestra.run.trial014.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-24T18:27:09.052 INFO:teuthology.orchestra.run.trial014.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-24T18:27:09.052 INFO:teuthology.orchestra.run.trial014.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-24T18:27:09.052 INFO:teuthology.orchestra.run.trial014.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-24T18:27:09.052 INFO:teuthology.orchestra.run.trial014.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-24T18:27:09.052 INFO:teuthology.orchestra.run.trial014.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-24T18:27:09.053 INFO:teuthology.orchestra.run.trial014.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-24T18:27:09.053 INFO:teuthology.orchestra.run.trial014.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-24T18:27:09.053 INFO:teuthology.orchestra.run.trial014.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-24T18:27:09.053 INFO:teuthology.orchestra.run.trial014.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-24T18:27:09.053 INFO:teuthology.orchestra.run.trial014.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-24T18:27:09.053 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:09.053 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T18:27:09.053 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:09.053 INFO:teuthology.orchestra.run.trial014.stdout:Install 40 Packages 2026-02-24T18:27:09.053 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:09.054 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 30 M 2026-02-24T18:27:09.054 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 100 M 2026-02-24T18:27:09.054 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T18:27:09.573 INFO:teuthology.orchestra.run.trial014.stdout:(1/40): ceph-20.2.0-681.g36d388f2.el9.x86_64.rp 25 kB/s | 6.5 kB 00:00 2026-02-24T18:27:10.164 INFO:teuthology.orchestra.run.trial014.stdout:(2/40): ceph-mgr-20.2.0-681.g36d388f2.el9.x86_6 1.1 MB/s | 961 kB 00:00 2026-02-24T18:27:10.687 INFO:teuthology.orchestra.run.trial014.stdout:(3/40): ceph-mds-20.2.0-681.g36d388f2.el9.x86_6 1.7 MB/s | 2.3 MB 00:01 2026-02-24T18:27:10.804 INFO:teuthology.orchestra.run.trial014.stdout:(4/40): ceph-mgr-modules-core-20.2.0-681.g36d38 2.4 MB/s | 290 kB 00:00 2026-02-24T18:27:11.007 INFO:teuthology.orchestra.run.trial044.stdout:(5/5): ceph-test-20.2.0-681.g36d388f2.el9.x86_6 2.6 MB/s | 84 MB 00:32 2026-02-24T18:27:11.008 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:11.008 INFO:teuthology.orchestra.run.trial044.stdout:Total 2.6 MB/s | 85 MB 00:32 2026-02-24T18:27:11.030 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T18:27:11.040 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T18:27:11.040 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T18:27:11.326 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T18:27:11.327 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T18:27:11.338 INFO:teuthology.orchestra.run.trial014.stdout:(5/40): ledmon-libs-1.1.0-3.el9.x86_64.rpm 76 kB/s | 40 kB 00:00 2026-02-24T18:27:11.499 INFO:teuthology.orchestra.run.trial014.stdout:(6/40): libconfig-1.7.2-9.el9.x86_64.rpm 448 kB/s | 72 kB 00:00 2026-02-24T18:27:11.640 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T18:27:11.646 INFO:teuthology.orchestra.run.trial044.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-24T18:27:11.650 INFO:teuthology.orchestra.run.trial044.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-24T18:27:11.658 INFO:teuthology.orchestra.run.trial044.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-24T18:27:11.659 INFO:teuthology.orchestra.run.trial044.stdout: Installing : libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 4/5 2026-02-24T18:27:11.773 INFO:teuthology.orchestra.run.trial014.stdout:(7/40): ceph-mon-20.2.0-681.g36d388f2.el9.x86_6 2.3 MB/s | 5.1 MB 00:02 2026-02-24T18:27:11.816 INFO:teuthology.orchestra.run.trial014.stdout:(8/40): python3-cffi-1.14.5-5.el9.x86_64.rpm 797 kB/s | 253 kB 00:00 2026-02-24T18:27:11.977 INFO:teuthology.orchestra.run.trial014.stdout:(9/40): python3-ply-3.11-14.el9.noarch.rpm 661 kB/s | 106 kB 00:00 2026-02-24T18:27:12.140 INFO:teuthology.orchestra.run.trial014.stdout:(10/40): python3-pycparser-2.20-6.el9.noarch.rp 835 kB/s | 135 kB 00:00 2026-02-24T18:27:12.378 INFO:teuthology.orchestra.run.trial014.stdout:(11/40): python3-pyparsing-2.4.7-9.el9.noarch.r 629 kB/s | 150 kB 00:00 2026-02-24T18:27:12.540 INFO:teuthology.orchestra.run.trial014.stdout:(12/40): python3-requests-2.25.1-10.el9.noarch. 784 kB/s | 126 kB 00:00 2026-02-24T18:27:12.857 INFO:teuthology.orchestra.run.trial014.stdout:(13/40): python3-urllib3-1.26.5-7.el9.noarch.rp 686 kB/s | 218 kB 00:00 2026-02-24T18:27:13.096 INFO:teuthology.orchestra.run.trial014.stdout:(14/40): unzip-6.0-59.el9.x86_64.rpm 762 kB/s | 182 kB 00:00 2026-02-24T18:27:13.114 INFO:teuthology.orchestra.run.trial195.stdout:(5/5): ceph-test-20.2.0-681.g36d388f2.el9.x86_6 2.6 MB/s | 84 MB 00:32 2026-02-24T18:27:13.116 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:13.116 INFO:teuthology.orchestra.run.trial195.stdout:Total 2.6 MB/s | 85 MB 00:32 2026-02-24T18:27:13.141 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T18:27:13.151 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T18:27:13.151 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T18:27:13.180 INFO:teuthology.orchestra.run.trial014.stdout:[MIRROR] zip-3.0-35.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/zip-3.0-35.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-24T18:27:13.438 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T18:27:13.438 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T18:27:13.520 INFO:teuthology.orchestra.run.trial014.stdout:[MIRROR] zip-3.0-35.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/zip-3.0-35.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-24T18:27:13.652 INFO:teuthology.orchestra.run.trial014.stdout:(15/40): python3-cryptography-36.0.1-5.el9.x86_ 679 kB/s | 1.2 MB 00:01 2026-02-24T18:27:13.706 INFO:teuthology.orchestra.run.trial014.stdout:(16/40): zip-3.0-35.el9.x86_64.rpm 435 kB/s | 266 kB 00:00 2026-02-24T18:27:13.751 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T18:27:13.756 INFO:teuthology.orchestra.run.trial195.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-24T18:27:13.760 INFO:teuthology.orchestra.run.trial195.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-24T18:27:13.768 INFO:teuthology.orchestra.run.trial195.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-24T18:27:13.769 INFO:teuthology.orchestra.run.trial195.stdout: Installing : libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 4/5 2026-02-24T18:27:13.782 INFO:teuthology.orchestra.run.trial014.stdout:[MIRROR] libstoragemgmt-1.10.1-1.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/libstoragemgmt-1.10.1-1.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-24T18:27:14.200 INFO:teuthology.orchestra.run.trial014.stdout:[MIRROR] libstoragemgmt-1.10.1-1.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/libstoragemgmt-1.10.1-1.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-24T18:27:14.255 INFO:teuthology.orchestra.run.trial014.stdout:(17/40): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 409 kB/s | 246 kB 00:00 2026-02-24T18:27:14.380 INFO:teuthology.orchestra.run.trial014.stdout:[MIRROR] lua-5.4.4-4.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/lua-5.4.4-4.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-24T18:27:14.601 INFO:teuthology.orchestra.run.trial014.stdout:[MIRROR] python3-libstoragemgmt-1.10.1-1.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-libstoragemgmt-1.10.1-1.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-24T18:27:14.725 INFO:teuthology.orchestra.run.trial014.stdout:[MIRROR] lua-5.4.4-4.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/lua-5.4.4-4.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-24T18:27:14.761 INFO:teuthology.orchestra.run.trial014.stdout:(18/40): lua-5.4.4-4.el9.x86_64.rpm 179 kB/s | 188 kB 00:01 2026-02-24T18:27:14.947 INFO:teuthology.orchestra.run.trial014.stdout:[MIRROR] python3-libstoragemgmt-1.10.1-1.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-libstoragemgmt-1.10.1-1.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-24T18:27:14.983 INFO:teuthology.orchestra.run.trial014.stdout:(19/40): python3-libstoragemgmt-1.10.1-1.el9.x8 243 kB/s | 177 kB 00:00 2026-02-24T18:27:15.109 INFO:teuthology.orchestra.run.trial014.stdout:[MIRROR] python3-packaging-20.9-5.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-packaging-20.9-5.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-24T18:27:15.142 INFO:teuthology.orchestra.run.trial014.stdout:(20/40): python3-packaging-20.9-5.el9.noarch.rp 203 kB/s | 77 kB 00:00 2026-02-24T18:27:15.162 INFO:teuthology.orchestra.run.trial014.stdout:(21/40): lua-devel-5.4.4-4.el9.x86_64.rpm 1.1 MB/s | 22 kB 00:00 2026-02-24T18:27:15.224 INFO:teuthology.orchestra.run.trial014.stdout:(22/40): luarocks-3.9.2-5.el9.noarch.rpm 2.4 MB/s | 151 kB 00:00 2026-02-24T18:27:15.241 INFO:teuthology.orchestra.run.trial014.stdout:(23/40): python3-autocommand-2.2.2-8.el9.noarch 1.7 MB/s | 29 kB 00:00 2026-02-24T18:27:15.259 INFO:teuthology.orchestra.run.trial014.stdout:(24/40): python3-backports-tarfile-1.2.0-1.el9. 3.3 MB/s | 60 kB 00:00 2026-02-24T18:27:15.280 INFO:teuthology.orchestra.run.trial014.stdout:(25/40): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 2.0 MB/s | 43 kB 00:00 2026-02-24T18:27:15.307 INFO:teuthology.orchestra.run.trial014.stdout:(26/40): python3-cheroot-10.0.1-4.el9.noarch.rp 6.4 MB/s | 173 kB 00:00 2026-02-24T18:27:15.336 INFO:teuthology.orchestra.run.trial014.stdout:(27/40): python3-cherrypy-18.6.1-2.el9.noarch.r 12 MB/s | 358 kB 00:00 2026-02-24T18:27:15.346 INFO:teuthology.orchestra.run.trial014.stdout:(28/40): python3-jaraco-8.2.1-3.el9.noarch.rpm 1.1 MB/s | 11 kB 00:00 2026-02-24T18:27:15.356 INFO:teuthology.orchestra.run.trial014.stdout:(29/40): python3-jaraco-classes-3.2.1-5.el9.noa 1.6 MB/s | 18 kB 00:00 2026-02-24T18:27:15.367 INFO:teuthology.orchestra.run.trial014.stdout:(30/40): python3-jaraco-collections-3.0.0-8.el9 2.2 MB/s | 23 kB 00:00 2026-02-24T18:27:15.371 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 4/5 2026-02-24T18:27:15.378 INFO:teuthology.orchestra.run.trial014.stdout:(31/40): python3-jaraco-context-6.0.1-3.el9.noa 1.8 MB/s | 20 kB 00:00 2026-02-24T18:27:15.387 INFO:teuthology.orchestra.run.trial014.stdout:(32/40): python3-jaraco-functools-3.5.0-2.el9.n 2.0 MB/s | 19 kB 00:00 2026-02-24T18:27:15.390 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 5/5 2026-02-24T18:27:15.398 INFO:teuthology.orchestra.run.trial014.stdout:(33/40): python3-jaraco-text-4.0.0-2.el9.noarch 2.5 MB/s | 26 kB 00:00 2026-02-24T18:27:15.403 INFO:teuthology.orchestra.run.trial014.stdout:(34/40): python3-toml-0.10.2-6.el9.noarch.rpm 99 kB/s | 42 kB 00:00 2026-02-24T18:27:15.408 INFO:teuthology.orchestra.run.trial014.stdout:(35/40): python3-more-itertools-8.12.0-2.el9.no 7.9 MB/s | 79 kB 00:00 2026-02-24T18:27:15.418 INFO:teuthology.orchestra.run.trial014.stdout:(36/40): python3-pyOpenSSL-21.0.0-1.el9.noarch. 8.8 MB/s | 90 kB 00:00 2026-02-24T18:27:15.436 INFO:teuthology.orchestra.run.trial014.stdout:(37/40): python3-tempora-5.0.0-2.el9.noarch.rpm 1.9 MB/s | 36 kB 00:00 2026-02-24T18:27:15.439 INFO:teuthology.orchestra.run.trial014.stdout:(38/40): python3-portend-3.1.0-2.el9.noarch.rpm 466 kB/s | 16 kB 00:00 2026-02-24T18:27:15.446 INFO:teuthology.orchestra.run.trial014.stdout:(39/40): python3-zc-lockfile-2.0-10.el9.noarch. 2.0 MB/s | 20 kB 00:00 2026-02-24T18:27:15.744 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 5/5 2026-02-24T18:27:15.744 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 1/5 2026-02-24T18:27:15.744 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 2/5 2026-02-24T18:27:15.744 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-24T18:27:15.744 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-24T18:27:15.772 INFO:teuthology.orchestra.run.trial014.stdout:(40/40): ceph-osd-20.2.0-681.g36d388f2.el9.x86_ 3.0 MB/s | 17 MB 00:05 2026-02-24T18:27:15.774 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:15.774 INFO:teuthology.orchestra.run.trial014.stdout:Total 4.5 MB/s | 30 MB 00:06 2026-02-24T18:27:15.802 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-24T18:27:15.802 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:15.802 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T18:27:15.802 INFO:teuthology.orchestra.run.trial044.stdout: ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:15.802 INFO:teuthology.orchestra.run.trial044.stdout: libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:15.802 INFO:teuthology.orchestra.run.trial044.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-24T18:27:15.802 INFO:teuthology.orchestra.run.trial044.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-24T18:27:15.802 INFO:teuthology.orchestra.run.trial044.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-24T18:27:15.802 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:15.802 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T18:27:15.839 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install ceph 2026-02-24T18:27:15.921 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T18:27:15.940 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T18:27:15.940 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T18:27:16.084 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T18:27:16.084 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T18:27:16.157 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:01:09 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:27:16.242 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T18:27:16.244 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:27:16.244 INFO:teuthology.orchestra.run.trial044.stdout: Package Arch Version Repository Size 2026-02-24T18:27:16.244 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:27:16.244 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T18:27:16.244 INFO:teuthology.orchestra.run.trial044.stdout: ceph x86_64 2:20.2.0-681.g36d388f2.el9 ceph 6.5 k 2026-02-24T18:27:16.244 INFO:teuthology.orchestra.run.trial044.stdout:Installing dependencies: 2026-02-24T18:27:16.244 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mds x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.3 M 2026-02-24T18:27:16.245 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mgr x86_64 2:20.2.0-681.g36d388f2.el9 ceph 961 k 2026-02-24T18:27:16.245 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mgr-modules-core noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 290 k 2026-02-24T18:27:16.245 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mon x86_64 2:20.2.0-681.g36d388f2.el9 ceph 5.1 M 2026-02-24T18:27:16.245 INFO:teuthology.orchestra.run.trial044.stdout: ceph-osd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 17 M 2026-02-24T18:27:16.245 INFO:teuthology.orchestra.run.trial044.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-24T18:27:16.245 INFO:teuthology.orchestra.run.trial044.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-24T18:27:16.245 INFO:teuthology.orchestra.run.trial044.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-24T18:27:16.245 INFO:teuthology.orchestra.run.trial044.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-24T18:27:16.245 INFO:teuthology.orchestra.run.trial044.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-24T18:27:16.245 INFO:teuthology.orchestra.run.trial044.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-24T18:27:16.245 INFO:teuthology.orchestra.run.trial044.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-24T18:27:16.245 INFO:teuthology.orchestra.run.trial044.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-24T18:27:16.245 INFO:teuthology.orchestra.run.trial044.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-24T18:27:16.246 INFO:teuthology.orchestra.run.trial044.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-24T18:27:16.246 INFO:teuthology.orchestra.run.trial044.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-24T18:27:16.246 INFO:teuthology.orchestra.run.trial044.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-24T18:27:16.246 INFO:teuthology.orchestra.run.trial044.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-24T18:27:16.246 INFO:teuthology.orchestra.run.trial044.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-24T18:27:16.246 INFO:teuthology.orchestra.run.trial044.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-24T18:27:16.246 INFO:teuthology.orchestra.run.trial044.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-24T18:27:16.246 INFO:teuthology.orchestra.run.trial044.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-24T18:27:16.246 INFO:teuthology.orchestra.run.trial044.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-24T18:27:16.246 INFO:teuthology.orchestra.run.trial044.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-24T18:27:16.246 INFO:teuthology.orchestra.run.trial044.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-24T18:27:16.246 INFO:teuthology.orchestra.run.trial044.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-24T18:27:16.247 INFO:teuthology.orchestra.run.trial044.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-24T18:27:16.247 INFO:teuthology.orchestra.run.trial044.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-24T18:27:16.247 INFO:teuthology.orchestra.run.trial044.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-24T18:27:16.247 INFO:teuthology.orchestra.run.trial044.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-24T18:27:16.247 INFO:teuthology.orchestra.run.trial044.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-24T18:27:16.247 INFO:teuthology.orchestra.run.trial044.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-24T18:27:16.247 INFO:teuthology.orchestra.run.trial044.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-24T18:27:16.247 INFO:teuthology.orchestra.run.trial044.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-24T18:27:16.247 INFO:teuthology.orchestra.run.trial044.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-24T18:27:16.247 INFO:teuthology.orchestra.run.trial044.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-24T18:27:16.247 INFO:teuthology.orchestra.run.trial044.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-24T18:27:16.247 INFO:teuthology.orchestra.run.trial044.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-24T18:27:16.247 INFO:teuthology.orchestra.run.trial044.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-24T18:27:16.248 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:16.248 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T18:27:16.248 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:27:16.248 INFO:teuthology.orchestra.run.trial044.stdout:Install 40 Packages 2026-02-24T18:27:16.248 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:16.249 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 30 M 2026-02-24T18:27:16.249 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 100 M 2026-02-24T18:27:16.249 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T18:27:16.268 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T18:27:16.270 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/40 2026-02-24T18:27:16.276 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/40 2026-02-24T18:27:16.281 INFO:teuthology.orchestra.run.trial014.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/40 2026-02-24T18:27:16.284 INFO:teuthology.orchestra.run.trial014.stdout: Installing : unzip-6.0-59.el9.x86_64 4/40 2026-02-24T18:27:16.290 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 5/40 2026-02-24T18:27:16.314 INFO:teuthology.orchestra.run.trial014.stdout: Installing : zip-3.0-35.el9.x86_64 6/40 2026-02-24T18:27:16.317 INFO:teuthology.orchestra.run.trial014.stdout: Installing : luarocks-3.9.2-5.el9.noarch 7/40 2026-02-24T18:27:16.322 INFO:teuthology.orchestra.run.trial014.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 8/40 2026-02-24T18:27:16.327 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 9/40 2026-02-24T18:27:16.333 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 10/40 2026-02-24T18:27:16.337 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 11/40 2026-02-24T18:27:16.343 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 12/40 2026-02-24T18:27:16.348 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 13/40 2026-02-24T18:27:16.352 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 14/40 2026-02-24T18:27:16.357 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 15/40 2026-02-24T18:27:16.361 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 16/40 2026-02-24T18:27:16.368 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 17/40 2026-02-24T18:27:16.371 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 18/40 2026-02-24T18:27:16.394 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 19/40 2026-02-24T18:27:16.406 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/40 2026-02-24T18:27:16.411 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/40 2026-02-24T18:27:16.421 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 22/40 2026-02-24T18:27:16.428 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-packaging-20.9-5.el9.noarch 23/40 2026-02-24T18:27:16.441 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/40 2026-02-24T18:27:16.456 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/40 2026-02-24T18:27:16.532 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/40 2026-02-24T18:27:16.540 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 27/40 2026-02-24T18:27:16.563 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/40 2026-02-24T18:27:16.592 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 29/40 2026-02-24T18:27:16.598 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/40 2026-02-24T18:27:16.644 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/40 2026-02-24T18:27:16.688 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.n 32/40 2026-02-24T18:27:16.689 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 33/40 2026-02-24T18:27:16.713 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 33/40 2026-02-24T18:27:16.713 INFO:teuthology.orchestra.run.trial014.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:16.714 INFO:teuthology.orchestra.run.trial014.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-24T18:27:16.714 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T18:27:16.714 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T18:27:16.714 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:16.717 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 34/40 2026-02-24T18:27:16.735 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-24T18:27:16.735 INFO:teuthology.orchestra.run.trial014.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-24T18:27:16.735 INFO:teuthology.orchestra.run.trial014.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-24T18:27:16.735 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:16.742 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-24T18:27:16.766 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-24T18:27:16.766 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-24T18:27:16.766 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:17.039 INFO:teuthology.orchestra.run.trial044.stdout:(1/40): ceph-20.2.0-681.g36d388f2.el9.x86_64.rp 29 kB/s | 6.5 kB 00:00 2026-02-24T18:27:17.491 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 36/40 2026-02-24T18:27:17.492 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 37/40 2026-02-24T18:27:17.518 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 37/40 2026-02-24T18:27:17.518 INFO:teuthology.orchestra.run.trial014.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:17.518 INFO:teuthology.orchestra.run.trial014.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-24T18:27:17.518 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T18:27:17.518 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T18:27:17.519 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:17.546 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 4/5 2026-02-24T18:27:17.565 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 5/5 2026-02-24T18:27:17.738 INFO:teuthology.orchestra.run.trial044.stdout:(2/40): ceph-mgr-20.2.0-681.g36d388f2.el9.x86_6 1.0 MB/s | 961 kB 00:00 2026-02-24T18:27:17.744 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 38/40 2026-02-24T18:27:17.764 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 38/40 2026-02-24T18:27:17.764 INFO:teuthology.orchestra.run.trial014.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:17.764 INFO:teuthology.orchestra.run.trial014.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-24T18:27:17.764 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T18:27:17.764 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T18:27:17.765 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:17.868 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 39/40 2026-02-24T18:27:17.889 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 39/40 2026-02-24T18:27:17.889 INFO:teuthology.orchestra.run.trial014.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:17.889 INFO:teuthology.orchestra.run.trial014.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-24T18:27:17.889 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T18:27:17.889 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T18:27:17.889 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:17.891 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 5/5 2026-02-24T18:27:17.891 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 1/5 2026-02-24T18:27:17.891 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 2/5 2026-02-24T18:27:17.891 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-24T18:27:17.891 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-24T18:27:17.907 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-2:20.2.0-681.g36d388f2.el9.x86_64 40/40 2026-02-24T18:27:17.949 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-24T18:27:17.949 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:17.949 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T18:27:17.949 INFO:teuthology.orchestra.run.trial195.stdout: ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:17.950 INFO:teuthology.orchestra.run.trial195.stdout: libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:17.950 INFO:teuthology.orchestra.run.trial195.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-24T18:27:17.950 INFO:teuthology.orchestra.run.trial195.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-24T18:27:17.950 INFO:teuthology.orchestra.run.trial195.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-24T18:27:17.950 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:17.950 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T18:27:17.988 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph 2026-02-24T18:27:18.239 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-2:20.2.0-681.g36d388f2.el9.x86_64 40/40 2026-02-24T18:27:18.239 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-2:20.2.0-681.g36d388f2.el9.x86_64 1/40 2026-02-24T18:27:18.240 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 2/40 2026-02-24T18:27:18.240 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 3/40 2026-02-24T18:27:18.240 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 4/40 2026-02-24T18:27:18.240 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 5/40 2026-02-24T18:27:18.240 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.n 6/40 2026-02-24T18:27:18.240 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 7/40 2026-02-24T18:27:18.240 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 8/40 2026-02-24T18:27:18.240 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 9/40 2026-02-24T18:27:18.240 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 10/40 2026-02-24T18:27:18.241 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-ply-3.11-14.el9.noarch 11/40 2026-02-24T18:27:18.241 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 12/40 2026-02-24T18:27:18.241 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 13/40 2026-02-24T18:27:18.241 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 14/40 2026-02-24T18:27:18.241 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 15/40 2026-02-24T18:27:18.241 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : unzip-6.0-59.el9.x86_64 16/40 2026-02-24T18:27:18.241 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : zip-3.0-35.el9.x86_64 17/40 2026-02-24T18:27:18.241 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 18/40 2026-02-24T18:27:18.241 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : lua-5.4.4-4.el9.x86_64 19/40 2026-02-24T18:27:18.241 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 20/40 2026-02-24T18:27:18.242 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 21/40 2026-02-24T18:27:18.242 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 22/40 2026-02-24T18:27:18.242 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 23/40 2026-02-24T18:27:18.242 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 24/40 2026-02-24T18:27:18.242 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 25/40 2026-02-24T18:27:18.242 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 26/40 2026-02-24T18:27:18.242 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 27/40 2026-02-24T18:27:18.242 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 28/40 2026-02-24T18:27:18.242 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 29/40 2026-02-24T18:27:18.242 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 30/40 2026-02-24T18:27:18.243 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 31/40 2026-02-24T18:27:18.243 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 32/40 2026-02-24T18:27:18.243 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 33/40 2026-02-24T18:27:18.243 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 34/40 2026-02-24T18:27:18.243 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 35/40 2026-02-24T18:27:18.243 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 36/40 2026-02-24T18:27:18.243 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 37/40 2026-02-24T18:27:18.243 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 38/40 2026-02-24T18:27:18.243 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 39/40 2026-02-24T18:27:18.299 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 40/40 2026-02-24T18:27:18.299 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:18.300 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T18:27:18.300 INFO:teuthology.orchestra.run.trial014.stdout: ceph-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:18.300 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:18.300 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:18.300 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:18.300 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:18.300 INFO:teuthology.orchestra.run.trial014.stdout: ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:18.300 INFO:teuthology.orchestra.run.trial014.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-24T18:27:18.300 INFO:teuthology.orchestra.run.trial014.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-24T18:27:18.300 INFO:teuthology.orchestra.run.trial014.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T18:27:18.300 INFO:teuthology.orchestra.run.trial014.stdout: lua-5.4.4-4.el9.x86_64 2026-02-24T18:27:18.300 INFO:teuthology.orchestra.run.trial014.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-24T18:27:18.300 INFO:teuthology.orchestra.run.trial014.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-24T18:27:18.300 INFO:teuthology.orchestra.run.trial014.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-24T18:27:18.300 INFO:teuthology.orchestra.run.trial014.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-24T18:27:18.301 INFO:teuthology.orchestra.run.trial014.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-24T18:27:18.301 INFO:teuthology.orchestra.run.trial014.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-24T18:27:18.301 INFO:teuthology.orchestra.run.trial014.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-24T18:27:18.301 INFO:teuthology.orchestra.run.trial014.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-24T18:27:18.301 INFO:teuthology.orchestra.run.trial014.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-24T18:27:18.301 INFO:teuthology.orchestra.run.trial014.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-24T18:27:18.301 INFO:teuthology.orchestra.run.trial014.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-24T18:27:18.301 INFO:teuthology.orchestra.run.trial014.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-24T18:27:18.301 INFO:teuthology.orchestra.run.trial014.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-24T18:27:18.301 INFO:teuthology.orchestra.run.trial014.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-24T18:27:18.301 INFO:teuthology.orchestra.run.trial014.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-24T18:27:18.301 INFO:teuthology.orchestra.run.trial014.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T18:27:18.301 INFO:teuthology.orchestra.run.trial014.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-24T18:27:18.301 INFO:teuthology.orchestra.run.trial014.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-24T18:27:18.301 INFO:teuthology.orchestra.run.trial014.stdout: python3-ply-3.11-14.el9.noarch 2026-02-24T18:27:18.301 INFO:teuthology.orchestra.run.trial014.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-24T18:27:18.301 INFO:teuthology.orchestra.run.trial014.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-24T18:27:18.302 INFO:teuthology.orchestra.run.trial014.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-24T18:27:18.302 INFO:teuthology.orchestra.run.trial014.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-24T18:27:18.302 INFO:teuthology.orchestra.run.trial014.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-24T18:27:18.302 INFO:teuthology.orchestra.run.trial014.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-24T18:27:18.302 INFO:teuthology.orchestra.run.trial014.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-24T18:27:18.302 INFO:teuthology.orchestra.run.trial014.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-24T18:27:18.302 INFO:teuthology.orchestra.run.trial014.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-24T18:27:18.302 INFO:teuthology.orchestra.run.trial014.stdout: unzip-6.0-59.el9.x86_64 2026-02-24T18:27:18.302 INFO:teuthology.orchestra.run.trial014.stdout: zip-3.0-35.el9.x86_64 2026-02-24T18:27:18.302 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:18.302 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T18:27:18.308 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:12 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T18:27:18.336 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install ceph-base 2026-02-24T18:27:18.392 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T18:27:18.393 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:27:18.393 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repository Size 2026-02-24T18:27:18.394 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:27:18.394 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T18:27:18.394 INFO:teuthology.orchestra.run.trial195.stdout: ceph x86_64 2:20.2.0-681.g36d388f2.el9 ceph 6.5 k 2026-02-24T18:27:18.394 INFO:teuthology.orchestra.run.trial195.stdout:Installing dependencies: 2026-02-24T18:27:18.394 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mds x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.3 M 2026-02-24T18:27:18.394 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mgr x86_64 2:20.2.0-681.g36d388f2.el9 ceph 961 k 2026-02-24T18:27:18.394 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mgr-modules-core noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 290 k 2026-02-24T18:27:18.394 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mon x86_64 2:20.2.0-681.g36d388f2.el9 ceph 5.1 M 2026-02-24T18:27:18.395 INFO:teuthology.orchestra.run.trial195.stdout: ceph-osd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 17 M 2026-02-24T18:27:18.395 INFO:teuthology.orchestra.run.trial195.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-24T18:27:18.395 INFO:teuthology.orchestra.run.trial195.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-24T18:27:18.395 INFO:teuthology.orchestra.run.trial195.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-24T18:27:18.395 INFO:teuthology.orchestra.run.trial195.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-24T18:27:18.395 INFO:teuthology.orchestra.run.trial195.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-24T18:27:18.395 INFO:teuthology.orchestra.run.trial195.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-24T18:27:18.395 INFO:teuthology.orchestra.run.trial195.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-24T18:27:18.395 INFO:teuthology.orchestra.run.trial195.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-24T18:27:18.395 INFO:teuthology.orchestra.run.trial195.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-24T18:27:18.395 INFO:teuthology.orchestra.run.trial195.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-24T18:27:18.396 INFO:teuthology.orchestra.run.trial195.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-24T18:27:18.396 INFO:teuthology.orchestra.run.trial195.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-24T18:27:18.396 INFO:teuthology.orchestra.run.trial195.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-24T18:27:18.396 INFO:teuthology.orchestra.run.trial195.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-24T18:27:18.396 INFO:teuthology.orchestra.run.trial195.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-24T18:27:18.396 INFO:teuthology.orchestra.run.trial195.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-24T18:27:18.396 INFO:teuthology.orchestra.run.trial195.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-24T18:27:18.396 INFO:teuthology.orchestra.run.trial195.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-24T18:27:18.396 INFO:teuthology.orchestra.run.trial195.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-24T18:27:18.396 INFO:teuthology.orchestra.run.trial195.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-24T18:27:18.396 INFO:teuthology.orchestra.run.trial195.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-24T18:27:18.397 INFO:teuthology.orchestra.run.trial195.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-24T18:27:18.397 INFO:teuthology.orchestra.run.trial195.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-24T18:27:18.397 INFO:teuthology.orchestra.run.trial195.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-24T18:27:18.397 INFO:teuthology.orchestra.run.trial195.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-24T18:27:18.397 INFO:teuthology.orchestra.run.trial195.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-24T18:27:18.397 INFO:teuthology.orchestra.run.trial195.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-24T18:27:18.397 INFO:teuthology.orchestra.run.trial195.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-24T18:27:18.397 INFO:teuthology.orchestra.run.trial195.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-24T18:27:18.397 INFO:teuthology.orchestra.run.trial195.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-24T18:27:18.397 INFO:teuthology.orchestra.run.trial195.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-24T18:27:18.398 INFO:teuthology.orchestra.run.trial195.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-24T18:27:18.398 INFO:teuthology.orchestra.run.trial195.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-24T18:27:18.398 INFO:teuthology.orchestra.run.trial195.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-24T18:27:18.398 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:18.398 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T18:27:18.398 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:27:18.398 INFO:teuthology.orchestra.run.trial195.stdout:Install 40 Packages 2026-02-24T18:27:18.398 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:18.399 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 30 M 2026-02-24T18:27:18.399 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 100 M 2026-02-24T18:27:18.399 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T18:27:18.529 INFO:teuthology.orchestra.run.trial170.stdout:(5/5): ceph-test-20.2.0-681.g36d388f2.el9.x86_6 1.8 MB/s | 84 MB 00:46 2026-02-24T18:27:18.531 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:18.531 INFO:teuthology.orchestra.run.trial170.stdout:Total 1.8 MB/s | 85 MB 00:46 2026-02-24T18:27:18.555 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T18:27:18.566 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T18:27:18.566 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T18:27:18.652 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:01:11 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:27:18.655 INFO:teuthology.orchestra.run.trial044.stdout:(3/40): ceph-mds-20.2.0-681.g36d388f2.el9.x86_6 1.3 MB/s | 2.3 MB 00:01 2026-02-24T18:27:18.716 INFO:teuthology.orchestra.run.trial014.stdout:Package ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:18.734 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T18:27:18.734 INFO:teuthology.orchestra.run.trial014.stdout:Nothing to do. 2026-02-24T18:27:18.734 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T18:27:18.756 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install cephadm 2026-02-24T18:27:18.855 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T18:27:18.855 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T18:27:18.865 INFO:teuthology.orchestra.run.trial044.stdout:(4/40): ceph-mgr-modules-core-20.2.0-681.g36d38 1.3 MB/s | 290 kB 00:00 2026-02-24T18:27:18.972 INFO:teuthology.orchestra.run.trial195.stdout:(1/40): ceph-20.2.0-681.g36d388f2.el9.x86_64.rp 24 kB/s | 6.5 kB 00:00 2026-02-24T18:27:19.066 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:01:12 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:27:19.145 INFO:teuthology.orchestra.run.trial044.stdout:(5/40): ledmon-libs-1.1.0-3.el9.x86_64.rpm 144 kB/s | 40 kB 00:00 2026-02-24T18:27:19.148 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T18:27:19.149 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:19.149 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repository Size 2026-02-24T18:27:19.149 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:19.149 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T18:27:19.149 INFO:teuthology.orchestra.run.trial014.stdout: cephadm noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 1.0 M 2026-02-24T18:27:19.149 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:19.149 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T18:27:19.149 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:19.149 INFO:teuthology.orchestra.run.trial014.stdout:Install 1 Package 2026-02-24T18:27:19.149 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:19.149 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 1.0 M 2026-02-24T18:27:19.149 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 1.0 M 2026-02-24T18:27:19.149 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T18:27:19.167 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T18:27:19.173 INFO:teuthology.orchestra.run.trial170.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-24T18:27:19.177 INFO:teuthology.orchestra.run.trial170.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-24T18:27:19.185 INFO:teuthology.orchestra.run.trial170.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-24T18:27:19.186 INFO:teuthology.orchestra.run.trial170.stdout: Installing : libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 4/5 2026-02-24T18:27:19.338 INFO:teuthology.orchestra.run.trial044.stdout:(6/40): libconfig-1.7.2-9.el9.x86_64.rpm 375 kB/s | 72 kB 00:00 2026-02-24T18:27:19.568 INFO:teuthology.orchestra.run.trial044.stdout:(7/40): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2026-02-24T18:27:19.705 INFO:teuthology.orchestra.run.trial195.stdout:(2/40): ceph-mgr-20.2.0-681.g36d388f2.el9.x86_6 956 kB/s | 961 kB 00:01 2026-02-24T18:27:19.853 INFO:teuthology.orchestra.run.trial044.stdout:(8/40): python3-cryptography-36.0.1-5.el9.x86_6 4.4 MB/s | 1.2 MB 00:00 2026-02-24T18:27:19.935 INFO:teuthology.orchestra.run.trial044.stdout:(9/40): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 106 kB 00:00 2026-02-24T18:27:20.020 INFO:teuthology.orchestra.run.trial044.stdout:(10/40): python3-pycparser-2.20-6.el9.noarch.rp 1.5 MB/s | 135 kB 00:00 2026-02-24T18:27:20.108 INFO:teuthology.orchestra.run.trial044.stdout:(11/40): python3-pyparsing-2.4.7-9.el9.noarch.r 1.7 MB/s | 150 kB 00:00 2026-02-24T18:27:20.147 INFO:teuthology.orchestra.run.trial014.stdout:cephadm-20.2.0-681.g36d388f2.el9.noarch.rpm 1.0 MB/s | 1.0 MB 00:00 2026-02-24T18:27:20.147 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:20.147 INFO:teuthology.orchestra.run.trial014.stdout:Total 1.0 MB/s | 1.0 MB 00:00 2026-02-24T18:27:20.147 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T18:27:20.150 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T18:27:20.150 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T18:27:20.154 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T18:27:20.154 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T18:27:20.174 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T18:27:20.191 INFO:teuthology.orchestra.run.trial044.stdout:(12/40): python3-requests-2.25.1-10.el9.noarch. 1.5 MB/s | 126 kB 00:00 2026-02-24T18:27:20.240 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:20.255 INFO:teuthology.orchestra.run.trial014.stdout: Installing : cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:20.278 INFO:teuthology.orchestra.run.trial044.stdout:(13/40): python3-urllib3-1.26.5-7.el9.noarch.rp 2.5 MB/s | 218 kB 00:00 2026-02-24T18:27:20.323 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:20.363 INFO:teuthology.orchestra.run.trial044.stdout:(14/40): unzip-6.0-59.el9.x86_64.rpm 2.1 MB/s | 182 kB 00:00 2026-02-24T18:27:20.381 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:20.382 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:20.382 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T18:27:20.382 INFO:teuthology.orchestra.run.trial014.stdout: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:20.382 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:20.382 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T18:27:20.408 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install ceph-immutable-object-cache 2026-02-24T18:27:20.450 INFO:teuthology.orchestra.run.trial044.stdout:(15/40): zip-3.0-35.el9.x86_64.rpm 3.0 MB/s | 266 kB 00:00 2026-02-24T18:27:20.471 INFO:teuthology.orchestra.run.trial044.stdout:(16/40): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 11 MB/s | 246 kB 00:00 2026-02-24T18:27:20.475 INFO:teuthology.orchestra.run.trial195.stdout:(3/40): ceph-mds-20.2.0-681.g36d388f2.el9.x86_6 1.3 MB/s | 2.3 MB 00:01 2026-02-24T18:27:20.479 INFO:teuthology.orchestra.run.trial044.stdout:(17/40): lua-5.4.4-4.el9.x86_64.rpm 26 MB/s | 188 kB 00:00 2026-02-24T18:27:20.485 INFO:teuthology.orchestra.run.trial044.stdout:(18/40): python3-libstoragemgmt-1.10.1-1.el9.x8 26 MB/s | 177 kB 00:00 2026-02-24T18:27:20.491 INFO:teuthology.orchestra.run.trial044.stdout:(19/40): python3-packaging-20.9-5.el9.noarch.rp 14 MB/s | 77 kB 00:00 2026-02-24T18:27:20.496 INFO:teuthology.orchestra.run.trial044.stdout:(20/40): python3-toml-0.10.2-6.el9.noarch.rpm 8.6 MB/s | 42 kB 00:00 2026-02-24T18:27:20.500 INFO:teuthology.orchestra.run.trial044.stdout:(21/40): lua-devel-5.4.4-4.el9.x86_64.rpm 5.3 MB/s | 22 kB 00:00 2026-02-24T18:27:20.532 INFO:teuthology.orchestra.run.trial044.stdout:(22/40): luarocks-3.9.2-5.el9.noarch.rpm 4.6 MB/s | 151 kB 00:00 2026-02-24T18:27:20.538 INFO:teuthology.orchestra.run.trial044.stdout:(23/40): python3-autocommand-2.2.2-8.el9.noarch 5.1 MB/s | 29 kB 00:00 2026-02-24T18:27:20.544 INFO:teuthology.orchestra.run.trial044.stdout:(24/40): python3-backports-tarfile-1.2.0-1.el9. 9.9 MB/s | 60 kB 00:00 2026-02-24T18:27:20.549 INFO:teuthology.orchestra.run.trial044.stdout:(25/40): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 7.5 MB/s | 43 kB 00:00 2026-02-24T18:27:20.557 INFO:teuthology.orchestra.run.trial044.stdout:(26/40): python3-cheroot-10.0.1-4.el9.noarch.rp 23 MB/s | 173 kB 00:00 2026-02-24T18:27:20.569 INFO:teuthology.orchestra.run.trial044.stdout:(27/40): python3-cherrypy-18.6.1-2.el9.noarch.r 28 MB/s | 358 kB 00:00 2026-02-24T18:27:20.575 INFO:teuthology.orchestra.run.trial044.stdout:(28/40): python3-jaraco-8.2.1-3.el9.noarch.rpm 2.0 MB/s | 11 kB 00:00 2026-02-24T18:27:20.580 INFO:teuthology.orchestra.run.trial044.stdout:(29/40): python3-jaraco-classes-3.2.1-5.el9.noa 3.3 MB/s | 18 kB 00:00 2026-02-24T18:27:20.585 INFO:teuthology.orchestra.run.trial044.stdout:(30/40): python3-jaraco-collections-3.0.0-8.el9 4.4 MB/s | 23 kB 00:00 2026-02-24T18:27:20.590 INFO:teuthology.orchestra.run.trial044.stdout:(31/40): python3-jaraco-context-6.0.1-3.el9.noa 3.6 MB/s | 20 kB 00:00 2026-02-24T18:27:20.596 INFO:teuthology.orchestra.run.trial044.stdout:(32/40): python3-jaraco-functools-3.5.0-2.el9.n 3.6 MB/s | 19 kB 00:00 2026-02-24T18:27:20.601 INFO:teuthology.orchestra.run.trial044.stdout:(33/40): python3-jaraco-text-4.0.0-2.el9.noarch 4.9 MB/s | 26 kB 00:00 2026-02-24T18:27:20.607 INFO:teuthology.orchestra.run.trial044.stdout:(34/40): python3-more-itertools-8.12.0-2.el9.no 13 MB/s | 79 kB 00:00 2026-02-24T18:27:20.613 INFO:teuthology.orchestra.run.trial044.stdout:(35/40): python3-portend-3.1.0-2.el9.noarch.rpm 3.2 MB/s | 16 kB 00:00 2026-02-24T18:27:20.619 INFO:teuthology.orchestra.run.trial044.stdout:(36/40): python3-pyOpenSSL-21.0.0-1.el9.noarch. 14 MB/s | 90 kB 00:00 2026-02-24T18:27:20.625 INFO:teuthology.orchestra.run.trial044.stdout:(37/40): python3-tempora-5.0.0-2.el9.noarch.rpm 6.2 MB/s | 36 kB 00:00 2026-02-24T18:27:20.631 INFO:teuthology.orchestra.run.trial044.stdout:(38/40): python3-zc-lockfile-2.0-10.el9.noarch. 3.1 MB/s | 20 kB 00:00 2026-02-24T18:27:20.683 INFO:teuthology.orchestra.run.trial195.stdout:(4/40): ceph-mgr-modules-core-20.2.0-681.g36d38 1.4 MB/s | 290 kB 00:00 2026-02-24T18:27:20.717 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:01:13 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:27:20.782 INFO:teuthology.orchestra.run.trial044.stdout:(39/40): ceph-mon-20.2.0-681.g36d388f2.el9.x86_ 1.4 MB/s | 5.1 MB 00:03 2026-02-24T18:27:20.799 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T18:27:20.800 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:20.800 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repo Size 2026-02-24T18:27:20.800 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:20.800 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T18:27:20.800 INFO:teuthology.orchestra.run.trial014.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-681.g36d388f2.el9 ceph 154 k 2026-02-24T18:27:20.800 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:20.800 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T18:27:20.800 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:20.800 INFO:teuthology.orchestra.run.trial014.stdout:Install 1 Package 2026-02-24T18:27:20.800 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:20.800 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 154 k 2026-02-24T18:27:20.800 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 447 k 2026-02-24T18:27:20.800 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T18:27:21.009 INFO:teuthology.orchestra.run.trial195.stdout:(5/40): ceph-mon-20.2.0-681.g36d388f2.el9.x86_6 2.5 MB/s | 5.1 MB 00:02 2026-02-24T18:27:21.265 INFO:teuthology.orchestra.run.trial195.stdout:(6/40): ledmon-libs-1.1.0-3.el9.x86_64.rpm 69 kB/s | 40 kB 00:00 2026-02-24T18:27:21.277 INFO:teuthology.orchestra.run.trial014.stdout:ceph-immutable-object-cache-20.2.0-681.g36d388f 323 kB/s | 154 kB 00:00 2026-02-24T18:27:21.277 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:21.277 INFO:teuthology.orchestra.run.trial014.stdout:Total 322 kB/s | 154 kB 00:00 2026-02-24T18:27:21.277 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T18:27:21.282 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T18:27:21.283 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T18:27:21.309 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T18:27:21.309 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T18:27:21.360 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T18:27:21.361 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-24T18:27:21.384 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-24T18:27:21.384 INFO:teuthology.orchestra.run.trial014.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:21.384 INFO:teuthology.orchestra.run.trial014.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-24T18:27:21.384 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:21.643 INFO:teuthology.orchestra.run.trial195.stdout:(7/40): libconfig-1.7.2-9.el9.x86_64.rpm 114 kB/s | 72 kB 00:00 2026-02-24T18:27:21.659 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-24T18:27:21.659 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:21.659 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T18:27:21.659 INFO:teuthology.orchestra.run.trial014.stdout: ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:21.660 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:21.660 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T18:27:21.686 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install ceph-mgr 2026-02-24T18:27:22.002 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:01:15 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:27:22.030 INFO:teuthology.orchestra.run.trial195.stdout:(8/40): python3-cffi-1.14.5-5.el9.x86_64.rpm 331 kB/s | 253 kB 00:00 2026-02-24T18:27:22.067 INFO:teuthology.orchestra.run.trial014.stdout:Package ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:22.085 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T18:27:22.085 INFO:teuthology.orchestra.run.trial014.stdout:Nothing to do. 2026-02-24T18:27:22.085 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T18:27:22.107 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install ceph-mgr-dashboard 2026-02-24T18:27:22.417 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:01:15 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:27:22.500 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T18:27:22.500 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:22.500 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repository Size 2026-02-24T18:27:22.501 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:22.501 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T18:27:22.501 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-dashboard noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 11 M 2026-02-24T18:27:22.501 INFO:teuthology.orchestra.run.trial014.stdout:Installing dependencies: 2026-02-24T18:27:22.501 INFO:teuthology.orchestra.run.trial014.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-24T18:27:22.501 INFO:teuthology.orchestra.run.trial014.stdout: ceph-grafana-dashboards noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 43 k 2026-02-24T18:27:22.501 INFO:teuthology.orchestra.run.trial014.stdout: ceph-prometheus-alerts noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 17 k 2026-02-24T18:27:22.501 INFO:teuthology.orchestra.run.trial014.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-24T18:27:22.501 INFO:teuthology.orchestra.run.trial014.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-24T18:27:22.501 INFO:teuthology.orchestra.run.trial014.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-24T18:27:22.502 INFO:teuthology.orchestra.run.trial014.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-24T18:27:22.502 INFO:teuthology.orchestra.run.trial014.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-24T18:27:22.502 INFO:teuthology.orchestra.run.trial014.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-24T18:27:22.502 INFO:teuthology.orchestra.run.trial014.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-24T18:27:22.502 INFO:teuthology.orchestra.run.trial014.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-24T18:27:22.502 INFO:teuthology.orchestra.run.trial014.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-24T18:27:22.502 INFO:teuthology.orchestra.run.trial014.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-24T18:27:22.502 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:22.502 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T18:27:22.502 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:22.502 INFO:teuthology.orchestra.run.trial014.stdout:Install 14 Packages 2026-02-24T18:27:22.503 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:22.503 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 16 M 2026-02-24T18:27:22.503 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 158 M 2026-02-24T18:27:22.504 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T18:27:22.593 INFO:teuthology.orchestra.run.trial195.stdout:(9/40): python3-cryptography-36.0.1-5.el9.x86_6 1.3 MB/s | 1.2 MB 00:00 2026-02-24T18:27:22.698 INFO:teuthology.orchestra.run.trial195.stdout:(10/40): python3-ply-3.11-14.el9.noarch.rpm 159 kB/s | 106 kB 00:00 2026-02-24T18:27:22.906 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 4/5 2026-02-24T18:27:22.925 INFO:teuthology.orchestra.run.trial170.stdout: Installing : ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 5/5 2026-02-24T18:27:23.266 INFO:teuthology.orchestra.run.trial014.stdout:(1/14): ceph-prometheus-alerts-20.2.0-681.g36d3 53 kB/s | 17 kB 00:00 2026-02-24T18:27:23.289 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 5/5 2026-02-24T18:27:23.290 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 1/5 2026-02-24T18:27:23.290 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 2/5 2026-02-24T18:27:23.290 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-24T18:27:23.290 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-24T18:27:23.298 INFO:teuthology.orchestra.run.trial195.stdout:(11/40): python3-pycparser-2.20-6.el9.noarch.rp 192 kB/s | 135 kB 00:00 2026-02-24T18:27:23.333 INFO:teuthology.orchestra.run.trial014.stdout:(2/14): ceph-grafana-dashboards-20.2.0-681.g36d 110 kB/s | 43 kB 00:00 2026-02-24T18:27:23.347 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-24T18:27:23.348 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:27:23.348 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T18:27:23.348 INFO:teuthology.orchestra.run.trial170.stdout: ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:23.348 INFO:teuthology.orchestra.run.trial170.stdout: libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:23.348 INFO:teuthology.orchestra.run.trial170.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-24T18:27:23.348 INFO:teuthology.orchestra.run.trial170.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-24T18:27:23.348 INFO:teuthology.orchestra.run.trial170.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-24T18:27:23.348 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:27:23.348 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T18:27:23.385 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install ceph 2026-02-24T18:27:23.415 INFO:teuthology.orchestra.run.trial195.stdout:(12/40): python3-pyparsing-2.4.7-9.el9.noarch.r 210 kB/s | 150 kB 00:00 2026-02-24T18:27:23.644 INFO:teuthology.orchestra.run.trial014.stdout:(3/14): python3-jmespath-1.0.1-1.el9.noarch.rpm 153 kB/s | 48 kB 00:00 2026-02-24T18:27:23.693 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:01:19 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T18:27:23.777 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T18:27:23.778 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:27:23.778 INFO:teuthology.orchestra.run.trial170.stdout: Package Arch Version Repository Size 2026-02-24T18:27:23.778 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:27:23.778 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T18:27:23.778 INFO:teuthology.orchestra.run.trial170.stdout: ceph x86_64 2:20.2.0-681.g36d388f2.el9 ceph 6.5 k 2026-02-24T18:27:23.778 INFO:teuthology.orchestra.run.trial170.stdout:Installing dependencies: 2026-02-24T18:27:23.779 INFO:teuthology.orchestra.run.trial170.stdout: ceph-mds x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.3 M 2026-02-24T18:27:23.779 INFO:teuthology.orchestra.run.trial170.stdout: ceph-mgr x86_64 2:20.2.0-681.g36d388f2.el9 ceph 961 k 2026-02-24T18:27:23.779 INFO:teuthology.orchestra.run.trial170.stdout: ceph-mgr-modules-core noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 290 k 2026-02-24T18:27:23.779 INFO:teuthology.orchestra.run.trial170.stdout: ceph-mon x86_64 2:20.2.0-681.g36d388f2.el9 ceph 5.1 M 2026-02-24T18:27:23.779 INFO:teuthology.orchestra.run.trial170.stdout: ceph-osd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 17 M 2026-02-24T18:27:23.779 INFO:teuthology.orchestra.run.trial170.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-24T18:27:23.779 INFO:teuthology.orchestra.run.trial170.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-24T18:27:23.779 INFO:teuthology.orchestra.run.trial170.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-24T18:27:23.779 INFO:teuthology.orchestra.run.trial170.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-24T18:27:23.779 INFO:teuthology.orchestra.run.trial170.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-24T18:27:23.779 INFO:teuthology.orchestra.run.trial170.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-24T18:27:23.779 INFO:teuthology.orchestra.run.trial170.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-24T18:27:23.779 INFO:teuthology.orchestra.run.trial170.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-24T18:27:23.779 INFO:teuthology.orchestra.run.trial170.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-24T18:27:23.779 INFO:teuthology.orchestra.run.trial170.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-24T18:27:23.779 INFO:teuthology.orchestra.run.trial170.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-24T18:27:23.779 INFO:teuthology.orchestra.run.trial170.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-24T18:27:23.779 INFO:teuthology.orchestra.run.trial170.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-24T18:27:23.779 INFO:teuthology.orchestra.run.trial170.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-24T18:27:23.779 INFO:teuthology.orchestra.run.trial170.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-24T18:27:23.779 INFO:teuthology.orchestra.run.trial170.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-24T18:27:23.779 INFO:teuthology.orchestra.run.trial170.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-24T18:27:23.780 INFO:teuthology.orchestra.run.trial170.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-24T18:27:23.780 INFO:teuthology.orchestra.run.trial170.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-24T18:27:23.780 INFO:teuthology.orchestra.run.trial170.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-24T18:27:23.780 INFO:teuthology.orchestra.run.trial170.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-24T18:27:23.780 INFO:teuthology.orchestra.run.trial170.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-24T18:27:23.780 INFO:teuthology.orchestra.run.trial170.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-24T18:27:23.780 INFO:teuthology.orchestra.run.trial170.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-24T18:27:23.780 INFO:teuthology.orchestra.run.trial170.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-24T18:27:23.780 INFO:teuthology.orchestra.run.trial170.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-24T18:27:23.780 INFO:teuthology.orchestra.run.trial170.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-24T18:27:23.780 INFO:teuthology.orchestra.run.trial170.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-24T18:27:23.780 INFO:teuthology.orchestra.run.trial170.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-24T18:27:23.780 INFO:teuthology.orchestra.run.trial170.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-24T18:27:23.780 INFO:teuthology.orchestra.run.trial170.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-24T18:27:23.780 INFO:teuthology.orchestra.run.trial170.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-24T18:27:23.780 INFO:teuthology.orchestra.run.trial170.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-24T18:27:23.780 INFO:teuthology.orchestra.run.trial170.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-24T18:27:23.780 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:27:23.780 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T18:27:23.780 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:27:23.780 INFO:teuthology.orchestra.run.trial170.stdout:Install 40 Packages 2026-02-24T18:27:23.780 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:27:23.781 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 30 M 2026-02-24T18:27:23.781 INFO:teuthology.orchestra.run.trial170.stdout:Installed size: 100 M 2026-02-24T18:27:23.781 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T18:27:23.921 INFO:teuthology.orchestra.run.trial014.stdout:(4/14): protobuf-3.14.0-17.el9.x86_64.rpm 1.5 MB/s | 1.0 MB 00:00 2026-02-24T18:27:23.923 INFO:teuthology.orchestra.run.trial014.stdout:(5/14): python3-protobuf-3.14.0-17.el9.noarch.r 959 kB/s | 267 kB 00:00 2026-02-24T18:27:24.000 INFO:teuthology.orchestra.run.trial195.stdout:(13/40): python3-requests-2.25.1-10.el9.noarch. 180 kB/s | 126 kB 00:00 2026-02-24T18:27:24.104 INFO:teuthology.orchestra.run.trial014.stdout:(6/14): abseil-cpp-20211102.0-4.el9.x86_64.rpm 3.0 MB/s | 551 kB 00:00 2026-02-24T18:27:24.125 INFO:teuthology.orchestra.run.trial014.stdout:(7/14): grpc-data-1.46.7-10.el9.noarch.rpm 934 kB/s | 19 kB 00:00 2026-02-24T18:27:24.165 INFO:teuthology.orchestra.run.trial195.stdout:(14/40): python3-urllib3-1.26.5-7.el9.noarch.rp 291 kB/s | 218 kB 00:00 2026-02-24T18:27:24.195 INFO:teuthology.orchestra.run.trial014.stdout:(8/14): python3-grpcio-1.46.7-10.el9.x86_64.rpm 29 MB/s | 2.0 MB 00:00 2026-02-24T18:27:24.217 INFO:teuthology.orchestra.run.trial014.stdout:(9/14): python3-grpcio-tools-1.46.7-10.el9.x86_ 6.6 MB/s | 144 kB 00:00 2026-02-24T18:27:24.238 INFO:teuthology.orchestra.run.trial014.stdout:(10/14): python3-repoze-lru-0.7-16.el9.noarch.r 1.5 MB/s | 31 kB 00:00 2026-02-24T18:27:24.259 INFO:teuthology.orchestra.run.trial014.stdout:(11/14): python3-routes-2.5.1-5.el9.noarch.rpm 8.5 MB/s | 188 kB 00:00 2026-02-24T18:27:24.280 INFO:teuthology.orchestra.run.trial014.stdout:(12/14): python3-xmltodict-0.12.0-15.el9.noarch 1.0 MB/s | 22 kB 00:00 2026-02-24T18:27:24.681 INFO:teuthology.orchestra.run.trial170.stdout:(1/40): ceph-20.2.0-681.g36d388f2.el9.x86_64.rp 23 kB/s | 6.5 kB 00:00 2026-02-24T18:27:24.733 INFO:teuthology.orchestra.run.trial195.stdout:(15/40): unzip-6.0-59.el9.x86_64.rpm 248 kB/s | 182 kB 00:00 2026-02-24T18:27:24.832 INFO:teuthology.orchestra.run.trial014.stdout:(13/14): protobuf-compiler-3.14.0-17.el9.x86_64 946 kB/s | 862 kB 00:00 2026-02-24T18:27:24.935 INFO:teuthology.orchestra.run.trial195.stdout:(16/40): zip-3.0-35.el9.x86_64.rpm 345 kB/s | 266 kB 00:00 2026-02-24T18:27:25.423 INFO:teuthology.orchestra.run.trial170.stdout:(2/40): ceph-mgr-20.2.0-681.g36d388f2.el9.x86_6 941 kB/s | 961 kB 00:01 2026-02-24T18:27:25.566 INFO:teuthology.orchestra.run.trial195.stdout:(17/40): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 296 kB/s | 246 kB 00:00 2026-02-24T18:27:25.597 INFO:teuthology.orchestra.run.trial195.stdout:(18/40): lua-5.4.4-4.el9.x86_64.rpm 285 kB/s | 188 kB 00:00 2026-02-24T18:27:25.777 INFO:teuthology.orchestra.run.trial195.stdout:(19/40): python3-packaging-20.9-5.el9.noarch.rp 429 kB/s | 77 kB 00:00 2026-02-24T18:27:25.826 INFO:teuthology.orchestra.run.trial195.stdout:(20/40): python3-libstoragemgmt-1.10.1-1.el9.x8 681 kB/s | 177 kB 00:00 2026-02-24T18:27:25.876 INFO:teuthology.orchestra.run.trial195.stdout:(21/40): lua-devel-5.4.4-4.el9.x86_64.rpm 444 kB/s | 22 kB 00:00 2026-02-24T18:27:25.877 INFO:teuthology.orchestra.run.trial195.stdout:(22/40): python3-toml-0.10.2-6.el9.noarch.rpm 413 kB/s | 42 kB 00:00 2026-02-24T18:27:25.912 INFO:teuthology.orchestra.run.trial014.stdout:(14/14): ceph-mgr-dashboard-20.2.0-681.g36d388f 3.6 MB/s | 11 MB 00:02 2026-02-24T18:27:25.914 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:25.914 INFO:teuthology.orchestra.run.trial014.stdout:Total 4.6 MB/s | 16 MB 00:03 2026-02-24T18:27:25.952 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T18:27:25.960 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T18:27:25.960 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T18:27:26.057 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T18:27:26.057 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T18:27:26.062 INFO:teuthology.orchestra.run.trial195.stdout:(23/40): python3-autocommand-2.2.2-8.el9.noarch 159 kB/s | 29 kB 00:00 2026-02-24T18:27:26.176 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T18:27:26.180 INFO:teuthology.orchestra.run.trial195.stdout:(24/40): luarocks-3.9.2-5.el9.noarch.rpm 497 kB/s | 151 kB 00:00 2026-02-24T18:27:26.184 INFO:teuthology.orchestra.run.trial014.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 1/14 2026-02-24T18:27:26.187 INFO:teuthology.orchestra.run.trial195.stdout:(25/40): python3-backports-tarfile-1.2.0-1.el9. 483 kB/s | 60 kB 00:00 2026-02-24T18:27:26.187 INFO:teuthology.orchestra.run.trial014.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 2/14 2026-02-24T18:27:26.192 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 3/14 2026-02-24T18:27:26.204 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 4/14 2026-02-24T18:27:26.206 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 5/14 2026-02-24T18:27:26.234 INFO:teuthology.orchestra.run.trial014.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 6/14 2026-02-24T18:27:26.244 INFO:teuthology.orchestra.run.trial195.stdout:(26/40): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 688 kB/s | 43 kB 00:00 2026-02-24T18:27:26.277 INFO:teuthology.orchestra.run.trial014.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 7/14 2026-02-24T18:27:26.306 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 8/14 2026-02-24T18:27:26.316 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 9/14 2026-02-24T18:27:26.323 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/14 2026-02-24T18:27:26.325 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 11/14 2026-02-24T18:27:26.331 INFO:teuthology.orchestra.run.trial195.stdout:(27/40): python3-cheroot-10.0.1-4.el9.noarch.rp 1.2 MB/s | 173 kB 00:00 2026-02-24T18:27:26.332 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9. 12/14 2026-02-24T18:27:26.384 INFO:teuthology.orchestra.run.trial195.stdout:(28/40): python3-cherrypy-18.6.1-2.el9.noarch.r 2.5 MB/s | 358 kB 00:00 2026-02-24T18:27:26.387 INFO:teuthology.orchestra.run.trial195.stdout:(29/40): python3-jaraco-8.2.1-3.el9.noarch.rpm 190 kB/s | 11 kB 00:00 2026-02-24T18:27:26.438 INFO:teuthology.orchestra.run.trial195.stdout:(30/40): python3-jaraco-classes-3.2.1-5.el9.noa 327 kB/s | 18 kB 00:00 2026-02-24T18:27:26.445 INFO:teuthology.orchestra.run.trial195.stdout:(31/40): python3-jaraco-collections-3.0.0-8.el9 397 kB/s | 23 kB 00:00 2026-02-24T18:27:26.492 INFO:teuthology.orchestra.run.trial195.stdout:(32/40): python3-jaraco-context-6.0.1-3.el9.noa 365 kB/s | 20 kB 00:00 2026-02-24T18:27:26.501 INFO:teuthology.orchestra.run.trial195.stdout:(33/40): python3-jaraco-functools-3.5.0-2.el9.n 347 kB/s | 19 kB 00:00 2026-02-24T18:27:26.533 INFO:teuthology.orchestra.run.trial170.stdout:(3/40): ceph-mds-20.2.0-681.g36d388f2.el9.x86_6 1.1 MB/s | 2.3 MB 00:02 2026-02-24T18:27:26.547 INFO:teuthology.orchestra.run.trial195.stdout:(34/40): python3-jaraco-text-4.0.0-2.el9.noarch 480 kB/s | 26 kB 00:00 2026-02-24T18:27:26.578 INFO:teuthology.orchestra.run.trial195.stdout:(35/40): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2026-02-24T18:27:26.601 INFO:teuthology.orchestra.run.trial195.stdout:(36/40): python3-portend-3.1.0-2.el9.noarch.rpm 306 kB/s | 16 kB 00:00 2026-02-24T18:27:26.649 INFO:teuthology.orchestra.run.trial195.stdout:(37/40): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2026-02-24T18:27:26.657 INFO:teuthology.orchestra.run.trial195.stdout:(38/40): python3-tempora-5.0.0-2.el9.noarch.rpm 641 kB/s | 36 kB 00:00 2026-02-24T18:27:26.705 INFO:teuthology.orchestra.run.trial195.stdout:(39/40): python3-zc-lockfile-2.0-10.el9.noarch. 352 kB/s | 20 kB 00:00 2026-02-24T18:27:26.732 INFO:teuthology.orchestra.run.trial170.stdout:(4/40): ceph-mgr-modules-core-20.2.0-681.g36d38 1.4 MB/s | 290 kB 00:00 2026-02-24T18:27:26.820 INFO:teuthology.orchestra.run.trial170.stdout:(5/40): ledmon-libs-1.1.0-3.el9.x86_64.rpm 463 kB/s | 40 kB 00:00 2026-02-24T18:27:26.879 INFO:teuthology.orchestra.run.trial170.stdout:(6/40): libconfig-1.7.2-9.el9.x86_64.rpm 1.2 MB/s | 72 kB 00:00 2026-02-24T18:27:26.950 INFO:teuthology.orchestra.run.trial170.stdout:(7/40): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.4 MB/s | 253 kB 00:00 2026-02-24T18:27:27.039 INFO:teuthology.orchestra.run.trial170.stdout:(8/40): python3-cryptography-36.0.1-5.el9.x86_6 14 MB/s | 1.2 MB 00:00 2026-02-24T18:27:27.066 INFO:teuthology.orchestra.run.trial170.stdout:(9/40): python3-ply-3.11-14.el9.noarch.rpm 3.9 MB/s | 106 kB 00:00 2026-02-24T18:27:27.094 INFO:teuthology.orchestra.run.trial170.stdout:(10/40): python3-pycparser-2.20-6.el9.noarch.rp 4.8 MB/s | 135 kB 00:00 2026-02-24T18:27:27.121 INFO:teuthology.orchestra.run.trial170.stdout:(11/40): python3-pyparsing-2.4.7-9.el9.noarch.r 5.4 MB/s | 150 kB 00:00 2026-02-24T18:27:27.149 INFO:teuthology.orchestra.run.trial170.stdout:(12/40): python3-requests-2.25.1-10.el9.noarch. 4.5 MB/s | 126 kB 00:00 2026-02-24T18:27:27.177 INFO:teuthology.orchestra.run.trial170.stdout:(13/40): python3-urllib3-1.26.5-7.el9.noarch.rp 7.7 MB/s | 218 kB 00:00 2026-02-24T18:27:27.205 INFO:teuthology.orchestra.run.trial170.stdout:(14/40): unzip-6.0-59.el9.x86_64.rpm 6.4 MB/s | 182 kB 00:00 2026-02-24T18:27:27.232 INFO:teuthology.orchestra.run.trial170.stdout:(15/40): zip-3.0-35.el9.x86_64.rpm 9.5 MB/s | 266 kB 00:00 2026-02-24T18:27:27.281 INFO:teuthology.orchestra.run.trial170.stdout:(16/40): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 4.9 MB/s | 246 kB 00:00 2026-02-24T18:27:27.293 INFO:teuthology.orchestra.run.trial170.stdout:(17/40): lua-5.4.4-4.el9.x86_64.rpm 16 MB/s | 188 kB 00:00 2026-02-24T18:27:27.304 INFO:teuthology.orchestra.run.trial170.stdout:(18/40): python3-libstoragemgmt-1.10.1-1.el9.x8 15 MB/s | 177 kB 00:00 2026-02-24T18:27:27.315 INFO:teuthology.orchestra.run.trial170.stdout:(19/40): python3-packaging-20.9-5.el9.noarch.rp 7.4 MB/s | 77 kB 00:00 2026-02-24T18:27:27.324 INFO:teuthology.orchestra.run.trial170.stdout:(20/40): python3-toml-0.10.2-6.el9.noarch.rpm 4.3 MB/s | 42 kB 00:00 2026-02-24T18:27:27.358 INFO:teuthology.orchestra.run.trial170.stdout:(21/40): lua-devel-5.4.4-4.el9.x86_64.rpm 677 kB/s | 22 kB 00:00 2026-02-24T18:27:27.389 INFO:teuthology.orchestra.run.trial170.stdout:(22/40): luarocks-3.9.2-5.el9.noarch.rpm 4.8 MB/s | 151 kB 00:00 2026-02-24T18:27:27.392 INFO:teuthology.orchestra.run.trial170.stdout:(23/40): python3-autocommand-2.2.2-8.el9.noarch 9.2 MB/s | 29 kB 00:00 2026-02-24T18:27:27.395 INFO:teuthology.orchestra.run.trial170.stdout:(24/40): python3-backports-tarfile-1.2.0-1.el9. 18 MB/s | 60 kB 00:00 2026-02-24T18:27:27.398 INFO:teuthology.orchestra.run.trial170.stdout:(25/40): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 13 MB/s | 43 kB 00:00 2026-02-24T18:27:27.404 INFO:teuthology.orchestra.run.trial170.stdout:(26/40): python3-cheroot-10.0.1-4.el9.noarch.rp 35 MB/s | 173 kB 00:00 2026-02-24T18:27:27.410 INFO:teuthology.orchestra.run.trial170.stdout:(27/40): python3-cherrypy-18.6.1-2.el9.noarch.r 55 MB/s | 358 kB 00:00 2026-02-24T18:27:27.413 INFO:teuthology.orchestra.run.trial170.stdout:(28/40): python3-jaraco-8.2.1-3.el9.noarch.rpm 3.4 MB/s | 11 kB 00:00 2026-02-24T18:27:27.417 INFO:teuthology.orchestra.run.trial170.stdout:(29/40): python3-jaraco-classes-3.2.1-5.el9.noa 5.6 MB/s | 18 kB 00:00 2026-02-24T18:27:27.420 INFO:teuthology.orchestra.run.trial170.stdout:(30/40): python3-jaraco-collections-3.0.0-8.el9 7.4 MB/s | 23 kB 00:00 2026-02-24T18:27:27.423 INFO:teuthology.orchestra.run.trial170.stdout:(31/40): python3-jaraco-context-6.0.1-3.el9.noa 6.3 MB/s | 20 kB 00:00 2026-02-24T18:27:27.426 INFO:teuthology.orchestra.run.trial170.stdout:(32/40): python3-jaraco-functools-3.5.0-2.el9.n 6.2 MB/s | 19 kB 00:00 2026-02-24T18:27:27.429 INFO:teuthology.orchestra.run.trial170.stdout:(33/40): python3-jaraco-text-4.0.0-2.el9.noarch 8.3 MB/s | 26 kB 00:00 2026-02-24T18:27:27.433 INFO:teuthology.orchestra.run.trial170.stdout:(34/40): python3-more-itertools-8.12.0-2.el9.no 23 MB/s | 79 kB 00:00 2026-02-24T18:27:27.436 INFO:teuthology.orchestra.run.trial170.stdout:(35/40): python3-portend-3.1.0-2.el9.noarch.rpm 5.2 MB/s | 16 kB 00:00 2026-02-24T18:27:27.439 INFO:teuthology.orchestra.run.trial170.stdout:(36/40): python3-pyOpenSSL-21.0.0-1.el9.noarch. 26 MB/s | 90 kB 00:00 2026-02-24T18:27:27.443 INFO:teuthology.orchestra.run.trial170.stdout:(37/40): python3-tempora-5.0.0-2.el9.noarch.rpm 11 MB/s | 36 kB 00:00 2026-02-24T18:27:27.446 INFO:teuthology.orchestra.run.trial170.stdout:(38/40): python3-zc-lockfile-2.0-10.el9.noarch. 6.4 MB/s | 20 kB 00:00 2026-02-24T18:27:27.468 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9 13/14 2026-02-24T18:27:27.473 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 14/14 2026-02-24T18:27:27.668 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 14/14 2026-02-24T18:27:27.669 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9 1/14 2026-02-24T18:27:27.669 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 2/14 2026-02-24T18:27:27.669 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9. 3/14 2026-02-24T18:27:27.669 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 4/14 2026-02-24T18:27:27.669 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 5/14 2026-02-24T18:27:27.669 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 6/14 2026-02-24T18:27:27.669 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 7/14 2026-02-24T18:27:27.669 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 8/14 2026-02-24T18:27:27.669 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 9/14 2026-02-24T18:27:27.669 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 10/14 2026-02-24T18:27:27.669 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 11/14 2026-02-24T18:27:27.670 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 12/14 2026-02-24T18:27:27.670 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 13/14 2026-02-24T18:27:27.729 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 14/14 2026-02-24T18:27:27.729 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:27.729 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T18:27:27.729 INFO:teuthology.orchestra.run.trial014.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-24T18:27:27.730 INFO:teuthology.orchestra.run.trial014.stdout: ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:27.730 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:27.730 INFO:teuthology.orchestra.run.trial014.stdout: ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:27.730 INFO:teuthology.orchestra.run.trial014.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-24T18:27:27.730 INFO:teuthology.orchestra.run.trial014.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-24T18:27:27.730 INFO:teuthology.orchestra.run.trial014.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-24T18:27:27.730 INFO:teuthology.orchestra.run.trial014.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-24T18:27:27.730 INFO:teuthology.orchestra.run.trial014.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-24T18:27:27.730 INFO:teuthology.orchestra.run.trial014.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-24T18:27:27.730 INFO:teuthology.orchestra.run.trial014.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-24T18:27:27.730 INFO:teuthology.orchestra.run.trial014.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-24T18:27:27.731 INFO:teuthology.orchestra.run.trial014.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-24T18:27:27.731 INFO:teuthology.orchestra.run.trial014.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-24T18:27:27.731 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:27.731 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T18:27:27.762 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-24T18:27:28.073 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:01:21 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:27:28.156 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T18:27:28.157 INFO:teuthology.orchestra.run.trial014.stdout:====================================================================================== 2026-02-24T18:27:28.157 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repository Size 2026-02-24T18:27:28.157 INFO:teuthology.orchestra.run.trial014.stdout:====================================================================================== 2026-02-24T18:27:28.157 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T18:27:28.157 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 7.4 M 2026-02-24T18:27:28.157 INFO:teuthology.orchestra.run.trial014.stdout:Installing dependencies: 2026-02-24T18:27:28.157 INFO:teuthology.orchestra.run.trial014.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-24T18:27:28.157 INFO:teuthology.orchestra.run.trial014.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-24T18:27:28.157 INFO:teuthology.orchestra.run.trial014.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-24T18:27:28.157 INFO:teuthology.orchestra.run.trial014.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-24T18:27:28.157 INFO:teuthology.orchestra.run.trial014.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-24T18:27:28.157 INFO:teuthology.orchestra.run.trial014.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-24T18:27:28.157 INFO:teuthology.orchestra.run.trial014.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-24T18:27:28.157 INFO:teuthology.orchestra.run.trial014.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-24T18:27:28.157 INFO:teuthology.orchestra.run.trial014.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-24T18:27:28.157 INFO:teuthology.orchestra.run.trial014.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-24T18:27:28.157 INFO:teuthology.orchestra.run.trial014.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-24T18:27:28.157 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:28.157 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T18:27:28.157 INFO:teuthology.orchestra.run.trial014.stdout:====================================================================================== 2026-02-24T18:27:28.157 INFO:teuthology.orchestra.run.trial014.stdout:Install 12 Packages 2026-02-24T18:27:28.157 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:28.158 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 43 M 2026-02-24T18:27:28.158 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 234 M 2026-02-24T18:27:28.158 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T18:27:28.608 INFO:teuthology.orchestra.run.trial044.stdout:(40/40): ceph-osd-20.2.0-681.g36d388f2.el9.x86_ 1.6 MB/s | 17 MB 00:10 2026-02-24T18:27:28.610 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:28.610 INFO:teuthology.orchestra.run.trial044.stdout:Total 2.4 MB/s | 30 MB 00:12 2026-02-24T18:27:28.748 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T18:27:28.766 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T18:27:28.766 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T18:27:28.865 INFO:teuthology.orchestra.run.trial170.stdout:(39/40): ceph-osd-20.2.0-681.g36d388f2.el9.x86_ 4.9 MB/s | 17 MB 00:03 2026-02-24T18:27:28.913 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T18:27:28.913 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T18:27:29.081 INFO:teuthology.orchestra.run.trial170.stdout:(40/40): ceph-mon-20.2.0-681.g36d388f2.el9.x86_ 1.2 MB/s | 5.1 MB 00:04 2026-02-24T18:27:29.083 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:29.083 INFO:teuthology.orchestra.run.trial170.stdout:Total 5.7 MB/s | 30 MB 00:05 2026-02-24T18:27:29.095 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T18:27:29.097 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/40 2026-02-24T18:27:29.102 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/40 2026-02-24T18:27:29.107 INFO:teuthology.orchestra.run.trial044.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/40 2026-02-24T18:27:29.109 INFO:teuthology.orchestra.run.trial044.stdout: Installing : unzip-6.0-59.el9.x86_64 4/40 2026-02-24T18:27:29.115 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 5/40 2026-02-24T18:27:29.122 INFO:teuthology.orchestra.run.trial014.stdout:(1/12): libquadmath-11.5.0-14.el9.x86_64.rpm 283 kB/s | 184 kB 00:00 2026-02-24T18:27:29.140 INFO:teuthology.orchestra.run.trial044.stdout: Installing : zip-3.0-35.el9.x86_64 6/40 2026-02-24T18:27:29.145 INFO:teuthology.orchestra.run.trial044.stdout: Installing : luarocks-3.9.2-5.el9.noarch 7/40 2026-02-24T18:27:29.150 INFO:teuthology.orchestra.run.trial044.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 8/40 2026-02-24T18:27:29.154 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 9/40 2026-02-24T18:27:29.161 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 10/40 2026-02-24T18:27:29.164 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 11/40 2026-02-24T18:27:29.170 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 12/40 2026-02-24T18:27:29.173 INFO:teuthology.orchestra.run.trial014.stdout:(2/12): flexiblas-3.0.4-9.el9.x86_64.rpm 581 kB/s | 30 kB 00:00 2026-02-24T18:27:29.176 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 13/40 2026-02-24T18:27:29.179 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 14/40 2026-02-24T18:27:29.185 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 15/40 2026-02-24T18:27:29.189 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 16/40 2026-02-24T18:27:29.195 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 17/40 2026-02-24T18:27:29.199 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 18/40 2026-02-24T18:27:29.220 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T18:27:29.222 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 19/40 2026-02-24T18:27:29.235 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/40 2026-02-24T18:27:29.235 INFO:teuthology.orchestra.run.trial014.stdout:(3/12): flexiblas-netlib-3.0.4-9.el9.x86_64.rpm 48 MB/s | 3.0 MB 00:00 2026-02-24T18:27:29.238 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T18:27:29.238 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T18:27:29.240 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/40 2026-02-24T18:27:29.250 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 22/40 2026-02-24T18:27:29.257 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-packaging-20.9-5.el9.noarch 23/40 2026-02-24T18:27:29.270 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/40 2026-02-24T18:27:29.271 INFO:teuthology.orchestra.run.trial014.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-9.el9.x 420 kB/s | 15 kB 00:00 2026-02-24T18:27:29.286 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/40 2026-02-24T18:27:29.298 INFO:teuthology.orchestra.run.trial014.stdout:(5/12): openblas-0.3.29-1.el9.x86_64.rpm 1.5 MB/s | 42 kB 00:00 2026-02-24T18:27:29.362 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/40 2026-02-24T18:27:29.369 INFO:teuthology.orchestra.run.trial014.stdout:(6/12): openblas-openmp-0.3.29-1.el9.x86_64.rpm 75 MB/s | 5.3 MB 00:00 2026-02-24T18:27:29.371 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 27/40 2026-02-24T18:27:29.383 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T18:27:29.383 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T18:27:29.395 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/40 2026-02-24T18:27:29.403 INFO:teuthology.orchestra.run.trial014.stdout:(7/12): python3-devel-3.9.25-3.el9.x86_64.rpm 7.0 MB/s | 244 kB 00:00 2026-02-24T18:27:29.425 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 29/40 2026-02-24T18:27:29.430 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/40 2026-02-24T18:27:29.478 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/40 2026-02-24T18:27:29.480 INFO:teuthology.orchestra.run.trial014.stdout:(8/12): python3-numpy-1.23.5-2.el9.x86_64.rpm 80 MB/s | 6.1 MB 00:00 2026-02-24T18:27:29.514 INFO:teuthology.orchestra.run.trial014.stdout:(9/12): python3-numpy-f2py-1.23.5-2.el9.x86_64. 13 MB/s | 442 kB 00:00 2026-02-24T18:27:29.521 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.n 32/40 2026-02-24T18:27:29.522 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 33/40 2026-02-24T18:27:29.546 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 33/40 2026-02-24T18:27:29.546 INFO:teuthology.orchestra.run.trial044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:29.546 INFO:teuthology.orchestra.run.trial044.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-24T18:27:29.547 INFO:teuthology.orchestra.run.trial044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T18:27:29.547 INFO:teuthology.orchestra.run.trial044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T18:27:29.547 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:29.550 INFO:teuthology.orchestra.run.trial044.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 34/40 2026-02-24T18:27:29.564 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T18:27:29.566 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/40 2026-02-24T18:27:29.568 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-24T18:27:29.568 INFO:teuthology.orchestra.run.trial044.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-24T18:27:29.568 INFO:teuthology.orchestra.run.trial044.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-24T18:27:29.568 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:29.570 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/40 2026-02-24T18:27:29.575 INFO:teuthology.orchestra.run.trial170.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/40 2026-02-24T18:27:29.577 INFO:teuthology.orchestra.run.trial044.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-24T18:27:29.578 INFO:teuthology.orchestra.run.trial170.stdout: Installing : unzip-6.0-59.el9.x86_64 4/40 2026-02-24T18:27:29.583 INFO:teuthology.orchestra.run.trial170.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 5/40 2026-02-24T18:27:29.600 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-24T18:27:29.600 INFO:teuthology.orchestra.run.trial044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-24T18:27:29.600 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:29.607 INFO:teuthology.orchestra.run.trial170.stdout: Installing : zip-3.0-35.el9.x86_64 6/40 2026-02-24T18:27:29.612 INFO:teuthology.orchestra.run.trial170.stdout: Installing : luarocks-3.9.2-5.el9.noarch 7/40 2026-02-24T18:27:29.617 INFO:teuthology.orchestra.run.trial170.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 8/40 2026-02-24T18:27:29.621 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 9/40 2026-02-24T18:27:29.627 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 10/40 2026-02-24T18:27:29.631 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 11/40 2026-02-24T18:27:29.637 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 12/40 2026-02-24T18:27:29.642 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 13/40 2026-02-24T18:27:29.646 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 14/40 2026-02-24T18:27:29.652 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 15/40 2026-02-24T18:27:29.655 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 16/40 2026-02-24T18:27:29.662 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 17/40 2026-02-24T18:27:29.665 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 18/40 2026-02-24T18:27:29.687 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 19/40 2026-02-24T18:27:29.699 INFO:teuthology.orchestra.run.trial014.stdout:(10/12): python3-scipy-1.9.3-2.el9.x86_64.rpm 104 MB/s | 19 MB 00:00 2026-02-24T18:27:29.700 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/40 2026-02-24T18:27:29.705 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/40 2026-02-24T18:27:29.715 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 22/40 2026-02-24T18:27:29.721 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-packaging-20.9-5.el9.noarch 23/40 2026-02-24T18:27:29.735 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/40 2026-02-24T18:27:29.744 INFO:teuthology.orchestra.run.trial014.stdout:(11/12): libgfortran-11.5.0-14.el9.x86_64.rpm 624 kB/s | 794 kB 00:01 2026-02-24T18:27:29.750 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/40 2026-02-24T18:27:29.825 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/40 2026-02-24T18:27:29.834 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 27/40 2026-02-24T18:27:29.857 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/40 2026-02-24T18:27:29.886 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 29/40 2026-02-24T18:27:29.891 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/40 2026-02-24T18:27:29.938 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/40 2026-02-24T18:27:29.982 INFO:teuthology.orchestra.run.trial170.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.n 32/40 2026-02-24T18:27:29.983 INFO:teuthology.orchestra.run.trial170.stdout: Installing : ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 33/40 2026-02-24T18:27:30.006 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 33/40 2026-02-24T18:27:30.006 INFO:teuthology.orchestra.run.trial170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:30.006 INFO:teuthology.orchestra.run.trial170.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-24T18:27:30.006 INFO:teuthology.orchestra.run.trial170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T18:27:30.006 INFO:teuthology.orchestra.run.trial170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T18:27:30.006 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:27:30.012 INFO:teuthology.orchestra.run.trial170.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 34/40 2026-02-24T18:27:30.027 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-24T18:27:30.028 INFO:teuthology.orchestra.run.trial170.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-24T18:27:30.028 INFO:teuthology.orchestra.run.trial170.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-24T18:27:30.028 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:27:30.036 INFO:teuthology.orchestra.run.trial170.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-24T18:27:30.059 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-24T18:27:30.059 INFO:teuthology.orchestra.run.trial170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-24T18:27:30.059 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:27:30.284 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 36/40 2026-02-24T18:27:30.285 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 37/40 2026-02-24T18:27:30.311 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 37/40 2026-02-24T18:27:30.311 INFO:teuthology.orchestra.run.trial044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:30.312 INFO:teuthology.orchestra.run.trial044.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-24T18:27:30.312 INFO:teuthology.orchestra.run.trial044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T18:27:30.312 INFO:teuthology.orchestra.run.trial044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T18:27:30.312 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:30.523 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 38/40 2026-02-24T18:27:30.545 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 38/40 2026-02-24T18:27:30.545 INFO:teuthology.orchestra.run.trial044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:30.546 INFO:teuthology.orchestra.run.trial044.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-24T18:27:30.546 INFO:teuthology.orchestra.run.trial044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T18:27:30.546 INFO:teuthology.orchestra.run.trial044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T18:27:30.546 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:30.643 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 39/40 2026-02-24T18:27:30.665 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 39/40 2026-02-24T18:27:30.665 INFO:teuthology.orchestra.run.trial044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:30.665 INFO:teuthology.orchestra.run.trial044.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-24T18:27:30.665 INFO:teuthology.orchestra.run.trial044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T18:27:30.665 INFO:teuthology.orchestra.run.trial044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T18:27:30.665 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:30.684 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-2:20.2.0-681.g36d388f2.el9.x86_64 40/40 2026-02-24T18:27:30.743 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 36/40 2026-02-24T18:27:30.745 INFO:teuthology.orchestra.run.trial170.stdout: Installing : ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 37/40 2026-02-24T18:27:30.770 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 37/40 2026-02-24T18:27:30.770 INFO:teuthology.orchestra.run.trial170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:30.770 INFO:teuthology.orchestra.run.trial170.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-24T18:27:30.770 INFO:teuthology.orchestra.run.trial170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T18:27:30.770 INFO:teuthology.orchestra.run.trial170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T18:27:30.770 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:27:30.981 INFO:teuthology.orchestra.run.trial170.stdout: Installing : ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 38/40 2026-02-24T18:27:31.003 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 38/40 2026-02-24T18:27:31.003 INFO:teuthology.orchestra.run.trial170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:31.003 INFO:teuthology.orchestra.run.trial170.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-24T18:27:31.003 INFO:teuthology.orchestra.run.trial170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T18:27:31.003 INFO:teuthology.orchestra.run.trial170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T18:27:31.003 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:27:31.029 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-2:20.2.0-681.g36d388f2.el9.x86_64 40/40 2026-02-24T18:27:31.029 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-2:20.2.0-681.g36d388f2.el9.x86_64 1/40 2026-02-24T18:27:31.029 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 2/40 2026-02-24T18:27:31.029 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 3/40 2026-02-24T18:27:31.029 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 4/40 2026-02-24T18:27:31.029 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 5/40 2026-02-24T18:27:31.029 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.n 6/40 2026-02-24T18:27:31.029 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 7/40 2026-02-24T18:27:31.030 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 8/40 2026-02-24T18:27:31.030 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 9/40 2026-02-24T18:27:31.030 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 10/40 2026-02-24T18:27:31.030 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-ply-3.11-14.el9.noarch 11/40 2026-02-24T18:27:31.030 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 12/40 2026-02-24T18:27:31.030 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 13/40 2026-02-24T18:27:31.030 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 14/40 2026-02-24T18:27:31.030 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 15/40 2026-02-24T18:27:31.030 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : unzip-6.0-59.el9.x86_64 16/40 2026-02-24T18:27:31.030 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : zip-3.0-35.el9.x86_64 17/40 2026-02-24T18:27:31.030 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 18/40 2026-02-24T18:27:31.030 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : lua-5.4.4-4.el9.x86_64 19/40 2026-02-24T18:27:31.030 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 20/40 2026-02-24T18:27:31.030 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 21/40 2026-02-24T18:27:31.030 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 22/40 2026-02-24T18:27:31.030 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 23/40 2026-02-24T18:27:31.030 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 24/40 2026-02-24T18:27:31.030 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 25/40 2026-02-24T18:27:31.030 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 26/40 2026-02-24T18:27:31.030 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 27/40 2026-02-24T18:27:31.030 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 28/40 2026-02-24T18:27:31.030 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 29/40 2026-02-24T18:27:31.030 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 30/40 2026-02-24T18:27:31.030 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 31/40 2026-02-24T18:27:31.030 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 32/40 2026-02-24T18:27:31.030 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 33/40 2026-02-24T18:27:31.030 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 34/40 2026-02-24T18:27:31.030 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 35/40 2026-02-24T18:27:31.030 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 36/40 2026-02-24T18:27:31.030 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 37/40 2026-02-24T18:27:31.030 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 38/40 2026-02-24T18:27:31.031 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 39/40 2026-02-24T18:27:31.091 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 40/40 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: ceph-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: lua-5.4.4-4.el9.x86_64 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: python3-ply-3.11-14.el9.noarch 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-24T18:27:31.092 INFO:teuthology.orchestra.run.trial044.stdout: unzip-6.0-59.el9.x86_64 2026-02-24T18:27:31.093 INFO:teuthology.orchestra.run.trial044.stdout: zip-3.0-35.el9.x86_64 2026-02-24T18:27:31.093 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:31.093 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T18:27:31.099 INFO:teuthology.orchestra.run.trial170.stdout: Installing : ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 39/40 2026-02-24T18:27:31.121 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 39/40 2026-02-24T18:27:31.121 INFO:teuthology.orchestra.run.trial170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:31.121 INFO:teuthology.orchestra.run.trial170.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-24T18:27:31.121 INFO:teuthology.orchestra.run.trial170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T18:27:31.121 INFO:teuthology.orchestra.run.trial170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T18:27:31.121 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:27:31.126 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install ceph-base 2026-02-24T18:27:31.140 INFO:teuthology.orchestra.run.trial170.stdout: Installing : ceph-2:20.2.0-681.g36d388f2.el9.x86_64 40/40 2026-02-24T18:27:31.145 INFO:teuthology.orchestra.run.trial014.stdout:(12/12): ceph-mgr-diskprediction-local-20.2.0-6 2.8 MB/s | 7.4 MB 00:02 2026-02-24T18:27:31.148 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:31.148 INFO:teuthology.orchestra.run.trial014.stdout:Total 14 MB/s | 43 MB 00:02 2026-02-24T18:27:31.308 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T18:27:31.321 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T18:27:31.321 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T18:27:31.440 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:01:24 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:27:31.469 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: ceph-2:20.2.0-681.g36d388f2.el9.x86_64 40/40 2026-02-24T18:27:31.469 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : ceph-2:20.2.0-681.g36d388f2.el9.x86_64 1/40 2026-02-24T18:27:31.469 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 2/40 2026-02-24T18:27:31.470 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 3/40 2026-02-24T18:27:31.470 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 4/40 2026-02-24T18:27:31.470 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 5/40 2026-02-24T18:27:31.470 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.n 6/40 2026-02-24T18:27:31.470 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 7/40 2026-02-24T18:27:31.470 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 8/40 2026-02-24T18:27:31.470 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 9/40 2026-02-24T18:27:31.470 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 10/40 2026-02-24T18:27:31.470 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-ply-3.11-14.el9.noarch 11/40 2026-02-24T18:27:31.470 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 12/40 2026-02-24T18:27:31.470 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 13/40 2026-02-24T18:27:31.470 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 14/40 2026-02-24T18:27:31.470 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 15/40 2026-02-24T18:27:31.470 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : unzip-6.0-59.el9.x86_64 16/40 2026-02-24T18:27:31.470 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : zip-3.0-35.el9.x86_64 17/40 2026-02-24T18:27:31.470 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 18/40 2026-02-24T18:27:31.470 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : lua-5.4.4-4.el9.x86_64 19/40 2026-02-24T18:27:31.470 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 20/40 2026-02-24T18:27:31.470 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 21/40 2026-02-24T18:27:31.470 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 22/40 2026-02-24T18:27:31.470 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 23/40 2026-02-24T18:27:31.470 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 24/40 2026-02-24T18:27:31.470 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 25/40 2026-02-24T18:27:31.470 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 26/40 2026-02-24T18:27:31.470 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 27/40 2026-02-24T18:27:31.470 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 28/40 2026-02-24T18:27:31.470 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 29/40 2026-02-24T18:27:31.470 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 30/40 2026-02-24T18:27:31.470 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 31/40 2026-02-24T18:27:31.470 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 32/40 2026-02-24T18:27:31.470 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 33/40 2026-02-24T18:27:31.470 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 34/40 2026-02-24T18:27:31.470 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 35/40 2026-02-24T18:27:31.470 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 36/40 2026-02-24T18:27:31.470 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 37/40 2026-02-24T18:27:31.470 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 38/40 2026-02-24T18:27:31.470 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 39/40 2026-02-24T18:27:31.505 INFO:teuthology.orchestra.run.trial044.stdout:Package ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:31.522 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T18:27:31.522 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T18:27:31.523 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T18:27:31.524 INFO:teuthology.orchestra.run.trial044.stdout:Nothing to do. 2026-02-24T18:27:31.524 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T18:27:31.531 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 40/40 2026-02-24T18:27:31.532 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:27:31.532 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T18:27:31.532 INFO:teuthology.orchestra.run.trial170.stdout: ceph-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:31.532 INFO:teuthology.orchestra.run.trial170.stdout: ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:31.532 INFO:teuthology.orchestra.run.trial170.stdout: ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:31.532 INFO:teuthology.orchestra.run.trial170.stdout: ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:31.532 INFO:teuthology.orchestra.run.trial170.stdout: ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:31.532 INFO:teuthology.orchestra.run.trial170.stdout: ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:31.532 INFO:teuthology.orchestra.run.trial170.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-24T18:27:31.532 INFO:teuthology.orchestra.run.trial170.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-24T18:27:31.532 INFO:teuthology.orchestra.run.trial170.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T18:27:31.533 INFO:teuthology.orchestra.run.trial170.stdout: lua-5.4.4-4.el9.x86_64 2026-02-24T18:27:31.533 INFO:teuthology.orchestra.run.trial170.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-24T18:27:31.533 INFO:teuthology.orchestra.run.trial170.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-24T18:27:31.533 INFO:teuthology.orchestra.run.trial170.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-24T18:27:31.533 INFO:teuthology.orchestra.run.trial170.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-24T18:27:31.533 INFO:teuthology.orchestra.run.trial170.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-24T18:27:31.533 INFO:teuthology.orchestra.run.trial170.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-24T18:27:31.533 INFO:teuthology.orchestra.run.trial170.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-24T18:27:31.533 INFO:teuthology.orchestra.run.trial170.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-24T18:27:31.533 INFO:teuthology.orchestra.run.trial170.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-24T18:27:31.533 INFO:teuthology.orchestra.run.trial170.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-24T18:27:31.533 INFO:teuthology.orchestra.run.trial170.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-24T18:27:31.534 INFO:teuthology.orchestra.run.trial170.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-24T18:27:31.534 INFO:teuthology.orchestra.run.trial170.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-24T18:27:31.534 INFO:teuthology.orchestra.run.trial170.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-24T18:27:31.534 INFO:teuthology.orchestra.run.trial170.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-24T18:27:31.534 INFO:teuthology.orchestra.run.trial170.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T18:27:31.534 INFO:teuthology.orchestra.run.trial170.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-24T18:27:31.534 INFO:teuthology.orchestra.run.trial170.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-24T18:27:31.534 INFO:teuthology.orchestra.run.trial170.stdout: python3-ply-3.11-14.el9.noarch 2026-02-24T18:27:31.534 INFO:teuthology.orchestra.run.trial170.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-24T18:27:31.534 INFO:teuthology.orchestra.run.trial170.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-24T18:27:31.534 INFO:teuthology.orchestra.run.trial170.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-24T18:27:31.534 INFO:teuthology.orchestra.run.trial170.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-24T18:27:31.535 INFO:teuthology.orchestra.run.trial170.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-24T18:27:31.535 INFO:teuthology.orchestra.run.trial170.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-24T18:27:31.535 INFO:teuthology.orchestra.run.trial170.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-24T18:27:31.535 INFO:teuthology.orchestra.run.trial170.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-24T18:27:31.535 INFO:teuthology.orchestra.run.trial170.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-24T18:27:31.535 INFO:teuthology.orchestra.run.trial170.stdout: unzip-6.0-59.el9.x86_64 2026-02-24T18:27:31.535 INFO:teuthology.orchestra.run.trial170.stdout: zip-3.0-35.el9.x86_64 2026-02-24T18:27:31.535 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:27:31.535 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T18:27:31.544 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install cephadm 2026-02-24T18:27:31.568 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install ceph-base 2026-02-24T18:27:31.740 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T18:27:31.742 INFO:teuthology.orchestra.run.trial014.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 1/12 2026-02-24T18:27:31.750 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 2/12 2026-02-24T18:27:31.784 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 3/12 2026-02-24T18:27:31.788 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 4/12 2026-02-24T18:27:31.821 INFO:teuthology.orchestra.run.trial195.stdout:(40/40): ceph-osd-20.2.0-681.g36d388f2.el9.x86_ 1.4 MB/s | 17 MB 00:12 2026-02-24T18:27:31.823 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:31.823 INFO:teuthology.orchestra.run.trial195.stdout:Total 2.3 MB/s | 30 MB 00:13 2026-02-24T18:27:31.847 INFO:teuthology.orchestra.run.trial014.stdout: Installing : openblas-0.3.29-1.el9.x86_64 5/12 2026-02-24T18:27:31.850 INFO:teuthology.orchestra.run.trial014.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 6/12 2026-02-24T18:27:31.857 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:01:24 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:27:31.872 INFO:teuthology.orchestra.run.trial014.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 7/12 2026-02-24T18:27:31.885 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:01:27 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T18:27:31.939 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T18:27:31.939 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:27:31.940 INFO:teuthology.orchestra.run.trial044.stdout: Package Arch Version Repository Size 2026-02-24T18:27:31.940 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:27:31.940 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T18:27:31.940 INFO:teuthology.orchestra.run.trial044.stdout: cephadm noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 1.0 M 2026-02-24T18:27:31.940 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:31.940 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T18:27:31.940 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:27:31.940 INFO:teuthology.orchestra.run.trial044.stdout:Install 1 Package 2026-02-24T18:27:31.940 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:31.940 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 1.0 M 2026-02-24T18:27:31.940 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 1.0 M 2026-02-24T18:27:31.941 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T18:27:31.949 INFO:teuthology.orchestra.run.trial170.stdout:Package ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:31.958 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T18:27:31.967 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T18:27:31.967 INFO:teuthology.orchestra.run.trial170.stdout:Nothing to do. 2026-02-24T18:27:31.968 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T18:27:31.976 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T18:27:31.976 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T18:27:31.989 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install cephadm 2026-02-24T18:27:32.122 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T18:27:32.122 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T18:27:32.196 INFO:teuthology.orchestra.run.trial014.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 8/12 2026-02-24T18:27:32.269 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 9/12 2026-02-24T18:27:32.302 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:01:28 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T18:27:32.302 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T18:27:32.304 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/40 2026-02-24T18:27:32.309 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/40 2026-02-24T18:27:32.314 INFO:teuthology.orchestra.run.trial195.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/40 2026-02-24T18:27:32.316 INFO:teuthology.orchestra.run.trial195.stdout: Installing : unzip-6.0-59.el9.x86_64 4/40 2026-02-24T18:27:32.322 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 5/40 2026-02-24T18:27:32.346 INFO:teuthology.orchestra.run.trial195.stdout: Installing : zip-3.0-35.el9.x86_64 6/40 2026-02-24T18:27:32.349 INFO:teuthology.orchestra.run.trial195.stdout: Installing : luarocks-3.9.2-5.el9.noarch 7/40 2026-02-24T18:27:32.354 INFO:teuthology.orchestra.run.trial195.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 8/40 2026-02-24T18:27:32.359 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 9/40 2026-02-24T18:27:32.365 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 10/40 2026-02-24T18:27:32.369 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 11/40 2026-02-24T18:27:32.375 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 12/40 2026-02-24T18:27:32.380 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 13/40 2026-02-24T18:27:32.383 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 14/40 2026-02-24T18:27:32.386 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T18:27:32.386 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:27:32.386 INFO:teuthology.orchestra.run.trial170.stdout: Package Arch Version Repository Size 2026-02-24T18:27:32.386 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:27:32.386 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T18:27:32.386 INFO:teuthology.orchestra.run.trial170.stdout: cephadm noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 1.0 M 2026-02-24T18:27:32.386 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:27:32.386 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T18:27:32.386 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:27:32.386 INFO:teuthology.orchestra.run.trial170.stdout:Install 1 Package 2026-02-24T18:27:32.386 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:27:32.386 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 1.0 M 2026-02-24T18:27:32.386 INFO:teuthology.orchestra.run.trial170.stdout:Installed size: 1.0 M 2026-02-24T18:27:32.386 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T18:27:32.389 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 15/40 2026-02-24T18:27:32.393 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 16/40 2026-02-24T18:27:32.400 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 17/40 2026-02-24T18:27:32.403 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 18/40 2026-02-24T18:27:32.426 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 19/40 2026-02-24T18:27:32.438 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/40 2026-02-24T18:27:32.444 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/40 2026-02-24T18:27:32.453 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 22/40 2026-02-24T18:27:32.460 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-packaging-20.9-5.el9.noarch 23/40 2026-02-24T18:27:32.473 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/40 2026-02-24T18:27:32.488 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/40 2026-02-24T18:27:32.563 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/40 2026-02-24T18:27:32.572 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 27/40 2026-02-24T18:27:32.594 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/40 2026-02-24T18:27:32.624 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 29/40 2026-02-24T18:27:32.629 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/40 2026-02-24T18:27:32.676 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/40 2026-02-24T18:27:32.719 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.n 32/40 2026-02-24T18:27:32.720 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 33/40 2026-02-24T18:27:32.744 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 33/40 2026-02-24T18:27:32.744 INFO:teuthology.orchestra.run.trial195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:32.744 INFO:teuthology.orchestra.run.trial195.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-24T18:27:32.744 INFO:teuthology.orchestra.run.trial195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T18:27:32.744 INFO:teuthology.orchestra.run.trial195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T18:27:32.744 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:32.749 INFO:teuthology.orchestra.run.trial195.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 34/40 2026-02-24T18:27:32.765 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-24T18:27:32.766 INFO:teuthology.orchestra.run.trial195.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-24T18:27:32.766 INFO:teuthology.orchestra.run.trial195.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-24T18:27:32.766 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:32.774 INFO:teuthology.orchestra.run.trial195.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-24T18:27:32.798 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-24T18:27:32.798 INFO:teuthology.orchestra.run.trial195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-24T18:27:32.798 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:32.938 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 10/12 2026-02-24T18:27:33.252 INFO:teuthology.orchestra.run.trial044.stdout:cephadm-20.2.0-681.g36d388f2.el9.noarch.rpm 778 kB/s | 1.0 MB 00:01 2026-02-24T18:27:33.252 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:33.252 INFO:teuthology.orchestra.run.trial044.stdout:Total 778 kB/s | 1.0 MB 00:01 2026-02-24T18:27:33.252 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T18:27:33.255 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T18:27:33.256 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T18:27:33.260 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T18:27:33.260 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T18:27:33.279 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T18:27:33.347 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:33.361 INFO:teuthology.orchestra.run.trial044.stdout: Installing : cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:33.391 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 11/12 2026-02-24T18:27:33.392 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 12/12 2026-02-24T18:27:33.430 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:33.489 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:33.489 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:33.489 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T18:27:33.489 INFO:teuthology.orchestra.run.trial044.stdout: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:33.489 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:33.489 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T18:27:33.496 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 36/40 2026-02-24T18:27:33.498 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 37/40 2026-02-24T18:27:33.516 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install ceph-immutable-object-cache 2026-02-24T18:27:33.523 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 37/40 2026-02-24T18:27:33.523 INFO:teuthology.orchestra.run.trial195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:33.523 INFO:teuthology.orchestra.run.trial195.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-24T18:27:33.523 INFO:teuthology.orchestra.run.trial195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T18:27:33.523 INFO:teuthology.orchestra.run.trial195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T18:27:33.523 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:33.694 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 12/12 2026-02-24T18:27:33.694 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 1/12 2026-02-24T18:27:33.694 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 2/12 2026-02-24T18:27:33.694 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 3/12 2026-02-24T18:27:33.694 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 4/12 2026-02-24T18:27:33.694 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 5/12 2026-02-24T18:27:33.694 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 6/12 2026-02-24T18:27:33.695 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 7/12 2026-02-24T18:27:33.695 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 8/12 2026-02-24T18:27:33.695 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 9/12 2026-02-24T18:27:33.695 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 10/12 2026-02-24T18:27:33.695 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 11/12 2026-02-24T18:27:33.721 INFO:teuthology.orchestra.run.trial170.stdout:cephadm-20.2.0-681.g36d388f2.el9.noarch.rpm 766 kB/s | 1.0 MB 00:01 2026-02-24T18:27:33.722 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:33.722 INFO:teuthology.orchestra.run.trial170.stdout:Total 765 kB/s | 1.0 MB 00:01 2026-02-24T18:27:33.722 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T18:27:33.725 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T18:27:33.725 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T18:27:33.729 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T18:27:33.729 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T18:27:33.743 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 38/40 2026-02-24T18:27:33.748 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T18:27:33.757 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 12/12 2026-02-24T18:27:33.757 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:33.757 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T18:27:33.757 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:33.757 INFO:teuthology.orchestra.run.trial014.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-24T18:27:33.758 INFO:teuthology.orchestra.run.trial014.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-24T18:27:33.758 INFO:teuthology.orchestra.run.trial014.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-24T18:27:33.758 INFO:teuthology.orchestra.run.trial014.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-24T18:27:33.758 INFO:teuthology.orchestra.run.trial014.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-24T18:27:33.758 INFO:teuthology.orchestra.run.trial014.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-24T18:27:33.758 INFO:teuthology.orchestra.run.trial014.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-24T18:27:33.758 INFO:teuthology.orchestra.run.trial014.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-24T18:27:33.758 INFO:teuthology.orchestra.run.trial014.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-24T18:27:33.758 INFO:teuthology.orchestra.run.trial014.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-24T18:27:33.758 INFO:teuthology.orchestra.run.trial014.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-24T18:27:33.758 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:33.759 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T18:27:33.765 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 38/40 2026-02-24T18:27:33.765 INFO:teuthology.orchestra.run.trial195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:33.765 INFO:teuthology.orchestra.run.trial195.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-24T18:27:33.765 INFO:teuthology.orchestra.run.trial195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T18:27:33.765 INFO:teuthology.orchestra.run.trial195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T18:27:33.765 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:33.797 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install ceph-mgr-rook 2026-02-24T18:27:33.815 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:33.829 INFO:teuthology.orchestra.run.trial170.stdout: Installing : cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:33.831 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:01:26 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:27:33.863 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 39/40 2026-02-24T18:27:33.884 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 39/40 2026-02-24T18:27:33.884 INFO:teuthology.orchestra.run.trial195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:33.884 INFO:teuthology.orchestra.run.trial195.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-24T18:27:33.884 INFO:teuthology.orchestra.run.trial195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T18:27:33.884 INFO:teuthology.orchestra.run.trial195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T18:27:33.884 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:33.901 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-2:20.2.0-681.g36d388f2.el9.x86_64 40/40 2026-02-24T18:27:33.905 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:33.913 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T18:27:33.914 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:27:33.914 INFO:teuthology.orchestra.run.trial044.stdout: Package Arch Version Repo Size 2026-02-24T18:27:33.914 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:27:33.914 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T18:27:33.914 INFO:teuthology.orchestra.run.trial044.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-681.g36d388f2.el9 ceph 154 k 2026-02-24T18:27:33.915 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:33.915 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T18:27:33.915 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:27:33.915 INFO:teuthology.orchestra.run.trial044.stdout:Install 1 Package 2026-02-24T18:27:33.915 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:33.915 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 154 k 2026-02-24T18:27:33.915 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 447 k 2026-02-24T18:27:33.915 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T18:27:33.963 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:33.963 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:27:33.963 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T18:27:33.963 INFO:teuthology.orchestra.run.trial170.stdout: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:33.963 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:27:33.964 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T18:27:33.990 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install ceph-immutable-object-cache 2026-02-24T18:27:34.111 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:01:27 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:27:34.195 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T18:27:34.196 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:34.196 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repository Size 2026-02-24T18:27:34.196 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:34.196 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T18:27:34.196 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-rook noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 50 k 2026-02-24T18:27:34.196 INFO:teuthology.orchestra.run.trial014.stdout:Installing dependencies: 2026-02-24T18:27:34.196 INFO:teuthology.orchestra.run.trial014.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-24T18:27:34.196 INFO:teuthology.orchestra.run.trial014.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-24T18:27:34.197 INFO:teuthology.orchestra.run.trial014.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-24T18:27:34.197 INFO:teuthology.orchestra.run.trial014.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-24T18:27:34.197 INFO:teuthology.orchestra.run.trial014.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-24T18:27:34.197 INFO:teuthology.orchestra.run.trial014.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-24T18:27:34.197 INFO:teuthology.orchestra.run.trial014.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-24T18:27:34.197 INFO:teuthology.orchestra.run.trial014.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-24T18:27:34.197 INFO:teuthology.orchestra.run.trial014.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-24T18:27:34.197 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:34.197 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T18:27:34.197 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:34.197 INFO:teuthology.orchestra.run.trial014.stdout:Install 10 Packages 2026-02-24T18:27:34.198 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:34.198 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 2.0 M 2026-02-24T18:27:34.198 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 25 M 2026-02-24T18:27:34.198 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T18:27:34.241 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-2:20.2.0-681.g36d388f2.el9.x86_64 40/40 2026-02-24T18:27:34.241 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-2:20.2.0-681.g36d388f2.el9.x86_64 1/40 2026-02-24T18:27:34.242 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 2/40 2026-02-24T18:27:34.242 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 3/40 2026-02-24T18:27:34.242 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 4/40 2026-02-24T18:27:34.242 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 5/40 2026-02-24T18:27:34.242 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.n 6/40 2026-02-24T18:27:34.242 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 7/40 2026-02-24T18:27:34.242 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 8/40 2026-02-24T18:27:34.242 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 9/40 2026-02-24T18:27:34.242 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 10/40 2026-02-24T18:27:34.243 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-ply-3.11-14.el9.noarch 11/40 2026-02-24T18:27:34.243 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 12/40 2026-02-24T18:27:34.243 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 13/40 2026-02-24T18:27:34.243 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 14/40 2026-02-24T18:27:34.243 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 15/40 2026-02-24T18:27:34.243 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : unzip-6.0-59.el9.x86_64 16/40 2026-02-24T18:27:34.243 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : zip-3.0-35.el9.x86_64 17/40 2026-02-24T18:27:34.243 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 18/40 2026-02-24T18:27:34.243 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : lua-5.4.4-4.el9.x86_64 19/40 2026-02-24T18:27:34.243 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 20/40 2026-02-24T18:27:34.243 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 21/40 2026-02-24T18:27:34.243 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 22/40 2026-02-24T18:27:34.244 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 23/40 2026-02-24T18:27:34.244 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 24/40 2026-02-24T18:27:34.244 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 25/40 2026-02-24T18:27:34.244 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 26/40 2026-02-24T18:27:34.244 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 27/40 2026-02-24T18:27:34.244 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 28/40 2026-02-24T18:27:34.244 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 29/40 2026-02-24T18:27:34.244 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 30/40 2026-02-24T18:27:34.244 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 31/40 2026-02-24T18:27:34.244 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 32/40 2026-02-24T18:27:34.244 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 33/40 2026-02-24T18:27:34.244 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 34/40 2026-02-24T18:27:34.244 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 35/40 2026-02-24T18:27:34.245 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 36/40 2026-02-24T18:27:34.245 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 37/40 2026-02-24T18:27:34.245 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 38/40 2026-02-24T18:27:34.245 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 39/40 2026-02-24T18:27:34.302 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 40/40 2026-02-24T18:27:34.302 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:34.302 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T18:27:34.302 INFO:teuthology.orchestra.run.trial195.stdout: ceph-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:34.302 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:34.302 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:34.302 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:34.302 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:34.302 INFO:teuthology.orchestra.run.trial195.stdout: ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:34.302 INFO:teuthology.orchestra.run.trial195.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-24T18:27:34.302 INFO:teuthology.orchestra.run.trial195.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-24T18:27:34.303 INFO:teuthology.orchestra.run.trial195.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T18:27:34.303 INFO:teuthology.orchestra.run.trial195.stdout: lua-5.4.4-4.el9.x86_64 2026-02-24T18:27:34.303 INFO:teuthology.orchestra.run.trial195.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-24T18:27:34.303 INFO:teuthology.orchestra.run.trial195.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-24T18:27:34.303 INFO:teuthology.orchestra.run.trial195.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-24T18:27:34.303 INFO:teuthology.orchestra.run.trial195.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-24T18:27:34.303 INFO:teuthology.orchestra.run.trial195.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-24T18:27:34.303 INFO:teuthology.orchestra.run.trial195.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-24T18:27:34.303 INFO:teuthology.orchestra.run.trial195.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-24T18:27:34.303 INFO:teuthology.orchestra.run.trial195.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-24T18:27:34.303 INFO:teuthology.orchestra.run.trial195.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-24T18:27:34.303 INFO:teuthology.orchestra.run.trial195.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-24T18:27:34.303 INFO:teuthology.orchestra.run.trial195.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-24T18:27:34.303 INFO:teuthology.orchestra.run.trial195.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-24T18:27:34.303 INFO:teuthology.orchestra.run.trial195.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-24T18:27:34.303 INFO:teuthology.orchestra.run.trial195.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-24T18:27:34.303 INFO:teuthology.orchestra.run.trial195.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-24T18:27:34.303 INFO:teuthology.orchestra.run.trial195.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T18:27:34.303 INFO:teuthology.orchestra.run.trial195.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-24T18:27:34.303 INFO:teuthology.orchestra.run.trial195.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-24T18:27:34.303 INFO:teuthology.orchestra.run.trial195.stdout: python3-ply-3.11-14.el9.noarch 2026-02-24T18:27:34.304 INFO:teuthology.orchestra.run.trial195.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-24T18:27:34.304 INFO:teuthology.orchestra.run.trial195.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-24T18:27:34.304 INFO:teuthology.orchestra.run.trial195.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-24T18:27:34.304 INFO:teuthology.orchestra.run.trial195.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-24T18:27:34.304 INFO:teuthology.orchestra.run.trial195.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-24T18:27:34.304 INFO:teuthology.orchestra.run.trial195.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-24T18:27:34.304 INFO:teuthology.orchestra.run.trial195.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-24T18:27:34.304 INFO:teuthology.orchestra.run.trial195.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-24T18:27:34.304 INFO:teuthology.orchestra.run.trial195.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-24T18:27:34.304 INFO:teuthology.orchestra.run.trial195.stdout: unzip-6.0-59.el9.x86_64 2026-02-24T18:27:34.304 INFO:teuthology.orchestra.run.trial195.stdout: zip-3.0-35.el9.x86_64 2026-02-24T18:27:34.304 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:34.304 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T18:27:34.306 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:01:30 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T18:27:34.339 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph-base 2026-02-24T18:27:34.354 INFO:teuthology.orchestra.run.trial014.stdout:(1/10): python3-pyasn1-modules-0.4.8-7.el9.noar 12 MB/s | 277 kB 00:00 2026-02-24T18:27:34.359 INFO:teuthology.orchestra.run.trial014.stdout:(2/10): python3-requests-oauthlib-1.3.0-12.el9. 10 MB/s | 54 kB 00:00 2026-02-24T18:27:34.363 INFO:teuthology.orchestra.run.trial014.stdout:(3/10): python3-pyasn1-0.4.8-7.el9.noarch.rpm 4.9 MB/s | 157 kB 00:00 2026-02-24T18:27:34.388 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T18:27:34.389 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:27:34.389 INFO:teuthology.orchestra.run.trial170.stdout: Package Arch Version Repo Size 2026-02-24T18:27:34.389 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:27:34.389 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T18:27:34.389 INFO:teuthology.orchestra.run.trial170.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-681.g36d388f2.el9 ceph 154 k 2026-02-24T18:27:34.389 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:27:34.389 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T18:27:34.389 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:27:34.389 INFO:teuthology.orchestra.run.trial170.stdout:Install 1 Package 2026-02-24T18:27:34.389 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:27:34.389 INFO:teuthology.orchestra.run.trial044.stdout:ceph-immutable-object-cache-20.2.0-681.g36d388f 324 kB/s | 154 kB 00:00 2026-02-24T18:27:34.390 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 154 k 2026-02-24T18:27:34.390 INFO:teuthology.orchestra.run.trial170.stdout:Installed size: 447 k 2026-02-24T18:27:34.390 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T18:27:34.390 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:34.390 INFO:teuthology.orchestra.run.trial044.stdout:Total 323 kB/s | 154 kB 00:00 2026-02-24T18:27:34.390 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T18:27:34.395 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T18:27:34.395 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T18:27:34.422 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T18:27:34.422 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T18:27:34.472 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T18:27:34.473 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-24T18:27:34.496 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-24T18:27:34.497 INFO:teuthology.orchestra.run.trial044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:34.497 INFO:teuthology.orchestra.run.trial044.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-24T18:27:34.497 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:34.583 INFO:teuthology.orchestra.run.trial014.stdout:(4/10): python3-certifi-2023.05.07-4.el9.noarch 64 kB/s | 14 kB 00:00 2026-02-24T18:27:34.587 INFO:teuthology.orchestra.run.trial014.stdout:(5/10): python3-cachetools-4.2.4-1.el9.noarch.r 141 kB/s | 32 kB 00:00 2026-02-24T18:27:34.654 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:28 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T18:27:34.719 INFO:teuthology.orchestra.run.trial195.stdout:Package ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:34.736 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T18:27:34.737 INFO:teuthology.orchestra.run.trial195.stdout:Nothing to do. 2026-02-24T18:27:34.737 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T18:27:34.744 INFO:teuthology.orchestra.run.trial014.stdout:(6/10): ceph-mgr-rook-20.2.0-681.g36d388f2.el9. 121 kB/s | 50 kB 00:00 2026-02-24T18:27:34.758 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install cephadm 2026-02-24T18:27:34.767 INFO:teuthology.orchestra.run.trial014.stdout:(7/10): python3-google-auth-2.45.0-1.el9.noarch 1.4 MB/s | 254 kB 00:00 2026-02-24T18:27:34.798 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-24T18:27:34.798 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:34.798 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T18:27:34.798 INFO:teuthology.orchestra.run.trial044.stdout: ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:34.798 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:34.799 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T18:27:34.816 INFO:teuthology.orchestra.run.trial014.stdout:(8/10): python3-websocket-client-1.2.3-2.el9.no 1.8 MB/s | 90 kB 00:00 2026-02-24T18:27:34.825 INFO:teuthology.orchestra.run.trial014.stdout:(9/10): python3-kubernetes-26.1.0-3.el9.noarch. 4.3 MB/s | 1.0 MB 00:00 2026-02-24T18:27:34.827 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install ceph-mgr 2026-02-24T18:27:34.872 INFO:teuthology.orchestra.run.trial170.stdout:ceph-immutable-object-cache-20.2.0-681.g36d388f 320 kB/s | 154 kB 00:00 2026-02-24T18:27:34.872 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:34.872 INFO:teuthology.orchestra.run.trial170.stdout:Total 319 kB/s | 154 kB 00:00 2026-02-24T18:27:34.872 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T18:27:34.877 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T18:27:34.877 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T18:27:34.903 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T18:27:34.903 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T18:27:34.927 INFO:teuthology.orchestra.run.trial014.stdout:(10/10): python3-rsa-4.9-2.el9.noarch.rpm 323 kB/s | 59 kB 00:00 2026-02-24T18:27:34.928 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:34.928 INFO:teuthology.orchestra.run.trial014.stdout:Total 2.7 MB/s | 2.0 MB 00:00 2026-02-24T18:27:34.953 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T18:27:34.954 INFO:teuthology.orchestra.run.trial170.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-24T18:27:34.956 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T18:27:34.964 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T18:27:34.964 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T18:27:34.978 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-24T18:27:34.978 INFO:teuthology.orchestra.run.trial170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:34.978 INFO:teuthology.orchestra.run.trial170.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-24T18:27:34.978 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:27:35.003 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T18:27:35.003 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T18:27:35.072 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:29 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T18:27:35.083 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T18:27:35.134 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 1/10 2026-02-24T18:27:35.143 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:01:28 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:27:35.147 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 2/10 2026-02-24T18:27:35.156 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T18:27:35.157 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:27:35.157 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repository Size 2026-02-24T18:27:35.157 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:27:35.157 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T18:27:35.157 INFO:teuthology.orchestra.run.trial195.stdout: cephadm noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 1.0 M 2026-02-24T18:27:35.157 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:35.157 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T18:27:35.158 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:27:35.158 INFO:teuthology.orchestra.run.trial195.stdout:Install 1 Package 2026-02-24T18:27:35.158 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:35.158 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 1.0 M 2026-02-24T18:27:35.158 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 1.0 M 2026-02-24T18:27:35.158 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T18:27:35.161 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/10 2026-02-24T18:27:35.166 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/10 2026-02-24T18:27:35.174 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/10 2026-02-24T18:27:35.208 INFO:teuthology.orchestra.run.trial044.stdout:Package ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:35.213 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/10 2026-02-24T18:27:35.225 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-24T18:27:35.226 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T18:27:35.226 INFO:teuthology.orchestra.run.trial044.stdout:Nothing to do. 2026-02-24T18:27:35.226 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T18:27:35.248 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install ceph-mgr-dashboard 2026-02-24T18:27:35.267 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-24T18:27:35.267 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:27:35.267 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T18:27:35.268 INFO:teuthology.orchestra.run.trial170.stdout: ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:35.268 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:27:35.268 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T18:27:35.294 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install ceph-mgr 2026-02-24T18:27:35.542 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 8/10 2026-02-24T18:27:35.557 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 9/10 2026-02-24T18:27:35.558 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 10/10 2026-02-24T18:27:35.562 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:01:28 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:27:35.615 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:01:31 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T18:27:35.646 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T18:27:35.646 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:27:35.646 INFO:teuthology.orchestra.run.trial044.stdout: Package Arch Version Repository Size 2026-02-24T18:27:35.646 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:27:35.646 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T18:27:35.646 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mgr-dashboard noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 11 M 2026-02-24T18:27:35.646 INFO:teuthology.orchestra.run.trial044.stdout:Installing dependencies: 2026-02-24T18:27:35.646 INFO:teuthology.orchestra.run.trial044.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-24T18:27:35.647 INFO:teuthology.orchestra.run.trial044.stdout: ceph-grafana-dashboards noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 43 k 2026-02-24T18:27:35.647 INFO:teuthology.orchestra.run.trial044.stdout: ceph-prometheus-alerts noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 17 k 2026-02-24T18:27:35.647 INFO:teuthology.orchestra.run.trial044.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-24T18:27:35.647 INFO:teuthology.orchestra.run.trial044.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-24T18:27:35.647 INFO:teuthology.orchestra.run.trial044.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-24T18:27:35.647 INFO:teuthology.orchestra.run.trial044.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-24T18:27:35.647 INFO:teuthology.orchestra.run.trial044.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-24T18:27:35.647 INFO:teuthology.orchestra.run.trial044.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-24T18:27:35.647 INFO:teuthology.orchestra.run.trial044.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-24T18:27:35.647 INFO:teuthology.orchestra.run.trial044.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-24T18:27:35.647 INFO:teuthology.orchestra.run.trial044.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-24T18:27:35.647 INFO:teuthology.orchestra.run.trial044.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-24T18:27:35.647 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:35.647 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T18:27:35.647 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:27:35.647 INFO:teuthology.orchestra.run.trial044.stdout:Install 14 Packages 2026-02-24T18:27:35.647 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:35.647 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 16 M 2026-02-24T18:27:35.647 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 158 M 2026-02-24T18:27:35.647 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T18:27:35.672 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 10/10 2026-02-24T18:27:35.672 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 1/10 2026-02-24T18:27:35.673 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 2/10 2026-02-24T18:27:35.673 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 3/10 2026-02-24T18:27:35.673 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 4/10 2026-02-24T18:27:35.673 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 5/10 2026-02-24T18:27:35.673 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 6/10 2026-02-24T18:27:35.673 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-24T18:27:35.673 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 8/10 2026-02-24T18:27:35.673 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 9/10 2026-02-24T18:27:35.679 INFO:teuthology.orchestra.run.trial170.stdout:Package ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:35.697 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T18:27:35.698 INFO:teuthology.orchestra.run.trial170.stdout:Nothing to do. 2026-02-24T18:27:35.698 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T18:27:35.719 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install ceph-mgr-dashboard 2026-02-24T18:27:35.734 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 10/10 2026-02-24T18:27:35.735 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:35.735 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T18:27:35.735 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:35.735 INFO:teuthology.orchestra.run.trial014.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-24T18:27:35.735 INFO:teuthology.orchestra.run.trial014.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-24T18:27:35.735 INFO:teuthology.orchestra.run.trial014.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-24T18:27:35.735 INFO:teuthology.orchestra.run.trial014.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-24T18:27:35.735 INFO:teuthology.orchestra.run.trial014.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-24T18:27:35.735 INFO:teuthology.orchestra.run.trial014.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-24T18:27:35.736 INFO:teuthology.orchestra.run.trial014.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-24T18:27:35.736 INFO:teuthology.orchestra.run.trial014.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-24T18:27:35.736 INFO:teuthology.orchestra.run.trial014.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-24T18:27:35.736 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:35.736 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T18:27:35.765 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install ceph-mgr-cephadm 2026-02-24T18:27:36.030 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:01:32 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T18:27:36.074 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:01:29 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:27:36.113 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T18:27:36.114 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:27:36.114 INFO:teuthology.orchestra.run.trial170.stdout: Package Arch Version Repository Size 2026-02-24T18:27:36.114 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:27:36.114 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T18:27:36.114 INFO:teuthology.orchestra.run.trial170.stdout: ceph-mgr-dashboard noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 11 M 2026-02-24T18:27:36.114 INFO:teuthology.orchestra.run.trial170.stdout:Installing dependencies: 2026-02-24T18:27:36.114 INFO:teuthology.orchestra.run.trial170.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-24T18:27:36.114 INFO:teuthology.orchestra.run.trial170.stdout: ceph-grafana-dashboards noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 43 k 2026-02-24T18:27:36.114 INFO:teuthology.orchestra.run.trial170.stdout: ceph-prometheus-alerts noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 17 k 2026-02-24T18:27:36.114 INFO:teuthology.orchestra.run.trial170.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-24T18:27:36.114 INFO:teuthology.orchestra.run.trial170.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-24T18:27:36.114 INFO:teuthology.orchestra.run.trial170.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-24T18:27:36.114 INFO:teuthology.orchestra.run.trial170.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-24T18:27:36.114 INFO:teuthology.orchestra.run.trial170.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-24T18:27:36.114 INFO:teuthology.orchestra.run.trial170.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-24T18:27:36.114 INFO:teuthology.orchestra.run.trial170.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-24T18:27:36.114 INFO:teuthology.orchestra.run.trial170.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-24T18:27:36.114 INFO:teuthology.orchestra.run.trial170.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-24T18:27:36.114 INFO:teuthology.orchestra.run.trial170.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-24T18:27:36.114 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:27:36.114 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T18:27:36.114 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:27:36.114 INFO:teuthology.orchestra.run.trial170.stdout:Install 14 Packages 2026-02-24T18:27:36.114 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:27:36.114 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 16 M 2026-02-24T18:27:36.114 INFO:teuthology.orchestra.run.trial170.stdout:Installed size: 158 M 2026-02-24T18:27:36.114 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T18:27:36.158 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T18:27:36.159 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:36.159 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repository Size 2026-02-24T18:27:36.159 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:36.159 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T18:27:36.159 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-cephadm noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 173 k 2026-02-24T18:27:36.159 INFO:teuthology.orchestra.run.trial014.stdout:Installing dependencies: 2026-02-24T18:27:36.159 INFO:teuthology.orchestra.run.trial014.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-24T18:27:36.159 INFO:teuthology.orchestra.run.trial014.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-24T18:27:36.159 INFO:teuthology.orchestra.run.trial014.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-24T18:27:36.159 INFO:teuthology.orchestra.run.trial014.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-24T18:27:36.159 INFO:teuthology.orchestra.run.trial014.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-24T18:27:36.159 INFO:teuthology.orchestra.run.trial014.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-24T18:27:36.159 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:36.159 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T18:27:36.159 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:36.160 INFO:teuthology.orchestra.run.trial014.stdout:Install 7 Packages 2026-02-24T18:27:36.160 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:36.160 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 7.1 M 2026-02-24T18:27:36.160 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 33 M 2026-02-24T18:27:36.160 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T18:27:36.386 INFO:teuthology.orchestra.run.trial014.stdout:(1/7): python3-jinja2-2.11.3-8.el9.noarch.rpm 4.0 MB/s | 249 kB 00:00 2026-02-24T18:27:36.397 INFO:teuthology.orchestra.run.trial014.stdout:(2/7): python3-markupsafe-1.1.1-12.el9.x86_64.r 3.2 MB/s | 35 kB 00:00 2026-02-24T18:27:36.446 INFO:teuthology.orchestra.run.trial014.stdout:(3/7): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2026-02-24T18:27:36.453 INFO:teuthology.orchestra.run.trial014.stdout:(4/7): python3-babel-2.9.1-2.el9.noarch.rpm 47 MB/s | 6.0 MB 00:00 2026-02-24T18:27:36.453 INFO:teuthology.orchestra.run.trial014.stdout:(5/7): python3-natsort-7.1.1-5.el9.noarch.rpm 7.6 MB/s | 58 kB 00:00 2026-02-24T18:27:36.457 INFO:teuthology.orchestra.run.trial014.stdout:(6/7): python3-typing-extensions-4.15.0-1.el9.n 21 MB/s | 86 kB 00:00 2026-02-24T18:27:36.556 INFO:teuthology.orchestra.run.trial044.stdout:(1/14): ceph-prometheus-alerts-20.2.0-681.g36d3 47 kB/s | 17 kB 00:00 2026-02-24T18:27:36.789 INFO:teuthology.orchestra.run.trial044.stdout:(2/14): ceph-grafana-dashboards-20.2.0-681.g36d 72 kB/s | 43 kB 00:00 2026-02-24T18:27:36.826 INFO:teuthology.orchestra.run.trial170.stdout:(1/14): ceph-prometheus-alerts-20.2.0-681.g36d3 56 kB/s | 17 kB 00:00 2026-02-24T18:27:36.850 INFO:teuthology.orchestra.run.trial014.stdout:(7/7): ceph-mgr-cephadm-20.2.0-681.g36d388f2.el 329 kB/s | 173 kB 00:00 2026-02-24T18:27:36.853 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:36.853 INFO:teuthology.orchestra.run.trial014.stdout:Total 10 MB/s | 7.1 MB 00:00 2026-02-24T18:27:36.893 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T18:27:36.900 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T18:27:36.900 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T18:27:36.902 INFO:teuthology.orchestra.run.trial170.stdout:(2/14): ceph-grafana-dashboards-20.2.0-681.g36d 112 kB/s | 43 kB 00:00 2026-02-24T18:27:36.971 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T18:27:36.971 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T18:27:37.063 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T18:27:37.108 INFO:teuthology.orchestra.run.trial044.stdout:(3/14): python3-jmespath-1.0.1-1.el9.noarch.rpm 149 kB/s | 48 kB 00:00 2026-02-24T18:27:37.113 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 1/7 2026-02-24T18:27:37.122 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/7 2026-02-24T18:27:37.128 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/7 2026-02-24T18:27:37.149 INFO:teuthology.orchestra.run.trial195.stdout:cephadm-20.2.0-681.g36d388f2.el9.noarch.rpm 513 kB/s | 1.0 MB 00:01 2026-02-24T18:27:37.150 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:37.150 INFO:teuthology.orchestra.run.trial195.stdout:Total 513 kB/s | 1.0 MB 00:01 2026-02-24T18:27:37.150 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T18:27:37.153 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T18:27:37.153 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T18:27:37.157 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T18:27:37.157 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T18:27:37.176 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T18:27:37.230 INFO:teuthology.orchestra.run.trial044.stdout:(4/14): protobuf-3.14.0-17.el9.x86_64.rpm 1.5 MB/s | 1.0 MB 00:00 2026-02-24T18:27:37.243 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:37.257 INFO:teuthology.orchestra.run.trial195.stdout: Installing : cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:37.300 INFO:teuthology.orchestra.run.trial044.stdout:(5/14): protobuf-compiler-3.14.0-17.el9.x86_64. 12 MB/s | 862 kB 00:00 2026-02-24T18:27:37.333 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:37.349 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-24T18:27:37.372 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 5/7 2026-02-24T18:27:37.393 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:37.393 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:37.393 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T18:27:37.393 INFO:teuthology.orchestra.run.trial195.stdout: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:37.393 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:37.393 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T18:27:37.395 INFO:teuthology.orchestra.run.trial044.stdout:(6/14): python3-protobuf-3.14.0-17.el9.noarch.r 930 kB/s | 267 kB 00:00 2026-02-24T18:27:37.396 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 6/7 2026-02-24T18:27:37.397 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 7/7 2026-02-24T18:27:37.422 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph-immutable-object-cache 2026-02-24T18:27:37.485 INFO:teuthology.orchestra.run.trial170.stdout:(3/14): python3-jmespath-1.0.1-1.el9.noarch.rpm 82 kB/s | 48 kB 00:00 2026-02-24T18:27:37.513 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 7/7 2026-02-24T18:27:37.513 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/7 2026-02-24T18:27:37.513 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/7 2026-02-24T18:27:37.513 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 3/7 2026-02-24T18:27:37.514 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-24T18:27:37.514 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 5/7 2026-02-24T18:27:37.514 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 6/7 2026-02-24T18:27:37.573 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 7/7 2026-02-24T18:27:37.573 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:37.574 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T18:27:37.574 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:37.574 INFO:teuthology.orchestra.run.trial014.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-24T18:27:37.574 INFO:teuthology.orchestra.run.trial014.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-24T18:27:37.574 INFO:teuthology.orchestra.run.trial014.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-24T18:27:37.574 INFO:teuthology.orchestra.run.trial014.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-24T18:27:37.574 INFO:teuthology.orchestra.run.trial014.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-24T18:27:37.574 INFO:teuthology.orchestra.run.trial014.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-24T18:27:37.574 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:37.574 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T18:27:37.604 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install ceph-fuse 2026-02-24T18:27:37.677 INFO:teuthology.orchestra.run.trial044.stdout:(7/14): grpc-data-1.46.7-10.el9.noarch.rpm 69 kB/s | 19 kB 00:00 2026-02-24T18:27:37.735 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:31 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T18:27:37.770 INFO:teuthology.orchestra.run.trial170.stdout:(4/14): protobuf-3.14.0-17.el9.x86_64.rpm 1.1 MB/s | 1.0 MB 00:00 2026-02-24T18:27:37.821 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T18:27:37.821 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:27:37.821 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repo Size 2026-02-24T18:27:37.821 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:27:37.821 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T18:27:37.821 INFO:teuthology.orchestra.run.trial195.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-681.g36d388f2.el9 ceph 154 k 2026-02-24T18:27:37.821 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:37.821 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T18:27:37.821 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:27:37.822 INFO:teuthology.orchestra.run.trial195.stdout:Install 1 Package 2026-02-24T18:27:37.822 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:37.822 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 154 k 2026-02-24T18:27:37.822 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 447 k 2026-02-24T18:27:37.822 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T18:27:37.850 INFO:teuthology.orchestra.run.trial044.stdout:(8/14): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.0 MB/s | 551 kB 00:00 2026-02-24T18:27:37.918 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:01:30 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:27:37.927 INFO:teuthology.orchestra.run.trial044.stdout:(9/14): python3-grpcio-tools-1.46.7-10.el9.x86_ 1.8 MB/s | 144 kB 00:00 2026-02-24T18:27:37.979 INFO:teuthology.orchestra.run.trial170.stdout:(5/14): protobuf-compiler-3.14.0-17.el9.x86_64. 4.0 MB/s | 862 kB 00:00 2026-02-24T18:27:37.994 INFO:teuthology.orchestra.run.trial044.stdout:(10/14): python3-repoze-lru-0.7-16.el9.noarch.r 457 kB/s | 31 kB 00:00 2026-02-24T18:27:38.002 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T18:27:38.003 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:38.003 INFO:teuthology.orchestra.run.trial014.stdout: Package Architecture Version Repository Size 2026-02-24T18:27:38.003 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:38.003 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T18:27:38.003 INFO:teuthology.orchestra.run.trial014.stdout: ceph-fuse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 942 k 2026-02-24T18:27:38.004 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:38.004 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T18:27:38.004 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:38.004 INFO:teuthology.orchestra.run.trial014.stdout:Install 1 Package 2026-02-24T18:27:38.004 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:38.004 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 942 k 2026-02-24T18:27:38.004 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 2.7 M 2026-02-24T18:27:38.004 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T18:27:38.076 INFO:teuthology.orchestra.run.trial044.stdout:(11/14): python3-routes-2.5.1-5.el9.noarch.rpm 2.3 MB/s | 188 kB 00:00 2026-02-24T18:27:38.142 INFO:teuthology.orchestra.run.trial044.stdout:(12/14): python3-xmltodict-0.12.0-15.el9.noarch 334 kB/s | 22 kB 00:00 2026-02-24T18:27:38.169 INFO:teuthology.orchestra.run.trial044.stdout:(13/14): python3-grpcio-1.46.7-10.el9.x86_64.rp 4.1 MB/s | 2.0 MB 00:00 2026-02-24T18:27:38.263 INFO:teuthology.orchestra.run.trial170.stdout:(6/14): python3-protobuf-3.14.0-17.el9.noarch.r 344 kB/s | 267 kB 00:00 2026-02-24T18:27:38.304 INFO:teuthology.orchestra.run.trial170.stdout:(7/14): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.7 MB/s | 551 kB 00:00 2026-02-24T18:27:38.358 INFO:teuthology.orchestra.run.trial195.stdout:ceph-immutable-object-cache-20.2.0-681.g36d388f 287 kB/s | 154 kB 00:00 2026-02-24T18:27:38.359 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:38.359 INFO:teuthology.orchestra.run.trial195.stdout:Total 287 kB/s | 154 kB 00:00 2026-02-24T18:27:38.359 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T18:27:38.363 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T18:27:38.364 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T18:27:38.391 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T18:27:38.391 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T18:27:38.419 INFO:teuthology.orchestra.run.trial170.stdout:(8/14): grpc-data-1.46.7-10.el9.noarch.rpm 124 kB/s | 19 kB 00:00 2026-02-24T18:27:38.434 INFO:teuthology.orchestra.run.trial170.stdout:(9/14): python3-grpcio-1.46.7-10.el9.x86_64.rpm 16 MB/s | 2.0 MB 00:00 2026-02-24T18:27:38.440 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T18:27:38.442 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-24T18:27:38.466 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-24T18:27:38.466 INFO:teuthology.orchestra.run.trial195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:38.466 INFO:teuthology.orchestra.run.trial195.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-24T18:27:38.466 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:38.471 INFO:teuthology.orchestra.run.trial170.stdout:(10/14): python3-repoze-lru-0.7-16.el9.noarch.r 815 kB/s | 31 kB 00:00 2026-02-24T18:27:38.511 INFO:teuthology.orchestra.run.trial170.stdout:(11/14): python3-routes-2.5.1-5.el9.noarch.rpm 4.7 MB/s | 188 kB 00:00 2026-02-24T18:27:38.546 INFO:teuthology.orchestra.run.trial170.stdout:(12/14): python3-grpcio-tools-1.46.7-10.el9.x86 1.1 MB/s | 144 kB 00:00 2026-02-24T18:27:38.549 INFO:teuthology.orchestra.run.trial170.stdout:(13/14): python3-xmltodict-0.12.0-15.el9.noarch 583 kB/s | 22 kB 00:00 2026-02-24T18:27:38.793 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-24T18:27:38.793 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:38.793 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T18:27:38.793 INFO:teuthology.orchestra.run.trial195.stdout: ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:38.793 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:38.794 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T18:27:38.822 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph-mgr 2026-02-24T18:27:38.983 INFO:teuthology.orchestra.run.trial014.stdout:ceph-fuse-20.2.0-681.g36d388f2.el9.x86_64.rpm 962 kB/s | 942 kB 00:00 2026-02-24T18:27:38.983 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:38.983 INFO:teuthology.orchestra.run.trial014.stdout:Total 961 kB/s | 942 kB 00:00 2026-02-24T18:27:38.984 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T18:27:38.989 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T18:27:38.989 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T18:27:39.021 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T18:27:39.021 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T18:27:39.113 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T18:27:39.131 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:39.140 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:33 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T18:27:39.207 INFO:teuthology.orchestra.run.trial195.stdout:Package ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:39.224 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T18:27:39.225 INFO:teuthology.orchestra.run.trial195.stdout:Nothing to do. 2026-02-24T18:27:39.225 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T18:27:39.246 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph-mgr-dashboard 2026-02-24T18:27:39.379 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:39.440 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:39.441 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:39.441 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T18:27:39.441 INFO:teuthology.orchestra.run.trial014.stdout: ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:39.441 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:39.441 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T18:27:39.468 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install ceph-volume 2026-02-24T18:27:39.559 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:33 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T18:27:39.642 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T18:27:39.644 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:27:39.644 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repository Size 2026-02-24T18:27:39.644 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:27:39.644 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T18:27:39.644 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mgr-dashboard noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 11 M 2026-02-24T18:27:39.644 INFO:teuthology.orchestra.run.trial195.stdout:Installing dependencies: 2026-02-24T18:27:39.644 INFO:teuthology.orchestra.run.trial195.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-24T18:27:39.644 INFO:teuthology.orchestra.run.trial195.stdout: ceph-grafana-dashboards noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 43 k 2026-02-24T18:27:39.645 INFO:teuthology.orchestra.run.trial195.stdout: ceph-prometheus-alerts noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 17 k 2026-02-24T18:27:39.645 INFO:teuthology.orchestra.run.trial195.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-24T18:27:39.645 INFO:teuthology.orchestra.run.trial195.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-24T18:27:39.645 INFO:teuthology.orchestra.run.trial195.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-24T18:27:39.645 INFO:teuthology.orchestra.run.trial195.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-24T18:27:39.645 INFO:teuthology.orchestra.run.trial195.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-24T18:27:39.645 INFO:teuthology.orchestra.run.trial195.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-24T18:27:39.645 INFO:teuthology.orchestra.run.trial195.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-24T18:27:39.645 INFO:teuthology.orchestra.run.trial195.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-24T18:27:39.645 INFO:teuthology.orchestra.run.trial195.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-24T18:27:39.645 INFO:teuthology.orchestra.run.trial195.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-24T18:27:39.646 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:39.646 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T18:27:39.646 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:27:39.646 INFO:teuthology.orchestra.run.trial195.stdout:Install 14 Packages 2026-02-24T18:27:39.646 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:39.646 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 16 M 2026-02-24T18:27:39.646 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 158 M 2026-02-24T18:27:39.646 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T18:27:39.780 INFO:teuthology.orchestra.run.trial044.stdout:(14/14): ceph-mgr-dashboard-20.2.0-681.g36d388f 2.9 MB/s | 11 MB 00:03 2026-02-24T18:27:39.782 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:01:32 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:27:39.783 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:39.783 INFO:teuthology.orchestra.run.trial044.stdout:Total 3.8 MB/s | 16 MB 00:04 2026-02-24T18:27:39.821 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T18:27:39.830 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T18:27:39.830 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T18:27:39.866 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T18:27:39.867 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:39.867 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repository Size 2026-02-24T18:27:39.867 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:39.867 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T18:27:39.867 INFO:teuthology.orchestra.run.trial014.stdout: ceph-volume noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 297 k 2026-02-24T18:27:39.867 INFO:teuthology.orchestra.run.trial014.stdout:Installing dependencies: 2026-02-24T18:27:39.867 INFO:teuthology.orchestra.run.trial014.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-24T18:27:39.867 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:39.868 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T18:27:39.868 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:39.868 INFO:teuthology.orchestra.run.trial014.stdout:Install 2 Packages 2026-02-24T18:27:39.868 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:39.868 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 648 k 2026-02-24T18:27:39.868 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 2.2 M 2026-02-24T18:27:39.868 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T18:27:39.926 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T18:27:39.926 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T18:27:40.038 INFO:teuthology.orchestra.run.trial014.stdout:(1/2): cryptsetup-2.8.1-3.el9.x86_64.rpm 3.1 MB/s | 351 kB 00:00 2026-02-24T18:27:40.045 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T18:27:40.053 INFO:teuthology.orchestra.run.trial044.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 1/14 2026-02-24T18:27:40.056 INFO:teuthology.orchestra.run.trial044.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 2/14 2026-02-24T18:27:40.061 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 3/14 2026-02-24T18:27:40.073 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 4/14 2026-02-24T18:27:40.074 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 5/14 2026-02-24T18:27:40.102 INFO:teuthology.orchestra.run.trial044.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 6/14 2026-02-24T18:27:40.145 INFO:teuthology.orchestra.run.trial044.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 7/14 2026-02-24T18:27:40.164 INFO:teuthology.orchestra.run.trial195.stdout:(1/14): ceph-prometheus-alerts-20.2.0-681.g36d3 63 kB/s | 17 kB 00:00 2026-02-24T18:27:40.174 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 8/14 2026-02-24T18:27:40.181 INFO:teuthology.orchestra.run.trial170.stdout:(14/14): ceph-mgr-dashboard-20.2.0-681.g36d388f 2.9 MB/s | 11 MB 00:03 2026-02-24T18:27:40.183 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:40.183 INFO:teuthology.orchestra.run.trial170.stdout:Total 3.9 MB/s | 16 MB 00:04 2026-02-24T18:27:40.183 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 9/14 2026-02-24T18:27:40.190 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/14 2026-02-24T18:27:40.193 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 11/14 2026-02-24T18:27:40.200 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9. 12/14 2026-02-24T18:27:40.209 INFO:teuthology.orchestra.run.trial195.stdout:(2/14): ceph-grafana-dashboards-20.2.0-681.g36d 135 kB/s | 43 kB 00:00 2026-02-24T18:27:40.223 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T18:27:40.232 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T18:27:40.233 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T18:27:40.236 INFO:teuthology.orchestra.run.trial195.stdout:(3/14): protobuf-3.14.0-17.el9.x86_64.rpm 14 MB/s | 1.0 MB 00:00 2026-02-24T18:27:40.240 INFO:teuthology.orchestra.run.trial195.stdout:(4/14): python3-jmespath-1.0.1-1.el9.noarch.rpm 1.5 MB/s | 48 kB 00:00 2026-02-24T18:27:40.270 INFO:teuthology.orchestra.run.trial195.stdout:(5/14): python3-protobuf-3.14.0-17.el9.noarch.r 7.8 MB/s | 267 kB 00:00 2026-02-24T18:27:40.310 INFO:teuthology.orchestra.run.trial195.stdout:(6/14): protobuf-compiler-3.14.0-17.el9.x86_64. 12 MB/s | 862 kB 00:00 2026-02-24T18:27:40.329 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T18:27:40.329 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T18:27:40.405 INFO:teuthology.orchestra.run.trial014.stdout:(2/2): ceph-volume-20.2.0-681.g36d388f2.el9.noa 623 kB/s | 297 kB 00:00 2026-02-24T18:27:40.406 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:40.406 INFO:teuthology.orchestra.run.trial014.stdout:Total 1.2 MB/s | 648 kB 00:00 2026-02-24T18:27:40.416 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T18:27:40.422 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T18:27:40.422 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T18:27:40.446 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T18:27:40.454 INFO:teuthology.orchestra.run.trial170.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 1/14 2026-02-24T18:27:40.457 INFO:teuthology.orchestra.run.trial170.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 2/14 2026-02-24T18:27:40.462 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 3/14 2026-02-24T18:27:40.465 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T18:27:40.465 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T18:27:40.474 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 4/14 2026-02-24T18:27:40.476 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 5/14 2026-02-24T18:27:40.485 INFO:teuthology.orchestra.run.trial195.stdout:(7/14): grpc-data-1.46.7-10.el9.noarch.rpm 111 kB/s | 19 kB 00:00 2026-02-24T18:27:40.502 INFO:teuthology.orchestra.run.trial170.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 6/14 2026-02-24T18:27:40.546 INFO:teuthology.orchestra.run.trial170.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 7/14 2026-02-24T18:27:40.547 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T18:27:40.575 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 8/14 2026-02-24T18:27:40.585 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 9/14 2026-02-24T18:27:40.592 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/14 2026-02-24T18:27:40.594 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 11/14 2026-02-24T18:27:40.601 INFO:teuthology.orchestra.run.trial170.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9. 12/14 2026-02-24T18:27:40.610 INFO:teuthology.orchestra.run.trial014.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 1/2 2026-02-24T18:27:40.612 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 2/2 2026-02-24T18:27:40.627 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 2/2 2026-02-24T18:27:40.627 INFO:teuthology.orchestra.run.trial014.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:40.627 INFO:teuthology.orchestra.run.trial014.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-24T18:27:40.627 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:40.631 INFO:teuthology.orchestra.run.trial195.stdout:(8/14): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.5 MB/s | 551 kB 00:00 2026-02-24T18:27:40.680 INFO:teuthology.orchestra.run.trial195.stdout:(9/14): python3-grpcio-tools-1.46.7-10.el9.x86_ 2.8 MB/s | 144 kB 00:00 2026-02-24T18:27:40.723 INFO:teuthology.orchestra.run.trial195.stdout:(10/14): python3-repoze-lru-0.7-16.el9.noarch.r 721 kB/s | 31 kB 00:00 2026-02-24T18:27:40.776 INFO:teuthology.orchestra.run.trial195.stdout:(11/14): python3-routes-2.5.1-5.el9.noarch.rpm 3.5 MB/s | 188 kB 00:00 2026-02-24T18:27:40.784 INFO:teuthology.orchestra.run.trial195.stdout:(12/14): python3-grpcio-1.46.7-10.el9.x86_64.rp 6.8 MB/s | 2.0 MB 00:00 2026-02-24T18:27:40.818 INFO:teuthology.orchestra.run.trial195.stdout:(13/14): python3-xmltodict-0.12.0-15.el9.noarch 522 kB/s | 22 kB 00:00 2026-02-24T18:27:40.847 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 1/2 2026-02-24T18:27:40.910 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 2/2 2026-02-24T18:27:40.910 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:40.911 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T18:27:40.911 INFO:teuthology.orchestra.run.trial014.stdout: ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch cryptsetup-2.8.1-3.el9.x86_64 2026-02-24T18:27:40.911 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:40.911 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T18:27:40.939 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install librados-devel 2026-02-24T18:27:41.255 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:01:34 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:27:41.331 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9 13/14 2026-02-24T18:27:41.336 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 14/14 2026-02-24T18:27:41.339 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T18:27:41.340 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:41.340 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repo Size 2026-02-24T18:27:41.340 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:41.340 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T18:27:41.340 INFO:teuthology.orchestra.run.trial014.stdout: librados-devel x86_64 2:20.2.0-681.g36d388f2.el9 ceph 126 k 2026-02-24T18:27:41.340 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:41.340 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T18:27:41.340 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:41.340 INFO:teuthology.orchestra.run.trial014.stdout:Install 1 Package 2026-02-24T18:27:41.340 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:41.340 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 126 k 2026-02-24T18:27:41.340 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 449 k 2026-02-24T18:27:41.340 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T18:27:41.537 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 14/14 2026-02-24T18:27:41.537 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9 1/14 2026-02-24T18:27:41.537 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 2/14 2026-02-24T18:27:41.537 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9. 3/14 2026-02-24T18:27:41.537 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 4/14 2026-02-24T18:27:41.537 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 5/14 2026-02-24T18:27:41.537 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 6/14 2026-02-24T18:27:41.537 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 7/14 2026-02-24T18:27:41.537 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 8/14 2026-02-24T18:27:41.537 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 9/14 2026-02-24T18:27:41.537 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 10/14 2026-02-24T18:27:41.537 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 11/14 2026-02-24T18:27:41.537 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 12/14 2026-02-24T18:27:41.538 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 13/14 2026-02-24T18:27:41.599 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 14/14 2026-02-24T18:27:41.599 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:41.599 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T18:27:41.599 INFO:teuthology.orchestra.run.trial044.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-24T18:27:41.599 INFO:teuthology.orchestra.run.trial044.stdout: ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:41.599 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:41.599 INFO:teuthology.orchestra.run.trial044.stdout: ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:41.599 INFO:teuthology.orchestra.run.trial044.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-24T18:27:41.599 INFO:teuthology.orchestra.run.trial044.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-24T18:27:41.600 INFO:teuthology.orchestra.run.trial044.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-24T18:27:41.600 INFO:teuthology.orchestra.run.trial044.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-24T18:27:41.600 INFO:teuthology.orchestra.run.trial044.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-24T18:27:41.600 INFO:teuthology.orchestra.run.trial044.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-24T18:27:41.600 INFO:teuthology.orchestra.run.trial044.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-24T18:27:41.600 INFO:teuthology.orchestra.run.trial044.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-24T18:27:41.600 INFO:teuthology.orchestra.run.trial044.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-24T18:27:41.600 INFO:teuthology.orchestra.run.trial044.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-24T18:27:41.600 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:41.600 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T18:27:41.631 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-24T18:27:41.720 INFO:teuthology.orchestra.run.trial170.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9 13/14 2026-02-24T18:27:41.725 INFO:teuthology.orchestra.run.trial170.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 14/14 2026-02-24T18:27:41.818 INFO:teuthology.orchestra.run.trial014.stdout:librados-devel-20.2.0-681.g36d388f2.el9.x86_64. 263 kB/s | 126 kB 00:00 2026-02-24T18:27:41.820 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:41.820 INFO:teuthology.orchestra.run.trial014.stdout:Total 262 kB/s | 126 kB 00:00 2026-02-24T18:27:41.820 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T18:27:41.823 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T18:27:41.824 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T18:27:41.854 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T18:27:41.854 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T18:27:41.908 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T18:27:41.922 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 14/14 2026-02-24T18:27:41.922 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9 1/14 2026-02-24T18:27:41.922 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 2/14 2026-02-24T18:27:41.922 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9. 3/14 2026-02-24T18:27:41.922 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 4/14 2026-02-24T18:27:41.922 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 5/14 2026-02-24T18:27:41.922 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 6/14 2026-02-24T18:27:41.922 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 7/14 2026-02-24T18:27:41.923 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 8/14 2026-02-24T18:27:41.923 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 9/14 2026-02-24T18:27:41.923 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 10/14 2026-02-24T18:27:41.923 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 11/14 2026-02-24T18:27:41.923 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 12/14 2026-02-24T18:27:41.923 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 13/14 2026-02-24T18:27:41.925 INFO:teuthology.orchestra.run.trial014.stdout: Installing : librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:41.945 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:01:34 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:27:41.982 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 14/14 2026-02-24T18:27:41.982 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:27:41.983 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T18:27:41.983 INFO:teuthology.orchestra.run.trial170.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-24T18:27:41.983 INFO:teuthology.orchestra.run.trial170.stdout: ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:41.983 INFO:teuthology.orchestra.run.trial170.stdout: ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:41.983 INFO:teuthology.orchestra.run.trial170.stdout: ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:41.983 INFO:teuthology.orchestra.run.trial170.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-24T18:27:41.983 INFO:teuthology.orchestra.run.trial170.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-24T18:27:41.983 INFO:teuthology.orchestra.run.trial170.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-24T18:27:41.983 INFO:teuthology.orchestra.run.trial170.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-24T18:27:41.983 INFO:teuthology.orchestra.run.trial170.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-24T18:27:41.983 INFO:teuthology.orchestra.run.trial170.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-24T18:27:41.983 INFO:teuthology.orchestra.run.trial170.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-24T18:27:41.983 INFO:teuthology.orchestra.run.trial170.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-24T18:27:41.983 INFO:teuthology.orchestra.run.trial170.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-24T18:27:41.983 INFO:teuthology.orchestra.run.trial170.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-24T18:27:41.983 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:27:41.983 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T18:27:42.013 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-24T18:27:42.017 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:42.029 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T18:27:42.030 INFO:teuthology.orchestra.run.trial044.stdout:====================================================================================== 2026-02-24T18:27:42.030 INFO:teuthology.orchestra.run.trial044.stdout: Package Arch Version Repository Size 2026-02-24T18:27:42.030 INFO:teuthology.orchestra.run.trial044.stdout:====================================================================================== 2026-02-24T18:27:42.030 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T18:27:42.030 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 7.4 M 2026-02-24T18:27:42.030 INFO:teuthology.orchestra.run.trial044.stdout:Installing dependencies: 2026-02-24T18:27:42.030 INFO:teuthology.orchestra.run.trial044.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-24T18:27:42.030 INFO:teuthology.orchestra.run.trial044.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-24T18:27:42.030 INFO:teuthology.orchestra.run.trial044.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-24T18:27:42.030 INFO:teuthology.orchestra.run.trial044.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-24T18:27:42.030 INFO:teuthology.orchestra.run.trial044.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-24T18:27:42.030 INFO:teuthology.orchestra.run.trial044.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-24T18:27:42.030 INFO:teuthology.orchestra.run.trial044.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-24T18:27:42.030 INFO:teuthology.orchestra.run.trial044.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-24T18:27:42.030 INFO:teuthology.orchestra.run.trial044.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-24T18:27:42.030 INFO:teuthology.orchestra.run.trial044.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-24T18:27:42.030 INFO:teuthology.orchestra.run.trial044.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-24T18:27:42.030 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:42.030 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T18:27:42.030 INFO:teuthology.orchestra.run.trial044.stdout:====================================================================================== 2026-02-24T18:27:42.030 INFO:teuthology.orchestra.run.trial044.stdout:Install 12 Packages 2026-02-24T18:27:42.030 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:42.030 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 43 M 2026-02-24T18:27:42.030 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 234 M 2026-02-24T18:27:42.030 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T18:27:42.080 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:42.080 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:42.080 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T18:27:42.080 INFO:teuthology.orchestra.run.trial014.stdout: librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:42.080 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:42.080 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T18:27:42.109 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install libcephfs2 2026-02-24T18:27:42.225 INFO:teuthology.orchestra.run.trial044.stdout:(1/12): libquadmath-11.5.0-14.el9.x86_64.rpm 9.9 MB/s | 184 kB 00:00 2026-02-24T18:27:42.230 INFO:teuthology.orchestra.run.trial044.stdout:(2/12): flexiblas-3.0.4-9.el9.x86_64.rpm 6.8 MB/s | 30 kB 00:00 2026-02-24T18:27:42.235 INFO:teuthology.orchestra.run.trial044.stdout:(3/12): libgfortran-11.5.0-14.el9.x86_64.rpm 28 MB/s | 794 kB 00:00 2026-02-24T18:27:42.239 INFO:teuthology.orchestra.run.trial044.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-9.el9.x 3.6 MB/s | 15 kB 00:00 2026-02-24T18:27:42.243 INFO:teuthology.orchestra.run.trial044.stdout:(5/12): openblas-0.3.29-1.el9.x86_64.rpm 9.5 MB/s | 42 kB 00:00 2026-02-24T18:27:42.300 INFO:teuthology.orchestra.run.trial044.stdout:(6/12): flexiblas-netlib-3.0.4-9.el9.x86_64.rpm 43 MB/s | 3.0 MB 00:00 2026-02-24T18:27:42.307 INFO:teuthology.orchestra.run.trial044.stdout:(7/12): python3-devel-3.9.25-3.el9.x86_64.rpm 33 MB/s | 244 kB 00:00 2026-02-24T18:27:42.322 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:01:38 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T18:27:42.398 INFO:teuthology.orchestra.run.trial044.stdout:(8/12): openblas-openmp-0.3.29-1.el9.x86_64.rpm 34 MB/s | 5.3 MB 00:00 2026-02-24T18:27:42.405 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T18:27:42.406 INFO:teuthology.orchestra.run.trial170.stdout:====================================================================================== 2026-02-24T18:27:42.406 INFO:teuthology.orchestra.run.trial170.stdout: Package Arch Version Repository Size 2026-02-24T18:27:42.406 INFO:teuthology.orchestra.run.trial170.stdout:====================================================================================== 2026-02-24T18:27:42.406 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T18:27:42.406 INFO:teuthology.orchestra.run.trial170.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 7.4 M 2026-02-24T18:27:42.407 INFO:teuthology.orchestra.run.trial170.stdout:Installing dependencies: 2026-02-24T18:27:42.407 INFO:teuthology.orchestra.run.trial170.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-24T18:27:42.407 INFO:teuthology.orchestra.run.trial170.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-24T18:27:42.407 INFO:teuthology.orchestra.run.trial170.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-24T18:27:42.407 INFO:teuthology.orchestra.run.trial170.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-24T18:27:42.407 INFO:teuthology.orchestra.run.trial170.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-24T18:27:42.407 INFO:teuthology.orchestra.run.trial170.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-24T18:27:42.407 INFO:teuthology.orchestra.run.trial170.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-24T18:27:42.407 INFO:teuthology.orchestra.run.trial170.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-24T18:27:42.407 INFO:teuthology.orchestra.run.trial170.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-24T18:27:42.407 INFO:teuthology.orchestra.run.trial170.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-24T18:27:42.408 INFO:teuthology.orchestra.run.trial170.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-24T18:27:42.408 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:27:42.408 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T18:27:42.408 INFO:teuthology.orchestra.run.trial170.stdout:====================================================================================== 2026-02-24T18:27:42.408 INFO:teuthology.orchestra.run.trial170.stdout:Install 12 Packages 2026-02-24T18:27:42.408 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:27:42.409 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 43 M 2026-02-24T18:27:42.409 INFO:teuthology.orchestra.run.trial170.stdout:Installed size: 234 M 2026-02-24T18:27:42.409 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T18:27:42.419 INFO:teuthology.orchestra.run.trial044.stdout:(9/12): python3-numpy-f2py-1.23.5-2.el9.x86_64. 20 MB/s | 442 kB 00:00 2026-02-24T18:27:42.425 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:01:35 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:27:42.438 INFO:teuthology.orchestra.run.trial044.stdout:(10/12): python3-numpy-1.23.5-2.el9.x86_64.rpm 47 MB/s | 6.1 MB 00:00 2026-02-24T18:27:42.490 INFO:teuthology.orchestra.run.trial014.stdout:Package libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:42.508 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T18:27:42.509 INFO:teuthology.orchestra.run.trial014.stdout:Nothing to do. 2026-02-24T18:27:42.509 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T18:27:42.531 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install libcephfs-devel 2026-02-24T18:27:42.846 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:01:35 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:27:42.930 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T18:27:42.930 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:42.930 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repo Size 2026-02-24T18:27:42.930 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:42.930 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T18:27:42.930 INFO:teuthology.orchestra.run.trial014.stdout: libcephfs-devel x86_64 2:20.2.0-681.g36d388f2.el9 ceph 34 k 2026-02-24T18:27:42.930 INFO:teuthology.orchestra.run.trial014.stdout:Installing dependencies: 2026-02-24T18:27:42.930 INFO:teuthology.orchestra.run.trial014.stdout: libcephfs-proxy2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 k 2026-02-24T18:27:42.930 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:42.930 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T18:27:42.930 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:42.930 INFO:teuthology.orchestra.run.trial014.stdout:Install 2 Packages 2026-02-24T18:27:42.930 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:42.930 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 58 k 2026-02-24T18:27:42.930 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 207 k 2026-02-24T18:27:42.930 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T18:27:43.049 INFO:teuthology.orchestra.run.trial170.stdout:(1/12): libquadmath-11.5.0-14.el9.x86_64.rpm 382 kB/s | 184 kB 00:00 2026-02-24T18:27:43.203 INFO:teuthology.orchestra.run.trial170.stdout:(2/12): libgfortran-11.5.0-14.el9.x86_64.rpm 1.2 MB/s | 794 kB 00:00 2026-02-24T18:27:43.243 INFO:teuthology.orchestra.run.trial014.stdout:(1/2): libcephfs-proxy2-20.2.0-681.g36d388f2.el 77 kB/s | 24 kB 00:00 2026-02-24T18:27:43.248 INFO:teuthology.orchestra.run.trial014.stdout:(2/2): libcephfs-devel-20.2.0-681.g36d388f2.el9 108 kB/s | 34 kB 00:00 2026-02-24T18:27:43.249 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:43.249 INFO:teuthology.orchestra.run.trial014.stdout:Total 183 kB/s | 58 kB 00:00 2026-02-24T18:27:43.249 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T18:27:43.252 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T18:27:43.252 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T18:27:43.284 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T18:27:43.284 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T18:27:43.333 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T18:27:43.334 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-24T18:27:43.345 INFO:teuthology.orchestra.run.trial044.stdout:(11/12): python3-scipy-1.9.3-2.el9.x86_64.rpm 21 MB/s | 19 MB 00:00 2026-02-24T18:27:43.348 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-24T18:27:43.365 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-24T18:27:43.395 INFO:teuthology.orchestra.run.trial195.stdout:(14/14): ceph-mgr-dashboard-20.2.0-681.g36d388f 3.0 MB/s | 11 MB 00:03 2026-02-24T18:27:43.398 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:43.398 INFO:teuthology.orchestra.run.trial195.stdout:Total 4.2 MB/s | 16 MB 00:03 2026-02-24T18:27:43.423 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-24T18:27:43.423 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-24T18:27:43.435 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T18:27:43.444 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T18:27:43.444 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T18:27:43.457 INFO:teuthology.orchestra.run.trial170.stdout:(3/12): flexiblas-3.0.4-9.el9.x86_64.rpm 72 kB/s | 30 kB 00:00 2026-02-24T18:27:43.484 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-24T18:27:43.484 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:43.484 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T18:27:43.485 INFO:teuthology.orchestra.run.trial014.stdout: libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:43.485 INFO:teuthology.orchestra.run.trial014.stdout: libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:43.485 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:43.485 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T18:27:43.512 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install librados2 2026-02-24T18:27:43.541 INFO:teuthology.orchestra.run.trial170.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-9.el9.x 177 kB/s | 15 kB 00:00 2026-02-24T18:27:43.542 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T18:27:43.542 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T18:27:43.660 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T18:27:43.668 INFO:teuthology.orchestra.run.trial195.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 1/14 2026-02-24T18:27:43.671 INFO:teuthology.orchestra.run.trial195.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 2/14 2026-02-24T18:27:43.676 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 3/14 2026-02-24T18:27:43.688 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 4/14 2026-02-24T18:27:43.690 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 5/14 2026-02-24T18:27:43.702 INFO:teuthology.orchestra.run.trial170.stdout:(5/12): openblas-0.3.29-1.el9.x86_64.rpm 262 kB/s | 42 kB 00:00 2026-02-24T18:27:43.717 INFO:teuthology.orchestra.run.trial195.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 6/14 2026-02-24T18:27:43.762 INFO:teuthology.orchestra.run.trial195.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 7/14 2026-02-24T18:27:43.790 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 8/14 2026-02-24T18:27:43.800 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 9/14 2026-02-24T18:27:43.807 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/14 2026-02-24T18:27:43.810 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 11/14 2026-02-24T18:27:43.817 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9. 12/14 2026-02-24T18:27:43.826 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:01:36 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:27:43.891 INFO:teuthology.orchestra.run.trial014.stdout:Package librados2-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:43.909 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T18:27:43.910 INFO:teuthology.orchestra.run.trial014.stdout:Nothing to do. 2026-02-24T18:27:43.910 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T18:27:43.931 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install librbd1 2026-02-24T18:27:44.245 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:01:37 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:27:44.310 INFO:teuthology.orchestra.run.trial014.stdout:Package librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:44.329 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T18:27:44.330 INFO:teuthology.orchestra.run.trial014.stdout:Nothing to do. 2026-02-24T18:27:44.330 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T18:27:44.352 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install python3-rados 2026-02-24T18:27:44.663 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:01:37 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:27:44.728 INFO:teuthology.orchestra.run.trial014.stdout:Package python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:44.747 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T18:27:44.747 INFO:teuthology.orchestra.run.trial014.stdout:Nothing to do. 2026-02-24T18:27:44.747 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T18:27:44.769 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install python3-rgw 2026-02-24T18:27:44.966 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9 13/14 2026-02-24T18:27:44.971 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 14/14 2026-02-24T18:27:45.085 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:01:38 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:27:45.151 INFO:teuthology.orchestra.run.trial014.stdout:Package python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:45.170 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T18:27:45.171 INFO:teuthology.orchestra.run.trial014.stdout:Nothing to do. 2026-02-24T18:27:45.171 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T18:27:45.182 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 14/14 2026-02-24T18:27:45.182 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9 1/14 2026-02-24T18:27:45.183 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 2/14 2026-02-24T18:27:45.183 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9. 3/14 2026-02-24T18:27:45.183 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 4/14 2026-02-24T18:27:45.183 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 5/14 2026-02-24T18:27:45.183 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 6/14 2026-02-24T18:27:45.183 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 7/14 2026-02-24T18:27:45.183 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 8/14 2026-02-24T18:27:45.183 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 9/14 2026-02-24T18:27:45.183 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 10/14 2026-02-24T18:27:45.183 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 11/14 2026-02-24T18:27:45.183 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 12/14 2026-02-24T18:27:45.184 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 13/14 2026-02-24T18:27:45.192 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install python3-cephfs 2026-02-24T18:27:45.242 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 14/14 2026-02-24T18:27:45.243 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:45.243 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T18:27:45.243 INFO:teuthology.orchestra.run.trial195.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-24T18:27:45.243 INFO:teuthology.orchestra.run.trial195.stdout: ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:45.243 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:45.243 INFO:teuthology.orchestra.run.trial195.stdout: ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:45.243 INFO:teuthology.orchestra.run.trial195.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-24T18:27:45.243 INFO:teuthology.orchestra.run.trial195.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-24T18:27:45.244 INFO:teuthology.orchestra.run.trial195.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-24T18:27:45.244 INFO:teuthology.orchestra.run.trial195.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-24T18:27:45.244 INFO:teuthology.orchestra.run.trial195.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-24T18:27:45.244 INFO:teuthology.orchestra.run.trial195.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-24T18:27:45.244 INFO:teuthology.orchestra.run.trial195.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-24T18:27:45.244 INFO:teuthology.orchestra.run.trial195.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-24T18:27:45.244 INFO:teuthology.orchestra.run.trial195.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-24T18:27:45.244 INFO:teuthology.orchestra.run.trial195.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-24T18:27:45.244 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:45.244 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T18:27:45.262 INFO:teuthology.orchestra.run.trial170.stdout:(6/12): ceph-mgr-diskprediction-local-20.2.0-68 2.7 MB/s | 7.4 MB 00:02 2026-02-24T18:27:45.276 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-24T18:27:45.508 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:01:38 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:27:45.573 INFO:teuthology.orchestra.run.trial014.stdout:Package python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:45.592 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T18:27:45.592 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:39 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T18:27:45.593 INFO:teuthology.orchestra.run.trial014.stdout:Nothing to do. 2026-02-24T18:27:45.593 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T18:27:45.615 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install python3-rbd 2026-02-24T18:27:45.676 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T18:27:45.676 INFO:teuthology.orchestra.run.trial195.stdout:====================================================================================== 2026-02-24T18:27:45.677 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repository Size 2026-02-24T18:27:45.677 INFO:teuthology.orchestra.run.trial195.stdout:====================================================================================== 2026-02-24T18:27:45.677 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T18:27:45.677 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 7.4 M 2026-02-24T18:27:45.677 INFO:teuthology.orchestra.run.trial195.stdout:Installing dependencies: 2026-02-24T18:27:45.677 INFO:teuthology.orchestra.run.trial195.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-24T18:27:45.677 INFO:teuthology.orchestra.run.trial195.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-24T18:27:45.677 INFO:teuthology.orchestra.run.trial195.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-24T18:27:45.677 INFO:teuthology.orchestra.run.trial195.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-24T18:27:45.677 INFO:teuthology.orchestra.run.trial195.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-24T18:27:45.678 INFO:teuthology.orchestra.run.trial195.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-24T18:27:45.678 INFO:teuthology.orchestra.run.trial195.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-24T18:27:45.678 INFO:teuthology.orchestra.run.trial195.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-24T18:27:45.678 INFO:teuthology.orchestra.run.trial195.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-24T18:27:45.678 INFO:teuthology.orchestra.run.trial195.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-24T18:27:45.678 INFO:teuthology.orchestra.run.trial195.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-24T18:27:45.678 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:45.678 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T18:27:45.678 INFO:teuthology.orchestra.run.trial195.stdout:====================================================================================== 2026-02-24T18:27:45.678 INFO:teuthology.orchestra.run.trial195.stdout:Install 12 Packages 2026-02-24T18:27:45.678 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:45.679 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 43 M 2026-02-24T18:27:45.679 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 234 M 2026-02-24T18:27:45.679 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T18:27:45.882 INFO:teuthology.orchestra.run.trial195.stdout:(1/12): libquadmath-11.5.0-14.el9.x86_64.rpm 2.9 MB/s | 184 kB 00:00 2026-02-24T18:27:45.896 INFO:teuthology.orchestra.run.trial195.stdout:(2/12): libgfortran-11.5.0-14.el9.x86_64.rpm 10 MB/s | 794 kB 00:00 2026-02-24T18:27:45.909 INFO:teuthology.orchestra.run.trial195.stdout:(3/12): flexiblas-3.0.4-9.el9.x86_64.rpm 1.1 MB/s | 30 kB 00:00 2026-02-24T18:27:45.918 INFO:teuthology.orchestra.run.trial195.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-9.el9.x 1.6 MB/s | 15 kB 00:00 2026-02-24T18:27:45.929 INFO:teuthology.orchestra.run.trial195.stdout:(5/12): openblas-0.3.29-1.el9.x86_64.rpm 3.8 MB/s | 42 kB 00:00 2026-02-24T18:27:45.929 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:01:38 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:27:45.983 INFO:teuthology.orchestra.run.trial170.stdout:(7/12): python3-devel-3.9.25-3.el9.x86_64.rpm 339 kB/s | 244 kB 00:00 2026-02-24T18:27:45.988 INFO:teuthology.orchestra.run.trial195.stdout:(6/12): openblas-openmp-0.3.29-1.el9.x86_64.rpm 89 MB/s | 5.3 MB 00:00 2026-02-24T18:27:45.994 INFO:teuthology.orchestra.run.trial195.stdout:(7/12): flexiblas-netlib-3.0.4-9.el9.x86_64.rpm 31 MB/s | 3.0 MB 00:00 2026-02-24T18:27:45.994 INFO:teuthology.orchestra.run.trial014.stdout:Package python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:46.000 INFO:teuthology.orchestra.run.trial195.stdout:(8/12): python3-devel-3.9.25-3.el9.x86_64.rpm 20 MB/s | 244 kB 00:00 2026-02-24T18:27:46.013 INFO:teuthology.orchestra.run.trial195.stdout:(9/12): python3-numpy-f2py-1.23.5-2.el9.x86_64. 35 MB/s | 442 kB 00:00 2026-02-24T18:27:46.013 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T18:27:46.014 INFO:teuthology.orchestra.run.trial014.stdout:Nothing to do. 2026-02-24T18:27:46.014 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T18:27:46.030 INFO:teuthology.orchestra.run.trial195.stdout:(10/12): python3-numpy-1.23.5-2.el9.x86_64.rpm 174 MB/s | 6.1 MB 00:00 2026-02-24T18:27:46.036 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install rbd-fuse 2026-02-24T18:27:46.143 INFO:teuthology.orchestra.run.trial195.stdout:(11/12): python3-scipy-1.9.3-2.el9.x86_64.rpm 148 MB/s | 19 MB 00:00 2026-02-24T18:27:46.349 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:01:39 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:27:46.434 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T18:27:46.434 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:46.434 INFO:teuthology.orchestra.run.trial014.stdout: Package Architecture Version Repository Size 2026-02-24T18:27:46.434 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:46.434 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T18:27:46.434 INFO:teuthology.orchestra.run.trial014.stdout: rbd-fuse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 91 k 2026-02-24T18:27:46.435 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:46.435 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T18:27:46.435 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:46.435 INFO:teuthology.orchestra.run.trial014.stdout:Install 1 Package 2026-02-24T18:27:46.435 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:46.435 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 91 k 2026-02-24T18:27:46.435 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 238 k 2026-02-24T18:27:46.435 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T18:27:46.916 INFO:teuthology.orchestra.run.trial014.stdout:rbd-fuse-20.2.0-681.g36d388f2.el9.x86_64.rpm 189 kB/s | 91 kB 00:00 2026-02-24T18:27:46.917 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:46.917 INFO:teuthology.orchestra.run.trial014.stdout:Total 189 kB/s | 91 kB 00:00 2026-02-24T18:27:46.917 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T18:27:46.922 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T18:27:46.922 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T18:27:46.953 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T18:27:46.953 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T18:27:47.004 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T18:27:47.022 INFO:teuthology.orchestra.run.trial014.stdout: Installing : rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:47.106 INFO:teuthology.orchestra.run.trial170.stdout:(8/12): flexiblas-netlib-3.0.4-9.el9.x86_64.rpm 784 kB/s | 3.0 MB 00:03 2026-02-24T18:27:47.107 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:47.169 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:47.170 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:47.170 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T18:27:47.170 INFO:teuthology.orchestra.run.trial014.stdout: rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:47.170 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:47.170 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T18:27:47.196 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install rbd-mirror 2026-02-24T18:27:47.510 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:01:40 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:27:47.594 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T18:27:47.594 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:47.594 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repo Size 2026-02-24T18:27:47.594 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:47.594 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T18:27:47.594 INFO:teuthology.orchestra.run.trial014.stdout: rbd-mirror x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.9 M 2026-02-24T18:27:47.595 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:47.595 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T18:27:47.595 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:47.595 INFO:teuthology.orchestra.run.trial014.stdout:Install 1 Package 2026-02-24T18:27:47.595 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:47.595 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 2.9 M 2026-02-24T18:27:47.595 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 11 M 2026-02-24T18:27:47.595 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T18:27:47.661 INFO:teuthology.orchestra.run.trial170.stdout:(9/12): python3-numpy-f2py-1.23.5-2.el9.x86_64. 796 kB/s | 442 kB 00:00 2026-02-24T18:27:48.482 INFO:teuthology.orchestra.run.trial044.stdout:(12/12): ceph-mgr-diskprediction-local-20.2.0-6 1.2 MB/s | 7.4 MB 00:06 2026-02-24T18:27:48.483 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:48.483 INFO:teuthology.orchestra.run.trial044.stdout:Total 6.6 MB/s | 43 MB 00:06 2026-02-24T18:27:48.642 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T18:27:48.655 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T18:27:48.655 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T18:27:48.858 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T18:27:48.858 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T18:27:49.077 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T18:27:49.080 INFO:teuthology.orchestra.run.trial044.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 1/12 2026-02-24T18:27:49.086 INFO:teuthology.orchestra.run.trial044.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 2/12 2026-02-24T18:27:49.120 INFO:teuthology.orchestra.run.trial044.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 3/12 2026-02-24T18:27:49.125 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 4/12 2026-02-24T18:27:49.185 INFO:teuthology.orchestra.run.trial044.stdout: Installing : openblas-0.3.29-1.el9.x86_64 5/12 2026-02-24T18:27:49.187 INFO:teuthology.orchestra.run.trial044.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 6/12 2026-02-24T18:27:49.209 INFO:teuthology.orchestra.run.trial044.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 7/12 2026-02-24T18:27:49.529 INFO:teuthology.orchestra.run.trial044.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 8/12 2026-02-24T18:27:49.601 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 9/12 2026-02-24T18:27:49.810 INFO:teuthology.orchestra.run.trial170.stdout:(10/12): openblas-openmp-0.3.29-1.el9.x86_64.rp 886 kB/s | 5.3 MB 00:06 2026-02-24T18:27:50.160 INFO:teuthology.orchestra.run.trial170.stdout:(11/12): python3-scipy-1.9.3-2.el9.x86_64.rpm 7.7 MB/s | 19 MB 00:02 2026-02-24T18:27:50.265 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 10/12 2026-02-24T18:27:50.489 INFO:teuthology.orchestra.run.trial195.stdout:(12/12): ceph-mgr-diskprediction-local-20.2.0-6 1.6 MB/s | 7.4 MB 00:04 2026-02-24T18:27:50.489 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:50.490 INFO:teuthology.orchestra.run.trial195.stdout:Total 8.9 MB/s | 43 MB 00:04 2026-02-24T18:27:50.651 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T18:27:50.663 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T18:27:50.664 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T18:27:50.722 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 11/12 2026-02-24T18:27:50.723 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 12/12 2026-02-24T18:27:50.865 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T18:27:50.865 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T18:27:51.031 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 12/12 2026-02-24T18:27:51.031 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 1/12 2026-02-24T18:27:51.032 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 2/12 2026-02-24T18:27:51.032 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 3/12 2026-02-24T18:27:51.032 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 4/12 2026-02-24T18:27:51.032 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 5/12 2026-02-24T18:27:51.032 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 6/12 2026-02-24T18:27:51.032 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 7/12 2026-02-24T18:27:51.032 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 8/12 2026-02-24T18:27:51.032 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 9/12 2026-02-24T18:27:51.033 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 10/12 2026-02-24T18:27:51.033 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 11/12 2026-02-24T18:27:51.081 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T18:27:51.083 INFO:teuthology.orchestra.run.trial195.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 1/12 2026-02-24T18:27:51.089 INFO:teuthology.orchestra.run.trial195.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 2/12 2026-02-24T18:27:51.093 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 12/12 2026-02-24T18:27:51.093 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:51.093 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T18:27:51.093 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:51.093 INFO:teuthology.orchestra.run.trial044.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-24T18:27:51.093 INFO:teuthology.orchestra.run.trial044.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-24T18:27:51.093 INFO:teuthology.orchestra.run.trial044.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-24T18:27:51.093 INFO:teuthology.orchestra.run.trial044.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-24T18:27:51.094 INFO:teuthology.orchestra.run.trial044.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-24T18:27:51.094 INFO:teuthology.orchestra.run.trial044.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-24T18:27:51.094 INFO:teuthology.orchestra.run.trial044.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-24T18:27:51.094 INFO:teuthology.orchestra.run.trial044.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-24T18:27:51.094 INFO:teuthology.orchestra.run.trial044.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-24T18:27:51.094 INFO:teuthology.orchestra.run.trial044.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-24T18:27:51.094 INFO:teuthology.orchestra.run.trial044.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-24T18:27:51.094 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:51.094 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T18:27:51.122 INFO:teuthology.orchestra.run.trial195.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 3/12 2026-02-24T18:27:51.127 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 4/12 2026-02-24T18:27:51.129 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install ceph-mgr-rook 2026-02-24T18:27:51.186 INFO:teuthology.orchestra.run.trial195.stdout: Installing : openblas-0.3.29-1.el9.x86_64 5/12 2026-02-24T18:27:51.188 INFO:teuthology.orchestra.run.trial195.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 6/12 2026-02-24T18:27:51.192 INFO:teuthology.orchestra.run.trial170.stdout:(12/12): python3-numpy-1.23.5-2.el9.x86_64.rpm 1.2 MB/s | 6.1 MB 00:05 2026-02-24T18:27:51.195 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:51.195 INFO:teuthology.orchestra.run.trial170.stdout:Total 4.9 MB/s | 43 MB 00:08 2026-02-24T18:27:51.210 INFO:teuthology.orchestra.run.trial195.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 7/12 2026-02-24T18:27:51.352 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T18:27:51.366 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T18:27:51.366 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T18:27:51.449 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:01:44 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:27:51.530 INFO:teuthology.orchestra.run.trial195.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 8/12 2026-02-24T18:27:51.532 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T18:27:51.533 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:27:51.533 INFO:teuthology.orchestra.run.trial044.stdout: Package Arch Version Repository Size 2026-02-24T18:27:51.533 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:27:51.533 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T18:27:51.533 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mgr-rook noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 50 k 2026-02-24T18:27:51.533 INFO:teuthology.orchestra.run.trial044.stdout:Installing dependencies: 2026-02-24T18:27:51.533 INFO:teuthology.orchestra.run.trial044.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-24T18:27:51.533 INFO:teuthology.orchestra.run.trial044.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-24T18:27:51.533 INFO:teuthology.orchestra.run.trial044.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-24T18:27:51.533 INFO:teuthology.orchestra.run.trial044.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-24T18:27:51.533 INFO:teuthology.orchestra.run.trial044.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-24T18:27:51.533 INFO:teuthology.orchestra.run.trial044.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-24T18:27:51.533 INFO:teuthology.orchestra.run.trial044.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-24T18:27:51.533 INFO:teuthology.orchestra.run.trial044.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-24T18:27:51.533 INFO:teuthology.orchestra.run.trial044.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-24T18:27:51.533 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:51.533 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T18:27:51.533 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:27:51.533 INFO:teuthology.orchestra.run.trial044.stdout:Install 10 Packages 2026-02-24T18:27:51.533 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:51.534 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 2.0 M 2026-02-24T18:27:51.534 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 25 M 2026-02-24T18:27:51.534 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T18:27:51.566 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T18:27:51.566 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T18:27:51.602 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 9/12 2026-02-24T18:27:51.781 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T18:27:51.784 INFO:teuthology.orchestra.run.trial170.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 1/12 2026-02-24T18:27:51.790 INFO:teuthology.orchestra.run.trial170.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 2/12 2026-02-24T18:27:51.824 INFO:teuthology.orchestra.run.trial170.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 3/12 2026-02-24T18:27:51.828 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 4/12 2026-02-24T18:27:51.886 INFO:teuthology.orchestra.run.trial170.stdout: Installing : openblas-0.3.29-1.el9.x86_64 5/12 2026-02-24T18:27:51.889 INFO:teuthology.orchestra.run.trial170.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 6/12 2026-02-24T18:27:51.909 INFO:teuthology.orchestra.run.trial170.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 7/12 2026-02-24T18:27:51.985 INFO:teuthology.orchestra.run.trial044.stdout:(1/10): python3-pyasn1-0.4.8-7.el9.noarch.rpm 7.9 MB/s | 157 kB 00:00 2026-02-24T18:27:51.989 INFO:teuthology.orchestra.run.trial044.stdout:(2/10): python3-pyasn1-modules-0.4.8-7.el9.noar 12 MB/s | 277 kB 00:00 2026-02-24T18:27:51.991 INFO:teuthology.orchestra.run.trial044.stdout:(3/10): python3-requests-oauthlib-1.3.0-12.el9. 9.7 MB/s | 54 kB 00:00 2026-02-24T18:27:52.035 INFO:teuthology.orchestra.run.trial014.stdout:rbd-mirror-20.2.0-681.g36d388f2.el9.x86_64.rpm 672 kB/s | 2.9 MB 00:04 2026-02-24T18:27:52.035 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:52.036 INFO:teuthology.orchestra.run.trial014.stdout:Total 672 kB/s | 2.9 MB 00:04 2026-02-24T18:27:52.036 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T18:27:52.041 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T18:27:52.041 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T18:27:52.080 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T18:27:52.080 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T18:27:52.124 INFO:teuthology.orchestra.run.trial044.stdout:(4/10): python3-certifi-2023.05.07-4.el9.noarch 106 kB/s | 14 kB 00:00 2026-02-24T18:27:52.131 INFO:teuthology.orchestra.run.trial044.stdout:(5/10): python3-cachetools-4.2.4-1.el9.noarch.r 227 kB/s | 32 kB 00:00 2026-02-24T18:27:52.228 INFO:teuthology.orchestra.run.trial170.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 8/12 2026-02-24T18:27:52.257 INFO:teuthology.orchestra.run.trial044.stdout:(6/10): python3-google-auth-2.45.0-1.el9.noarch 1.9 MB/s | 254 kB 00:00 2026-02-24T18:27:52.258 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 10/12 2026-02-24T18:27:52.263 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T18:27:52.265 INFO:teuthology.orchestra.run.trial014.stdout: Installing : rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:52.287 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:52.288 INFO:teuthology.orchestra.run.trial014.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:52.288 INFO:teuthology.orchestra.run.trial014.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-24T18:27:52.288 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T18:27:52.288 INFO:teuthology.orchestra.run.trial014.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T18:27:52.288 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:52.291 INFO:teuthology.orchestra.run.trial044.stdout:(7/10): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2026-02-24T18:27:52.299 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 9/12 2026-02-24T18:27:52.310 INFO:teuthology.orchestra.run.trial044.stdout:(8/10): python3-kubernetes-26.1.0-3.el9.noarch. 5.7 MB/s | 1.0 MB 00:00 2026-02-24T18:27:52.328 INFO:teuthology.orchestra.run.trial044.stdout:(9/10): python3-websocket-client-1.2.3-2.el9.no 2.4 MB/s | 90 kB 00:00 2026-02-24T18:27:52.366 INFO:teuthology.orchestra.run.trial044.stdout:(10/10): ceph-mgr-rook-20.2.0-681.g36d388f2.el9 125 kB/s | 50 kB 00:00 2026-02-24T18:27:52.367 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:52.367 INFO:teuthology.orchestra.run.trial044.stdout:Total 2.4 MB/s | 2.0 MB 00:00 2026-02-24T18:27:52.393 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T18:27:52.400 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T18:27:52.400 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T18:27:52.440 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T18:27:52.440 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T18:27:52.516 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T18:27:52.567 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 1/10 2026-02-24T18:27:52.580 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 2/10 2026-02-24T18:27:52.595 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/10 2026-02-24T18:27:52.600 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/10 2026-02-24T18:27:52.608 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/10 2026-02-24T18:27:52.613 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:52.613 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:52.613 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T18:27:52.613 INFO:teuthology.orchestra.run.trial014.stdout: rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:52.614 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:52.614 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T18:27:52.641 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install rbd-nbd 2026-02-24T18:27:52.647 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/10 2026-02-24T18:27:52.659 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-24T18:27:52.711 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 11/12 2026-02-24T18:27:52.712 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 12/12 2026-02-24T18:27:52.959 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:01:45 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:27:52.960 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 10/12 2026-02-24T18:27:52.979 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 8/10 2026-02-24T18:27:52.993 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 9/10 2026-02-24T18:27:52.994 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 10/10 2026-02-24T18:27:52.997 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 12/12 2026-02-24T18:27:52.997 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 1/12 2026-02-24T18:27:52.998 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 2/12 2026-02-24T18:27:52.998 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 3/12 2026-02-24T18:27:52.998 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 4/12 2026-02-24T18:27:52.998 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 5/12 2026-02-24T18:27:52.998 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 6/12 2026-02-24T18:27:52.998 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 7/12 2026-02-24T18:27:52.998 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 8/12 2026-02-24T18:27:52.998 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 9/12 2026-02-24T18:27:52.998 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 10/12 2026-02-24T18:27:52.998 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 11/12 2026-02-24T18:27:53.043 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T18:27:53.043 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:53.043 INFO:teuthology.orchestra.run.trial014.stdout: Package Architecture Version Repository Size 2026-02-24T18:27:53.043 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:53.043 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T18:27:53.043 INFO:teuthology.orchestra.run.trial014.stdout: rbd-nbd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 180 k 2026-02-24T18:27:53.043 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:53.043 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T18:27:53.043 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:53.043 INFO:teuthology.orchestra.run.trial014.stdout:Install 1 Package 2026-02-24T18:27:53.043 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:53.043 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 180 k 2026-02-24T18:27:53.043 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 498 k 2026-02-24T18:27:53.043 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T18:27:53.062 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 12/12 2026-02-24T18:27:53.062 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:53.062 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T18:27:53.063 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:53.063 INFO:teuthology.orchestra.run.trial195.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-24T18:27:53.063 INFO:teuthology.orchestra.run.trial195.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-24T18:27:53.063 INFO:teuthology.orchestra.run.trial195.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-24T18:27:53.063 INFO:teuthology.orchestra.run.trial195.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-24T18:27:53.063 INFO:teuthology.orchestra.run.trial195.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-24T18:27:53.063 INFO:teuthology.orchestra.run.trial195.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-24T18:27:53.063 INFO:teuthology.orchestra.run.trial195.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-24T18:27:53.063 INFO:teuthology.orchestra.run.trial195.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-24T18:27:53.063 INFO:teuthology.orchestra.run.trial195.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-24T18:27:53.063 INFO:teuthology.orchestra.run.trial195.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-24T18:27:53.063 INFO:teuthology.orchestra.run.trial195.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-24T18:27:53.063 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:53.063 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T18:27:53.100 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph-mgr-rook 2026-02-24T18:27:53.110 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 10/10 2026-02-24T18:27:53.110 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 1/10 2026-02-24T18:27:53.110 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 2/10 2026-02-24T18:27:53.110 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 3/10 2026-02-24T18:27:53.110 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 4/10 2026-02-24T18:27:53.110 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 5/10 2026-02-24T18:27:53.110 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 6/10 2026-02-24T18:27:53.110 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-24T18:27:53.111 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 8/10 2026-02-24T18:27:53.111 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 9/10 2026-02-24T18:27:53.171 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 10/10 2026-02-24T18:27:53.171 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:53.171 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T18:27:53.171 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:53.171 INFO:teuthology.orchestra.run.trial044.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-24T18:27:53.171 INFO:teuthology.orchestra.run.trial044.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-24T18:27:53.171 INFO:teuthology.orchestra.run.trial044.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-24T18:27:53.171 INFO:teuthology.orchestra.run.trial044.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-24T18:27:53.171 INFO:teuthology.orchestra.run.trial044.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-24T18:27:53.171 INFO:teuthology.orchestra.run.trial044.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-24T18:27:53.171 INFO:teuthology.orchestra.run.trial044.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-24T18:27:53.171 INFO:teuthology.orchestra.run.trial044.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-24T18:27:53.171 INFO:teuthology.orchestra.run.trial044.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-24T18:27:53.171 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:53.171 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T18:27:53.201 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install ceph-mgr-cephadm 2026-02-24T18:27:53.414 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 11/12 2026-02-24T18:27:53.415 INFO:teuthology.orchestra.run.trial170.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 12/12 2026-02-24T18:27:53.416 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:47 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T18:27:53.501 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T18:27:53.501 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:27:53.501 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repository Size 2026-02-24T18:27:53.502 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:27:53.502 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T18:27:53.502 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mgr-rook noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 50 k 2026-02-24T18:27:53.502 INFO:teuthology.orchestra.run.trial195.stdout:Installing dependencies: 2026-02-24T18:27:53.502 INFO:teuthology.orchestra.run.trial195.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-24T18:27:53.502 INFO:teuthology.orchestra.run.trial195.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-24T18:27:53.502 INFO:teuthology.orchestra.run.trial195.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-24T18:27:53.502 INFO:teuthology.orchestra.run.trial195.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-24T18:27:53.502 INFO:teuthology.orchestra.run.trial195.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-24T18:27:53.502 INFO:teuthology.orchestra.run.trial195.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-24T18:27:53.502 INFO:teuthology.orchestra.run.trial195.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-24T18:27:53.502 INFO:teuthology.orchestra.run.trial195.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-24T18:27:53.502 INFO:teuthology.orchestra.run.trial195.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-24T18:27:53.502 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:53.502 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T18:27:53.502 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:27:53.502 INFO:teuthology.orchestra.run.trial195.stdout:Install 10 Packages 2026-02-24T18:27:53.502 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:53.503 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 2.0 M 2026-02-24T18:27:53.503 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 25 M 2026-02-24T18:27:53.503 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T18:27:53.512 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:01:46 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:27:53.517 INFO:teuthology.orchestra.run.trial014.stdout:rbd-nbd-20.2.0-681.g36d388f2.el9.x86_64.rpm 379 kB/s | 180 kB 00:00 2026-02-24T18:27:53.518 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:53.518 INFO:teuthology.orchestra.run.trial014.stdout:Total 379 kB/s | 180 kB 00:00 2026-02-24T18:27:53.518 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T18:27:53.523 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T18:27:53.523 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T18:27:53.553 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T18:27:53.553 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T18:27:53.595 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T18:27:53.595 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:27:53.595 INFO:teuthology.orchestra.run.trial044.stdout: Package Arch Version Repository Size 2026-02-24T18:27:53.595 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:27:53.595 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T18:27:53.595 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mgr-cephadm noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 173 k 2026-02-24T18:27:53.595 INFO:teuthology.orchestra.run.trial044.stdout:Installing dependencies: 2026-02-24T18:27:53.595 INFO:teuthology.orchestra.run.trial044.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-24T18:27:53.595 INFO:teuthology.orchestra.run.trial044.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-24T18:27:53.595 INFO:teuthology.orchestra.run.trial044.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-24T18:27:53.595 INFO:teuthology.orchestra.run.trial044.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-24T18:27:53.595 INFO:teuthology.orchestra.run.trial044.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-24T18:27:53.595 INFO:teuthology.orchestra.run.trial044.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-24T18:27:53.596 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:53.596 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T18:27:53.596 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:27:53.596 INFO:teuthology.orchestra.run.trial044.stdout:Install 7 Packages 2026-02-24T18:27:53.596 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:53.596 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 7.1 M 2026-02-24T18:27:53.596 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 33 M 2026-02-24T18:27:53.596 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T18:27:53.609 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T18:27:53.626 INFO:teuthology.orchestra.run.trial014.stdout: Installing : rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:53.712 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:53.715 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 12/12 2026-02-24T18:27:53.716 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 1/12 2026-02-24T18:27:53.716 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 2/12 2026-02-24T18:27:53.716 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 3/12 2026-02-24T18:27:53.716 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 4/12 2026-02-24T18:27:53.716 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 5/12 2026-02-24T18:27:53.716 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 6/12 2026-02-24T18:27:53.716 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 7/12 2026-02-24T18:27:53.716 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 8/12 2026-02-24T18:27:53.716 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 9/12 2026-02-24T18:27:53.716 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 10/12 2026-02-24T18:27:53.716 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 11/12 2026-02-24T18:27:53.777 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 12/12 2026-02-24T18:27:53.778 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:27:53.778 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T18:27:53.778 INFO:teuthology.orchestra.run.trial170.stdout: ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:53.778 INFO:teuthology.orchestra.run.trial170.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-24T18:27:53.778 INFO:teuthology.orchestra.run.trial170.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-24T18:27:53.778 INFO:teuthology.orchestra.run.trial170.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-24T18:27:53.778 INFO:teuthology.orchestra.run.trial170.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-24T18:27:53.778 INFO:teuthology.orchestra.run.trial170.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-24T18:27:53.778 INFO:teuthology.orchestra.run.trial170.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-24T18:27:53.778 INFO:teuthology.orchestra.run.trial170.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-24T18:27:53.778 INFO:teuthology.orchestra.run.trial170.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-24T18:27:53.778 INFO:teuthology.orchestra.run.trial170.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-24T18:27:53.778 INFO:teuthology.orchestra.run.trial170.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-24T18:27:53.778 INFO:teuthology.orchestra.run.trial170.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-24T18:27:53.778 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:27:53.778 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T18:27:53.778 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:53.778 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:53.778 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T18:27:53.779 INFO:teuthology.orchestra.run.trial014.stdout: rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:53.779 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:53.779 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T18:27:53.807 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install ceph-base-debuginfo 2026-02-24T18:27:53.814 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install ceph-mgr-rook 2026-02-24T18:27:54.123 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:01:47 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:27:54.131 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:01:50 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T18:27:54.177 INFO:teuthology.orchestra.run.trial195.stdout:(1/10): python3-pyasn1-modules-0.4.8-7.el9.noar 12 MB/s | 277 kB 00:00 2026-02-24T18:27:54.182 INFO:teuthology.orchestra.run.trial195.stdout:(2/10): python3-requests-oauthlib-1.3.0-12.el9. 9.7 MB/s | 54 kB 00:00 2026-02-24T18:27:54.188 INFO:teuthology.orchestra.run.trial195.stdout:(3/10): python3-pyasn1-0.4.8-7.el9.noarch.rpm 4.6 MB/s | 157 kB 00:00 2026-02-24T18:27:54.209 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T18:27:54.209 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:54.209 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repo Size 2026-02-24T18:27:54.209 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:54.209 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T18:27:54.210 INFO:teuthology.orchestra.run.trial014.stdout: ceph-base-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 107 M 2026-02-24T18:27:54.210 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:54.210 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T18:27:54.210 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:27:54.210 INFO:teuthology.orchestra.run.trial014.stdout:Install 1 Package 2026-02-24T18:27:54.210 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:27:54.210 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 107 M 2026-02-24T18:27:54.210 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 664 M 2026-02-24T18:27:54.210 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T18:27:54.215 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T18:27:54.216 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:27:54.216 INFO:teuthology.orchestra.run.trial170.stdout: Package Arch Version Repository Size 2026-02-24T18:27:54.217 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:27:54.217 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T18:27:54.217 INFO:teuthology.orchestra.run.trial170.stdout: ceph-mgr-rook noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 50 k 2026-02-24T18:27:54.217 INFO:teuthology.orchestra.run.trial170.stdout:Installing dependencies: 2026-02-24T18:27:54.217 INFO:teuthology.orchestra.run.trial170.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-24T18:27:54.217 INFO:teuthology.orchestra.run.trial170.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-24T18:27:54.217 INFO:teuthology.orchestra.run.trial170.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-24T18:27:54.217 INFO:teuthology.orchestra.run.trial170.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-24T18:27:54.217 INFO:teuthology.orchestra.run.trial170.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-24T18:27:54.217 INFO:teuthology.orchestra.run.trial170.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-24T18:27:54.217 INFO:teuthology.orchestra.run.trial170.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-24T18:27:54.218 INFO:teuthology.orchestra.run.trial170.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-24T18:27:54.218 INFO:teuthology.orchestra.run.trial170.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-24T18:27:54.218 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:27:54.218 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T18:27:54.218 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:27:54.218 INFO:teuthology.orchestra.run.trial170.stdout:Install 10 Packages 2026-02-24T18:27:54.218 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:27:54.218 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 2.0 M 2026-02-24T18:27:54.218 INFO:teuthology.orchestra.run.trial170.stdout:Installed size: 25 M 2026-02-24T18:27:54.218 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T18:27:54.278 INFO:teuthology.orchestra.run.trial195.stdout:(4/10): python3-certifi-2023.05.07-4.el9.noarch 158 kB/s | 14 kB 00:00 2026-02-24T18:27:54.281 INFO:teuthology.orchestra.run.trial195.stdout:(5/10): python3-cachetools-4.2.4-1.el9.noarch.r 325 kB/s | 32 kB 00:00 2026-02-24T18:27:54.392 INFO:teuthology.orchestra.run.trial195.stdout:(6/10): python3-google-auth-2.45.0-1.el9.noarch 2.2 MB/s | 254 kB 00:00 2026-02-24T18:27:54.422 INFO:teuthology.orchestra.run.trial195.stdout:(7/10): python3-rsa-4.9-2.el9.noarch.rpm 1.9 MB/s | 59 kB 00:00 2026-02-24T18:27:54.428 INFO:teuthology.orchestra.run.trial195.stdout:(8/10): python3-kubernetes-26.1.0-3.el9.noarch. 6.9 MB/s | 1.0 MB 00:00 2026-02-24T18:27:54.452 INFO:teuthology.orchestra.run.trial195.stdout:(9/10): python3-websocket-client-1.2.3-2.el9.no 2.9 MB/s | 90 kB 00:00 2026-02-24T18:27:54.558 INFO:teuthology.orchestra.run.trial195.stdout:(10/10): ceph-mgr-rook-20.2.0-681.g36d388f2.el9 124 kB/s | 50 kB 00:00 2026-02-24T18:27:54.559 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:54.559 INFO:teuthology.orchestra.run.trial195.stdout:Total 1.9 MB/s | 2.0 MB 00:01 2026-02-24T18:27:54.585 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T18:27:54.592 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T18:27:54.592 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T18:27:54.632 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T18:27:54.632 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T18:27:54.708 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T18:27:54.758 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 1/10 2026-02-24T18:27:54.770 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 2/10 2026-02-24T18:27:54.785 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/10 2026-02-24T18:27:54.790 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/10 2026-02-24T18:27:54.797 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/10 2026-02-24T18:27:54.836 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/10 2026-02-24T18:27:54.848 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-24T18:27:54.933 INFO:teuthology.orchestra.run.trial044.stdout:(1/7): python3-jinja2-2.11.3-8.el9.noarch.rpm 287 kB/s | 249 kB 00:00 2026-02-24T18:27:54.954 INFO:teuthology.orchestra.run.trial170.stdout:(1/10): ceph-mgr-rook-20.2.0-681.g36d388f2.el9. 122 kB/s | 50 kB 00:00 2026-02-24T18:27:54.992 INFO:teuthology.orchestra.run.trial170.stdout:(2/10): python3-pyasn1-0.4.8-7.el9.noarch.rpm 351 kB/s | 157 kB 00:00 2026-02-24T18:27:55.007 INFO:teuthology.orchestra.run.trial044.stdout:(2/7): ceph-mgr-cephadm-20.2.0-681.g36d388f2.el 184 kB/s | 173 kB 00:00 2026-02-24T18:27:55.058 INFO:teuthology.orchestra.run.trial170.stdout:(3/10): python3-pyasn1-modules-0.4.8-7.el9.noar 540 kB/s | 277 kB 00:00 2026-02-24T18:27:55.093 INFO:teuthology.orchestra.run.trial044.stdout:(3/7): python3-markupsafe-1.1.1-12.el9.x86_64.r 216 kB/s | 35 kB 00:00 2026-02-24T18:27:55.165 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 8/10 2026-02-24T18:27:55.180 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 9/10 2026-02-24T18:27:55.181 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 10/10 2026-02-24T18:27:55.284 INFO:teuthology.orchestra.run.trial170.stdout:(4/10): python3-requests-oauthlib-1.3.0-12.el9. 162 kB/s | 54 kB 00:00 2026-02-24T18:27:55.295 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 10/10 2026-02-24T18:27:55.295 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 1/10 2026-02-24T18:27:55.295 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 2/10 2026-02-24T18:27:55.295 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 3/10 2026-02-24T18:27:55.295 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 4/10 2026-02-24T18:27:55.295 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 5/10 2026-02-24T18:27:55.295 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 6/10 2026-02-24T18:27:55.295 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-24T18:27:55.296 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 8/10 2026-02-24T18:27:55.296 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 9/10 2026-02-24T18:27:55.303 INFO:teuthology.orchestra.run.trial170.stdout:(5/10): python3-certifi-2023.05.07-4.el9.noarch 57 kB/s | 14 kB 00:00 2026-02-24T18:27:55.308 INFO:teuthology.orchestra.run.trial170.stdout:(6/10): python3-cachetools-4.2.4-1.el9.noarch.r 102 kB/s | 32 kB 00:00 2026-02-24T18:27:55.358 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 10/10 2026-02-24T18:27:55.358 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:55.358 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T18:27:55.358 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:55.358 INFO:teuthology.orchestra.run.trial195.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-24T18:27:55.359 INFO:teuthology.orchestra.run.trial195.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-24T18:27:55.359 INFO:teuthology.orchestra.run.trial195.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-24T18:27:55.359 INFO:teuthology.orchestra.run.trial195.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-24T18:27:55.359 INFO:teuthology.orchestra.run.trial195.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-24T18:27:55.359 INFO:teuthology.orchestra.run.trial195.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-24T18:27:55.359 INFO:teuthology.orchestra.run.trial195.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-24T18:27:55.359 INFO:teuthology.orchestra.run.trial195.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-24T18:27:55.360 INFO:teuthology.orchestra.run.trial195.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-24T18:27:55.360 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:55.360 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T18:27:55.391 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph-mgr-cephadm 2026-02-24T18:27:55.443 INFO:teuthology.orchestra.run.trial170.stdout:(7/10): python3-rsa-4.9-2.el9.noarch.rpm 439 kB/s | 59 kB 00:00 2026-02-24T18:27:55.465 INFO:teuthology.orchestra.run.trial044.stdout:(4/7): python3-natsort-7.1.1-5.el9.noarch.rpm 155 kB/s | 58 kB 00:00 2026-02-24T18:27:55.543 INFO:teuthology.orchestra.run.trial170.stdout:(8/10): python3-websocket-client-1.2.3-2.el9.no 891 kB/s | 90 kB 00:00 2026-02-24T18:27:55.597 INFO:teuthology.orchestra.run.trial044.stdout:(5/7): python3-asyncssh-2.13.2-5.el9.noarch.rpm 929 kB/s | 548 kB 00:00 2026-02-24T18:27:55.597 INFO:teuthology.orchestra.run.trial044.stdout:(6/7): python3-typing-extensions-4.15.0-1.el9.n 655 kB/s | 86 kB 00:00 2026-02-24T18:27:55.703 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:49 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T18:27:55.724 INFO:teuthology.orchestra.run.trial170.stdout:(9/10): python3-kubernetes-26.1.0-3.el9.noarch. 2.4 MB/s | 1.0 MB 00:00 2026-02-24T18:27:55.765 INFO:teuthology.orchestra.run.trial170.stdout:(10/10): python3-google-auth-2.45.0-1.el9.noarc 528 kB/s | 254 kB 00:00 2026-02-24T18:27:55.767 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:55.767 INFO:teuthology.orchestra.run.trial170.stdout:Total 1.3 MB/s | 2.0 MB 00:01 2026-02-24T18:27:55.789 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T18:27:55.791 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:27:55.791 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repository Size 2026-02-24T18:27:55.791 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:27:55.791 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T18:27:55.792 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mgr-cephadm noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 173 k 2026-02-24T18:27:55.792 INFO:teuthology.orchestra.run.trial195.stdout:Installing dependencies: 2026-02-24T18:27:55.792 INFO:teuthology.orchestra.run.trial195.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-24T18:27:55.792 INFO:teuthology.orchestra.run.trial195.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-24T18:27:55.792 INFO:teuthology.orchestra.run.trial195.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-24T18:27:55.792 INFO:teuthology.orchestra.run.trial195.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-24T18:27:55.792 INFO:teuthology.orchestra.run.trial195.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-24T18:27:55.792 INFO:teuthology.orchestra.run.trial195.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-24T18:27:55.793 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:55.793 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T18:27:55.793 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:27:55.793 INFO:teuthology.orchestra.run.trial195.stdout:Install 7 Packages 2026-02-24T18:27:55.793 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:55.793 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 7.1 M 2026-02-24T18:27:55.794 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 33 M 2026-02-24T18:27:55.794 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T18:27:55.794 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T18:27:55.799 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T18:27:55.799 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T18:27:55.837 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T18:27:55.838 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T18:27:55.912 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T18:27:55.961 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 1/10 2026-02-24T18:27:55.974 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 2/10 2026-02-24T18:27:55.988 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/10 2026-02-24T18:27:55.993 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/10 2026-02-24T18:27:56.000 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/10 2026-02-24T18:27:56.039 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/10 2026-02-24T18:27:56.051 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-24T18:27:56.261 INFO:teuthology.orchestra.run.trial195.stdout:(1/7): python3-jinja2-2.11.3-8.el9.noarch.rpm 4.6 MB/s | 249 kB 00:00 2026-02-24T18:27:56.271 INFO:teuthology.orchestra.run.trial195.stdout:(2/7): python3-markupsafe-1.1.1-12.el9.x86_64.r 3.5 MB/s | 35 kB 00:00 2026-02-24T18:27:56.315 INFO:teuthology.orchestra.run.trial195.stdout:(3/7): python3-babel-2.9.1-2.el9.noarch.rpm 56 MB/s | 6.0 MB 00:00 2026-02-24T18:27:56.364 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 8/10 2026-02-24T18:27:56.378 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 9/10 2026-02-24T18:27:56.379 INFO:teuthology.orchestra.run.trial170.stdout: Installing : ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 10/10 2026-02-24T18:27:56.493 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 10/10 2026-02-24T18:27:56.493 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 1/10 2026-02-24T18:27:56.493 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 2/10 2026-02-24T18:27:56.493 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 3/10 2026-02-24T18:27:56.493 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 4/10 2026-02-24T18:27:56.493 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 5/10 2026-02-24T18:27:56.493 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 6/10 2026-02-24T18:27:56.494 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-24T18:27:56.494 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 8/10 2026-02-24T18:27:56.494 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 9/10 2026-02-24T18:27:56.553 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 10/10 2026-02-24T18:27:56.553 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:27:56.553 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T18:27:56.553 INFO:teuthology.orchestra.run.trial170.stdout: ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:56.553 INFO:teuthology.orchestra.run.trial170.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-24T18:27:56.553 INFO:teuthology.orchestra.run.trial170.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-24T18:27:56.554 INFO:teuthology.orchestra.run.trial170.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-24T18:27:56.554 INFO:teuthology.orchestra.run.trial170.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-24T18:27:56.554 INFO:teuthology.orchestra.run.trial170.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-24T18:27:56.554 INFO:teuthology.orchestra.run.trial170.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-24T18:27:56.554 INFO:teuthology.orchestra.run.trial170.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-24T18:27:56.554 INFO:teuthology.orchestra.run.trial170.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-24T18:27:56.554 INFO:teuthology.orchestra.run.trial170.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-24T18:27:56.554 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:27:56.554 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T18:27:56.584 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install ceph-mgr-cephadm 2026-02-24T18:27:56.610 INFO:teuthology.orchestra.run.trial195.stdout:(4/7): python3-natsort-7.1.1-5.el9.noarch.rpm 196 kB/s | 58 kB 00:00 2026-02-24T18:27:56.633 INFO:teuthology.orchestra.run.trial195.stdout:(5/7): ceph-mgr-cephadm-20.2.0-681.g36d388f2.el 407 kB/s | 173 kB 00:00 2026-02-24T18:27:56.758 INFO:teuthology.orchestra.run.trial195.stdout:(6/7): python3-typing-extensions-4.15.0-1.el9.n 583 kB/s | 86 kB 00:00 2026-02-24T18:27:56.800 INFO:teuthology.orchestra.run.trial195.stdout:(7/7): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.0 MB/s | 548 kB 00:00 2026-02-24T18:27:56.800 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:56.801 INFO:teuthology.orchestra.run.trial195.stdout:Total 7.0 MB/s | 7.1 MB 00:01 2026-02-24T18:27:56.840 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T18:27:56.846 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T18:27:56.846 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T18:27:56.895 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:01:52 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T18:27:56.917 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T18:27:56.917 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T18:27:56.980 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T18:27:56.981 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:27:56.981 INFO:teuthology.orchestra.run.trial170.stdout: Package Arch Version Repository Size 2026-02-24T18:27:56.981 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:27:56.981 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T18:27:56.981 INFO:teuthology.orchestra.run.trial170.stdout: ceph-mgr-cephadm noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 173 k 2026-02-24T18:27:56.982 INFO:teuthology.orchestra.run.trial170.stdout:Installing dependencies: 2026-02-24T18:27:56.982 INFO:teuthology.orchestra.run.trial170.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-24T18:27:56.982 INFO:teuthology.orchestra.run.trial170.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-24T18:27:56.982 INFO:teuthology.orchestra.run.trial170.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-24T18:27:56.982 INFO:teuthology.orchestra.run.trial170.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-24T18:27:56.982 INFO:teuthology.orchestra.run.trial170.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-24T18:27:56.982 INFO:teuthology.orchestra.run.trial170.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-24T18:27:56.982 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:27:56.982 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T18:27:56.982 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:27:56.982 INFO:teuthology.orchestra.run.trial170.stdout:Install 7 Packages 2026-02-24T18:27:56.983 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:27:56.983 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 7.1 M 2026-02-24T18:27:56.983 INFO:teuthology.orchestra.run.trial170.stdout:Installed size: 33 M 2026-02-24T18:27:56.983 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T18:27:57.008 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T18:27:57.057 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 1/7 2026-02-24T18:27:57.066 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/7 2026-02-24T18:27:57.072 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/7 2026-02-24T18:27:57.252 INFO:teuthology.orchestra.run.trial044.stdout:(7/7): python3-babel-2.9.1-2.el9.noarch.rpm 1.9 MB/s | 6.0 MB 00:03 2026-02-24T18:27:57.254 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:57.254 INFO:teuthology.orchestra.run.trial044.stdout:Total 1.9 MB/s | 7.1 MB 00:03 2026-02-24T18:27:57.291 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-24T18:27:57.294 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T18:27:57.301 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T18:27:57.301 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T18:27:57.314 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 5/7 2026-02-24T18:27:57.337 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 6/7 2026-02-24T18:27:57.339 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 7/7 2026-02-24T18:27:57.374 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T18:27:57.374 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T18:27:57.450 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 7/7 2026-02-24T18:27:57.450 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/7 2026-02-24T18:27:57.450 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/7 2026-02-24T18:27:57.450 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 3/7 2026-02-24T18:27:57.450 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-24T18:27:57.450 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 5/7 2026-02-24T18:27:57.450 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 6/7 2026-02-24T18:27:57.464 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T18:27:57.512 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 7/7 2026-02-24T18:27:57.512 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:57.512 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T18:27:57.512 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:57.512 INFO:teuthology.orchestra.run.trial195.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-24T18:27:57.512 INFO:teuthology.orchestra.run.trial195.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-24T18:27:57.512 INFO:teuthology.orchestra.run.trial195.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-24T18:27:57.513 INFO:teuthology.orchestra.run.trial195.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-24T18:27:57.513 INFO:teuthology.orchestra.run.trial195.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-24T18:27:57.513 INFO:teuthology.orchestra.run.trial195.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-24T18:27:57.513 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:57.513 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T18:27:57.514 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 1/7 2026-02-24T18:27:57.524 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/7 2026-02-24T18:27:57.530 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/7 2026-02-24T18:27:57.544 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph-fuse 2026-02-24T18:27:57.592 INFO:teuthology.orchestra.run.trial170.stdout:(1/7): ceph-mgr-cephadm-20.2.0-681.g36d388f2.el 373 kB/s | 173 kB 00:00 2026-02-24T18:27:57.752 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-24T18:27:57.776 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 5/7 2026-02-24T18:27:57.800 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 6/7 2026-02-24T18:27:57.801 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 7/7 2026-02-24T18:27:57.862 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:51 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T18:27:57.919 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 7/7 2026-02-24T18:27:57.919 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/7 2026-02-24T18:27:57.919 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/7 2026-02-24T18:27:57.919 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 3/7 2026-02-24T18:27:57.919 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-24T18:27:57.919 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 5/7 2026-02-24T18:27:57.920 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 6/7 2026-02-24T18:27:57.948 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T18:27:57.948 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:27:57.948 INFO:teuthology.orchestra.run.trial195.stdout: Package Architecture Version Repository Size 2026-02-24T18:27:57.948 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:27:57.948 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T18:27:57.948 INFO:teuthology.orchestra.run.trial195.stdout: ceph-fuse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 942 k 2026-02-24T18:27:57.948 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:57.948 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T18:27:57.948 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:27:57.948 INFO:teuthology.orchestra.run.trial195.stdout:Install 1 Package 2026-02-24T18:27:57.949 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:57.949 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 942 k 2026-02-24T18:27:57.949 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 2.7 M 2026-02-24T18:27:57.949 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T18:27:57.981 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 7/7 2026-02-24T18:27:57.981 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:57.982 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T18:27:57.982 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:57.982 INFO:teuthology.orchestra.run.trial044.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-24T18:27:57.982 INFO:teuthology.orchestra.run.trial044.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-24T18:27:57.982 INFO:teuthology.orchestra.run.trial044.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-24T18:27:57.982 INFO:teuthology.orchestra.run.trial044.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-24T18:27:57.982 INFO:teuthology.orchestra.run.trial044.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-24T18:27:57.982 INFO:teuthology.orchestra.run.trial044.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-24T18:27:57.982 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:57.982 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T18:27:57.997 INFO:teuthology.orchestra.run.trial170.stdout:(2/7): python3-jinja2-2.11.3-8.el9.noarch.rpm 286 kB/s | 249 kB 00:00 2026-02-24T18:27:58.014 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install ceph-fuse 2026-02-24T18:27:58.069 INFO:teuthology.orchestra.run.trial170.stdout:(3/7): python3-markupsafe-1.1.1-12.el9.x86_64.r 73 kB/s | 35 kB 00:00 2026-02-24T18:27:58.334 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:01:51 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:27:58.382 INFO:teuthology.orchestra.run.trial170.stdout:(4/7): python3-natsort-7.1.1-5.el9.noarch.rpm 184 kB/s | 58 kB 00:00 2026-02-24T18:27:58.419 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T18:27:58.419 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:27:58.419 INFO:teuthology.orchestra.run.trial044.stdout: Package Architecture Version Repository Size 2026-02-24T18:27:58.419 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:27:58.419 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T18:27:58.419 INFO:teuthology.orchestra.run.trial044.stdout: ceph-fuse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 942 k 2026-02-24T18:27:58.419 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:58.419 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T18:27:58.419 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:27:58.420 INFO:teuthology.orchestra.run.trial044.stdout:Install 1 Package 2026-02-24T18:27:58.420 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:58.420 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 942 k 2026-02-24T18:27:58.420 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 2.7 M 2026-02-24T18:27:58.420 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T18:27:58.507 INFO:teuthology.orchestra.run.trial170.stdout:(5/7): python3-typing-extensions-4.15.0-1.el9.n 692 kB/s | 86 kB 00:00 2026-02-24T18:27:58.512 INFO:teuthology.orchestra.run.trial170.stdout:(6/7): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.0 MB/s | 548 kB 00:00 2026-02-24T18:27:58.711 INFO:teuthology.orchestra.run.trial195.stdout:ceph-fuse-20.2.0-681.g36d388f2.el9.x86_64.rpm 1.2 MB/s | 942 kB 00:00 2026-02-24T18:27:58.712 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:58.712 INFO:teuthology.orchestra.run.trial195.stdout:Total 1.2 MB/s | 942 kB 00:00 2026-02-24T18:27:58.712 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T18:27:58.716 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T18:27:58.717 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T18:27:58.749 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T18:27:58.749 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T18:27:58.839 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T18:27:58.857 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:59.071 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:59.132 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:59.132 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:59.133 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T18:27:59.133 INFO:teuthology.orchestra.run.trial195.stdout: ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:59.133 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:59.133 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T18:27:59.161 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph-volume 2026-02-24T18:27:59.177 INFO:teuthology.orchestra.run.trial044.stdout:ceph-fuse-20.2.0-681.g36d388f2.el9.x86_64.rpm 1.2 MB/s | 942 kB 00:00 2026-02-24T18:27:59.178 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:59.178 INFO:teuthology.orchestra.run.trial044.stdout:Total 1.2 MB/s | 942 kB 00:00 2026-02-24T18:27:59.178 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T18:27:59.183 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T18:27:59.183 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T18:27:59.216 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T18:27:59.216 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T18:27:59.305 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T18:27:59.322 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:59.476 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:53 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T18:27:59.563 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T18:27:59.563 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:27:59.563 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repository Size 2026-02-24T18:27:59.563 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:27:59.564 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T18:27:59.564 INFO:teuthology.orchestra.run.trial195.stdout: ceph-volume noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 297 k 2026-02-24T18:27:59.564 INFO:teuthology.orchestra.run.trial195.stdout:Installing dependencies: 2026-02-24T18:27:59.564 INFO:teuthology.orchestra.run.trial195.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-24T18:27:59.564 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:59.564 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T18:27:59.564 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:27:59.565 INFO:teuthology.orchestra.run.trial195.stdout:Install 2 Packages 2026-02-24T18:27:59.565 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:27:59.565 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 648 k 2026-02-24T18:27:59.565 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 2.2 M 2026-02-24T18:27:59.565 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T18:27:59.582 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:59.644 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:59.644 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:59.644 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T18:27:59.644 INFO:teuthology.orchestra.run.trial044.stdout: ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:59.644 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:27:59.644 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T18:27:59.647 INFO:teuthology.orchestra.run.trial195.stdout:(1/2): cryptsetup-2.8.1-3.el9.x86_64.rpm 16 MB/s | 351 kB 00:00 2026-02-24T18:27:59.673 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install ceph-volume 2026-02-24T18:27:59.988 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:01:52 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:27:59.993 INFO:teuthology.orchestra.run.trial170.stdout:(7/7): python3-babel-2.9.1-2.el9.noarch.rpm 2.1 MB/s | 6.0 MB 00:02 2026-02-24T18:27:59.995 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:59.995 INFO:teuthology.orchestra.run.trial170.stdout:Total 2.4 MB/s | 7.1 MB 00:03 2026-02-24T18:28:00.033 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T18:28:00.039 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T18:28:00.039 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T18:28:00.071 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T18:28:00.072 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:28:00.072 INFO:teuthology.orchestra.run.trial044.stdout: Package Arch Version Repository Size 2026-02-24T18:28:00.072 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:28:00.072 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T18:28:00.072 INFO:teuthology.orchestra.run.trial044.stdout: ceph-volume noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 297 k 2026-02-24T18:28:00.072 INFO:teuthology.orchestra.run.trial044.stdout:Installing dependencies: 2026-02-24T18:28:00.072 INFO:teuthology.orchestra.run.trial044.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-24T18:28:00.072 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:28:00.072 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T18:28:00.072 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:28:00.072 INFO:teuthology.orchestra.run.trial044.stdout:Install 2 Packages 2026-02-24T18:28:00.072 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:28:00.072 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 648 k 2026-02-24T18:28:00.072 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 2.2 M 2026-02-24T18:28:00.072 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T18:28:00.111 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T18:28:00.111 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T18:28:00.128 INFO:teuthology.orchestra.run.trial195.stdout:(2/2): ceph-volume-20.2.0-681.g36d388f2.el9.noa 591 kB/s | 297 kB 00:00 2026-02-24T18:28:00.128 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:00.129 INFO:teuthology.orchestra.run.trial195.stdout:Total 1.1 MB/s | 648 kB 00:00 2026-02-24T18:28:00.140 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T18:28:00.148 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T18:28:00.148 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T18:28:00.191 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T18:28:00.191 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T18:28:00.202 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T18:28:00.250 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 1/7 2026-02-24T18:28:00.260 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/7 2026-02-24T18:28:00.266 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/7 2026-02-24T18:28:00.270 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T18:28:00.332 INFO:teuthology.orchestra.run.trial195.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 1/2 2026-02-24T18:28:00.334 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 2/2 2026-02-24T18:28:00.349 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 2/2 2026-02-24T18:28:00.349 INFO:teuthology.orchestra.run.trial195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:28:00.349 INFO:teuthology.orchestra.run.trial195.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-24T18:28:00.349 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:28:00.485 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-24T18:28:00.508 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 5/7 2026-02-24T18:28:00.533 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 6/7 2026-02-24T18:28:00.534 INFO:teuthology.orchestra.run.trial170.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 7/7 2026-02-24T18:28:00.584 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 1/2 2026-02-24T18:28:00.647 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 2/2 2026-02-24T18:28:00.647 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:28:00.647 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T18:28:00.647 INFO:teuthology.orchestra.run.trial195.stdout: ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch cryptsetup-2.8.1-3.el9.x86_64 2026-02-24T18:28:00.647 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:28:00.647 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T18:28:00.651 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 7/7 2026-02-24T18:28:00.651 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/7 2026-02-24T18:28:00.651 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/7 2026-02-24T18:28:00.651 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 3/7 2026-02-24T18:28:00.651 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-24T18:28:00.651 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 5/7 2026-02-24T18:28:00.651 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 6/7 2026-02-24T18:28:00.675 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install librados-devel 2026-02-24T18:28:00.676 INFO:teuthology.orchestra.run.trial044.stdout:(1/2): ceph-volume-20.2.0-681.g36d388f2.el9.noa 593 kB/s | 297 kB 00:00 2026-02-24T18:28:00.713 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 7/7 2026-02-24T18:28:00.713 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:28:00.713 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T18:28:00.713 INFO:teuthology.orchestra.run.trial170.stdout: ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:28:00.713 INFO:teuthology.orchestra.run.trial170.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-24T18:28:00.713 INFO:teuthology.orchestra.run.trial170.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-24T18:28:00.713 INFO:teuthology.orchestra.run.trial170.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-24T18:28:00.713 INFO:teuthology.orchestra.run.trial170.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-24T18:28:00.713 INFO:teuthology.orchestra.run.trial170.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-24T18:28:00.713 INFO:teuthology.orchestra.run.trial170.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-24T18:28:00.713 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:28:00.713 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T18:28:00.744 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install ceph-fuse 2026-02-24T18:28:00.995 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:54 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T18:28:01.056 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:01:57 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T18:28:01.080 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T18:28:01.080 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:28:01.080 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repo Size 2026-02-24T18:28:01.080 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:28:01.080 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T18:28:01.080 INFO:teuthology.orchestra.run.trial195.stdout: librados-devel x86_64 2:20.2.0-681.g36d388f2.el9 ceph 126 k 2026-02-24T18:28:01.080 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:28:01.080 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T18:28:01.080 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:28:01.081 INFO:teuthology.orchestra.run.trial195.stdout:Install 1 Package 2026-02-24T18:28:01.081 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:28:01.081 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 126 k 2026-02-24T18:28:01.081 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 449 k 2026-02-24T18:28:01.081 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T18:28:01.139 INFO:teuthology.orchestra.run.trial044.stdout:(2/2): cryptsetup-2.8.1-3.el9.x86_64.rpm 364 kB/s | 351 kB 00:00 2026-02-24T18:28:01.140 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T18:28:01.140 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:28:01.140 INFO:teuthology.orchestra.run.trial170.stdout: Package Architecture Version Repository Size 2026-02-24T18:28:01.140 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:28:01.140 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T18:28:01.140 INFO:teuthology.orchestra.run.trial170.stdout: ceph-fuse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 942 k 2026-02-24T18:28:01.140 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:28:01.141 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T18:28:01.141 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:28:01.141 INFO:teuthology.orchestra.run.trial170.stdout:Install 1 Package 2026-02-24T18:28:01.141 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:28:01.141 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 942 k 2026-02-24T18:28:01.141 INFO:teuthology.orchestra.run.trial170.stdout:Installed size: 2.7 M 2026-02-24T18:28:01.141 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T18:28:01.142 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:01.142 INFO:teuthology.orchestra.run.trial044.stdout:Total 608 kB/s | 648 kB 00:01 2026-02-24T18:28:01.150 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T18:28:01.156 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T18:28:01.156 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T18:28:01.199 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T18:28:01.199 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T18:28:01.280 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T18:28:01.342 INFO:teuthology.orchestra.run.trial044.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 1/2 2026-02-24T18:28:01.344 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 2/2 2026-02-24T18:28:01.358 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 2/2 2026-02-24T18:28:01.359 INFO:teuthology.orchestra.run.trial044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:28:01.359 INFO:teuthology.orchestra.run.trial044.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-24T18:28:01.359 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:28:01.512 INFO:teuthology.orchestra.run.trial195.stdout:librados-devel-20.2.0-681.g36d388f2.el9.x86_64. 291 kB/s | 126 kB 00:00 2026-02-24T18:28:01.512 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:01.513 INFO:teuthology.orchestra.run.trial195.stdout:Total 291 kB/s | 126 kB 00:00 2026-02-24T18:28:01.513 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T18:28:01.515 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T18:28:01.515 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T18:28:01.546 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T18:28:01.546 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T18:28:01.592 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 1/2 2026-02-24T18:28:01.600 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T18:28:01.617 INFO:teuthology.orchestra.run.trial195.stdout: Installing : librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:01.654 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 2/2 2026-02-24T18:28:01.654 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:28:01.655 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T18:28:01.655 INFO:teuthology.orchestra.run.trial044.stdout: ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch cryptsetup-2.8.1-3.el9.x86_64 2026-02-24T18:28:01.655 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:28:01.655 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T18:28:01.683 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install librados-devel 2026-02-24T18:28:01.704 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:01.768 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:01.768 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:28:01.768 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T18:28:01.768 INFO:teuthology.orchestra.run.trial195.stdout: librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:01.768 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:28:01.769 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T18:28:01.772 INFO:teuthology.orchestra.run.trial170.stdout:ceph-fuse-20.2.0-681.g36d388f2.el9.x86_64.rpm 1.5 MB/s | 942 kB 00:00 2026-02-24T18:28:01.772 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:01.772 INFO:teuthology.orchestra.run.trial170.stdout:Total 1.5 MB/s | 942 kB 00:00 2026-02-24T18:28:01.772 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T18:28:01.777 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T18:28:01.777 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T18:28:01.797 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install libcephfs2 2026-02-24T18:28:01.809 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T18:28:01.809 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T18:28:01.898 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T18:28:01.915 INFO:teuthology.orchestra.run.trial170.stdout: Installing : ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:02.007 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:01:55 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:28:02.091 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T18:28:02.092 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:28:02.092 INFO:teuthology.orchestra.run.trial044.stdout: Package Arch Version Repo Size 2026-02-24T18:28:02.092 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:28:02.092 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T18:28:02.092 INFO:teuthology.orchestra.run.trial044.stdout: librados-devel x86_64 2:20.2.0-681.g36d388f2.el9 ceph 126 k 2026-02-24T18:28:02.093 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:28:02.093 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T18:28:02.093 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:28:02.093 INFO:teuthology.orchestra.run.trial044.stdout:Install 1 Package 2026-02-24T18:28:02.093 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:28:02.093 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 126 k 2026-02-24T18:28:02.093 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 449 k 2026-02-24T18:28:02.094 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T18:28:02.119 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:56 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T18:28:02.152 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:02.185 INFO:teuthology.orchestra.run.trial195.stdout:Package libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:02.204 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T18:28:02.204 INFO:teuthology.orchestra.run.trial195.stdout:Nothing to do. 2026-02-24T18:28:02.205 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T18:28:02.213 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:02.213 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:28:02.214 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T18:28:02.214 INFO:teuthology.orchestra.run.trial170.stdout: ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:02.214 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:28:02.214 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T18:28:02.226 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install libcephfs-devel 2026-02-24T18:28:02.240 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install ceph-volume 2026-02-24T18:28:02.544 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:56 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T18:28:02.556 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:01:58 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T18:28:02.629 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T18:28:02.630 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:28:02.630 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repo Size 2026-02-24T18:28:02.630 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:28:02.630 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T18:28:02.630 INFO:teuthology.orchestra.run.trial195.stdout: libcephfs-devel x86_64 2:20.2.0-681.g36d388f2.el9 ceph 34 k 2026-02-24T18:28:02.630 INFO:teuthology.orchestra.run.trial195.stdout:Installing dependencies: 2026-02-24T18:28:02.630 INFO:teuthology.orchestra.run.trial195.stdout: libcephfs-proxy2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 k 2026-02-24T18:28:02.631 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:28:02.631 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T18:28:02.631 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:28:02.631 INFO:teuthology.orchestra.run.trial195.stdout:Install 2 Packages 2026-02-24T18:28:02.631 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:28:02.631 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 58 k 2026-02-24T18:28:02.631 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 207 k 2026-02-24T18:28:02.631 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T18:28:02.640 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T18:28:02.641 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:28:02.641 INFO:teuthology.orchestra.run.trial170.stdout: Package Arch Version Repository Size 2026-02-24T18:28:02.641 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:28:02.641 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T18:28:02.642 INFO:teuthology.orchestra.run.trial170.stdout: ceph-volume noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 297 k 2026-02-24T18:28:02.642 INFO:teuthology.orchestra.run.trial170.stdout:Installing dependencies: 2026-02-24T18:28:02.642 INFO:teuthology.orchestra.run.trial170.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-24T18:28:02.642 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:28:02.642 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T18:28:02.642 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:28:02.642 INFO:teuthology.orchestra.run.trial170.stdout:Install 2 Packages 2026-02-24T18:28:02.642 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:28:02.642 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 648 k 2026-02-24T18:28:02.643 INFO:teuthology.orchestra.run.trial170.stdout:Installed size: 2.2 M 2026-02-24T18:28:02.643 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T18:28:02.650 INFO:teuthology.orchestra.run.trial044.stdout:librados-devel-20.2.0-681.g36d388f2.el9.x86_64. 225 kB/s | 126 kB 00:00 2026-02-24T18:28:02.650 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:02.650 INFO:teuthology.orchestra.run.trial044.stdout:Total 225 kB/s | 126 kB 00:00 2026-02-24T18:28:02.650 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T18:28:02.653 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T18:28:02.653 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T18:28:02.684 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T18:28:02.684 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T18:28:02.739 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T18:28:02.756 INFO:teuthology.orchestra.run.trial044.stdout: Installing : librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:02.844 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:02.907 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:02.907 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:28:02.907 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T18:28:02.907 INFO:teuthology.orchestra.run.trial044.stdout: librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:02.907 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:28:02.907 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T18:28:02.935 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install libcephfs2 2026-02-24T18:28:02.965 INFO:teuthology.orchestra.run.trial195.stdout:(1/2): libcephfs-proxy2-20.2.0-681.g36d388f2.el 72 kB/s | 24 kB 00:00 2026-02-24T18:28:02.966 INFO:teuthology.orchestra.run.trial195.stdout:(2/2): libcephfs-devel-20.2.0-681.g36d388f2.el9 102 kB/s | 34 kB 00:00 2026-02-24T18:28:02.967 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:02.967 INFO:teuthology.orchestra.run.trial195.stdout:Total 173 kB/s | 58 kB 00:00 2026-02-24T18:28:02.967 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T18:28:02.970 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T18:28:02.970 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T18:28:03.002 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T18:28:03.002 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T18:28:03.051 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T18:28:03.052 INFO:teuthology.orchestra.run.trial195.stdout: Installing : libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-24T18:28:03.066 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-24T18:28:03.084 INFO:teuthology.orchestra.run.trial195.stdout: Installing : libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-24T18:28:03.148 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-24T18:28:03.148 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-24T18:28:03.211 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-24T18:28:03.211 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:28:03.211 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T18:28:03.211 INFO:teuthology.orchestra.run.trial195.stdout: libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:03.211 INFO:teuthology.orchestra.run.trial195.stdout: libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:03.212 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:28:03.212 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T18:28:03.240 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install librados2 2026-02-24T18:28:03.254 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:01:56 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:28:03.319 INFO:teuthology.orchestra.run.trial044.stdout:Package libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:03.338 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T18:28:03.338 INFO:teuthology.orchestra.run.trial044.stdout:Nothing to do. 2026-02-24T18:28:03.338 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T18:28:03.360 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install libcephfs-devel 2026-02-24T18:28:03.545 INFO:teuthology.orchestra.run.trial170.stdout:(1/2): ceph-volume-20.2.0-681.g36d388f2.el9.noa 500 kB/s | 297 kB 00:00 2026-02-24T18:28:03.559 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:57 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T18:28:03.625 INFO:teuthology.orchestra.run.trial195.stdout:Package librados2-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:03.643 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T18:28:03.644 INFO:teuthology.orchestra.run.trial195.stdout:Nothing to do. 2026-02-24T18:28:03.644 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T18:28:03.666 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install librbd1 2026-02-24T18:28:03.676 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:01:56 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:28:03.760 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T18:28:03.760 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:28:03.760 INFO:teuthology.orchestra.run.trial044.stdout: Package Arch Version Repo Size 2026-02-24T18:28:03.760 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:28:03.761 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T18:28:03.761 INFO:teuthology.orchestra.run.trial044.stdout: libcephfs-devel x86_64 2:20.2.0-681.g36d388f2.el9 ceph 34 k 2026-02-24T18:28:03.761 INFO:teuthology.orchestra.run.trial044.stdout:Installing dependencies: 2026-02-24T18:28:03.761 INFO:teuthology.orchestra.run.trial044.stdout: libcephfs-proxy2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 k 2026-02-24T18:28:03.761 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:28:03.761 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T18:28:03.761 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:28:03.761 INFO:teuthology.orchestra.run.trial044.stdout:Install 2 Packages 2026-02-24T18:28:03.761 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:28:03.761 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 58 k 2026-02-24T18:28:03.762 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 207 k 2026-02-24T18:28:03.762 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T18:28:03.895 INFO:teuthology.orchestra.run.trial170.stdout:(2/2): cryptsetup-2.8.1-3.el9.x86_64.rpm 371 kB/s | 351 kB 00:00 2026-02-24T18:28:03.895 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:03.896 INFO:teuthology.orchestra.run.trial170.stdout:Total 517 kB/s | 648 kB 00:01 2026-02-24T18:28:03.906 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T18:28:03.912 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T18:28:03.912 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T18:28:03.955 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T18:28:03.956 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T18:28:03.976 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:57 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T18:28:04.036 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T18:28:04.042 INFO:teuthology.orchestra.run.trial195.stdout:Package librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:04.061 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T18:28:04.062 INFO:teuthology.orchestra.run.trial195.stdout:Nothing to do. 2026-02-24T18:28:04.062 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T18:28:04.082 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install python3-rados 2026-02-24T18:28:04.089 INFO:teuthology.orchestra.run.trial044.stdout:(1/2): libcephfs-devel-20.2.0-681.g36d388f2.el9 105 kB/s | 34 kB 00:00 2026-02-24T18:28:04.092 INFO:teuthology.orchestra.run.trial044.stdout:(2/2): libcephfs-proxy2-20.2.0-681.g36d388f2.el 73 kB/s | 24 kB 00:00 2026-02-24T18:28:04.093 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:04.093 INFO:teuthology.orchestra.run.trial044.stdout:Total 176 kB/s | 58 kB 00:00 2026-02-24T18:28:04.093 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T18:28:04.097 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T18:28:04.097 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T18:28:04.099 INFO:teuthology.orchestra.run.trial170.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 1/2 2026-02-24T18:28:04.101 INFO:teuthology.orchestra.run.trial170.stdout: Installing : ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 2/2 2026-02-24T18:28:04.116 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 2/2 2026-02-24T18:28:04.116 INFO:teuthology.orchestra.run.trial170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:28:04.116 INFO:teuthology.orchestra.run.trial170.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-24T18:28:04.116 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:28:04.127 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T18:28:04.128 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T18:28:04.177 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T18:28:04.178 INFO:teuthology.orchestra.run.trial044.stdout: Installing : libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-24T18:28:04.192 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-24T18:28:04.210 INFO:teuthology.orchestra.run.trial044.stdout: Installing : libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-24T18:28:04.269 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-24T18:28:04.270 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-24T18:28:04.331 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-24T18:28:04.331 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:28:04.331 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T18:28:04.331 INFO:teuthology.orchestra.run.trial044.stdout: libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:04.331 INFO:teuthology.orchestra.run.trial044.stdout: libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:04.331 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:28:04.331 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T18:28:04.351 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 1/2 2026-02-24T18:28:04.359 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install librados2 2026-02-24T18:28:04.392 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:58 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T18:28:04.413 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 2/2 2026-02-24T18:28:04.414 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:28:04.414 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T18:28:04.414 INFO:teuthology.orchestra.run.trial170.stdout: ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch cryptsetup-2.8.1-3.el9.x86_64 2026-02-24T18:28:04.414 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:28:04.414 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T18:28:04.442 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install librados-devel 2026-02-24T18:28:04.458 INFO:teuthology.orchestra.run.trial195.stdout:Package python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:04.477 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T18:28:04.478 INFO:teuthology.orchestra.run.trial195.stdout:Nothing to do. 2026-02-24T18:28:04.478 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T18:28:04.498 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install python3-rgw 2026-02-24T18:28:04.676 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:01:57 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:28:04.741 INFO:teuthology.orchestra.run.trial044.stdout:Package librados2-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:04.760 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T18:28:04.760 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:02:00 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T18:28:04.761 INFO:teuthology.orchestra.run.trial044.stdout:Nothing to do. 2026-02-24T18:28:04.761 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T18:28:04.781 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install librbd1 2026-02-24T18:28:04.808 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:58 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T18:28:04.844 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T18:28:04.844 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:28:04.844 INFO:teuthology.orchestra.run.trial170.stdout: Package Arch Version Repo Size 2026-02-24T18:28:04.844 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:28:04.844 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T18:28:04.845 INFO:teuthology.orchestra.run.trial170.stdout: librados-devel x86_64 2:20.2.0-681.g36d388f2.el9 ceph 126 k 2026-02-24T18:28:04.845 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:28:04.845 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T18:28:04.845 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:28:04.845 INFO:teuthology.orchestra.run.trial170.stdout:Install 1 Package 2026-02-24T18:28:04.845 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:28:04.845 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 126 k 2026-02-24T18:28:04.845 INFO:teuthology.orchestra.run.trial170.stdout:Installed size: 449 k 2026-02-24T18:28:04.845 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T18:28:04.875 INFO:teuthology.orchestra.run.trial195.stdout:Package python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:04.894 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T18:28:04.895 INFO:teuthology.orchestra.run.trial195.stdout:Nothing to do. 2026-02-24T18:28:04.895 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T18:28:04.916 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install python3-cephfs 2026-02-24T18:28:05.097 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:01:58 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:28:05.162 INFO:teuthology.orchestra.run.trial044.stdout:Package librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:05.181 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T18:28:05.181 INFO:teuthology.orchestra.run.trial044.stdout:Nothing to do. 2026-02-24T18:28:05.181 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T18:28:05.203 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install python3-rados 2026-02-24T18:28:05.235 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:59 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T18:28:05.301 INFO:teuthology.orchestra.run.trial195.stdout:Package python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:05.320 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T18:28:05.321 INFO:teuthology.orchestra.run.trial195.stdout:Nothing to do. 2026-02-24T18:28:05.321 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T18:28:05.323 INFO:teuthology.orchestra.run.trial170.stdout:librados-devel-20.2.0-681.g36d388f2.el9.x86_64. 263 kB/s | 126 kB 00:00 2026-02-24T18:28:05.324 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:05.324 INFO:teuthology.orchestra.run.trial170.stdout:Total 262 kB/s | 126 kB 00:00 2026-02-24T18:28:05.324 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T18:28:05.327 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T18:28:05.327 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T18:28:05.341 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install python3-rbd 2026-02-24T18:28:05.358 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T18:28:05.358 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T18:28:05.412 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T18:28:05.429 INFO:teuthology.orchestra.run.trial170.stdout: Installing : librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:05.519 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:01:58 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:28:05.519 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:05.580 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:05.580 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:28:05.580 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T18:28:05.580 INFO:teuthology.orchestra.run.trial170.stdout: librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:05.580 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:28:05.581 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T18:28:05.584 INFO:teuthology.orchestra.run.trial044.stdout:Package python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:05.602 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T18:28:05.603 INFO:teuthology.orchestra.run.trial044.stdout:Nothing to do. 2026-02-24T18:28:05.603 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T18:28:05.609 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install libcephfs2 2026-02-24T18:28:05.624 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install python3-rgw 2026-02-24T18:28:05.660 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:59 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T18:28:05.725 INFO:teuthology.orchestra.run.trial195.stdout:Package python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:05.744 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T18:28:05.744 INFO:teuthology.orchestra.run.trial195.stdout:Nothing to do. 2026-02-24T18:28:05.744 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T18:28:05.766 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install rbd-fuse 2026-02-24T18:28:05.926 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:02:01 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T18:28:05.936 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:01:58 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:28:05.992 INFO:teuthology.orchestra.run.trial170.stdout:Package libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:06.000 INFO:teuthology.orchestra.run.trial044.stdout:Package python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:06.011 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T18:28:06.012 INFO:teuthology.orchestra.run.trial170.stdout:Nothing to do. 2026-02-24T18:28:06.012 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T18:28:06.019 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T18:28:06.020 INFO:teuthology.orchestra.run.trial044.stdout:Nothing to do. 2026-02-24T18:28:06.020 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T18:28:06.033 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install libcephfs-devel 2026-02-24T18:28:06.040 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install python3-cephfs 2026-02-24T18:28:06.085 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:02:00 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T18:28:06.169 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T18:28:06.170 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:28:06.170 INFO:teuthology.orchestra.run.trial195.stdout: Package Architecture Version Repository Size 2026-02-24T18:28:06.170 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:28:06.170 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T18:28:06.170 INFO:teuthology.orchestra.run.trial195.stdout: rbd-fuse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 91 k 2026-02-24T18:28:06.170 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:28:06.170 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T18:28:06.171 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:28:06.171 INFO:teuthology.orchestra.run.trial195.stdout:Install 1 Package 2026-02-24T18:28:06.171 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:28:06.171 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 91 k 2026-02-24T18:28:06.171 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 238 k 2026-02-24T18:28:06.171 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T18:28:06.346 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:02:02 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T18:28:06.356 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:01:59 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:28:06.421 INFO:teuthology.orchestra.run.trial044.stdout:Package python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:06.430 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T18:28:06.430 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:28:06.430 INFO:teuthology.orchestra.run.trial170.stdout: Package Arch Version Repo Size 2026-02-24T18:28:06.430 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:28:06.430 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T18:28:06.430 INFO:teuthology.orchestra.run.trial170.stdout: libcephfs-devel x86_64 2:20.2.0-681.g36d388f2.el9 ceph 34 k 2026-02-24T18:28:06.430 INFO:teuthology.orchestra.run.trial170.stdout:Installing dependencies: 2026-02-24T18:28:06.430 INFO:teuthology.orchestra.run.trial170.stdout: libcephfs-proxy2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 k 2026-02-24T18:28:06.430 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:28:06.430 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T18:28:06.430 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:28:06.430 INFO:teuthology.orchestra.run.trial170.stdout:Install 2 Packages 2026-02-24T18:28:06.430 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:28:06.430 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 58 k 2026-02-24T18:28:06.430 INFO:teuthology.orchestra.run.trial170.stdout:Installed size: 207 k 2026-02-24T18:28:06.431 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T18:28:06.440 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T18:28:06.440 INFO:teuthology.orchestra.run.trial044.stdout:Nothing to do. 2026-02-24T18:28:06.440 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T18:28:06.462 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install python3-rbd 2026-02-24T18:28:06.587 INFO:teuthology.orchestra.run.trial195.stdout:rbd-fuse-20.2.0-681.g36d388f2.el9.x86_64.rpm 218 kB/s | 91 kB 00:00 2026-02-24T18:28:06.587 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:06.588 INFO:teuthology.orchestra.run.trial195.stdout:Total 218 kB/s | 91 kB 00:00 2026-02-24T18:28:06.588 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T18:28:06.592 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T18:28:06.592 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T18:28:06.623 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T18:28:06.623 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T18:28:06.674 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T18:28:06.692 INFO:teuthology.orchestra.run.trial195.stdout: Installing : rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:06.776 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:01:59 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:28:06.778 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:06.785 INFO:teuthology.orchestra.run.trial170.stdout:(1/2): libcephfs-devel-20.2.0-681.g36d388f2.el9 97 kB/s | 34 kB 00:00 2026-02-24T18:28:06.788 INFO:teuthology.orchestra.run.trial170.stdout:(2/2): libcephfs-proxy2-20.2.0-681.g36d388f2.el 68 kB/s | 24 kB 00:00 2026-02-24T18:28:06.789 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:06.789 INFO:teuthology.orchestra.run.trial170.stdout:Total 163 kB/s | 58 kB 00:00 2026-02-24T18:28:06.789 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T18:28:06.792 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T18:28:06.793 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T18:28:06.824 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T18:28:06.824 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T18:28:06.841 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:06.841 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:28:06.841 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T18:28:06.841 INFO:teuthology.orchestra.run.trial195.stdout: rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:06.841 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:28:06.841 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T18:28:06.842 INFO:teuthology.orchestra.run.trial044.stdout:Package python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:06.860 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T18:28:06.861 INFO:teuthology.orchestra.run.trial044.stdout:Nothing to do. 2026-02-24T18:28:06.861 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T18:28:06.870 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install rbd-mirror 2026-02-24T18:28:06.873 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T18:28:06.874 INFO:teuthology.orchestra.run.trial170.stdout: Installing : libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-24T18:28:06.882 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install rbd-fuse 2026-02-24T18:28:06.890 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-24T18:28:06.907 INFO:teuthology.orchestra.run.trial170.stdout: Installing : libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-24T18:28:06.967 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-24T18:28:06.967 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-24T18:28:07.027 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-24T18:28:07.027 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:28:07.027 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T18:28:07.027 INFO:teuthology.orchestra.run.trial170.stdout: libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:07.027 INFO:teuthology.orchestra.run.trial170.stdout: libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:07.027 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:28:07.028 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T18:28:07.055 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install librados2 2026-02-24T18:28:07.186 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:02:01 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T18:28:07.199 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:02:00 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:28:07.270 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T18:28:07.270 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:28:07.270 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repo Size 2026-02-24T18:28:07.270 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:28:07.270 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T18:28:07.270 INFO:teuthology.orchestra.run.trial195.stdout: rbd-mirror x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.9 M 2026-02-24T18:28:07.270 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:28:07.270 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T18:28:07.270 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:28:07.271 INFO:teuthology.orchestra.run.trial195.stdout:Install 1 Package 2026-02-24T18:28:07.271 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:28:07.271 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 2.9 M 2026-02-24T18:28:07.271 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 11 M 2026-02-24T18:28:07.271 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T18:28:07.282 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T18:28:07.283 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:28:07.283 INFO:teuthology.orchestra.run.trial044.stdout: Package Architecture Version Repository Size 2026-02-24T18:28:07.284 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:28:07.284 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T18:28:07.284 INFO:teuthology.orchestra.run.trial044.stdout: rbd-fuse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 91 k 2026-02-24T18:28:07.284 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:28:07.284 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T18:28:07.284 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:28:07.284 INFO:teuthology.orchestra.run.trial044.stdout:Install 1 Package 2026-02-24T18:28:07.284 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:28:07.284 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 91 k 2026-02-24T18:28:07.284 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 238 k 2026-02-24T18:28:07.284 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T18:28:07.369 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:02:03 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T18:28:07.435 INFO:teuthology.orchestra.run.trial170.stdout:Package librados2-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:07.453 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T18:28:07.454 INFO:teuthology.orchestra.run.trial170.stdout:Nothing to do. 2026-02-24T18:28:07.454 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T18:28:07.476 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install librbd1 2026-02-24T18:28:07.693 INFO:teuthology.orchestra.run.trial044.stdout:rbd-fuse-20.2.0-681.g36d388f2.el9.x86_64.rpm 223 kB/s | 91 kB 00:00 2026-02-24T18:28:07.693 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:07.693 INFO:teuthology.orchestra.run.trial044.stdout:Total 223 kB/s | 91 kB 00:00 2026-02-24T18:28:07.693 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T18:28:07.698 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T18:28:07.698 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T18:28:07.728 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T18:28:07.728 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T18:28:07.779 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T18:28:07.789 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:02:03 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T18:28:07.796 INFO:teuthology.orchestra.run.trial044.stdout: Installing : rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:07.855 INFO:teuthology.orchestra.run.trial170.stdout:Package librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:07.874 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T18:28:07.874 INFO:teuthology.orchestra.run.trial170.stdout:Nothing to do. 2026-02-24T18:28:07.874 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T18:28:07.882 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:07.895 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install python3-rados 2026-02-24T18:28:07.949 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:07.949 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:28:07.949 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T18:28:07.949 INFO:teuthology.orchestra.run.trial044.stdout: rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:07.949 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:28:07.949 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T18:28:07.976 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install rbd-mirror 2026-02-24T18:28:08.207 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:02:04 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T18:28:08.273 INFO:teuthology.orchestra.run.trial170.stdout:Package python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:08.291 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:02:01 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:28:08.291 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T18:28:08.292 INFO:teuthology.orchestra.run.trial170.stdout:Nothing to do. 2026-02-24T18:28:08.292 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T18:28:08.314 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install python3-rgw 2026-02-24T18:28:08.376 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T18:28:08.376 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:28:08.376 INFO:teuthology.orchestra.run.trial044.stdout: Package Arch Version Repo Size 2026-02-24T18:28:08.377 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:28:08.377 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T18:28:08.377 INFO:teuthology.orchestra.run.trial044.stdout: rbd-mirror x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.9 M 2026-02-24T18:28:08.377 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:28:08.377 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T18:28:08.377 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:28:08.377 INFO:teuthology.orchestra.run.trial044.stdout:Install 1 Package 2026-02-24T18:28:08.377 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:28:08.377 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 2.9 M 2026-02-24T18:28:08.377 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 11 M 2026-02-24T18:28:08.378 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T18:28:08.631 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:02:04 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T18:28:08.697 INFO:teuthology.orchestra.run.trial170.stdout:Package python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:08.716 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T18:28:08.716 INFO:teuthology.orchestra.run.trial170.stdout:Nothing to do. 2026-02-24T18:28:08.716 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T18:28:08.738 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install python3-cephfs 2026-02-24T18:28:09.053 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:02:05 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T18:28:09.120 INFO:teuthology.orchestra.run.trial170.stdout:Package python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:09.138 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T18:28:09.139 INFO:teuthology.orchestra.run.trial170.stdout:Nothing to do. 2026-02-24T18:28:09.139 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T18:28:09.161 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install python3-rbd 2026-02-24T18:28:09.331 INFO:teuthology.orchestra.run.trial195.stdout:rbd-mirror-20.2.0-681.g36d388f2.el9.x86_64.rpm 1.4 MB/s | 2.9 MB 00:02 2026-02-24T18:28:09.332 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:09.332 INFO:teuthology.orchestra.run.trial195.stdout:Total 1.4 MB/s | 2.9 MB 00:02 2026-02-24T18:28:09.333 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T18:28:09.337 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T18:28:09.337 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T18:28:09.376 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T18:28:09.376 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T18:28:09.479 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:02:05 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T18:28:09.545 INFO:teuthology.orchestra.run.trial170.stdout:Package python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:09.555 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T18:28:09.556 INFO:teuthology.orchestra.run.trial195.stdout: Installing : rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:09.564 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T18:28:09.564 INFO:teuthology.orchestra.run.trial170.stdout:Nothing to do. 2026-02-24T18:28:09.564 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T18:28:09.579 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:09.579 INFO:teuthology.orchestra.run.trial195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:28:09.579 INFO:teuthology.orchestra.run.trial195.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-24T18:28:09.579 INFO:teuthology.orchestra.run.trial195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T18:28:09.579 INFO:teuthology.orchestra.run.trial195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T18:28:09.579 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:28:09.586 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install rbd-fuse 2026-02-24T18:28:09.891 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:09.891 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:28:09.891 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T18:28:09.891 INFO:teuthology.orchestra.run.trial195.stdout: rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:09.891 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:28:09.891 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T18:28:09.896 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:02:05 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T18:28:09.919 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install rbd-nbd 2026-02-24T18:28:09.980 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T18:28:09.980 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:28:09.980 INFO:teuthology.orchestra.run.trial170.stdout: Package Architecture Version Repository Size 2026-02-24T18:28:09.980 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:28:09.980 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T18:28:09.980 INFO:teuthology.orchestra.run.trial170.stdout: rbd-fuse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 91 k 2026-02-24T18:28:09.980 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:28:09.980 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T18:28:09.980 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:28:09.980 INFO:teuthology.orchestra.run.trial170.stdout:Install 1 Package 2026-02-24T18:28:09.980 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:28:09.981 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 91 k 2026-02-24T18:28:09.981 INFO:teuthology.orchestra.run.trial170.stdout:Installed size: 238 k 2026-02-24T18:28:09.981 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T18:28:10.242 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:02:04 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T18:28:10.328 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T18:28:10.328 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:28:10.328 INFO:teuthology.orchestra.run.trial195.stdout: Package Architecture Version Repository Size 2026-02-24T18:28:10.328 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:28:10.328 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T18:28:10.328 INFO:teuthology.orchestra.run.trial195.stdout: rbd-nbd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 180 k 2026-02-24T18:28:10.328 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:28:10.328 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T18:28:10.328 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:28:10.328 INFO:teuthology.orchestra.run.trial195.stdout:Install 1 Package 2026-02-24T18:28:10.328 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:28:10.328 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 180 k 2026-02-24T18:28:10.328 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 498 k 2026-02-24T18:28:10.328 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T18:28:10.422 INFO:teuthology.orchestra.run.trial044.stdout:rbd-mirror-20.2.0-681.g36d388f2.el9.x86_64.rpm 1.4 MB/s | 2.9 MB 00:02 2026-02-24T18:28:10.422 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:10.423 INFO:teuthology.orchestra.run.trial044.stdout:Total 1.4 MB/s | 2.9 MB 00:02 2026-02-24T18:28:10.423 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T18:28:10.428 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T18:28:10.428 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T18:28:10.456 INFO:teuthology.orchestra.run.trial170.stdout:rbd-fuse-20.2.0-681.g36d388f2.el9.x86_64.rpm 192 kB/s | 91 kB 00:00 2026-02-24T18:28:10.456 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:10.456 INFO:teuthology.orchestra.run.trial170.stdout:Total 191 kB/s | 91 kB 00:00 2026-02-24T18:28:10.456 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T18:28:10.461 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T18:28:10.461 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T18:28:10.467 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T18:28:10.467 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T18:28:10.491 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T18:28:10.491 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T18:28:10.542 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T18:28:10.559 INFO:teuthology.orchestra.run.trial170.stdout: Installing : rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:10.643 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:10.649 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T18:28:10.650 INFO:teuthology.orchestra.run.trial044.stdout: Installing : rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:10.673 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:10.673 INFO:teuthology.orchestra.run.trial044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:28:10.673 INFO:teuthology.orchestra.run.trial044.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-24T18:28:10.673 INFO:teuthology.orchestra.run.trial044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T18:28:10.673 INFO:teuthology.orchestra.run.trial044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T18:28:10.673 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:28:10.705 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:10.705 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:28:10.705 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T18:28:10.705 INFO:teuthology.orchestra.run.trial170.stdout: rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:10.705 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:28:10.705 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T18:28:10.732 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install rbd-mirror 2026-02-24T18:28:10.980 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:10.980 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:28:10.980 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T18:28:10.981 INFO:teuthology.orchestra.run.trial044.stdout: rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:10.981 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:28:10.981 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T18:28:11.008 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install rbd-nbd 2026-02-24T18:28:11.047 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:02:07 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T18:28:11.056 INFO:teuthology.orchestra.run.trial195.stdout:rbd-nbd-20.2.0-681.g36d388f2.el9.x86_64.rpm 247 kB/s | 180 kB 00:00 2026-02-24T18:28:11.057 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:11.057 INFO:teuthology.orchestra.run.trial195.stdout:Total 246 kB/s | 180 kB 00:00 2026-02-24T18:28:11.058 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T18:28:11.062 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T18:28:11.062 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T18:28:11.093 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T18:28:11.093 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T18:28:11.130 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T18:28:11.131 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:28:11.131 INFO:teuthology.orchestra.run.trial170.stdout: Package Arch Version Repo Size 2026-02-24T18:28:11.131 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:28:11.131 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T18:28:11.131 INFO:teuthology.orchestra.run.trial170.stdout: rbd-mirror x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.9 M 2026-02-24T18:28:11.131 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:28:11.131 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T18:28:11.131 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:28:11.131 INFO:teuthology.orchestra.run.trial170.stdout:Install 1 Package 2026-02-24T18:28:11.131 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:28:11.131 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 2.9 M 2026-02-24T18:28:11.132 INFO:teuthology.orchestra.run.trial170.stdout:Installed size: 11 M 2026-02-24T18:28:11.132 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T18:28:11.149 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T18:28:11.167 INFO:teuthology.orchestra.run.trial195.stdout: Installing : rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:11.251 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:11.313 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:11.313 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:28:11.313 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T18:28:11.313 INFO:teuthology.orchestra.run.trial195.stdout: rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:11.313 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:28:11.313 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T18:28:11.328 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:02:04 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:28:11.341 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph-base-debuginfo 2026-02-24T18:28:11.411 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T18:28:11.412 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:28:11.412 INFO:teuthology.orchestra.run.trial044.stdout: Package Architecture Version Repository Size 2026-02-24T18:28:11.412 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:28:11.412 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T18:28:11.412 INFO:teuthology.orchestra.run.trial044.stdout: rbd-nbd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 180 k 2026-02-24T18:28:11.412 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:28:11.412 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T18:28:11.412 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:28:11.412 INFO:teuthology.orchestra.run.trial044.stdout:Install 1 Package 2026-02-24T18:28:11.412 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:28:11.412 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 180 k 2026-02-24T18:28:11.412 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 498 k 2026-02-24T18:28:11.412 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T18:28:11.662 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:02:05 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T18:28:11.746 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T18:28:11.746 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:28:11.746 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repo Size 2026-02-24T18:28:11.746 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:28:11.746 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T18:28:11.746 INFO:teuthology.orchestra.run.trial195.stdout: ceph-base-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 107 M 2026-02-24T18:28:11.747 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:28:11.747 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T18:28:11.747 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:28:11.747 INFO:teuthology.orchestra.run.trial195.stdout:Install 1 Package 2026-02-24T18:28:11.747 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:28:11.747 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 107 M 2026-02-24T18:28:11.747 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 664 M 2026-02-24T18:28:11.747 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T18:28:12.045 INFO:teuthology.orchestra.run.trial044.stdout:rbd-nbd-20.2.0-681.g36d388f2.el9.x86_64.rpm 284 kB/s | 180 kB 00:00 2026-02-24T18:28:12.047 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:12.047 INFO:teuthology.orchestra.run.trial044.stdout:Total 283 kB/s | 180 kB 00:00 2026-02-24T18:28:12.047 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T18:28:12.052 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T18:28:12.052 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T18:28:12.083 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T18:28:12.083 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T18:28:12.139 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T18:28:12.156 INFO:teuthology.orchestra.run.trial044.stdout: Installing : rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:12.243 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:12.305 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:12.305 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:28:12.305 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T18:28:12.306 INFO:teuthology.orchestra.run.trial044.stdout: rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:12.306 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:28:12.306 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T18:28:12.333 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install ceph-base-debuginfo 2026-02-24T18:28:12.649 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:02:05 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:28:12.733 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T18:28:12.733 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:28:12.733 INFO:teuthology.orchestra.run.trial044.stdout: Package Arch Version Repo Size 2026-02-24T18:28:12.734 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:28:12.734 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T18:28:12.734 INFO:teuthology.orchestra.run.trial044.stdout: ceph-base-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 107 M 2026-02-24T18:28:12.734 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:28:12.734 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T18:28:12.734 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:28:12.734 INFO:teuthology.orchestra.run.trial044.stdout:Install 1 Package 2026-02-24T18:28:12.734 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:28:12.734 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 107 M 2026-02-24T18:28:12.734 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 664 M 2026-02-24T18:28:12.735 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T18:28:13.794 INFO:teuthology.orchestra.run.trial170.stdout:rbd-mirror-20.2.0-681.g36d388f2.el9.x86_64.rpm 1.1 MB/s | 2.9 MB 00:02 2026-02-24T18:28:13.794 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:13.794 INFO:teuthology.orchestra.run.trial170.stdout:Total 1.1 MB/s | 2.9 MB 00:02 2026-02-24T18:28:13.794 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T18:28:13.799 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T18:28:13.799 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T18:28:13.837 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T18:28:13.837 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T18:28:14.020 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T18:28:14.022 INFO:teuthology.orchestra.run.trial170.stdout: Installing : rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:14.045 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:14.045 INFO:teuthology.orchestra.run.trial170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:28:14.045 INFO:teuthology.orchestra.run.trial170.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-24T18:28:14.045 INFO:teuthology.orchestra.run.trial170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T18:28:14.045 INFO:teuthology.orchestra.run.trial170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T18:28:14.045 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:28:14.344 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:14.345 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:28:14.345 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T18:28:14.345 INFO:teuthology.orchestra.run.trial170.stdout: rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:14.345 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:28:14.345 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T18:28:14.372 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install rbd-nbd 2026-02-24T18:28:14.689 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:02:10 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T18:28:14.773 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T18:28:14.774 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:28:14.774 INFO:teuthology.orchestra.run.trial170.stdout: Package Architecture Version Repository Size 2026-02-24T18:28:14.774 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:28:14.774 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T18:28:14.774 INFO:teuthology.orchestra.run.trial170.stdout: rbd-nbd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 180 k 2026-02-24T18:28:14.774 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:28:14.774 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T18:28:14.774 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:28:14.774 INFO:teuthology.orchestra.run.trial170.stdout:Install 1 Package 2026-02-24T18:28:14.774 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:28:14.775 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 180 k 2026-02-24T18:28:14.775 INFO:teuthology.orchestra.run.trial170.stdout:Installed size: 498 k 2026-02-24T18:28:14.775 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T18:28:16.116 INFO:teuthology.orchestra.run.trial170.stdout:rbd-nbd-20.2.0-681.g36d388f2.el9.x86_64.rpm 134 kB/s | 180 kB 00:01 2026-02-24T18:28:16.117 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:16.117 INFO:teuthology.orchestra.run.trial170.stdout:Total 134 kB/s | 180 kB 00:01 2026-02-24T18:28:16.117 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T18:28:16.122 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T18:28:16.122 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T18:28:16.152 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T18:28:16.152 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T18:28:16.209 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T18:28:16.226 INFO:teuthology.orchestra.run.trial170.stdout: Installing : rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:16.316 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:16.378 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:16.378 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:28:16.378 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T18:28:16.378 INFO:teuthology.orchestra.run.trial170.stdout: rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:16.378 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:28:16.378 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T18:28:16.406 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install ceph-base-debuginfo 2026-02-24T18:28:16.724 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:02:12 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T18:28:16.809 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T18:28:16.809 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:28:16.810 INFO:teuthology.orchestra.run.trial170.stdout: Package Arch Version Repo Size 2026-02-24T18:28:16.810 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:28:16.810 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T18:28:16.810 INFO:teuthology.orchestra.run.trial170.stdout: ceph-base-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 107 M 2026-02-24T18:28:16.810 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:28:16.810 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T18:28:16.810 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:28:16.811 INFO:teuthology.orchestra.run.trial170.stdout:Install 1 Package 2026-02-24T18:28:16.811 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:28:16.811 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 107 M 2026-02-24T18:28:16.811 INFO:teuthology.orchestra.run.trial170.stdout:Installed size: 664 M 2026-02-24T18:28:16.811 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T18:28:45.882 INFO:teuthology.orchestra.run.trial014.stdout:ceph-base-debuginfo-20.2.0-681.g36d388f2.el9.x8 2.1 MB/s | 107 MB 00:51 2026-02-24T18:28:45.883 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:45.883 INFO:teuthology.orchestra.run.trial014.stdout:Total 2.1 MB/s | 107 MB 00:51 2026-02-24T18:28:45.883 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T18:28:45.885 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T18:28:45.885 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T18:28:46.222 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T18:28:46.222 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T18:28:52.263 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T18:28:52.282 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T18:28:52.766 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T18:28:52.829 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T18:28:52.829 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:28:52.829 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T18:28:52.829 INFO:teuthology.orchestra.run.trial014.stdout: ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:52.829 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:28:52.829 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T18:28:52.864 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install ceph-common-debuginfo 2026-02-24T18:28:53.174 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:02:46 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:28:53.182 INFO:teuthology.orchestra.run.trial044.stdout:ceph-base-debuginfo-20.2.0-681.g36d388f2.el9.x8 2.6 MB/s | 107 MB 00:40 2026-02-24T18:28:53.182 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:53.183 INFO:teuthology.orchestra.run.trial044.stdout:Total 2.6 MB/s | 107 MB 00:40 2026-02-24T18:28:53.183 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T18:28:53.185 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T18:28:53.185 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T18:28:53.259 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T18:28:53.259 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:28:53.259 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repo Size 2026-02-24T18:28:53.259 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:28:53.259 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T18:28:53.259 INFO:teuthology.orchestra.run.trial014.stdout: ceph-common-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 586 M 2026-02-24T18:28:53.259 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:28:53.259 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T18:28:53.260 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:28:53.260 INFO:teuthology.orchestra.run.trial014.stdout:Install 1 Package 2026-02-24T18:28:53.260 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:28:53.260 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 586 M 2026-02-24T18:28:53.260 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 3.4 G 2026-02-24T18:28:53.260 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T18:28:53.522 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T18:28:53.522 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T18:28:59.420 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T18:28:59.438 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T18:28:59.941 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T18:29:00.003 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T18:29:00.003 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:29:00.003 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T18:29:00.004 INFO:teuthology.orchestra.run.trial044.stdout: ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:29:00.004 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:29:00.004 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T18:29:00.039 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install ceph-common-debuginfo 2026-02-24T18:29:00.352 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:02:53 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:29:00.437 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T18:29:00.437 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:29:00.437 INFO:teuthology.orchestra.run.trial044.stdout: Package Arch Version Repo Size 2026-02-24T18:29:00.437 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:29:00.437 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T18:29:00.437 INFO:teuthology.orchestra.run.trial044.stdout: ceph-common-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 586 M 2026-02-24T18:29:00.437 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:29:00.438 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T18:29:00.438 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:29:00.438 INFO:teuthology.orchestra.run.trial044.stdout:Install 1 Package 2026-02-24T18:29:00.438 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:29:00.438 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 586 M 2026-02-24T18:29:00.438 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 3.4 G 2026-02-24T18:29:00.438 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T18:29:29.011 INFO:teuthology.orchestra.run.trial170.stdout:ceph-base-debuginfo-20.2.0-681.g36d388f2.el9.x8 1.5 MB/s | 107 MB 01:12 2026-02-24T18:29:29.012 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:29:29.012 INFO:teuthology.orchestra.run.trial170.stdout:Total 1.5 MB/s | 107 MB 01:12 2026-02-24T18:29:29.012 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T18:29:29.014 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T18:29:29.014 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T18:29:29.352 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T18:29:29.352 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T18:29:35.236 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T18:29:35.255 INFO:teuthology.orchestra.run.trial170.stdout: Installing : ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T18:29:35.746 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T18:29:35.807 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T18:29:35.807 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:29:35.807 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T18:29:35.807 INFO:teuthology.orchestra.run.trial170.stdout: ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:29:35.807 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:29:35.807 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T18:29:35.842 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install ceph-common-debuginfo 2026-02-24T18:29:36.158 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:03:32 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T18:29:36.244 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T18:29:36.245 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:29:36.245 INFO:teuthology.orchestra.run.trial170.stdout: Package Arch Version Repo Size 2026-02-24T18:29:36.245 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:29:36.245 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T18:29:36.245 INFO:teuthology.orchestra.run.trial170.stdout: ceph-common-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 586 M 2026-02-24T18:29:36.245 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:29:36.245 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T18:29:36.245 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:29:36.245 INFO:teuthology.orchestra.run.trial170.stdout:Install 1 Package 2026-02-24T18:29:36.246 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:29:36.246 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 586 M 2026-02-24T18:29:36.246 INFO:teuthology.orchestra.run.trial170.stdout:Installed size: 3.4 G 2026-02-24T18:29:36.246 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T18:29:48.156 INFO:teuthology.orchestra.run.trial195.stdout:ceph-base-debuginfo-20.2.0-681.g36d388f2.el9.x8 1.1 MB/s | 107 MB 01:36 2026-02-24T18:29:48.158 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:29:48.158 INFO:teuthology.orchestra.run.trial195.stdout:Total 1.1 MB/s | 107 MB 01:36 2026-02-24T18:29:48.158 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T18:29:48.160 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T18:29:48.160 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T18:29:48.496 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T18:29:48.496 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T18:29:54.372 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T18:29:54.391 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T18:29:54.926 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T18:29:54.987 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T18:29:54.987 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:29:54.988 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T18:29:54.988 INFO:teuthology.orchestra.run.trial195.stdout: ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:29:54.988 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:29:54.988 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T18:29:55.025 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph-common-debuginfo 2026-02-24T18:29:55.349 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:03:49 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T18:29:55.435 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T18:29:55.436 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:29:55.436 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repo Size 2026-02-24T18:29:55.436 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:29:55.436 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T18:29:55.436 INFO:teuthology.orchestra.run.trial195.stdout: ceph-common-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 586 M 2026-02-24T18:29:55.436 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:29:55.436 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T18:29:55.436 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:29:55.436 INFO:teuthology.orchestra.run.trial195.stdout:Install 1 Package 2026-02-24T18:29:55.437 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:29:55.437 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 586 M 2026-02-24T18:29:55.437 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 3.4 G 2026-02-24T18:29:55.437 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T18:36:00.970 INFO:teuthology.orchestra.run.trial014.stdout:ceph-common-debuginfo-20.2.0-681.g36d388f2.el9. 1.4 MB/s | 586 MB 07:07 2026-02-24T18:36:00.981 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:36:00.981 INFO:teuthology.orchestra.run.trial014.stdout:Total 1.4 MB/s | 586 MB 07:07 2026-02-24T18:36:00.981 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T18:36:00.981 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T18:36:00.981 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T18:36:02.713 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T18:36:02.713 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T18:36:34.487 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T18:36:34.504 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T18:36:35.516 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T18:36:35.577 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T18:36:35.577 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:36:35.578 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T18:36:35.578 INFO:teuthology.orchestra.run.trial014.stdout: ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:36:35.578 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:36:35.578 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T18:36:35.661 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-24T18:36:35.981 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:10:28 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:36:36.066 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T18:36:36.066 INFO:teuthology.orchestra.run.trial014.stdout:======================================================================================= 2026-02-24T18:36:36.066 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repo Size 2026-02-24T18:36:36.066 INFO:teuthology.orchestra.run.trial014.stdout:======================================================================================= 2026-02-24T18:36:36.066 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T18:36:36.067 INFO:teuthology.orchestra.run.trial014.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 3.0 M 2026-02-24T18:36:36.067 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:36:36.067 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T18:36:36.067 INFO:teuthology.orchestra.run.trial014.stdout:======================================================================================= 2026-02-24T18:36:36.067 INFO:teuthology.orchestra.run.trial014.stdout:Install 1 Package 2026-02-24T18:36:36.067 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:36:36.067 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 3.0 M 2026-02-24T18:36:36.067 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 15 M 2026-02-24T18:36:36.067 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T18:36:38.476 INFO:teuthology.orchestra.run.trial014.stdout:ceph-immutable-object-cache-debuginfo-20.2.0-68 1.3 MB/s | 3.0 MB 00:02 2026-02-24T18:36:38.477 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:36:38.477 INFO:teuthology.orchestra.run.trial014.stdout:Total 1.3 MB/s | 3.0 MB 00:02 2026-02-24T18:36:38.477 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T18:36:38.478 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T18:36:38.478 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T18:36:38.504 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T18:36:38.504 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T18:36:38.699 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T18:36:38.716 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-24T18:36:38.784 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-24T18:36:38.846 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-24T18:36:38.846 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:36:38.847 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T18:36:38.847 INFO:teuthology.orchestra.run.trial014.stdout: ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:36:38.847 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:36:38.847 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T18:36:38.874 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-24T18:36:39.195 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:10:32 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:36:39.281 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T18:36:39.282 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:36:39.282 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repo Size 2026-02-24T18:36:39.282 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:36:39.282 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T18:36:39.282 INFO:teuthology.orchestra.run.trial014.stdout: ceph-radosgw-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 543 M 2026-02-24T18:36:39.282 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:36:39.282 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T18:36:39.282 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:36:39.283 INFO:teuthology.orchestra.run.trial014.stdout:Install 1 Package 2026-02-24T18:36:39.283 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:36:39.283 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 543 M 2026-02-24T18:36:39.283 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 0 2026-02-24T18:36:39.283 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T18:37:02.148 INFO:teuthology.orchestra.run.trial170.stdout:ceph-common-debuginfo-20.2.0-681.g36d388f2.el9. 1.3 MB/s | 586 MB 07:25 2026-02-24T18:37:02.148 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:37:02.148 INFO:teuthology.orchestra.run.trial170.stdout:Total 1.3 MB/s | 586 MB 07:25 2026-02-24T18:37:02.148 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T18:37:02.151 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T18:37:02.151 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T18:37:03.885 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T18:37:03.885 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T18:37:35.691 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T18:37:35.710 INFO:teuthology.orchestra.run.trial170.stdout: Installing : ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T18:37:38.207 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T18:37:38.269 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T18:37:38.269 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:37:38.269 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T18:37:38.269 INFO:teuthology.orchestra.run.trial170.stdout: ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:37:38.269 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:37:38.270 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T18:37:38.350 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-24T18:37:38.668 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:11:34 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T18:37:38.752 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T18:37:38.753 INFO:teuthology.orchestra.run.trial170.stdout:======================================================================================= 2026-02-24T18:37:38.753 INFO:teuthology.orchestra.run.trial170.stdout: Package Arch Version Repo Size 2026-02-24T18:37:38.753 INFO:teuthology.orchestra.run.trial170.stdout:======================================================================================= 2026-02-24T18:37:38.753 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T18:37:38.753 INFO:teuthology.orchestra.run.trial170.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 3.0 M 2026-02-24T18:37:38.753 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:37:38.753 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T18:37:38.753 INFO:teuthology.orchestra.run.trial170.stdout:======================================================================================= 2026-02-24T18:37:38.753 INFO:teuthology.orchestra.run.trial170.stdout:Install 1 Package 2026-02-24T18:37:38.754 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:37:38.754 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 3.0 M 2026-02-24T18:37:38.754 INFO:teuthology.orchestra.run.trial170.stdout:Installed size: 15 M 2026-02-24T18:37:38.754 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T18:37:41.409 INFO:teuthology.orchestra.run.trial170.stdout:ceph-immutable-object-cache-debuginfo-20.2.0-68 1.1 MB/s | 3.0 MB 00:02 2026-02-24T18:37:41.410 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:37:41.410 INFO:teuthology.orchestra.run.trial170.stdout:Total 1.1 MB/s | 3.0 MB 00:02 2026-02-24T18:37:41.410 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T18:37:41.412 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T18:37:41.412 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T18:37:41.437 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T18:37:41.437 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T18:37:41.627 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T18:37:41.643 INFO:teuthology.orchestra.run.trial170.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-24T18:37:41.712 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-24T18:37:41.773 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-24T18:37:41.773 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:37:41.773 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T18:37:41.773 INFO:teuthology.orchestra.run.trial170.stdout: ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:37:41.773 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:37:41.774 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T18:37:41.800 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-24T18:37:42.121 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:11:38 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T18:37:42.207 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T18:37:42.207 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:37:42.208 INFO:teuthology.orchestra.run.trial170.stdout: Package Arch Version Repo Size 2026-02-24T18:37:42.208 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:37:42.208 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T18:37:42.208 INFO:teuthology.orchestra.run.trial170.stdout: ceph-radosgw-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 543 M 2026-02-24T18:37:42.208 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:37:42.208 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T18:37:42.208 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:37:42.208 INFO:teuthology.orchestra.run.trial170.stdout:Install 1 Package 2026-02-24T18:37:42.208 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:37:42.208 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 543 M 2026-02-24T18:37:42.209 INFO:teuthology.orchestra.run.trial170.stdout:Installed size: 0 2026-02-24T18:37:42.209 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T18:38:10.677 INFO:teuthology.orchestra.run.trial044.stdout:ceph-common-debuginfo-20.2.0-681.g36d388f2.el9. 1.1 MB/s | 586 MB 09:10 2026-02-24T18:38:10.677 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:38:10.678 INFO:teuthology.orchestra.run.trial044.stdout:Total 1.1 MB/s | 586 MB 09:10 2026-02-24T18:38:10.678 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T18:38:10.680 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T18:38:10.680 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T18:38:12.428 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T18:38:12.428 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T18:38:44.313 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T18:38:44.331 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T18:38:45.596 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T18:38:45.657 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T18:38:45.657 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:38:45.657 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T18:38:45.657 INFO:teuthology.orchestra.run.trial044.stdout: ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:38:45.657 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:38:45.657 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T18:38:45.737 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-24T18:38:46.058 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:12:39 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:38:46.142 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T18:38:46.143 INFO:teuthology.orchestra.run.trial044.stdout:======================================================================================= 2026-02-24T18:38:46.143 INFO:teuthology.orchestra.run.trial044.stdout: Package Arch Version Repo Size 2026-02-24T18:38:46.143 INFO:teuthology.orchestra.run.trial044.stdout:======================================================================================= 2026-02-24T18:38:46.143 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T18:38:46.143 INFO:teuthology.orchestra.run.trial044.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 3.0 M 2026-02-24T18:38:46.143 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:38:46.144 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T18:38:46.144 INFO:teuthology.orchestra.run.trial044.stdout:======================================================================================= 2026-02-24T18:38:46.144 INFO:teuthology.orchestra.run.trial044.stdout:Install 1 Package 2026-02-24T18:38:46.144 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:38:46.144 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 3.0 M 2026-02-24T18:38:46.144 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 15 M 2026-02-24T18:38:46.144 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T18:38:50.482 INFO:teuthology.orchestra.run.trial044.stdout:ceph-immutable-object-cache-debuginfo-20.2.0-68 716 kB/s | 3.0 MB 00:04 2026-02-24T18:38:50.483 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:38:50.483 INFO:teuthology.orchestra.run.trial044.stdout:Total 715 kB/s | 3.0 MB 00:04 2026-02-24T18:38:50.483 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T18:38:50.485 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T18:38:50.485 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T18:38:50.511 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T18:38:50.511 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T18:38:50.708 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T18:38:50.725 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-24T18:38:50.792 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-24T18:38:50.854 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-24T18:38:50.854 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:38:50.854 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T18:38:50.854 INFO:teuthology.orchestra.run.trial044.stdout: ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:38:50.854 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:38:50.855 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T18:38:50.881 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-24T18:38:51.192 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:12:44 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:38:51.276 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T18:38:51.276 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:38:51.276 INFO:teuthology.orchestra.run.trial044.stdout: Package Arch Version Repo Size 2026-02-24T18:38:51.276 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:38:51.276 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T18:38:51.276 INFO:teuthology.orchestra.run.trial044.stdout: ceph-radosgw-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 543 M 2026-02-24T18:38:51.276 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:38:51.276 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T18:38:51.276 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:38:51.276 INFO:teuthology.orchestra.run.trial044.stdout:Install 1 Package 2026-02-24T18:38:51.276 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:38:51.277 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 543 M 2026-02-24T18:38:51.277 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 0 2026-02-24T18:38:51.277 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T18:41:08.805 INFO:teuthology.orchestra.run.trial195.stdout:ceph-common-debuginfo-20.2.0-681.g36d388f2.el9. 891 kB/s | 586 MB 11:13 2026-02-24T18:41:08.806 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:41:08.806 INFO:teuthology.orchestra.run.trial195.stdout:Total 891 kB/s | 586 MB 11:13 2026-02-24T18:41:08.807 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T18:41:08.809 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T18:41:08.809 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T18:41:10.551 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T18:41:10.551 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T18:41:43.666 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T18:41:43.684 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T18:41:44.952 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T18:41:45.014 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T18:41:45.014 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:41:45.014 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T18:41:45.014 INFO:teuthology.orchestra.run.trial195.stdout: ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:41:45.014 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:41:45.014 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T18:41:45.100 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-24T18:41:45.420 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:15:39 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T18:41:45.506 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T18:41:45.507 INFO:teuthology.orchestra.run.trial195.stdout:======================================================================================= 2026-02-24T18:41:45.507 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repo Size 2026-02-24T18:41:45.507 INFO:teuthology.orchestra.run.trial195.stdout:======================================================================================= 2026-02-24T18:41:45.507 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T18:41:45.507 INFO:teuthology.orchestra.run.trial195.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 3.0 M 2026-02-24T18:41:45.507 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:41:45.508 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T18:41:45.508 INFO:teuthology.orchestra.run.trial195.stdout:======================================================================================= 2026-02-24T18:41:45.508 INFO:teuthology.orchestra.run.trial195.stdout:Install 1 Package 2026-02-24T18:41:45.508 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:41:45.508 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 3.0 M 2026-02-24T18:41:45.508 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 15 M 2026-02-24T18:41:45.508 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T18:41:48.809 INFO:teuthology.orchestra.run.trial195.stdout:ceph-immutable-object-cache-debuginfo-20.2.0-68 940 kB/s | 3.0 MB 00:03 2026-02-24T18:41:48.811 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:41:48.811 INFO:teuthology.orchestra.run.trial195.stdout:Total 940 kB/s | 3.0 MB 00:03 2026-02-24T18:41:48.812 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T18:41:48.813 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T18:41:48.813 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T18:41:48.838 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T18:41:48.839 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T18:41:49.027 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T18:41:49.044 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-24T18:41:49.115 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-24T18:41:49.178 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-24T18:41:49.178 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:41:49.178 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T18:41:49.178 INFO:teuthology.orchestra.run.trial195.stdout: ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:41:49.178 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:41:49.179 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T18:41:49.208 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-24T18:41:49.529 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:15:43 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T18:41:49.614 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T18:41:49.615 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:41:49.615 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repo Size 2026-02-24T18:41:49.615 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:41:49.615 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T18:41:49.615 INFO:teuthology.orchestra.run.trial195.stdout: ceph-radosgw-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 543 M 2026-02-24T18:41:49.615 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:41:49.615 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T18:41:49.615 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:41:49.616 INFO:teuthology.orchestra.run.trial195.stdout:Install 1 Package 2026-02-24T18:41:49.616 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:41:49.616 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 543 M 2026-02-24T18:41:49.616 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 0 2026-02-24T18:41:49.616 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T18:48:01.492 INFO:teuthology.orchestra.run.trial014.stdout:ceph-radosgw-debuginfo-20.2.0-681.g36d388f2.el9 815 kB/s | 543 MB 11:22 2026-02-24T18:48:01.493 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:48:01.493 INFO:teuthology.orchestra.run.trial014.stdout:Total 815 kB/s | 543 MB 11:22 2026-02-24T18:48:01.493 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T18:48:01.494 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T18:48:01.495 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T18:48:03.105 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T18:48:03.105 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T18:48:36.276 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T18:48:36.294 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-24T18:48:37.757 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-24T18:48:37.818 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-24T18:48:37.819 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:48:37.819 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T18:48:37.819 INFO:teuthology.orchestra.run.trial014.stdout: ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:48:37.819 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:48:37.819 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T18:48:37.895 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install ceph-test-debuginfo 2026-02-24T18:48:38.213 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:22:31 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:48:38.297 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T18:48:38.298 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:48:38.298 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repo Size 2026-02-24T18:48:38.299 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:48:38.299 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T18:48:38.299 INFO:teuthology.orchestra.run.trial014.stdout: ceph-test-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.7 G 2026-02-24T18:48:38.299 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:48:38.299 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T18:48:38.299 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T18:48:38.299 INFO:teuthology.orchestra.run.trial014.stdout:Install 1 Package 2026-02-24T18:48:38.299 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T18:48:38.299 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 1.7 G 2026-02-24T18:48:38.299 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 0 2026-02-24T18:48:38.299 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T18:49:35.263 INFO:teuthology.orchestra.run.trial195.stdout:ceph-radosgw-debuginfo-20.2.0-681.g36d388f2.el9 1.2 MB/s | 543 MB 07:45 2026-02-24T18:49:35.264 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:49:35.264 INFO:teuthology.orchestra.run.trial195.stdout:Total 1.2 MB/s | 543 MB 07:45 2026-02-24T18:49:35.265 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T18:49:35.267 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T18:49:35.267 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T18:49:36.879 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T18:49:36.880 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T18:49:44.687 INFO:teuthology.orchestra.run.trial044.stdout:ceph-radosgw-debuginfo-20.2.0-681.g36d388f2.el9 851 kB/s | 543 MB 10:53 2026-02-24T18:49:44.688 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:49:44.688 INFO:teuthology.orchestra.run.trial044.stdout:Total 851 kB/s | 543 MB 10:53 2026-02-24T18:49:44.688 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T18:49:44.691 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T18:49:44.691 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T18:49:46.310 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T18:49:46.310 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T18:49:50.934 INFO:teuthology.orchestra.run.trial170.stdout:ceph-radosgw-debuginfo-20.2.0-681.g36d388f2.el9 763 kB/s | 543 MB 12:08 2026-02-24T18:49:50.934 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:49:50.935 INFO:teuthology.orchestra.run.trial170.stdout:Total 763 kB/s | 543 MB 12:08 2026-02-24T18:49:50.935 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T18:49:50.937 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T18:49:50.937 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T18:49:52.546 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T18:49:52.547 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T18:50:09.590 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T18:50:09.608 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-24T18:50:11.123 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-24T18:50:11.186 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-24T18:50:11.186 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:50:11.186 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T18:50:11.186 INFO:teuthology.orchestra.run.trial195.stdout: ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:50:11.186 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:50:11.186 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T18:50:11.269 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph-test-debuginfo 2026-02-24T18:50:11.588 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:24:05 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T18:50:11.673 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T18:50:11.673 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:50:11.673 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repo Size 2026-02-24T18:50:11.674 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:50:11.674 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T18:50:11.674 INFO:teuthology.orchestra.run.trial195.stdout: ceph-test-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.7 G 2026-02-24T18:50:11.674 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:50:11.674 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T18:50:11.674 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T18:50:11.674 INFO:teuthology.orchestra.run.trial195.stdout:Install 1 Package 2026-02-24T18:50:11.674 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T18:50:11.674 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 1.7 G 2026-02-24T18:50:11.675 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 0 2026-02-24T18:50:11.675 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T18:50:18.685 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T18:50:18.703 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-24T18:50:20.210 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-24T18:50:20.271 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-24T18:50:20.271 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:50:20.271 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T18:50:20.271 INFO:teuthology.orchestra.run.trial044.stdout: ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:50:20.272 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:50:20.272 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T18:50:20.347 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install ceph-test-debuginfo 2026-02-24T18:50:20.663 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:24:13 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T18:50:20.747 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T18:50:20.748 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:50:20.748 INFO:teuthology.orchestra.run.trial044.stdout: Package Arch Version Repo Size 2026-02-24T18:50:20.748 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:50:20.748 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T18:50:20.749 INFO:teuthology.orchestra.run.trial044.stdout: ceph-test-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.7 G 2026-02-24T18:50:20.749 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:50:20.749 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T18:50:20.749 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T18:50:20.749 INFO:teuthology.orchestra.run.trial044.stdout:Install 1 Package 2026-02-24T18:50:20.749 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T18:50:20.749 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 1.7 G 2026-02-24T18:50:20.749 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 0 2026-02-24T18:50:20.749 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T18:50:24.861 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T18:50:24.879 INFO:teuthology.orchestra.run.trial170.stdout: Installing : ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-24T18:50:26.351 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-24T18:50:26.412 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-24T18:50:26.412 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:50:26.413 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T18:50:26.413 INFO:teuthology.orchestra.run.trial170.stdout: ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:50:26.413 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:50:26.413 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T18:50:26.489 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install ceph-test-debuginfo 2026-02-24T18:50:26.802 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:24:22 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T18:50:26.886 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T18:50:26.887 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:50:26.887 INFO:teuthology.orchestra.run.trial170.stdout: Package Arch Version Repo Size 2026-02-24T18:50:26.887 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:50:26.887 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T18:50:26.888 INFO:teuthology.orchestra.run.trial170.stdout: ceph-test-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.7 G 2026-02-24T18:50:26.888 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:50:26.888 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T18:50:26.888 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T18:50:26.888 INFO:teuthology.orchestra.run.trial170.stdout:Install 1 Package 2026-02-24T18:50:26.888 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T18:50:26.888 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 1.7 G 2026-02-24T18:50:26.888 INFO:teuthology.orchestra.run.trial170.stdout:Installed size: 0 2026-02-24T18:50:26.888 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T19:06:09.772 INFO:teuthology.orchestra.run.trial044.stdout:ceph-test-debuginfo-20.2.0-681.g36d388f2.el9.x8 1.9 MB/s | 1.7 GB 15:49 2026-02-24T19:06:09.773 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:06:09.773 INFO:teuthology.orchestra.run.trial044.stdout:Total 1.9 MB/s | 1.7 GB 15:49 2026-02-24T19:06:09.773 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T19:06:09.776 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T19:06:09.776 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T19:06:14.981 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T19:06:14.981 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T19:06:39.402 INFO:teuthology.orchestra.run.trial195.stdout:ceph-test-debuginfo-20.2.0-681.g36d388f2.el9.x8 1.8 MB/s | 1.7 GB 16:27 2026-02-24T19:06:39.403 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:06:39.403 INFO:teuthology.orchestra.run.trial195.stdout:Total 1.8 MB/s | 1.7 GB 16:27 2026-02-24T19:06:39.404 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T19:06:39.407 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T19:06:39.407 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T19:06:44.605 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T19:06:44.605 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T19:07:55.290 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T19:07:55.310 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:07:58.494 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:07:58.555 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:07:58.555 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:07:58.555 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T19:07:58.555 INFO:teuthology.orchestra.run.trial044.stdout: ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:07:58.555 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:07:58.555 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T19:07:58.757 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install ceph-base-debuginfo 2026-02-24T19:07:59.070 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:41:52 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T19:07:59.135 INFO:teuthology.orchestra.run.trial044.stdout:Package ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T19:07:59.154 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T19:07:59.155 INFO:teuthology.orchestra.run.trial044.stdout:Nothing to do. 2026-02-24T19:07:59.155 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T19:07:59.176 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install ceph-mgr-debuginfo 2026-02-24T19:07:59.498 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:41:52 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T19:07:59.583 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T19:07:59.584 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:07:59.584 INFO:teuthology.orchestra.run.trial044.stdout: Package Arch Version Repo Size 2026-02-24T19:07:59.584 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:07:59.584 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T19:07:59.584 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mgr-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 22 M 2026-02-24T19:07:59.585 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:07:59.585 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T19:07:59.585 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:07:59.585 INFO:teuthology.orchestra.run.trial044.stdout:Install 1 Package 2026-02-24T19:07:59.585 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:07:59.585 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 22 M 2026-02-24T19:07:59.585 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 146 M 2026-02-24T19:07:59.585 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T19:08:14.784 INFO:teuthology.orchestra.run.trial044.stdout:ceph-mgr-debuginfo-20.2.0-681.g36d388f2.el9.x86 1.4 MB/s | 22 MB 00:15 2026-02-24T19:08:14.785 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:08:14.785 INFO:teuthology.orchestra.run.trial044.stdout:Total 1.4 MB/s | 22 MB 00:15 2026-02-24T19:08:14.785 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T19:08:14.787 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T19:08:14.787 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T19:08:14.869 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T19:08:14.870 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T19:08:16.128 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T19:08:16.145 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:08:16.319 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:08:16.382 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:08:16.382 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:08:16.382 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T19:08:16.383 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:08:16.383 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:08:16.383 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T19:08:16.412 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install ceph-mds-debuginfo 2026-02-24T19:08:16.727 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:42:09 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T19:08:16.811 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T19:08:16.812 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:08:16.812 INFO:teuthology.orchestra.run.trial044.stdout: Package Arch Version Repo Size 2026-02-24T19:08:16.812 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:08:16.812 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T19:08:16.812 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mds-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 54 M 2026-02-24T19:08:16.813 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:08:16.813 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T19:08:16.813 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:08:16.813 INFO:teuthology.orchestra.run.trial044.stdout:Install 1 Package 2026-02-24T19:08:16.813 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:08:16.813 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 54 M 2026-02-24T19:08:16.813 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 221 M 2026-02-24T19:08:16.813 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T19:08:27.621 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T19:08:27.696 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:08:30.123 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:08:30.184 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:08:30.184 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:08:30.185 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T19:08:30.185 INFO:teuthology.orchestra.run.trial195.stdout: ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:08:30.185 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:08:30.185 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T19:08:30.386 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph-base-debuginfo 2026-02-24T19:08:30.708 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:42:24 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T19:08:30.775 INFO:teuthology.orchestra.run.trial195.stdout:Package ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T19:08:30.794 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T19:08:30.794 INFO:teuthology.orchestra.run.trial195.stdout:Nothing to do. 2026-02-24T19:08:30.795 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T19:08:30.817 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph-mgr-debuginfo 2026-02-24T19:08:31.134 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:42:25 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T19:08:31.218 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T19:08:31.219 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:08:31.219 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repo Size 2026-02-24T19:08:31.219 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:08:31.219 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T19:08:31.219 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mgr-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 22 M 2026-02-24T19:08:31.219 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:08:31.219 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T19:08:31.219 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:08:31.219 INFO:teuthology.orchestra.run.trial195.stdout:Install 1 Package 2026-02-24T19:08:31.220 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:08:31.220 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 22 M 2026-02-24T19:08:31.220 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 146 M 2026-02-24T19:08:31.220 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T19:08:34.626 INFO:teuthology.orchestra.run.trial044.stdout:ceph-mds-debuginfo-20.2.0-681.g36d388f2.el9.x86 3.0 MB/s | 54 MB 00:17 2026-02-24T19:08:34.627 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:08:34.627 INFO:teuthology.orchestra.run.trial044.stdout:Total 3.0 MB/s | 54 MB 00:17 2026-02-24T19:08:34.627 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T19:08:34.629 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T19:08:34.629 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T19:08:34.805 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T19:08:34.805 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T19:08:37.449 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T19:08:37.467 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:08:37.683 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:08:37.745 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:08:37.745 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:08:37.745 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T19:08:37.745 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:08:37.745 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:08:37.745 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T19:08:37.775 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install ceph-mon-debuginfo 2026-02-24T19:08:38.093 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:42:31 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T19:08:38.177 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T19:08:38.177 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:08:38.178 INFO:teuthology.orchestra.run.trial044.stdout: Package Arch Version Repo Size 2026-02-24T19:08:38.178 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:08:38.178 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T19:08:38.178 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mon-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 130 M 2026-02-24T19:08:38.178 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:08:38.178 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T19:08:38.178 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:08:38.178 INFO:teuthology.orchestra.run.trial044.stdout:Install 1 Package 2026-02-24T19:08:38.178 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:08:38.179 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 130 M 2026-02-24T19:08:38.179 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 643 M 2026-02-24T19:08:38.179 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T19:08:40.143 INFO:teuthology.orchestra.run.trial195.stdout:ceph-mgr-debuginfo-20.2.0-681.g36d388f2.el9.x86 2.5 MB/s | 22 MB 00:08 2026-02-24T19:08:40.143 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:08:40.144 INFO:teuthology.orchestra.run.trial195.stdout:Total 2.5 MB/s | 22 MB 00:08 2026-02-24T19:08:40.144 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T19:08:40.145 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T19:08:40.145 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T19:08:40.228 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T19:08:40.228 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T19:08:41.488 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T19:08:41.505 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:08:41.673 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:08:41.735 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:08:41.735 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:08:41.735 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T19:08:41.735 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:08:41.735 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:08:41.735 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T19:08:41.765 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph-mds-debuginfo 2026-02-24T19:08:42.083 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:42:36 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T19:08:42.169 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T19:08:42.170 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:08:42.170 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repo Size 2026-02-24T19:08:42.170 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:08:42.170 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T19:08:42.170 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mds-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 54 M 2026-02-24T19:08:42.170 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:08:42.171 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T19:08:42.171 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:08:42.171 INFO:teuthology.orchestra.run.trial195.stdout:Install 1 Package 2026-02-24T19:08:42.171 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:08:42.171 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 54 M 2026-02-24T19:08:42.171 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 221 M 2026-02-24T19:08:42.171 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T19:09:05.245 INFO:teuthology.orchestra.run.trial044.stdout:ceph-mon-debuginfo-20.2.0-681.g36d388f2.el9.x86 4.8 MB/s | 130 MB 00:27 2026-02-24T19:09:05.246 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:09:05.246 INFO:teuthology.orchestra.run.trial044.stdout:Total 4.8 MB/s | 130 MB 00:27 2026-02-24T19:09:05.246 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T19:09:05.248 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T19:09:05.248 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T19:09:05.648 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T19:09:05.648 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T19:09:12.320 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T19:09:12.338 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:09:12.885 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:09:12.948 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:09:12.948 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:09:12.948 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T19:09:12.948 INFO:teuthology.orchestra.run.trial044.stdout: ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:09:12.948 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:09:12.948 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T19:09:12.986 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install ceph-osd-debuginfo 2026-02-24T19:09:13.304 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:43:06 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T19:09:13.388 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T19:09:13.389 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:09:13.389 INFO:teuthology.orchestra.run.trial044.stdout: Package Arch Version Repo Size 2026-02-24T19:09:13.389 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:09:13.389 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T19:09:13.389 INFO:teuthology.orchestra.run.trial044.stdout: ceph-osd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 343 M 2026-02-24T19:09:13.389 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:09:13.390 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T19:09:13.390 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:09:13.390 INFO:teuthology.orchestra.run.trial044.stdout:Install 1 Package 2026-02-24T19:09:13.390 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:09:13.390 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 343 M 2026-02-24T19:09:13.390 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 1.6 G 2026-02-24T19:09:13.390 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T19:09:26.211 INFO:teuthology.orchestra.run.trial195.stdout:ceph-mds-debuginfo-20.2.0-681.g36d388f2.el9.x86 1.2 MB/s | 54 MB 00:44 2026-02-24T19:09:26.212 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:09:26.212 INFO:teuthology.orchestra.run.trial195.stdout:Total 1.2 MB/s | 54 MB 00:44 2026-02-24T19:09:26.212 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T19:09:26.214 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T19:09:26.214 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T19:09:26.391 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T19:09:26.391 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T19:09:29.051 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T19:09:29.068 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:09:29.292 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:09:29.355 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:09:29.355 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:09:29.355 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T19:09:29.355 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:09:29.355 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:09:29.355 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T19:09:29.387 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph-mon-debuginfo 2026-02-24T19:09:29.706 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:43:23 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T19:09:29.791 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T19:09:29.792 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:09:29.792 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repo Size 2026-02-24T19:09:29.792 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:09:29.792 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T19:09:29.792 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mon-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 130 M 2026-02-24T19:09:29.792 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:09:29.792 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T19:09:29.792 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:09:29.792 INFO:teuthology.orchestra.run.trial195.stdout:Install 1 Package 2026-02-24T19:09:29.793 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:09:29.793 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 130 M 2026-02-24T19:09:29.793 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 643 M 2026-02-24T19:09:29.793 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T19:10:04.926 INFO:teuthology.orchestra.run.trial195.stdout:ceph-mon-debuginfo-20.2.0-681.g36d388f2.el9.x86 3.7 MB/s | 130 MB 00:35 2026-02-24T19:10:04.927 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:10:04.927 INFO:teuthology.orchestra.run.trial195.stdout:Total 3.7 MB/s | 130 MB 00:35 2026-02-24T19:10:04.927 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T19:10:04.929 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T19:10:04.929 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T19:10:05.328 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T19:10:05.328 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T19:10:11.961 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T19:10:11.978 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:10:12.497 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:10:12.565 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:10:12.565 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:10:12.565 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T19:10:12.565 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:10:12.565 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:10:12.565 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T19:10:12.603 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph-osd-debuginfo 2026-02-24T19:10:12.917 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:44:06 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T19:10:13.004 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T19:10:13.005 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:10:13.005 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repo Size 2026-02-24T19:10:13.005 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:10:13.005 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T19:10:13.005 INFO:teuthology.orchestra.run.trial195.stdout: ceph-osd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 343 M 2026-02-24T19:10:13.005 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:10:13.005 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T19:10:13.005 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:10:13.005 INFO:teuthology.orchestra.run.trial195.stdout:Install 1 Package 2026-02-24T19:10:13.005 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:10:13.006 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 343 M 2026-02-24T19:10:13.006 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 1.6 G 2026-02-24T19:10:13.006 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T19:10:55.162 INFO:teuthology.orchestra.run.trial014.stdout:ceph-test-debuginfo-20.2.0-681.g36d388f2.el9.x8 1.3 MB/s | 1.7 GB 22:16 2026-02-24T19:10:55.163 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:10:55.163 INFO:teuthology.orchestra.run.trial014.stdout:Total 1.3 MB/s | 1.7 GB 22:16 2026-02-24T19:10:55.163 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T19:10:55.166 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T19:10:55.167 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T19:11:00.356 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T19:11:00.357 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T19:11:38.488 INFO:teuthology.orchestra.run.trial044.stdout:ceph-osd-debuginfo-20.2.0-681.g36d388f2.el9.x86 2.4 MB/s | 343 MB 02:25 2026-02-24T19:11:38.489 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:11:38.489 INFO:teuthology.orchestra.run.trial044.stdout:Total 2.4 MB/s | 343 MB 02:25 2026-02-24T19:11:38.489 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T19:11:38.491 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T19:11:38.491 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T19:11:39.520 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T19:11:39.521 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T19:11:56.776 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T19:11:56.794 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:11:58.056 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:11:58.119 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:11:58.119 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:11:58.119 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T19:11:58.119 INFO:teuthology.orchestra.run.trial044.stdout: ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:11:58.119 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:11:58.119 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T19:11:58.180 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install ceph-fuse-debuginfo 2026-02-24T19:11:58.496 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:45:51 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T19:11:58.579 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T19:11:58.580 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:11:58.580 INFO:teuthology.orchestra.run.trial044.stdout: Package Arch Version Repo Size 2026-02-24T19:11:58.580 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:11:58.580 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T19:11:58.580 INFO:teuthology.orchestra.run.trial044.stdout: ceph-fuse-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 10 M 2026-02-24T19:11:58.580 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:11:58.580 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T19:11:58.581 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:11:58.581 INFO:teuthology.orchestra.run.trial044.stdout:Install 1 Package 2026-02-24T19:11:58.581 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:11:58.581 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 10 M 2026-02-24T19:11:58.581 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 51 M 2026-02-24T19:11:58.581 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T19:12:01.874 INFO:teuthology.orchestra.run.trial044.stdout:ceph-fuse-debuginfo-20.2.0-681.g36d388f2.el9.x8 3.1 MB/s | 10 MB 00:03 2026-02-24T19:12:01.875 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:12:01.875 INFO:teuthology.orchestra.run.trial044.stdout:Total 3.1 MB/s | 10 MB 00:03 2026-02-24T19:12:01.875 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T19:12:01.876 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T19:12:01.876 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T19:12:01.924 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T19:12:01.924 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T19:12:02.476 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T19:12:02.494 INFO:teuthology.orchestra.run.trial044.stdout: Installing : ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:12:02.592 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:12:02.654 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:12:02.654 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:02.654 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T19:12:02.654 INFO:teuthology.orchestra.run.trial044.stdout: ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:12:02.654 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:02.654 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T19:12:02.682 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install librados-devel-debuginfo 2026-02-24T19:12:02.997 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:45:55 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T19:12:03.080 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T19:12:03.081 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:12:03.081 INFO:teuthology.orchestra.run.trial044.stdout: Package Arch Version Repo Size 2026-02-24T19:12:03.081 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:12:03.081 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T19:12:03.081 INFO:teuthology.orchestra.run.trial044.stdout: librados-devel-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 144 k 2026-02-24T19:12:03.081 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:03.082 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T19:12:03.082 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:12:03.082 INFO:teuthology.orchestra.run.trial044.stdout:Install 1 Package 2026-02-24T19:12:03.082 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:03.082 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 144 k 2026-02-24T19:12:03.082 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 802 k 2026-02-24T19:12:03.082 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T19:12:03.424 INFO:teuthology.orchestra.run.trial170.stdout:ceph-test-debuginfo-20.2.0-681.g36d388f2.el9.x8 1.4 MB/s | 1.7 GB 21:36 2026-02-24T19:12:03.425 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:12:03.425 INFO:teuthology.orchestra.run.trial170.stdout:Total 1.4 MB/s | 1.7 GB 21:36 2026-02-24T19:12:03.426 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T19:12:03.429 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T19:12:03.429 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T19:12:03.534 INFO:teuthology.orchestra.run.trial044.stdout:librados-devel-debuginfo-20.2.0-681.g36d388f2.e 317 kB/s | 144 kB 00:00 2026-02-24T19:12:03.535 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:12:03.535 INFO:teuthology.orchestra.run.trial044.stdout:Total 317 kB/s | 144 kB 00:00 2026-02-24T19:12:03.535 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T19:12:03.537 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T19:12:03.537 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T19:12:03.556 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T19:12:03.557 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T19:12:03.597 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T19:12:03.614 INFO:teuthology.orchestra.run.trial044.stdout: Installing : librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:12:03.675 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:12:03.737 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:12:03.737 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:03.737 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T19:12:03.737 INFO:teuthology.orchestra.run.trial044.stdout: librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:12:03.737 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:03.738 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T19:12:03.764 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install libcephfs2-debuginfo 2026-02-24T19:12:04.081 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:45:57 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T19:12:04.165 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T19:12:04.166 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:12:04.166 INFO:teuthology.orchestra.run.trial044.stdout: Package Arch Version Repo Size 2026-02-24T19:12:04.166 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:12:04.166 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T19:12:04.166 INFO:teuthology.orchestra.run.trial044.stdout: libcephfs2-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 9.1 M 2026-02-24T19:12:04.166 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:04.166 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T19:12:04.166 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:12:04.166 INFO:teuthology.orchestra.run.trial044.stdout:Install 1 Package 2026-02-24T19:12:04.167 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:04.167 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 9.1 M 2026-02-24T19:12:04.167 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 46 M 2026-02-24T19:12:04.167 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T19:12:07.640 INFO:teuthology.orchestra.run.trial044.stdout:libcephfs2-debuginfo-20.2.0-681.g36d388f2.el9.x 2.6 MB/s | 9.1 MB 00:03 2026-02-24T19:12:07.641 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:12:07.642 INFO:teuthology.orchestra.run.trial044.stdout:Total 2.6 MB/s | 9.1 MB 00:03 2026-02-24T19:12:07.642 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T19:12:07.643 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T19:12:07.643 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T19:12:07.687 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T19:12:07.688 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T19:12:08.192 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T19:12:08.210 INFO:teuthology.orchestra.run.trial044.stdout: Installing : libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:12:08.301 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:12:08.363 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:12:08.363 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:08.363 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T19:12:08.363 INFO:teuthology.orchestra.run.trial044.stdout: libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:12:08.363 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:08.363 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T19:12:08.391 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install librados2-debuginfo 2026-02-24T19:12:08.626 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T19:12:08.626 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T19:12:08.706 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:46:01 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T19:12:08.789 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T19:12:08.790 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:12:08.790 INFO:teuthology.orchestra.run.trial044.stdout: Package Arch Version Repo Size 2026-02-24T19:12:08.790 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:12:08.790 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T19:12:08.790 INFO:teuthology.orchestra.run.trial044.stdout: librados2-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 63 M 2026-02-24T19:12:08.790 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:08.791 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T19:12:08.791 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:12:08.791 INFO:teuthology.orchestra.run.trial044.stdout:Install 1 Package 2026-02-24T19:12:08.791 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:08.791 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 63 M 2026-02-24T19:12:08.791 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 397 M 2026-02-24T19:12:08.791 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T19:12:16.012 INFO:teuthology.orchestra.run.trial044.stdout:librados2-debuginfo-20.2.0-681.g36d388f2.el9.x8 8.8 MB/s | 63 MB 00:07 2026-02-24T19:12:16.012 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:12:16.013 INFO:teuthology.orchestra.run.trial044.stdout:Total 8.8 MB/s | 63 MB 00:07 2026-02-24T19:12:16.013 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T19:12:16.015 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T19:12:16.015 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T19:12:16.221 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T19:12:16.221 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T19:12:17.682 INFO:teuthology.orchestra.run.trial195.stdout:ceph-osd-debuginfo-20.2.0-681.g36d388f2.el9.x86 2.8 MB/s | 343 MB 02:04 2026-02-24T19:12:17.683 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:12:17.683 INFO:teuthology.orchestra.run.trial195.stdout:Total 2.8 MB/s | 343 MB 02:04 2026-02-24T19:12:17.684 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T19:12:17.685 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T19:12:17.686 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T19:12:18.710 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T19:12:18.710 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T19:12:19.726 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T19:12:19.743 INFO:teuthology.orchestra.run.trial044.stdout: Installing : librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:12:20.086 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:12:20.148 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:12:20.149 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:20.149 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T19:12:20.149 INFO:teuthology.orchestra.run.trial044.stdout: librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:12:20.149 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:20.149 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T19:12:20.181 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install librbd1-debuginfo 2026-02-24T19:12:20.499 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:46:13 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T19:12:20.582 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T19:12:20.583 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:12:20.583 INFO:teuthology.orchestra.run.trial044.stdout: Package Arch Version Repo Size 2026-02-24T19:12:20.583 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:12:20.583 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T19:12:20.583 INFO:teuthology.orchestra.run.trial044.stdout: librbd1-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 80 M 2026-02-24T19:12:20.583 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:20.583 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T19:12:20.583 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:12:20.584 INFO:teuthology.orchestra.run.trial044.stdout:Install 1 Package 2026-02-24T19:12:20.584 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:20.584 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 80 M 2026-02-24T19:12:20.584 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 406 M 2026-02-24T19:12:20.584 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T19:12:34.904 INFO:teuthology.orchestra.run.trial044.stdout:librbd1-debuginfo-20.2.0-681.g36d388f2.el9.x86_ 5.6 MB/s | 80 MB 00:14 2026-02-24T19:12:34.904 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:12:34.905 INFO:teuthology.orchestra.run.trial044.stdout:Total 5.6 MB/s | 80 MB 00:14 2026-02-24T19:12:34.905 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T19:12:34.906 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T19:12:34.906 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T19:12:35.162 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T19:12:35.162 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T19:12:35.937 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T19:12:35.955 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:12:37.209 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:12:37.270 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:12:37.271 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:12:37.271 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T19:12:37.271 INFO:teuthology.orchestra.run.trial195.stdout: ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:12:37.271 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:12:37.271 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T19:12:37.330 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph-fuse-debuginfo 2026-02-24T19:12:37.653 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:46:31 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T19:12:37.737 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T19:12:37.738 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:12:37.738 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repo Size 2026-02-24T19:12:37.738 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:12:37.738 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T19:12:37.738 INFO:teuthology.orchestra.run.trial195.stdout: ceph-fuse-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 10 M 2026-02-24T19:12:37.738 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:12:37.739 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T19:12:37.739 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:12:37.739 INFO:teuthology.orchestra.run.trial195.stdout:Install 1 Package 2026-02-24T19:12:37.739 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:12:37.739 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 10 M 2026-02-24T19:12:37.739 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 51 M 2026-02-24T19:12:37.739 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T19:12:39.248 INFO:teuthology.orchestra.run.trial195.stdout:ceph-fuse-debuginfo-20.2.0-681.g36d388f2.el9.x8 6.7 MB/s | 10 MB 00:01 2026-02-24T19:12:39.248 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:12:39.248 INFO:teuthology.orchestra.run.trial195.stdout:Total 6.7 MB/s | 10 MB 00:01 2026-02-24T19:12:39.248 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T19:12:39.250 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T19:12:39.250 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T19:12:39.298 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T19:12:39.298 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T19:12:39.423 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T19:12:39.441 INFO:teuthology.orchestra.run.trial044.stdout: Installing : librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:12:39.802 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:12:39.855 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T19:12:39.864 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:12:39.865 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:39.865 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T19:12:39.865 INFO:teuthology.orchestra.run.trial044.stdout: librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:12:39.865 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:39.865 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T19:12:39.872 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:12:39.899 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install python3-cephfs-debuginfo 2026-02-24T19:12:39.971 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:12:40.033 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:12:40.033 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:12:40.034 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T19:12:40.034 INFO:teuthology.orchestra.run.trial195.stdout: ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:12:40.034 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:12:40.034 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T19:12:40.061 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install librados-devel-debuginfo 2026-02-24T19:12:40.215 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:46:33 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T19:12:40.298 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T19:12:40.299 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:12:40.299 INFO:teuthology.orchestra.run.trial044.stdout: Package Arch Version Repo Size 2026-02-24T19:12:40.299 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:12:40.299 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T19:12:40.299 INFO:teuthology.orchestra.run.trial044.stdout: python3-cephfs-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 645 k 2026-02-24T19:12:40.299 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:40.299 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T19:12:40.299 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:12:40.300 INFO:teuthology.orchestra.run.trial044.stdout:Install 1 Package 2026-02-24T19:12:40.300 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:40.300 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 645 k 2026-02-24T19:12:40.300 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 2.3 M 2026-02-24T19:12:40.300 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T19:12:40.372 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:46:34 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T19:12:40.454 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T19:12:40.455 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:12:40.455 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repo Size 2026-02-24T19:12:40.455 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:12:40.455 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T19:12:40.455 INFO:teuthology.orchestra.run.trial195.stdout: librados-devel-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 144 k 2026-02-24T19:12:40.455 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:12:40.456 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T19:12:40.456 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:12:40.456 INFO:teuthology.orchestra.run.trial195.stdout:Install 1 Package 2026-02-24T19:12:40.456 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:12:40.456 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 144 k 2026-02-24T19:12:40.456 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 802 k 2026-02-24T19:12:40.456 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T19:12:40.528 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T19:12:40.549 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:12:40.606 INFO:teuthology.orchestra.run.trial044.stdout:python3-cephfs-debuginfo-20.2.0-681.g36d388f2.e 2.1 MB/s | 645 kB 00:00 2026-02-24T19:12:40.607 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:12:40.607 INFO:teuthology.orchestra.run.trial044.stdout:Total 2.0 MB/s | 645 kB 00:00 2026-02-24T19:12:40.607 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T19:12:40.609 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T19:12:40.609 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T19:12:40.628 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T19:12:40.628 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T19:12:40.692 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T19:12:40.703 INFO:teuthology.orchestra.run.trial195.stdout:librados-devel-debuginfo-20.2.0-681.g36d388f2.e 580 kB/s | 144 kB 00:00 2026-02-24T19:12:40.703 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:12:40.704 INFO:teuthology.orchestra.run.trial195.stdout:Total 579 kB/s | 144 kB 00:00 2026-02-24T19:12:40.704 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T19:12:40.706 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T19:12:40.706 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T19:12:40.710 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:12:40.724 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T19:12:40.725 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T19:12:40.766 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T19:12:40.774 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:12:40.783 INFO:teuthology.orchestra.run.trial195.stdout: Installing : librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:12:40.837 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:12:40.837 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:40.837 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T19:12:40.837 INFO:teuthology.orchestra.run.trial044.stdout: python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:12:40.837 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:40.838 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T19:12:40.843 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:12:40.865 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install python3-rados-debuginfo 2026-02-24T19:12:40.904 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:12:40.904 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:12:40.905 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T19:12:40.905 INFO:teuthology.orchestra.run.trial195.stdout: librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:12:40.905 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:12:40.905 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T19:12:40.931 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install libcephfs2-debuginfo 2026-02-24T19:12:41.177 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:46:34 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T19:12:41.245 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:46:35 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T19:12:41.259 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T19:12:41.260 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:12:41.260 INFO:teuthology.orchestra.run.trial044.stdout: Package Arch Version Repo Size 2026-02-24T19:12:41.260 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:12:41.260 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T19:12:41.260 INFO:teuthology.orchestra.run.trial044.stdout: python3-rados-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 802 k 2026-02-24T19:12:41.260 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:41.261 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T19:12:41.261 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:12:41.261 INFO:teuthology.orchestra.run.trial044.stdout:Install 1 Package 2026-02-24T19:12:41.261 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:41.261 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 802 k 2026-02-24T19:12:41.261 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 3.1 M 2026-02-24T19:12:41.261 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T19:12:41.330 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T19:12:41.331 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:12:41.331 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repo Size 2026-02-24T19:12:41.331 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:12:41.331 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T19:12:41.331 INFO:teuthology.orchestra.run.trial195.stdout: libcephfs2-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 9.1 M 2026-02-24T19:12:41.331 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:12:41.332 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T19:12:41.332 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:12:41.332 INFO:teuthology.orchestra.run.trial195.stdout:Install 1 Package 2026-02-24T19:12:41.332 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:12:41.332 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 9.1 M 2026-02-24T19:12:41.332 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 46 M 2026-02-24T19:12:41.332 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T19:12:41.586 INFO:teuthology.orchestra.run.trial044.stdout:python3-rados-debuginfo-20.2.0-681.g36d388f2.el 2.4 MB/s | 802 kB 00:00 2026-02-24T19:12:41.587 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:12:41.587 INFO:teuthology.orchestra.run.trial044.stdout:Total 2.4 MB/s | 802 kB 00:00 2026-02-24T19:12:41.587 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T19:12:41.588 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T19:12:41.588 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T19:12:41.608 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T19:12:41.609 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T19:12:41.681 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T19:12:41.698 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-24T19:12:41.759 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-24T19:12:41.820 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-24T19:12:41.821 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:41.821 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T19:12:41.821 INFO:teuthology.orchestra.run.trial044.stdout: python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:12:41.821 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:41.821 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T19:12:41.846 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install python3-rbd-debuginfo 2026-02-24T19:12:42.163 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:46:35 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T19:12:42.247 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T19:12:42.248 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:12:42.248 INFO:teuthology.orchestra.run.trial044.stdout: Package Arch Version Repo Size 2026-02-24T19:12:42.248 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:12:42.248 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T19:12:42.248 INFO:teuthology.orchestra.run.trial044.stdout: python3-rbd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.2 M 2026-02-24T19:12:42.248 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:42.248 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T19:12:42.248 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:12:42.248 INFO:teuthology.orchestra.run.trial044.stdout:Install 1 Package 2026-02-24T19:12:42.249 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:42.249 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 1.2 M 2026-02-24T19:12:42.249 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 4.7 M 2026-02-24T19:12:42.249 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T19:12:42.780 INFO:teuthology.orchestra.run.trial044.stdout:python3-rbd-debuginfo-20.2.0-681.g36d388f2.el9. 2.2 MB/s | 1.2 MB 00:00 2026-02-24T19:12:42.781 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:12:42.781 INFO:teuthology.orchestra.run.trial044.stdout:Total 2.2 MB/s | 1.2 MB 00:00 2026-02-24T19:12:42.781 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T19:12:42.782 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T19:12:42.783 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T19:12:42.803 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T19:12:42.803 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T19:12:42.899 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T19:12:42.916 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:12:42.979 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:12:43.041 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:12:43.041 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:43.042 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T19:12:43.042 INFO:teuthology.orchestra.run.trial044.stdout: python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:12:43.042 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:43.042 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T19:12:43.068 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install python3-rgw-debuginfo 2026-02-24T19:12:43.106 INFO:teuthology.orchestra.run.trial195.stdout:libcephfs2-debuginfo-20.2.0-681.g36d388f2.el9.x 5.1 MB/s | 9.1 MB 00:01 2026-02-24T19:12:43.107 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:12:43.107 INFO:teuthology.orchestra.run.trial195.stdout:Total 5.1 MB/s | 9.1 MB 00:01 2026-02-24T19:12:43.107 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T19:12:43.109 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T19:12:43.109 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T19:12:43.154 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T19:12:43.154 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T19:12:43.384 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:46:36 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T19:12:43.467 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T19:12:43.468 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:12:43.468 INFO:teuthology.orchestra.run.trial044.stdout: Package Arch Version Repo Size 2026-02-24T19:12:43.468 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:12:43.469 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T19:12:43.469 INFO:teuthology.orchestra.run.trial044.stdout: python3-rgw-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 350 k 2026-02-24T19:12:43.469 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:43.469 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T19:12:43.469 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:12:43.469 INFO:teuthology.orchestra.run.trial044.stdout:Install 1 Package 2026-02-24T19:12:43.469 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:43.469 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 350 k 2026-02-24T19:12:43.469 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 1.1 M 2026-02-24T19:12:43.469 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T19:12:43.622 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:12:43.656 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T19:12:43.660 INFO:teuthology.orchestra.run.trial044.stdout:python3-rgw-debuginfo-20.2.0-681.g36d388f2.el9. 1.8 MB/s | 350 kB 00:00 2026-02-24T19:12:43.660 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:12:43.661 INFO:teuthology.orchestra.run.trial044.stdout:Total 1.8 MB/s | 350 kB 00:00 2026-02-24T19:12:43.661 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T19:12:43.663 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T19:12:43.663 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T19:12:43.673 INFO:teuthology.orchestra.run.trial195.stdout: Installing : libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:12:43.682 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T19:12:43.682 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T19:12:43.684 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:12:43.684 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:12:43.684 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T19:12:43.684 INFO:teuthology.orchestra.run.trial014.stdout: ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:12:43.684 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:12:43.684 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T19:12:43.736 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T19:12:43.754 INFO:teuthology.orchestra.run.trial044.stdout: Installing : python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:12:43.770 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:12:43.813 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:12:43.832 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:12:43.832 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:12:43.832 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T19:12:43.833 INFO:teuthology.orchestra.run.trial195.stdout: libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:12:43.833 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:12:43.833 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T19:12:43.860 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install librados2-debuginfo 2026-02-24T19:12:43.875 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:12:43.875 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:43.875 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T19:12:43.875 INFO:teuthology.orchestra.run.trial044.stdout: python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:12:43.875 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:43.875 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T19:12:43.887 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install ceph-base-debuginfo 2026-02-24T19:12:43.900 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install rbd-fuse-debuginfo 2026-02-24T19:12:44.173 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:46:38 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T19:12:44.203 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:46:37 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T19:12:44.218 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:46:37 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T19:12:44.258 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T19:12:44.259 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:12:44.259 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repo Size 2026-02-24T19:12:44.259 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:12:44.260 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T19:12:44.260 INFO:teuthology.orchestra.run.trial195.stdout: librados2-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 63 M 2026-02-24T19:12:44.260 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:12:44.260 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T19:12:44.260 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:12:44.260 INFO:teuthology.orchestra.run.trial195.stdout:Install 1 Package 2026-02-24T19:12:44.260 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:12:44.260 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 63 M 2026-02-24T19:12:44.260 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 397 M 2026-02-24T19:12:44.260 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T19:12:44.269 INFO:teuthology.orchestra.run.trial014.stdout:Package ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T19:12:44.288 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T19:12:44.288 INFO:teuthology.orchestra.run.trial014.stdout:Nothing to do. 2026-02-24T19:12:44.288 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T19:12:44.302 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T19:12:44.302 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:12:44.303 INFO:teuthology.orchestra.run.trial044.stdout: Package Arch Version Repo Size 2026-02-24T19:12:44.303 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:12:44.303 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T19:12:44.303 INFO:teuthology.orchestra.run.trial044.stdout: rbd-fuse-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.5 M 2026-02-24T19:12:44.303 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:44.303 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T19:12:44.303 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:12:44.303 INFO:teuthology.orchestra.run.trial044.stdout:Install 1 Package 2026-02-24T19:12:44.303 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:44.303 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 1.5 M 2026-02-24T19:12:44.304 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 7.9 M 2026-02-24T19:12:44.304 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T19:12:44.310 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install ceph-mgr-debuginfo 2026-02-24T19:12:44.624 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:46:37 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T19:12:44.708 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T19:12:44.709 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:12:44.709 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repo Size 2026-02-24T19:12:44.710 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:12:44.710 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T19:12:44.710 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 22 M 2026-02-24T19:12:44.710 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:12:44.710 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T19:12:44.710 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:12:44.710 INFO:teuthology.orchestra.run.trial014.stdout:Install 1 Package 2026-02-24T19:12:44.710 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:12:44.710 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 22 M 2026-02-24T19:12:44.710 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 146 M 2026-02-24T19:12:44.710 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T19:12:45.047 INFO:teuthology.orchestra.run.trial044.stdout:rbd-fuse-debuginfo-20.2.0-681.g36d388f2.el9.x86 2.1 MB/s | 1.5 MB 00:00 2026-02-24T19:12:45.048 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:12:45.048 INFO:teuthology.orchestra.run.trial044.stdout:Total 2.1 MB/s | 1.5 MB 00:00 2026-02-24T19:12:45.048 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T19:12:45.050 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T19:12:45.050 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T19:12:45.073 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T19:12:45.073 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T19:12:45.188 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T19:12:45.205 INFO:teuthology.orchestra.run.trial044.stdout: Installing : rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:12:45.270 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:12:45.332 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:12:45.332 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:45.333 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T19:12:45.333 INFO:teuthology.orchestra.run.trial044.stdout: rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:12:45.333 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:45.333 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T19:12:45.360 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install rbd-mirror-debuginfo 2026-02-24T19:12:45.672 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:46:38 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T19:12:45.758 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T19:12:45.758 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:12:45.759 INFO:teuthology.orchestra.run.trial044.stdout: Package Arch Version Repo Size 2026-02-24T19:12:45.759 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:12:45.759 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T19:12:45.759 INFO:teuthology.orchestra.run.trial044.stdout: rbd-mirror-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 79 M 2026-02-24T19:12:45.759 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:45.759 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T19:12:45.759 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:12:45.759 INFO:teuthology.orchestra.run.trial044.stdout:Install 1 Package 2026-02-24T19:12:45.759 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:12:45.760 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 79 M 2026-02-24T19:12:45.760 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 375 M 2026-02-24T19:12:45.760 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T19:12:47.240 INFO:teuthology.orchestra.run.trial014.stdout:ceph-mgr-debuginfo-20.2.0-681.g36d388f2.el9.x86 8.6 MB/s | 22 MB 00:02 2026-02-24T19:12:47.241 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:12:47.241 INFO:teuthology.orchestra.run.trial014.stdout:Total 8.6 MB/s | 22 MB 00:02 2026-02-24T19:12:47.241 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T19:12:47.243 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T19:12:47.243 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T19:12:47.324 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T19:12:47.325 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T19:12:48.620 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T19:12:48.637 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:12:48.802 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:12:48.865 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:12:48.865 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:12:48.865 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T19:12:48.865 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:12:48.865 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:12:48.866 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T19:12:48.896 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install ceph-mds-debuginfo 2026-02-24T19:12:49.211 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:46:42 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T19:12:49.296 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T19:12:49.296 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:12:49.297 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repo Size 2026-02-24T19:12:49.297 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:12:49.297 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T19:12:49.297 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mds-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 54 M 2026-02-24T19:12:49.297 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:12:49.297 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T19:12:49.297 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:12:49.297 INFO:teuthology.orchestra.run.trial014.stdout:Install 1 Package 2026-02-24T19:12:49.297 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:12:49.297 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 54 M 2026-02-24T19:12:49.298 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 221 M 2026-02-24T19:12:49.298 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T19:12:51.317 INFO:teuthology.orchestra.run.trial014.stdout:ceph-mds-debuginfo-20.2.0-681.g36d388f2.el9.x86 27 MB/s | 54 MB 00:02 2026-02-24T19:12:51.318 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:12:51.318 INFO:teuthology.orchestra.run.trial014.stdout:Total 27 MB/s | 54 MB 00:02 2026-02-24T19:12:51.319 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T19:12:51.320 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T19:12:51.320 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T19:12:51.496 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T19:12:51.496 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T19:12:52.554 INFO:teuthology.orchestra.run.trial195.stdout:librados2-debuginfo-20.2.0-681.g36d388f2.el9.x8 7.7 MB/s | 63 MB 00:08 2026-02-24T19:12:52.554 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:12:52.555 INFO:teuthology.orchestra.run.trial195.stdout:Total 7.7 MB/s | 63 MB 00:08 2026-02-24T19:12:52.555 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T19:12:52.556 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T19:12:52.556 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T19:12:52.761 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T19:12:52.761 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T19:12:54.197 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T19:12:54.214 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:12:54.430 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:12:54.492 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:12:54.492 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:12:54.492 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T19:12:54.492 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:12:54.492 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:12:54.492 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T19:12:54.522 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install ceph-mon-debuginfo 2026-02-24T19:12:54.839 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:46:47 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T19:12:54.923 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T19:12:54.924 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:12:54.924 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repo Size 2026-02-24T19:12:54.924 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:12:54.924 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T19:12:54.924 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mon-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 130 M 2026-02-24T19:12:54.924 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:12:54.924 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T19:12:54.925 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:12:54.925 INFO:teuthology.orchestra.run.trial014.stdout:Install 1 Package 2026-02-24T19:12:54.925 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:12:54.925 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 130 M 2026-02-24T19:12:54.925 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 643 M 2026-02-24T19:12:54.925 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T19:12:56.254 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T19:12:56.272 INFO:teuthology.orchestra.run.trial195.stdout: Installing : librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:12:56.633 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:12:56.695 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:12:56.696 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:12:56.696 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T19:12:56.696 INFO:teuthology.orchestra.run.trial195.stdout: librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:12:56.696 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:12:56.696 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T19:12:56.727 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install librbd1-debuginfo 2026-02-24T19:12:57.045 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:46:51 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T19:12:57.129 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T19:12:57.130 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:12:57.130 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repo Size 2026-02-24T19:12:57.131 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:12:57.131 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T19:12:57.131 INFO:teuthology.orchestra.run.trial195.stdout: librbd1-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 80 M 2026-02-24T19:12:57.131 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:12:57.131 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T19:12:57.131 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:12:57.131 INFO:teuthology.orchestra.run.trial195.stdout:Install 1 Package 2026-02-24T19:12:57.131 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:12:57.131 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 80 M 2026-02-24T19:12:57.131 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 406 M 2026-02-24T19:12:57.131 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T19:13:07.202 INFO:teuthology.orchestra.run.trial044.stdout:rbd-mirror-debuginfo-20.2.0-681.g36d388f2.el9.x 3.7 MB/s | 79 MB 00:21 2026-02-24T19:13:07.203 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:13:07.203 INFO:teuthology.orchestra.run.trial044.stdout:Total 3.7 MB/s | 79 MB 00:21 2026-02-24T19:13:07.203 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T19:13:07.205 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T19:13:07.205 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T19:13:07.456 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T19:13:07.456 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T19:13:07.550 INFO:teuthology.orchestra.run.trial014.stdout:ceph-mon-debuginfo-20.2.0-681.g36d388f2.el9.x86 10 MB/s | 130 MB 00:12 2026-02-24T19:13:07.551 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:13:07.552 INFO:teuthology.orchestra.run.trial014.stdout:Total 10 MB/s | 130 MB 00:12 2026-02-24T19:13:07.552 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T19:13:07.553 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T19:13:07.554 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T19:13:07.952 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T19:13:07.952 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T19:13:11.513 INFO:teuthology.orchestra.run.trial195.stdout:librbd1-debuginfo-20.2.0-681.g36d388f2.el9.x86_ 5.6 MB/s | 80 MB 00:14 2026-02-24T19:13:11.514 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:13:11.514 INFO:teuthology.orchestra.run.trial195.stdout:Total 5.6 MB/s | 80 MB 00:14 2026-02-24T19:13:11.514 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T19:13:11.515 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T19:13:11.516 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T19:13:11.589 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T19:13:11.606 INFO:teuthology.orchestra.run.trial044.stdout: Installing : rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:13:11.773 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T19:13:11.773 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T19:13:11.934 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:13:11.996 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:13:11.996 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:13:11.996 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T19:13:11.996 INFO:teuthology.orchestra.run.trial044.stdout: rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:13:11.996 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:13:11.996 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T19:13:12.028 DEBUG:teuthology.orchestra.run.trial044:> sudo yum -y install rbd-nbd-debuginfo 2026-02-24T19:13:12.340 INFO:teuthology.orchestra.run.trial044.stdout:Last metadata expiration check: 0:47:05 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T19:13:12.424 INFO:teuthology.orchestra.run.trial044.stdout:Dependencies resolved. 2026-02-24T19:13:12.425 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:13:12.425 INFO:teuthology.orchestra.run.trial044.stdout: Package Arch Version Repo Size 2026-02-24T19:13:12.425 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:13:12.425 INFO:teuthology.orchestra.run.trial044.stdout:Installing: 2026-02-24T19:13:12.425 INFO:teuthology.orchestra.run.trial044.stdout: rbd-nbd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.4 M 2026-02-24T19:13:12.425 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:13:12.425 INFO:teuthology.orchestra.run.trial044.stdout:Transaction Summary 2026-02-24T19:13:12.425 INFO:teuthology.orchestra.run.trial044.stdout:================================================================================ 2026-02-24T19:13:12.426 INFO:teuthology.orchestra.run.trial044.stdout:Install 1 Package 2026-02-24T19:13:12.426 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:13:12.426 INFO:teuthology.orchestra.run.trial044.stdout:Total download size: 2.4 M 2026-02-24T19:13:12.426 INFO:teuthology.orchestra.run.trial044.stdout:Installed size: 12 M 2026-02-24T19:13:12.426 INFO:teuthology.orchestra.run.trial044.stdout:Downloading Packages: 2026-02-24T19:13:13.385 INFO:teuthology.orchestra.run.trial044.stdout:rbd-nbd-debuginfo-20.2.0-681.g36d388f2.el9.x86_ 2.5 MB/s | 2.4 MB 00:00 2026-02-24T19:13:13.387 INFO:teuthology.orchestra.run.trial044.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:13:13.387 INFO:teuthology.orchestra.run.trial044.stdout:Total 2.5 MB/s | 2.4 MB 00:00 2026-02-24T19:13:13.387 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction check 2026-02-24T19:13:13.389 INFO:teuthology.orchestra.run.trial044.stdout:Transaction check succeeded. 2026-02-24T19:13:13.389 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction test 2026-02-24T19:13:13.414 INFO:teuthology.orchestra.run.trial044.stdout:Transaction test succeeded. 2026-02-24T19:13:13.415 INFO:teuthology.orchestra.run.trial044.stdout:Running transaction 2026-02-24T19:13:13.579 INFO:teuthology.orchestra.run.trial044.stdout: Preparing : 1/1 2026-02-24T19:13:13.596 INFO:teuthology.orchestra.run.trial044.stdout: Installing : rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:13.664 INFO:teuthology.orchestra.run.trial044.stdout: Running scriptlet: rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:13.727 INFO:teuthology.orchestra.run.trial044.stdout: Verifying : rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:13.727 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:13:13.727 INFO:teuthology.orchestra.run.trial044.stdout:Installed: 2026-02-24T19:13:13.727 INFO:teuthology.orchestra.run.trial044.stdout: rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:13:13.727 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:13:13.727 INFO:teuthology.orchestra.run.trial044.stdout:Complete! 2026-02-24T19:13:13.759 DEBUG:teuthology.parallel:result is None 2026-02-24T19:13:14.605 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T19:13:14.623 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:15.141 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:15.203 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:15.203 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:13:15.203 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T19:13:15.203 INFO:teuthology.orchestra.run.trial014.stdout: ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:13:15.204 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:13:15.204 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T19:13:15.242 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install ceph-osd-debuginfo 2026-02-24T19:13:15.556 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:47:08 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T19:13:15.641 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T19:13:15.641 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:13:15.641 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repo Size 2026-02-24T19:13:15.641 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:13:15.641 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T19:13:15.641 INFO:teuthology.orchestra.run.trial014.stdout: ceph-osd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 343 M 2026-02-24T19:13:15.641 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:13:15.641 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T19:13:15.642 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:13:15.642 INFO:teuthology.orchestra.run.trial014.stdout:Install 1 Package 2026-02-24T19:13:15.642 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:13:15.642 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 343 M 2026-02-24T19:13:15.642 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 1.6 G 2026-02-24T19:13:15.642 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T19:13:15.934 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T19:13:15.951 INFO:teuthology.orchestra.run.trial195.stdout: Installing : librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:16.304 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:16.365 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:16.365 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:13:16.366 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T19:13:16.366 INFO:teuthology.orchestra.run.trial195.stdout: librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:13:16.366 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:13:16.366 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T19:13:16.398 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install python3-cephfs-debuginfo 2026-02-24T19:13:16.710 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:47:10 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T19:13:16.794 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T19:13:16.795 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:13:16.795 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repo Size 2026-02-24T19:13:16.795 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:13:16.795 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T19:13:16.795 INFO:teuthology.orchestra.run.trial195.stdout: python3-cephfs-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 645 k 2026-02-24T19:13:16.795 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:13:16.795 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T19:13:16.795 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:13:16.796 INFO:teuthology.orchestra.run.trial195.stdout:Install 1 Package 2026-02-24T19:13:16.796 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:13:16.796 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 645 k 2026-02-24T19:13:16.796 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 2.3 M 2026-02-24T19:13:16.796 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T19:13:17.355 INFO:teuthology.orchestra.run.trial195.stdout:python3-cephfs-debuginfo-20.2.0-681.g36d388f2.e 1.1 MB/s | 645 kB 00:00 2026-02-24T19:13:17.356 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:13:17.356 INFO:teuthology.orchestra.run.trial195.stdout:Total 1.1 MB/s | 645 kB 00:00 2026-02-24T19:13:17.356 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T19:13:17.358 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T19:13:17.359 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T19:13:17.378 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T19:13:17.378 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T19:13:17.443 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T19:13:17.460 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:13:17.521 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:13:17.582 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:13:17.582 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:13:17.582 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T19:13:17.582 INFO:teuthology.orchestra.run.trial195.stdout: python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:13:17.582 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:13:17.583 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T19:13:17.608 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install python3-rados-debuginfo 2026-02-24T19:13:17.928 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:47:11 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T19:13:18.013 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T19:13:18.014 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:13:18.014 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repo Size 2026-02-24T19:13:18.014 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:13:18.014 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T19:13:18.015 INFO:teuthology.orchestra.run.trial195.stdout: python3-rados-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 802 k 2026-02-24T19:13:18.015 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:13:18.015 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T19:13:18.015 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:13:18.015 INFO:teuthology.orchestra.run.trial195.stdout:Install 1 Package 2026-02-24T19:13:18.015 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:13:18.015 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 802 k 2026-02-24T19:13:18.015 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 3.1 M 2026-02-24T19:13:18.015 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T19:13:18.906 INFO:teuthology.orchestra.run.trial195.stdout:python3-rados-debuginfo-20.2.0-681.g36d388f2.el 900 kB/s | 802 kB 00:00 2026-02-24T19:13:18.907 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:13:18.907 INFO:teuthology.orchestra.run.trial195.stdout:Total 899 kB/s | 802 kB 00:00 2026-02-24T19:13:18.907 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T19:13:18.909 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T19:13:18.909 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T19:13:18.928 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T19:13:18.929 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T19:13:19.001 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T19:13:19.018 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-24T19:13:19.078 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-24T19:13:19.140 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-24T19:13:19.140 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:13:19.140 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T19:13:19.140 INFO:teuthology.orchestra.run.trial195.stdout: python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:13:19.140 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:13:19.141 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T19:13:19.168 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install python3-rbd-debuginfo 2026-02-24T19:13:19.485 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:47:13 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T19:13:19.568 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T19:13:19.569 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:13:19.570 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repo Size 2026-02-24T19:13:19.570 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:13:19.570 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T19:13:19.570 INFO:teuthology.orchestra.run.trial195.stdout: python3-rbd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.2 M 2026-02-24T19:13:19.570 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:13:19.570 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T19:13:19.570 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:13:19.570 INFO:teuthology.orchestra.run.trial195.stdout:Install 1 Package 2026-02-24T19:13:19.570 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:13:19.570 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 1.2 M 2026-02-24T19:13:19.570 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 4.7 M 2026-02-24T19:13:19.570 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T19:13:20.620 INFO:teuthology.orchestra.run.trial195.stdout:python3-rbd-debuginfo-20.2.0-681.g36d388f2.el9. 1.1 MB/s | 1.2 MB 00:01 2026-02-24T19:13:20.622 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:13:20.622 INFO:teuthology.orchestra.run.trial195.stdout:Total 1.1 MB/s | 1.2 MB 00:01 2026-02-24T19:13:20.622 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T19:13:20.624 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T19:13:20.624 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T19:13:20.645 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T19:13:20.645 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T19:13:20.737 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T19:13:20.754 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:13:20.815 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:13:20.876 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:13:20.876 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:13:20.876 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T19:13:20.877 INFO:teuthology.orchestra.run.trial195.stdout: python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:13:20.877 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:13:20.877 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T19:13:20.903 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install python3-rgw-debuginfo 2026-02-24T19:13:21.225 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:47:15 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T19:13:21.310 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T19:13:21.310 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:13:21.310 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repo Size 2026-02-24T19:13:21.310 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:13:21.311 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T19:13:21.311 INFO:teuthology.orchestra.run.trial195.stdout: python3-rgw-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 350 k 2026-02-24T19:13:21.311 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:13:21.311 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T19:13:21.311 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:13:21.311 INFO:teuthology.orchestra.run.trial195.stdout:Install 1 Package 2026-02-24T19:13:21.311 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:13:21.311 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 350 k 2026-02-24T19:13:21.311 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 1.1 M 2026-02-24T19:13:21.311 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T19:13:21.751 INFO:teuthology.orchestra.run.trial195.stdout:python3-rgw-debuginfo-20.2.0-681.g36d388f2.el9. 797 kB/s | 350 kB 00:00 2026-02-24T19:13:21.751 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:13:21.751 INFO:teuthology.orchestra.run.trial195.stdout:Total 795 kB/s | 350 kB 00:00 2026-02-24T19:13:21.752 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T19:13:21.754 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T19:13:21.754 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T19:13:21.773 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T19:13:21.773 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T19:13:21.823 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T19:13:21.840 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:13:21.901 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:13:21.963 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:13:21.963 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:13:21.963 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T19:13:21.963 INFO:teuthology.orchestra.run.trial195.stdout: python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:13:21.963 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:13:21.963 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T19:13:21.991 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install rbd-fuse-debuginfo 2026-02-24T19:13:22.312 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:47:16 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T19:13:22.397 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T19:13:22.398 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:13:22.398 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repo Size 2026-02-24T19:13:22.398 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:13:22.398 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T19:13:22.398 INFO:teuthology.orchestra.run.trial195.stdout: rbd-fuse-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.5 M 2026-02-24T19:13:22.398 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:13:22.398 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T19:13:22.398 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:13:22.398 INFO:teuthology.orchestra.run.trial195.stdout:Install 1 Package 2026-02-24T19:13:22.398 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:13:22.398 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 1.5 M 2026-02-24T19:13:22.399 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 7.9 M 2026-02-24T19:13:22.399 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T19:13:23.131 INFO:teuthology.orchestra.run.trial195.stdout:rbd-fuse-debuginfo-20.2.0-681.g36d388f2.el9.x86 2.1 MB/s | 1.5 MB 00:00 2026-02-24T19:13:23.132 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:13:23.132 INFO:teuthology.orchestra.run.trial195.stdout:Total 2.1 MB/s | 1.5 MB 00:00 2026-02-24T19:13:23.132 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T19:13:23.134 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T19:13:23.134 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T19:13:23.157 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T19:13:23.157 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T19:13:23.269 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T19:13:23.286 INFO:teuthology.orchestra.run.trial195.stdout: Installing : rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:23.351 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:23.414 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:23.414 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:13:23.414 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T19:13:23.414 INFO:teuthology.orchestra.run.trial195.stdout: rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:13:23.414 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:13:23.414 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T19:13:23.442 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install rbd-mirror-debuginfo 2026-02-24T19:13:23.762 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:47:17 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T19:13:23.847 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T19:13:23.847 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:13:23.847 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repo Size 2026-02-24T19:13:23.847 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:13:23.848 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T19:13:23.848 INFO:teuthology.orchestra.run.trial195.stdout: rbd-mirror-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 79 M 2026-02-24T19:13:23.848 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:13:23.848 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T19:13:23.848 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:13:23.848 INFO:teuthology.orchestra.run.trial195.stdout:Install 1 Package 2026-02-24T19:13:23.848 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:13:23.848 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 79 M 2026-02-24T19:13:23.848 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 375 M 2026-02-24T19:13:23.848 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T19:13:34.909 INFO:teuthology.orchestra.run.trial195.stdout:rbd-mirror-debuginfo-20.2.0-681.g36d388f2.el9.x 7.2 MB/s | 79 MB 00:11 2026-02-24T19:13:34.909 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:13:34.910 INFO:teuthology.orchestra.run.trial195.stdout:Total 7.2 MB/s | 79 MB 00:11 2026-02-24T19:13:34.910 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T19:13:34.912 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T19:13:34.912 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T19:13:35.164 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T19:13:35.164 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T19:13:39.221 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T19:13:39.239 INFO:teuthology.orchestra.run.trial195.stdout: Installing : rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:13:39.581 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:13:39.644 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:13:39.644 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:13:39.644 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T19:13:39.644 INFO:teuthology.orchestra.run.trial195.stdout: rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:13:39.644 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:13:39.644 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T19:13:39.678 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install rbd-nbd-debuginfo 2026-02-24T19:13:40.000 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:47:33 ago on Tue 24 Feb 2026 06:26:06 PM UTC. 2026-02-24T19:13:40.086 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T19:13:40.086 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:13:40.086 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repo Size 2026-02-24T19:13:40.086 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:13:40.086 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T19:13:40.086 INFO:teuthology.orchestra.run.trial195.stdout: rbd-nbd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.4 M 2026-02-24T19:13:40.086 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:13:40.087 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T19:13:40.087 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T19:13:40.087 INFO:teuthology.orchestra.run.trial195.stdout:Install 1 Package 2026-02-24T19:13:40.087 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:13:40.087 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 2.4 M 2026-02-24T19:13:40.087 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 12 M 2026-02-24T19:13:40.087 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T19:13:40.136 INFO:teuthology.orchestra.run.trial014.stdout:ceph-osd-debuginfo-20.2.0-681.g36d388f2.el9.x86 14 MB/s | 343 MB 00:24 2026-02-24T19:13:40.136 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:13:40.136 INFO:teuthology.orchestra.run.trial014.stdout:Total 14 MB/s | 343 MB 00:24 2026-02-24T19:13:40.137 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T19:13:40.138 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T19:13:40.138 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T19:13:41.162 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T19:13:41.162 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T19:13:41.194 INFO:teuthology.orchestra.run.trial195.stdout:rbd-nbd-debuginfo-20.2.0-681.g36d388f2.el9.x86_ 2.2 MB/s | 2.4 MB 00:01 2026-02-24T19:13:41.194 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:13:41.194 INFO:teuthology.orchestra.run.trial195.stdout:Total 2.2 MB/s | 2.4 MB 00:01 2026-02-24T19:13:41.194 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T19:13:41.196 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T19:13:41.196 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T19:13:41.221 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T19:13:41.221 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T19:13:41.380 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T19:13:41.397 INFO:teuthology.orchestra.run.trial195.stdout: Installing : rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:41.468 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:41.530 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:41.530 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:13:41.530 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T19:13:41.530 INFO:teuthology.orchestra.run.trial195.stdout: rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:13:41.530 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:13:41.530 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T19:13:41.559 DEBUG:teuthology.parallel:result is None 2026-02-24T19:13:52.290 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T19:13:52.310 INFO:teuthology.orchestra.run.trial170.stdout: Installing : ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:13:54.638 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:13:54.699 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:13:54.699 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:13:54.699 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T19:13:54.700 INFO:teuthology.orchestra.run.trial170.stdout: ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:13:54.700 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:13:54.700 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T19:13:54.901 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install ceph-base-debuginfo 2026-02-24T19:13:55.216 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:47:51 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T19:13:55.281 INFO:teuthology.orchestra.run.trial170.stdout:Package ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T19:13:55.300 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T19:13:55.300 INFO:teuthology.orchestra.run.trial170.stdout:Nothing to do. 2026-02-24T19:13:55.300 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T19:13:55.322 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install ceph-mgr-debuginfo 2026-02-24T19:13:55.636 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:47:51 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T19:13:55.721 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T19:13:55.721 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:13:55.721 INFO:teuthology.orchestra.run.trial170.stdout: Package Arch Version Repo Size 2026-02-24T19:13:55.721 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:13:55.721 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T19:13:55.722 INFO:teuthology.orchestra.run.trial170.stdout: ceph-mgr-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 22 M 2026-02-24T19:13:55.722 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:13:55.722 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T19:13:55.722 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:13:55.722 INFO:teuthology.orchestra.run.trial170.stdout:Install 1 Package 2026-02-24T19:13:55.722 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:13:55.722 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 22 M 2026-02-24T19:13:55.722 INFO:teuthology.orchestra.run.trial170.stdout:Installed size: 146 M 2026-02-24T19:13:55.722 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T19:13:56.894 INFO:teuthology.orchestra.run.trial170.stdout:ceph-mgr-debuginfo-20.2.0-681.g36d388f2.el9.x86 19 MB/s | 22 MB 00:01 2026-02-24T19:13:56.894 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:13:56.895 INFO:teuthology.orchestra.run.trial170.stdout:Total 19 MB/s | 22 MB 00:01 2026-02-24T19:13:56.895 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T19:13:56.896 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T19:13:56.897 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T19:13:56.978 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T19:13:56.978 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T19:13:58.229 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T19:13:58.246 INFO:teuthology.orchestra.run.trial170.stdout: Installing : ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:58.354 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T19:13:58.372 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:58.411 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:58.472 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:58.472 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:13:58.472 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T19:13:58.473 INFO:teuthology.orchestra.run.trial170.stdout: ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:13:58.473 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:13:58.473 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T19:13:58.500 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install ceph-mds-debuginfo 2026-02-24T19:13:58.818 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:47:54 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T19:13:58.902 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T19:13:58.902 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:13:58.903 INFO:teuthology.orchestra.run.trial170.stdout: Package Arch Version Repo Size 2026-02-24T19:13:58.903 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:13:58.903 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T19:13:58.903 INFO:teuthology.orchestra.run.trial170.stdout: ceph-mds-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 54 M 2026-02-24T19:13:58.903 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:13:58.903 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T19:13:58.903 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:13:58.903 INFO:teuthology.orchestra.run.trial170.stdout:Install 1 Package 2026-02-24T19:13:58.903 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:13:58.903 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 54 M 2026-02-24T19:13:58.904 INFO:teuthology.orchestra.run.trial170.stdout:Installed size: 221 M 2026-02-24T19:13:58.904 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T19:13:59.584 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:59.645 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:59.646 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:13:59.646 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T19:13:59.646 INFO:teuthology.orchestra.run.trial014.stdout: ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:13:59.646 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:13:59.646 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T19:13:59.705 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install ceph-fuse-debuginfo 2026-02-24T19:14:00.019 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:47:53 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T19:14:00.102 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T19:14:00.103 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:14:00.103 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repo Size 2026-02-24T19:14:00.103 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:14:00.103 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T19:14:00.103 INFO:teuthology.orchestra.run.trial014.stdout: ceph-fuse-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 10 M 2026-02-24T19:14:00.103 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:14:00.103 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T19:14:00.103 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:14:00.104 INFO:teuthology.orchestra.run.trial014.stdout:Install 1 Package 2026-02-24T19:14:00.104 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:14:00.104 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 10 M 2026-02-24T19:14:00.104 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 51 M 2026-02-24T19:14:00.104 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T19:14:02.940 INFO:teuthology.orchestra.run.trial014.stdout:ceph-fuse-debuginfo-20.2.0-681.g36d388f2.el9.x8 3.6 MB/s | 10 MB 00:02 2026-02-24T19:14:02.941 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:14:02.941 INFO:teuthology.orchestra.run.trial014.stdout:Total 3.6 MB/s | 10 MB 00:02 2026-02-24T19:14:02.941 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T19:14:02.942 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T19:14:02.942 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T19:14:02.974 INFO:teuthology.orchestra.run.trial170.stdout:ceph-mds-debuginfo-20.2.0-681.g36d388f2.el9.x86 13 MB/s | 54 MB 00:04 2026-02-24T19:14:02.975 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:14:02.975 INFO:teuthology.orchestra.run.trial170.stdout:Total 13 MB/s | 54 MB 00:04 2026-02-24T19:14:02.975 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T19:14:02.977 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T19:14:02.977 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T19:14:02.989 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T19:14:02.989 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T19:14:03.153 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T19:14:03.153 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T19:14:03.543 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T19:14:03.561 INFO:teuthology.orchestra.run.trial014.stdout: Installing : ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:14:03.657 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:14:03.719 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:14:03.719 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:14:03.719 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T19:14:03.719 INFO:teuthology.orchestra.run.trial014.stdout: ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:14:03.719 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:14:03.719 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T19:14:03.745 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install librados-devel-debuginfo 2026-02-24T19:14:04.057 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:47:57 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T19:14:04.140 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T19:14:04.141 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:14:04.141 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repo Size 2026-02-24T19:14:04.141 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:14:04.141 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T19:14:04.141 INFO:teuthology.orchestra.run.trial014.stdout: librados-devel-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 144 k 2026-02-24T19:14:04.141 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:14:04.142 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T19:14:04.142 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:14:04.142 INFO:teuthology.orchestra.run.trial014.stdout:Install 1 Package 2026-02-24T19:14:04.142 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:14:04.142 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 144 k 2026-02-24T19:14:04.142 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 802 k 2026-02-24T19:14:04.142 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T19:14:04.394 INFO:teuthology.orchestra.run.trial014.stdout:librados-devel-debuginfo-20.2.0-681.g36d388f2.e 569 kB/s | 144 kB 00:00 2026-02-24T19:14:04.394 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:14:04.395 INFO:teuthology.orchestra.run.trial014.stdout:Total 567 kB/s | 144 kB 00:00 2026-02-24T19:14:04.395 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T19:14:04.396 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T19:14:04.396 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T19:14:04.414 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T19:14:04.414 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T19:14:04.455 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T19:14:04.472 INFO:teuthology.orchestra.run.trial014.stdout: Installing : librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:14:04.531 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:14:04.593 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:14:04.593 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:14:04.593 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T19:14:04.593 INFO:teuthology.orchestra.run.trial014.stdout: librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:14:04.593 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:14:04.593 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T19:14:04.619 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install libcephfs2-debuginfo 2026-02-24T19:14:04.933 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:47:57 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T19:14:05.015 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T19:14:05.016 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:14:05.016 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repo Size 2026-02-24T19:14:05.016 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:14:05.017 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T19:14:05.017 INFO:teuthology.orchestra.run.trial014.stdout: libcephfs2-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 9.1 M 2026-02-24T19:14:05.017 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:14:05.017 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T19:14:05.017 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:14:05.017 INFO:teuthology.orchestra.run.trial014.stdout:Install 1 Package 2026-02-24T19:14:05.017 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:14:05.017 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 9.1 M 2026-02-24T19:14:05.017 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 46 M 2026-02-24T19:14:05.017 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T19:14:05.796 INFO:teuthology.orchestra.run.trial014.stdout:libcephfs2-debuginfo-20.2.0-681.g36d388f2.el9.x 12 MB/s | 9.1 MB 00:00 2026-02-24T19:14:05.797 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:14:05.797 INFO:teuthology.orchestra.run.trial014.stdout:Total 12 MB/s | 9.1 MB 00:00 2026-02-24T19:14:05.797 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T19:14:05.799 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T19:14:05.799 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T19:14:05.842 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T19:14:05.842 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T19:14:05.908 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T19:14:05.926 INFO:teuthology.orchestra.run.trial170.stdout: Installing : ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:06.137 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:06.198 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:06.198 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:14:06.198 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T19:14:06.198 INFO:teuthology.orchestra.run.trial170.stdout: ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:14:06.198 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:14:06.198 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T19:14:06.228 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install ceph-mon-debuginfo 2026-02-24T19:14:06.336 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T19:14:06.353 INFO:teuthology.orchestra.run.trial014.stdout: Installing : libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:14:06.450 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:14:06.511 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:14:06.512 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:14:06.512 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T19:14:06.512 INFO:teuthology.orchestra.run.trial014.stdout: libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:14:06.512 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:14:06.512 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T19:14:06.540 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install librados2-debuginfo 2026-02-24T19:14:06.543 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:48:02 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T19:14:06.626 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T19:14:06.627 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:14:06.627 INFO:teuthology.orchestra.run.trial170.stdout: Package Arch Version Repo Size 2026-02-24T19:14:06.627 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:14:06.627 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T19:14:06.627 INFO:teuthology.orchestra.run.trial170.stdout: ceph-mon-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 130 M 2026-02-24T19:14:06.627 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:14:06.627 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T19:14:06.627 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:14:06.628 INFO:teuthology.orchestra.run.trial170.stdout:Install 1 Package 2026-02-24T19:14:06.628 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:14:06.628 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 130 M 2026-02-24T19:14:06.628 INFO:teuthology.orchestra.run.trial170.stdout:Installed size: 643 M 2026-02-24T19:14:06.628 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T19:14:06.853 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:47:59 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T19:14:06.935 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T19:14:06.936 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:14:06.936 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repo Size 2026-02-24T19:14:06.936 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:14:06.937 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T19:14:06.937 INFO:teuthology.orchestra.run.trial014.stdout: librados2-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 63 M 2026-02-24T19:14:06.937 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:14:06.937 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T19:14:06.937 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:14:06.937 INFO:teuthology.orchestra.run.trial014.stdout:Install 1 Package 2026-02-24T19:14:06.937 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:14:06.937 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 63 M 2026-02-24T19:14:06.937 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 397 M 2026-02-24T19:14:06.937 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T19:14:16.625 INFO:teuthology.orchestra.run.trial170.stdout:ceph-mon-debuginfo-20.2.0-681.g36d388f2.el9.x86 13 MB/s | 130 MB 00:09 2026-02-24T19:14:16.626 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:14:16.626 INFO:teuthology.orchestra.run.trial170.stdout:Total 13 MB/s | 130 MB 00:09 2026-02-24T19:14:16.626 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T19:14:16.628 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T19:14:16.628 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T19:14:17.026 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T19:14:17.026 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T19:14:23.654 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T19:14:23.671 INFO:teuthology.orchestra.run.trial170.stdout: Installing : ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:24.191 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:24.253 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:24.253 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:14:24.253 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T19:14:24.253 INFO:teuthology.orchestra.run.trial170.stdout: ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:14:24.253 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:14:24.254 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T19:14:24.293 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install ceph-osd-debuginfo 2026-02-24T19:14:24.606 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:48:20 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T19:14:24.689 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T19:14:24.690 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:14:24.690 INFO:teuthology.orchestra.run.trial170.stdout: Package Arch Version Repo Size 2026-02-24T19:14:24.691 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:14:24.691 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T19:14:24.691 INFO:teuthology.orchestra.run.trial170.stdout: ceph-osd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 343 M 2026-02-24T19:14:24.691 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:14:24.691 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T19:14:24.691 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:14:24.691 INFO:teuthology.orchestra.run.trial170.stdout:Install 1 Package 2026-02-24T19:14:24.691 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:14:24.691 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 343 M 2026-02-24T19:14:24.691 INFO:teuthology.orchestra.run.trial170.stdout:Installed size: 1.6 G 2026-02-24T19:14:24.691 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T19:14:25.132 INFO:teuthology.orchestra.run.trial014.stdout:librados2-debuginfo-20.2.0-681.g36d388f2.el9.x8 3.5 MB/s | 63 MB 00:18 2026-02-24T19:14:25.133 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:14:25.133 INFO:teuthology.orchestra.run.trial014.stdout:Total 3.5 MB/s | 63 MB 00:18 2026-02-24T19:14:25.133 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T19:14:25.135 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T19:14:25.135 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T19:14:25.341 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T19:14:25.341 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T19:14:28.847 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T19:14:28.864 INFO:teuthology.orchestra.run.trial014.stdout: Installing : librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:14:29.216 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:14:29.277 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:14:29.277 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:14:29.278 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T19:14:29.278 INFO:teuthology.orchestra.run.trial014.stdout: librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:14:29.278 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:14:29.278 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T19:14:29.308 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install librbd1-debuginfo 2026-02-24T19:14:29.622 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:48:22 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T19:14:29.705 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T19:14:29.706 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:14:29.706 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repo Size 2026-02-24T19:14:29.706 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:14:29.706 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T19:14:29.706 INFO:teuthology.orchestra.run.trial014.stdout: librbd1-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 80 M 2026-02-24T19:14:29.706 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:14:29.706 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T19:14:29.706 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:14:29.707 INFO:teuthology.orchestra.run.trial014.stdout:Install 1 Package 2026-02-24T19:14:29.707 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:14:29.707 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 80 M 2026-02-24T19:14:29.707 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 406 M 2026-02-24T19:14:29.707 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T19:14:50.802 INFO:teuthology.orchestra.run.trial170.stdout:ceph-osd-debuginfo-20.2.0-681.g36d388f2.el9.x86 13 MB/s | 343 MB 00:26 2026-02-24T19:14:50.803 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:14:50.803 INFO:teuthology.orchestra.run.trial170.stdout:Total 13 MB/s | 343 MB 00:26 2026-02-24T19:14:50.803 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T19:14:50.805 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T19:14:50.805 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T19:14:51.828 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T19:14:51.828 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T19:15:00.312 INFO:teuthology.orchestra.run.trial014.stdout:librbd1-debuginfo-20.2.0-681.g36d388f2.el9.x86_ 2.6 MB/s | 80 MB 00:30 2026-02-24T19:15:00.313 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:00.313 INFO:teuthology.orchestra.run.trial014.stdout:Total 2.6 MB/s | 80 MB 00:30 2026-02-24T19:15:00.313 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T19:15:00.315 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T19:15:00.315 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T19:15:00.569 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T19:15:00.569 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T19:15:04.739 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T19:15:04.757 INFO:teuthology.orchestra.run.trial014.stdout: Installing : librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:05.103 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:05.164 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:05.165 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:05.165 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T19:15:05.165 INFO:teuthology.orchestra.run.trial014.stdout: librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:05.165 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:05.165 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T19:15:05.198 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install python3-cephfs-debuginfo 2026-02-24T19:15:05.513 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:48:58 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T19:15:05.596 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T19:15:05.597 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:15:05.597 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repo Size 2026-02-24T19:15:05.597 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:15:05.597 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T19:15:05.597 INFO:teuthology.orchestra.run.trial014.stdout: python3-cephfs-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 645 k 2026-02-24T19:15:05.597 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:05.598 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T19:15:05.598 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:15:05.598 INFO:teuthology.orchestra.run.trial014.stdout:Install 1 Package 2026-02-24T19:15:05.598 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:05.598 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 645 k 2026-02-24T19:15:05.598 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 2.3 M 2026-02-24T19:15:05.598 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T19:15:06.249 INFO:teuthology.orchestra.run.trial014.stdout:python3-cephfs-debuginfo-20.2.0-681.g36d388f2.e 989 kB/s | 645 kB 00:00 2026-02-24T19:15:06.250 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:06.250 INFO:teuthology.orchestra.run.trial014.stdout:Total 988 kB/s | 645 kB 00:00 2026-02-24T19:15:06.250 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T19:15:06.252 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T19:15:06.252 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T19:15:06.272 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T19:15:06.272 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T19:15:06.337 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T19:15:06.354 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:15:06.414 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:15:06.477 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:15:06.477 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:06.477 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T19:15:06.477 INFO:teuthology.orchestra.run.trial014.stdout: python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:06.478 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:06.478 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T19:15:06.504 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install python3-rados-debuginfo 2026-02-24T19:15:06.821 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:48:59 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T19:15:06.904 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T19:15:06.905 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:15:06.905 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repo Size 2026-02-24T19:15:06.905 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:15:06.905 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T19:15:06.905 INFO:teuthology.orchestra.run.trial014.stdout: python3-rados-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 802 k 2026-02-24T19:15:06.905 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:06.905 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T19:15:06.905 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:15:06.905 INFO:teuthology.orchestra.run.trial014.stdout:Install 1 Package 2026-02-24T19:15:06.905 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:06.906 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 802 k 2026-02-24T19:15:06.906 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 3.1 M 2026-02-24T19:15:06.906 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T19:15:07.477 INFO:teuthology.orchestra.run.trial014.stdout:python3-rados-debuginfo-20.2.0-681.g36d388f2.el 1.4 MB/s | 802 kB 00:00 2026-02-24T19:15:07.477 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:07.477 INFO:teuthology.orchestra.run.trial014.stdout:Total 1.4 MB/s | 802 kB 00:00 2026-02-24T19:15:07.477 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T19:15:07.479 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T19:15:07.479 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T19:15:07.499 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T19:15:07.499 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T19:15:07.571 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T19:15:07.589 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-24T19:15:07.653 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-24T19:15:07.715 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-24T19:15:07.715 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:07.715 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T19:15:07.716 INFO:teuthology.orchestra.run.trial014.stdout: python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:07.716 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:07.716 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T19:15:07.743 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install python3-rbd-debuginfo 2026-02-24T19:15:08.054 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:49:01 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T19:15:08.137 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T19:15:08.137 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:15:08.138 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repo Size 2026-02-24T19:15:08.138 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:15:08.138 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T19:15:08.138 INFO:teuthology.orchestra.run.trial014.stdout: python3-rbd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.2 M 2026-02-24T19:15:08.138 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:08.138 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T19:15:08.138 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:15:08.138 INFO:teuthology.orchestra.run.trial014.stdout:Install 1 Package 2026-02-24T19:15:08.138 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:08.138 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 1.2 M 2026-02-24T19:15:08.139 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 4.7 M 2026-02-24T19:15:08.139 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T19:15:08.934 INFO:teuthology.orchestra.run.trial014.stdout:python3-rbd-debuginfo-20.2.0-681.g36d388f2.el9. 1.5 MB/s | 1.2 MB 00:00 2026-02-24T19:15:08.935 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:08.935 INFO:teuthology.orchestra.run.trial014.stdout:Total 1.5 MB/s | 1.2 MB 00:00 2026-02-24T19:15:08.935 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T19:15:08.937 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T19:15:08.937 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T19:15:08.958 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T19:15:08.958 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T19:15:08.986 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T19:15:09.003 INFO:teuthology.orchestra.run.trial170.stdout: Installing : ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:09.051 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T19:15:09.068 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:15:09.130 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:15:09.192 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:15:09.192 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:09.192 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T19:15:09.192 INFO:teuthology.orchestra.run.trial014.stdout: python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:09.192 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:09.192 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T19:15:09.219 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install python3-rgw-debuginfo 2026-02-24T19:15:09.530 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:49:02 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T19:15:09.614 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T19:15:09.615 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:15:09.615 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repo Size 2026-02-24T19:15:09.615 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:15:09.615 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T19:15:09.615 INFO:teuthology.orchestra.run.trial014.stdout: python3-rgw-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 350 k 2026-02-24T19:15:09.616 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:09.616 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T19:15:09.616 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:15:09.616 INFO:teuthology.orchestra.run.trial014.stdout:Install 1 Package 2026-02-24T19:15:09.616 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:09.616 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 350 k 2026-02-24T19:15:09.616 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 1.1 M 2026-02-24T19:15:09.616 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T19:15:10.132 INFO:teuthology.orchestra.run.trial014.stdout:python3-rgw-debuginfo-20.2.0-681.g36d388f2.el9. 678 kB/s | 350 kB 00:00 2026-02-24T19:15:10.133 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:10.133 INFO:teuthology.orchestra.run.trial014.stdout:Total 677 kB/s | 350 kB 00:00 2026-02-24T19:15:10.133 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T19:15:10.135 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T19:15:10.135 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T19:15:10.153 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T19:15:10.153 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T19:15:10.191 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:10.204 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T19:15:10.222 INFO:teuthology.orchestra.run.trial014.stdout: Installing : python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:15:10.252 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:10.252 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:10.252 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T19:15:10.253 INFO:teuthology.orchestra.run.trial170.stdout: ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:10.253 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:10.253 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T19:15:10.280 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:15:10.312 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install ceph-fuse-debuginfo 2026-02-24T19:15:10.341 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:15:10.342 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:10.342 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T19:15:10.342 INFO:teuthology.orchestra.run.trial014.stdout: python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:10.342 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:10.342 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T19:15:10.368 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install rbd-fuse-debuginfo 2026-02-24T19:15:10.626 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:49:06 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T19:15:10.681 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:49:03 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T19:15:10.709 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T19:15:10.710 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:15:10.710 INFO:teuthology.orchestra.run.trial170.stdout: Package Arch Version Repo Size 2026-02-24T19:15:10.710 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:15:10.710 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T19:15:10.711 INFO:teuthology.orchestra.run.trial170.stdout: ceph-fuse-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 10 M 2026-02-24T19:15:10.711 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:10.711 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T19:15:10.711 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:15:10.711 INFO:teuthology.orchestra.run.trial170.stdout:Install 1 Package 2026-02-24T19:15:10.711 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:10.711 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 10 M 2026-02-24T19:15:10.711 INFO:teuthology.orchestra.run.trial170.stdout:Installed size: 51 M 2026-02-24T19:15:10.711 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T19:15:10.764 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T19:15:10.765 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:15:10.765 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repo Size 2026-02-24T19:15:10.765 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:15:10.765 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T19:15:10.765 INFO:teuthology.orchestra.run.trial014.stdout: rbd-fuse-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.5 M 2026-02-24T19:15:10.765 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:10.765 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T19:15:10.765 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:15:10.765 INFO:teuthology.orchestra.run.trial014.stdout:Install 1 Package 2026-02-24T19:15:10.765 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:10.765 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 1.5 M 2026-02-24T19:15:10.766 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 7.9 M 2026-02-24T19:15:10.766 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T19:15:11.692 INFO:teuthology.orchestra.run.trial014.stdout:rbd-fuse-debuginfo-20.2.0-681.g36d388f2.el9.x86 1.7 MB/s | 1.5 MB 00:00 2026-02-24T19:15:11.693 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:11.693 INFO:teuthology.orchestra.run.trial014.stdout:Total 1.7 MB/s | 1.5 MB 00:00 2026-02-24T19:15:11.693 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T19:15:11.695 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T19:15:11.695 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T19:15:11.717 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T19:15:11.718 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T19:15:11.829 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T19:15:11.847 INFO:teuthology.orchestra.run.trial014.stdout: Installing : rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:11.909 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:11.971 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:11.971 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:11.971 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T19:15:11.971 INFO:teuthology.orchestra.run.trial014.stdout: rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:11.971 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:11.972 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T19:15:11.998 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install rbd-mirror-debuginfo 2026-02-24T19:15:12.308 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:49:05 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T19:15:12.391 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T19:15:12.392 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:15:12.392 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repo Size 2026-02-24T19:15:12.392 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:15:12.392 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T19:15:12.392 INFO:teuthology.orchestra.run.trial014.stdout: rbd-mirror-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 79 M 2026-02-24T19:15:12.392 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:12.392 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T19:15:12.392 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:15:12.392 INFO:teuthology.orchestra.run.trial014.stdout:Install 1 Package 2026-02-24T19:15:12.393 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:12.393 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 79 M 2026-02-24T19:15:12.393 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 375 M 2026-02-24T19:15:12.393 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T19:15:13.319 INFO:teuthology.orchestra.run.trial170.stdout:ceph-fuse-debuginfo-20.2.0-681.g36d388f2.el9.x8 3.9 MB/s | 10 MB 00:02 2026-02-24T19:15:13.320 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:13.320 INFO:teuthology.orchestra.run.trial170.stdout:Total 3.9 MB/s | 10 MB 00:02 2026-02-24T19:15:13.320 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T19:15:13.322 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T19:15:13.322 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T19:15:13.370 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T19:15:13.370 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T19:15:13.917 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T19:15:13.935 INFO:teuthology.orchestra.run.trial170.stdout: Installing : ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:15:14.036 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:15:14.097 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:15:14.097 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:14.097 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T19:15:14.098 INFO:teuthology.orchestra.run.trial170.stdout: ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:14.098 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:14.098 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T19:15:14.126 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install librados-devel-debuginfo 2026-02-24T19:15:14.441 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:49:10 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T19:15:14.525 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T19:15:14.526 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:15:14.526 INFO:teuthology.orchestra.run.trial170.stdout: Package Arch Version Repo Size 2026-02-24T19:15:14.526 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:15:14.526 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T19:15:14.526 INFO:teuthology.orchestra.run.trial170.stdout: librados-devel-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 144 k 2026-02-24T19:15:14.526 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:14.526 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T19:15:14.527 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:15:14.527 INFO:teuthology.orchestra.run.trial170.stdout:Install 1 Package 2026-02-24T19:15:14.527 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:14.527 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 144 k 2026-02-24T19:15:14.527 INFO:teuthology.orchestra.run.trial170.stdout:Installed size: 802 k 2026-02-24T19:15:14.527 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T19:15:15.000 INFO:teuthology.orchestra.run.trial170.stdout:librados-devel-debuginfo-20.2.0-681.g36d388f2.e 303 kB/s | 144 kB 00:00 2026-02-24T19:15:15.001 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:15.001 INFO:teuthology.orchestra.run.trial170.stdout:Total 303 kB/s | 144 kB 00:00 2026-02-24T19:15:15.001 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T19:15:15.003 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T19:15:15.003 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T19:15:15.022 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T19:15:15.022 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T19:15:15.062 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T19:15:15.079 INFO:teuthology.orchestra.run.trial170.stdout: Installing : librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:15:15.138 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:15:15.199 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:15:15.200 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:15.200 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T19:15:15.200 INFO:teuthology.orchestra.run.trial170.stdout: librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:15.200 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:15.200 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T19:15:15.225 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install libcephfs2-debuginfo 2026-02-24T19:15:15.540 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:49:11 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T19:15:15.622 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T19:15:15.623 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:15:15.623 INFO:teuthology.orchestra.run.trial170.stdout: Package Arch Version Repo Size 2026-02-24T19:15:15.623 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:15:15.624 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T19:15:15.624 INFO:teuthology.orchestra.run.trial170.stdout: libcephfs2-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 9.1 M 2026-02-24T19:15:15.624 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:15.624 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T19:15:15.624 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:15:15.624 INFO:teuthology.orchestra.run.trial170.stdout:Install 1 Package 2026-02-24T19:15:15.624 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:15.624 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 9.1 M 2026-02-24T19:15:15.624 INFO:teuthology.orchestra.run.trial170.stdout:Installed size: 46 M 2026-02-24T19:15:15.624 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T19:15:17.895 INFO:teuthology.orchestra.run.trial170.stdout:libcephfs2-debuginfo-20.2.0-681.g36d388f2.el9.x 4.0 MB/s | 9.1 MB 00:02 2026-02-24T19:15:17.896 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:17.896 INFO:teuthology.orchestra.run.trial170.stdout:Total 4.0 MB/s | 9.1 MB 00:02 2026-02-24T19:15:17.896 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T19:15:17.898 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T19:15:17.898 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T19:15:17.942 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T19:15:17.942 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T19:15:18.439 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T19:15:18.456 INFO:teuthology.orchestra.run.trial170.stdout: Installing : libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:15:18.550 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:15:18.611 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:15:18.611 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:18.611 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T19:15:18.611 INFO:teuthology.orchestra.run.trial170.stdout: libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:18.611 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:18.611 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T19:15:18.637 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install librados2-debuginfo 2026-02-24T19:15:18.946 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:49:14 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T19:15:19.030 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T19:15:19.030 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:15:19.031 INFO:teuthology.orchestra.run.trial170.stdout: Package Arch Version Repo Size 2026-02-24T19:15:19.031 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:15:19.031 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T19:15:19.031 INFO:teuthology.orchestra.run.trial170.stdout: librados2-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 63 M 2026-02-24T19:15:19.031 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:19.031 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T19:15:19.031 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:15:19.031 INFO:teuthology.orchestra.run.trial170.stdout:Install 1 Package 2026-02-24T19:15:19.031 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:19.031 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 63 M 2026-02-24T19:15:19.031 INFO:teuthology.orchestra.run.trial170.stdout:Installed size: 397 M 2026-02-24T19:15:19.032 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T19:15:26.889 INFO:teuthology.orchestra.run.trial170.stdout:librados2-debuginfo-20.2.0-681.g36d388f2.el9.x8 8.1 MB/s | 63 MB 00:07 2026-02-24T19:15:26.889 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:26.890 INFO:teuthology.orchestra.run.trial170.stdout:Total 8.1 MB/s | 63 MB 00:07 2026-02-24T19:15:26.890 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T19:15:26.891 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T19:15:26.891 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T19:15:27.098 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T19:15:27.098 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T19:15:30.651 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T19:15:30.668 INFO:teuthology.orchestra.run.trial170.stdout: Installing : librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:15:30.975 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:15:31.037 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:15:31.037 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:31.037 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T19:15:31.037 INFO:teuthology.orchestra.run.trial170.stdout: librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:31.037 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:31.037 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T19:15:31.071 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install librbd1-debuginfo 2026-02-24T19:15:31.384 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:49:27 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T19:15:31.468 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T19:15:31.468 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:15:31.469 INFO:teuthology.orchestra.run.trial170.stdout: Package Arch Version Repo Size 2026-02-24T19:15:31.469 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:15:31.469 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T19:15:31.469 INFO:teuthology.orchestra.run.trial170.stdout: librbd1-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 80 M 2026-02-24T19:15:31.469 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:31.469 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T19:15:31.469 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:15:31.469 INFO:teuthology.orchestra.run.trial170.stdout:Install 1 Package 2026-02-24T19:15:31.469 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:31.470 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 80 M 2026-02-24T19:15:31.470 INFO:teuthology.orchestra.run.trial170.stdout:Installed size: 406 M 2026-02-24T19:15:31.470 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T19:15:34.186 INFO:teuthology.orchestra.run.trial014.stdout:rbd-mirror-debuginfo-20.2.0-681.g36d388f2.el9.x 3.6 MB/s | 79 MB 00:21 2026-02-24T19:15:34.187 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:34.187 INFO:teuthology.orchestra.run.trial014.stdout:Total 3.6 MB/s | 79 MB 00:21 2026-02-24T19:15:34.188 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T19:15:34.189 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T19:15:34.189 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T19:15:34.438 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T19:15:34.438 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T19:15:35.867 INFO:teuthology.orchestra.run.trial170.stdout:librbd1-debuginfo-20.2.0-681.g36d388f2.el9.x86_ 18 MB/s | 80 MB 00:04 2026-02-24T19:15:35.868 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:35.868 INFO:teuthology.orchestra.run.trial170.stdout:Total 18 MB/s | 80 MB 00:04 2026-02-24T19:15:35.868 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T19:15:35.870 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T19:15:35.870 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T19:15:36.124 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T19:15:36.125 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T19:15:38.695 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T19:15:38.713 INFO:teuthology.orchestra.run.trial014.stdout: Installing : rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:15:39.048 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:15:39.109 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:15:39.109 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:39.109 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T19:15:39.109 INFO:teuthology.orchestra.run.trial014.stdout: rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:39.109 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:39.109 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T19:15:39.143 DEBUG:teuthology.orchestra.run.trial014:> sudo yum -y install rbd-nbd-debuginfo 2026-02-24T19:15:39.458 INFO:teuthology.orchestra.run.trial014.stdout:Last metadata expiration check: 0:49:32 ago on Tue 24 Feb 2026 06:26:07 PM UTC. 2026-02-24T19:15:39.540 INFO:teuthology.orchestra.run.trial014.stdout:Dependencies resolved. 2026-02-24T19:15:39.541 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:15:39.541 INFO:teuthology.orchestra.run.trial014.stdout: Package Arch Version Repo Size 2026-02-24T19:15:39.542 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:15:39.542 INFO:teuthology.orchestra.run.trial014.stdout:Installing: 2026-02-24T19:15:39.542 INFO:teuthology.orchestra.run.trial014.stdout: rbd-nbd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.4 M 2026-02-24T19:15:39.542 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:39.542 INFO:teuthology.orchestra.run.trial014.stdout:Transaction Summary 2026-02-24T19:15:39.542 INFO:teuthology.orchestra.run.trial014.stdout:================================================================================ 2026-02-24T19:15:39.542 INFO:teuthology.orchestra.run.trial014.stdout:Install 1 Package 2026-02-24T19:15:39.542 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:39.542 INFO:teuthology.orchestra.run.trial014.stdout:Total download size: 2.4 M 2026-02-24T19:15:39.542 INFO:teuthology.orchestra.run.trial014.stdout:Installed size: 12 M 2026-02-24T19:15:39.543 INFO:teuthology.orchestra.run.trial014.stdout:Downloading Packages: 2026-02-24T19:15:39.689 INFO:teuthology.orchestra.run.trial014.stdout:rbd-nbd-debuginfo-20.2.0-681.g36d388f2.el9.x86_ 17 MB/s | 2.4 MB 00:00 2026-02-24T19:15:39.689 INFO:teuthology.orchestra.run.trial014.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:39.689 INFO:teuthology.orchestra.run.trial014.stdout:Total 17 MB/s | 2.4 MB 00:00 2026-02-24T19:15:39.689 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction check 2026-02-24T19:15:39.691 INFO:teuthology.orchestra.run.trial014.stdout:Transaction check succeeded. 2026-02-24T19:15:39.691 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction test 2026-02-24T19:15:39.716 INFO:teuthology.orchestra.run.trial014.stdout:Transaction test succeeded. 2026-02-24T19:15:39.716 INFO:teuthology.orchestra.run.trial014.stdout:Running transaction 2026-02-24T19:15:39.874 INFO:teuthology.orchestra.run.trial014.stdout: Preparing : 1/1 2026-02-24T19:15:39.891 INFO:teuthology.orchestra.run.trial014.stdout: Installing : rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:39.964 INFO:teuthology.orchestra.run.trial014.stdout: Running scriptlet: rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:40.026 INFO:teuthology.orchestra.run.trial014.stdout: Verifying : rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:40.027 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:40.027 INFO:teuthology.orchestra.run.trial014.stdout:Installed: 2026-02-24T19:15:40.027 INFO:teuthology.orchestra.run.trial014.stdout: rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:40.027 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:40.027 INFO:teuthology.orchestra.run.trial014.stdout:Complete! 2026-02-24T19:15:40.060 DEBUG:teuthology.parallel:result is None 2026-02-24T19:15:40.420 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T19:15:40.438 INFO:teuthology.orchestra.run.trial170.stdout: Installing : librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:40.770 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:40.832 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:40.832 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:40.832 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T19:15:40.832 INFO:teuthology.orchestra.run.trial170.stdout: librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:40.832 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:40.832 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T19:15:40.865 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install python3-cephfs-debuginfo 2026-02-24T19:15:41.176 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:49:37 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T19:15:41.260 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T19:15:41.261 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:15:41.261 INFO:teuthology.orchestra.run.trial170.stdout: Package Arch Version Repo Size 2026-02-24T19:15:41.261 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:15:41.261 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T19:15:41.261 INFO:teuthology.orchestra.run.trial170.stdout: python3-cephfs-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 645 k 2026-02-24T19:15:41.261 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:41.261 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T19:15:41.262 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:15:41.262 INFO:teuthology.orchestra.run.trial170.stdout:Install 1 Package 2026-02-24T19:15:41.262 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:41.262 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 645 k 2026-02-24T19:15:41.262 INFO:teuthology.orchestra.run.trial170.stdout:Installed size: 2.3 M 2026-02-24T19:15:41.262 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T19:15:41.380 INFO:teuthology.orchestra.run.trial170.stdout:python3-cephfs-debuginfo-20.2.0-681.g36d388f2.e 5.3 MB/s | 645 kB 00:00 2026-02-24T19:15:41.381 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:41.381 INFO:teuthology.orchestra.run.trial170.stdout:Total 5.3 MB/s | 645 kB 00:00 2026-02-24T19:15:41.381 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T19:15:41.383 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T19:15:41.383 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T19:15:41.401 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T19:15:41.401 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T19:15:41.466 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T19:15:41.484 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:15:41.542 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:15:41.604 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:15:41.604 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:41.604 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T19:15:41.604 INFO:teuthology.orchestra.run.trial170.stdout: python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:41.604 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:41.604 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T19:15:41.629 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install python3-rados-debuginfo 2026-02-24T19:15:41.939 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:49:37 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T19:15:42.021 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T19:15:42.022 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:15:42.022 INFO:teuthology.orchestra.run.trial170.stdout: Package Arch Version Repo Size 2026-02-24T19:15:42.023 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:15:42.023 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T19:15:42.023 INFO:teuthology.orchestra.run.trial170.stdout: python3-rados-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 802 k 2026-02-24T19:15:42.023 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:42.023 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T19:15:42.023 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:15:42.023 INFO:teuthology.orchestra.run.trial170.stdout:Install 1 Package 2026-02-24T19:15:42.023 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:42.023 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 802 k 2026-02-24T19:15:42.023 INFO:teuthology.orchestra.run.trial170.stdout:Installed size: 3.1 M 2026-02-24T19:15:42.024 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T19:15:42.144 INFO:teuthology.orchestra.run.trial170.stdout:python3-rados-debuginfo-20.2.0-681.g36d388f2.el 6.5 MB/s | 802 kB 00:00 2026-02-24T19:15:42.145 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:42.145 INFO:teuthology.orchestra.run.trial170.stdout:Total 6.4 MB/s | 802 kB 00:00 2026-02-24T19:15:42.145 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T19:15:42.146 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T19:15:42.147 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T19:15:42.166 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T19:15:42.166 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T19:15:42.238 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T19:15:42.257 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-24T19:15:42.318 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-24T19:15:42.380 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-24T19:15:42.380 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:42.380 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T19:15:42.380 INFO:teuthology.orchestra.run.trial170.stdout: python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:42.380 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:42.380 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T19:15:42.406 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install python3-rbd-debuginfo 2026-02-24T19:15:42.717 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:49:38 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T19:15:42.800 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T19:15:42.801 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:15:42.801 INFO:teuthology.orchestra.run.trial170.stdout: Package Arch Version Repo Size 2026-02-24T19:15:42.801 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:15:42.801 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T19:15:42.801 INFO:teuthology.orchestra.run.trial170.stdout: python3-rbd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.2 M 2026-02-24T19:15:42.801 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:42.801 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T19:15:42.802 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:15:42.802 INFO:teuthology.orchestra.run.trial170.stdout:Install 1 Package 2026-02-24T19:15:42.802 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:42.802 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 1.2 M 2026-02-24T19:15:42.802 INFO:teuthology.orchestra.run.trial170.stdout:Installed size: 4.7 M 2026-02-24T19:15:42.802 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T19:15:42.943 INFO:teuthology.orchestra.run.trial170.stdout:python3-rbd-debuginfo-20.2.0-681.g36d388f2.el9. 8.2 MB/s | 1.2 MB 00:00 2026-02-24T19:15:42.943 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:42.944 INFO:teuthology.orchestra.run.trial170.stdout:Total 8.2 MB/s | 1.2 MB 00:00 2026-02-24T19:15:42.944 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T19:15:42.945 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T19:15:42.945 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T19:15:42.966 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T19:15:42.966 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T19:15:43.057 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T19:15:43.074 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:15:43.138 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:15:43.200 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:15:43.200 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:43.200 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T19:15:43.201 INFO:teuthology.orchestra.run.trial170.stdout: python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:43.201 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:43.201 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T19:15:43.227 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install python3-rgw-debuginfo 2026-02-24T19:15:43.538 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:49:39 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T19:15:43.621 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T19:15:43.622 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:15:43.622 INFO:teuthology.orchestra.run.trial170.stdout: Package Arch Version Repo Size 2026-02-24T19:15:43.622 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:15:43.623 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T19:15:43.623 INFO:teuthology.orchestra.run.trial170.stdout: python3-rgw-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 350 k 2026-02-24T19:15:43.623 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:43.623 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T19:15:43.623 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:15:43.623 INFO:teuthology.orchestra.run.trial170.stdout:Install 1 Package 2026-02-24T19:15:43.623 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:43.623 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 350 k 2026-02-24T19:15:43.623 INFO:teuthology.orchestra.run.trial170.stdout:Installed size: 1.1 M 2026-02-24T19:15:43.623 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T19:15:43.720 INFO:teuthology.orchestra.run.trial170.stdout:python3-rgw-debuginfo-20.2.0-681.g36d388f2.el9. 3.5 MB/s | 350 kB 00:00 2026-02-24T19:15:43.720 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:43.720 INFO:teuthology.orchestra.run.trial170.stdout:Total 3.5 MB/s | 350 kB 00:00 2026-02-24T19:15:43.721 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T19:15:43.722 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T19:15:43.722 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T19:15:43.740 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T19:15:43.740 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T19:15:43.792 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T19:15:43.810 INFO:teuthology.orchestra.run.trial170.stdout: Installing : python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:15:43.868 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:15:43.930 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:15:43.930 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:43.930 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T19:15:43.930 INFO:teuthology.orchestra.run.trial170.stdout: python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:43.931 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:43.931 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T19:15:43.958 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install rbd-fuse-debuginfo 2026-02-24T19:15:44.270 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:49:40 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T19:15:44.353 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T19:15:44.354 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:15:44.354 INFO:teuthology.orchestra.run.trial170.stdout: Package Arch Version Repo Size 2026-02-24T19:15:44.355 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:15:44.355 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T19:15:44.355 INFO:teuthology.orchestra.run.trial170.stdout: rbd-fuse-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.5 M 2026-02-24T19:15:44.355 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:44.355 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T19:15:44.355 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:15:44.355 INFO:teuthology.orchestra.run.trial170.stdout:Install 1 Package 2026-02-24T19:15:44.355 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:44.355 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 1.5 M 2026-02-24T19:15:44.355 INFO:teuthology.orchestra.run.trial170.stdout:Installed size: 7.9 M 2026-02-24T19:15:44.356 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T19:15:44.500 INFO:teuthology.orchestra.run.trial170.stdout:rbd-fuse-debuginfo-20.2.0-681.g36d388f2.el9.x86 11 MB/s | 1.5 MB 00:00 2026-02-24T19:15:44.500 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:44.500 INFO:teuthology.orchestra.run.trial170.stdout:Total 11 MB/s | 1.5 MB 00:00 2026-02-24T19:15:44.500 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T19:15:44.501 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T19:15:44.502 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T19:15:44.523 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T19:15:44.523 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T19:15:44.635 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T19:15:44.652 INFO:teuthology.orchestra.run.trial170.stdout: Installing : rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:44.714 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:44.775 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:44.775 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:44.776 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T19:15:44.776 INFO:teuthology.orchestra.run.trial170.stdout: rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:44.776 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:44.776 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T19:15:44.801 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install rbd-mirror-debuginfo 2026-02-24T19:15:45.117 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:49:41 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T19:15:45.202 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T19:15:45.202 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:15:45.202 INFO:teuthology.orchestra.run.trial170.stdout: Package Arch Version Repo Size 2026-02-24T19:15:45.202 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:15:45.203 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T19:15:45.203 INFO:teuthology.orchestra.run.trial170.stdout: rbd-mirror-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 79 M 2026-02-24T19:15:45.203 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:45.203 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T19:15:45.203 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:15:45.203 INFO:teuthology.orchestra.run.trial170.stdout:Install 1 Package 2026-02-24T19:15:45.203 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:45.203 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 79 M 2026-02-24T19:15:45.203 INFO:teuthology.orchestra.run.trial170.stdout:Installed size: 375 M 2026-02-24T19:15:45.203 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T19:15:46.865 INFO:teuthology.orchestra.run.trial170.stdout:rbd-mirror-debuginfo-20.2.0-681.g36d388f2.el9.x 48 MB/s | 79 MB 00:01 2026-02-24T19:15:46.866 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:46.866 INFO:teuthology.orchestra.run.trial170.stdout:Total 48 MB/s | 79 MB 00:01 2026-02-24T19:15:46.866 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T19:15:46.868 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T19:15:46.868 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T19:15:47.118 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T19:15:47.118 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T19:15:51.269 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T19:15:51.287 INFO:teuthology.orchestra.run.trial170.stdout: Installing : rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:15:51.607 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:15:51.667 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:15:51.668 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:51.668 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T19:15:51.668 INFO:teuthology.orchestra.run.trial170.stdout: rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:51.668 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:51.668 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T19:15:51.701 DEBUG:teuthology.orchestra.run.trial170:> sudo yum -y install rbd-nbd-debuginfo 2026-02-24T19:15:52.017 INFO:teuthology.orchestra.run.trial170.stdout:Last metadata expiration check: 0:49:48 ago on Tue 24 Feb 2026 06:26:04 PM UTC. 2026-02-24T19:15:52.101 INFO:teuthology.orchestra.run.trial170.stdout:Dependencies resolved. 2026-02-24T19:15:52.101 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:15:52.102 INFO:teuthology.orchestra.run.trial170.stdout: Package Arch Version Repo Size 2026-02-24T19:15:52.102 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:15:52.102 INFO:teuthology.orchestra.run.trial170.stdout:Installing: 2026-02-24T19:15:52.102 INFO:teuthology.orchestra.run.trial170.stdout: rbd-nbd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.4 M 2026-02-24T19:15:52.102 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:52.102 INFO:teuthology.orchestra.run.trial170.stdout:Transaction Summary 2026-02-24T19:15:52.102 INFO:teuthology.orchestra.run.trial170.stdout:================================================================================ 2026-02-24T19:15:52.102 INFO:teuthology.orchestra.run.trial170.stdout:Install 1 Package 2026-02-24T19:15:52.102 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:52.103 INFO:teuthology.orchestra.run.trial170.stdout:Total download size: 2.4 M 2026-02-24T19:15:52.103 INFO:teuthology.orchestra.run.trial170.stdout:Installed size: 12 M 2026-02-24T19:15:52.103 INFO:teuthology.orchestra.run.trial170.stdout:Downloading Packages: 2026-02-24T19:15:52.515 INFO:teuthology.orchestra.run.trial170.stdout:rbd-nbd-debuginfo-20.2.0-681.g36d388f2.el9.x86_ 5.9 MB/s | 2.4 MB 00:00 2026-02-24T19:15:52.515 INFO:teuthology.orchestra.run.trial170.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:52.516 INFO:teuthology.orchestra.run.trial170.stdout:Total 5.9 MB/s | 2.4 MB 00:00 2026-02-24T19:15:52.516 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction check 2026-02-24T19:15:52.517 INFO:teuthology.orchestra.run.trial170.stdout:Transaction check succeeded. 2026-02-24T19:15:52.517 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction test 2026-02-24T19:15:52.542 INFO:teuthology.orchestra.run.trial170.stdout:Transaction test succeeded. 2026-02-24T19:15:52.542 INFO:teuthology.orchestra.run.trial170.stdout:Running transaction 2026-02-24T19:15:52.700 INFO:teuthology.orchestra.run.trial170.stdout: Preparing : 1/1 2026-02-24T19:15:52.717 INFO:teuthology.orchestra.run.trial170.stdout: Installing : rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:52.783 INFO:teuthology.orchestra.run.trial170.stdout: Running scriptlet: rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:52.844 INFO:teuthology.orchestra.run.trial170.stdout: Verifying : rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:52.845 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:52.845 INFO:teuthology.orchestra.run.trial170.stdout:Installed: 2026-02-24T19:15:52.845 INFO:teuthology.orchestra.run.trial170.stdout: rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:52.845 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:52.845 INFO:teuthology.orchestra.run.trial170.stdout:Complete! 2026-02-24T19:15:52.875 DEBUG:teuthology.parallel:result is None 2026-02-24T19:15:52.876 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-24T19:15:53.043 DEBUG:teuthology.orchestra.run.trial014:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-24T19:15:53.065 INFO:teuthology.orchestra.run.trial014.stdout:20.2.0-681.g36d388f2.el9 2026-02-24T19:15:53.065 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-681.g36d388f2.el9 2026-02-24T19:15:53.066 INFO:teuthology.task.install:The correct ceph version 20.2.0-681.g36d388f2 is installed. 2026-02-24T19:15:53.069 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-24T19:15:53.224 DEBUG:teuthology.orchestra.run.trial044:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-24T19:15:53.247 INFO:teuthology.orchestra.run.trial044.stdout:20.2.0-681.g36d388f2.el9 2026-02-24T19:15:53.247 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-681.g36d388f2.el9 2026-02-24T19:15:53.247 INFO:teuthology.task.install:The correct ceph version 20.2.0-681.g36d388f2 is installed. 2026-02-24T19:15:53.250 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-24T19:15:53.406 DEBUG:teuthology.orchestra.run.trial170:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-24T19:15:53.427 INFO:teuthology.orchestra.run.trial170.stdout:20.2.0-681.g36d388f2.el9 2026-02-24T19:15:53.428 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-681.g36d388f2.el9 2026-02-24T19:15:53.428 INFO:teuthology.task.install:The correct ceph version 20.2.0-681.g36d388f2 is installed. 2026-02-24T19:15:53.430 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-24T19:15:53.585 DEBUG:teuthology.orchestra.run.trial195:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-24T19:15:53.606 INFO:teuthology.orchestra.run.trial195.stdout:20.2.0-681.g36d388f2.el9 2026-02-24T19:15:53.606 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-681.g36d388f2.el9 2026-02-24T19:15:53.606 INFO:teuthology.task.install:The correct ceph version 20.2.0-681.g36d388f2 is installed. 2026-02-24T19:15:53.609 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-24T19:15:53.609 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-24T19:15:53.609 DEBUG:teuthology.orchestra.run.trial014:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-24T19:15:53.635 DEBUG:teuthology.orchestra.run.trial044:> set -ex 2026-02-24T19:15:53.636 DEBUG:teuthology.orchestra.run.trial044:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-24T19:15:53.662 DEBUG:teuthology.orchestra.run.trial170:> set -ex 2026-02-24T19:15:53.662 DEBUG:teuthology.orchestra.run.trial170:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-24T19:15:53.687 DEBUG:teuthology.orchestra.run.trial195:> set -ex 2026-02-24T19:15:53.687 DEBUG:teuthology.orchestra.run.trial195:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-24T19:15:53.713 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-24T19:15:53.713 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-24T19:15:53.713 DEBUG:teuthology.orchestra.run.trial014:> sudo dd of=/usr/bin/daemon-helper 2026-02-24T19:15:53.739 DEBUG:teuthology.orchestra.run.trial014:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-24T19:15:53.804 DEBUG:teuthology.orchestra.run.trial044:> set -ex 2026-02-24T19:15:53.804 DEBUG:teuthology.orchestra.run.trial044:> sudo dd of=/usr/bin/daemon-helper 2026-02-24T19:15:53.830 DEBUG:teuthology.orchestra.run.trial044:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-24T19:15:53.895 DEBUG:teuthology.orchestra.run.trial170:> set -ex 2026-02-24T19:15:53.895 DEBUG:teuthology.orchestra.run.trial170:> sudo dd of=/usr/bin/daemon-helper 2026-02-24T19:15:53.921 DEBUG:teuthology.orchestra.run.trial170:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-24T19:15:53.985 DEBUG:teuthology.orchestra.run.trial195:> set -ex 2026-02-24T19:15:53.985 DEBUG:teuthology.orchestra.run.trial195:> sudo dd of=/usr/bin/daemon-helper 2026-02-24T19:15:54.011 DEBUG:teuthology.orchestra.run.trial195:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-24T19:15:54.075 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-24T19:15:54.076 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-24T19:15:54.076 DEBUG:teuthology.orchestra.run.trial014:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-24T19:15:54.102 DEBUG:teuthology.orchestra.run.trial014:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-24T19:15:54.165 DEBUG:teuthology.orchestra.run.trial044:> set -ex 2026-02-24T19:15:54.166 DEBUG:teuthology.orchestra.run.trial044:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-24T19:15:54.192 DEBUG:teuthology.orchestra.run.trial044:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-24T19:15:54.255 DEBUG:teuthology.orchestra.run.trial170:> set -ex 2026-02-24T19:15:54.255 DEBUG:teuthology.orchestra.run.trial170:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-24T19:15:54.281 DEBUG:teuthology.orchestra.run.trial170:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-24T19:15:54.344 DEBUG:teuthology.orchestra.run.trial195:> set -ex 2026-02-24T19:15:54.344 DEBUG:teuthology.orchestra.run.trial195:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-24T19:15:54.369 DEBUG:teuthology.orchestra.run.trial195:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-24T19:15:54.433 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-24T19:15:54.433 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-24T19:15:54.434 DEBUG:teuthology.orchestra.run.trial014:> sudo dd of=/usr/bin/stdin-killer 2026-02-24T19:15:54.459 DEBUG:teuthology.orchestra.run.trial014:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-24T19:15:54.522 DEBUG:teuthology.orchestra.run.trial044:> set -ex 2026-02-24T19:15:54.522 DEBUG:teuthology.orchestra.run.trial044:> sudo dd of=/usr/bin/stdin-killer 2026-02-24T19:15:54.548 DEBUG:teuthology.orchestra.run.trial044:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-24T19:15:54.612 DEBUG:teuthology.orchestra.run.trial170:> set -ex 2026-02-24T19:15:54.612 DEBUG:teuthology.orchestra.run.trial170:> sudo dd of=/usr/bin/stdin-killer 2026-02-24T19:15:54.637 DEBUG:teuthology.orchestra.run.trial170:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-24T19:15:54.700 DEBUG:teuthology.orchestra.run.trial195:> set -ex 2026-02-24T19:15:54.701 DEBUG:teuthology.orchestra.run.trial195:> sudo dd of=/usr/bin/stdin-killer 2026-02-24T19:15:54.726 DEBUG:teuthology.orchestra.run.trial195:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-24T19:15:54.789 INFO:teuthology.run_tasks:Running task ceph... 2026-02-24T19:15:54.906 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-24T19:15:54.906 DEBUG:teuthology.orchestra.run.trial014:> sudo chmod 777 /var/log/ceph 2026-02-24T19:15:54.908 DEBUG:teuthology.orchestra.run.trial044:> sudo chmod 777 /var/log/ceph 2026-02-24T19:15:54.910 DEBUG:teuthology.orchestra.run.trial170:> sudo chmod 777 /var/log/ceph 2026-02-24T19:15:54.912 DEBUG:teuthology.orchestra.run.trial195:> sudo chmod 777 /var/log/ceph 2026-02-24T19:15:54.936 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-24T19:15:54.936 DEBUG:teuthology.orchestra.run.trial014:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-24T19:15:54.973 DEBUG:teuthology.orchestra.run.trial044:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-24T19:15:54.975 DEBUG:teuthology.orchestra.run.trial170:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-24T19:15:54.977 DEBUG:teuthology.orchestra.run.trial195:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-24T19:15:55.001 INFO:tasks.ceph:Creating extra log directories... 2026-02-24T19:15:55.001 DEBUG:teuthology.orchestra.run.trial014:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-24T19:15:55.035 DEBUG:teuthology.orchestra.run.trial044:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-24T19:15:55.039 DEBUG:teuthology.orchestra.run.trial170:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-24T19:15:55.042 DEBUG:teuthology.orchestra.run.trial195:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-24T19:15:55.085 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-24T19:15:55.085 INFO:tasks.ceph:config {'conf': {'client': {'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20, 'rados replica read policy': 'balance'}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 160, 'osd op thread timeout': 150}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'btree', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore onode segment size': 0, 'bluestore write v2 random': True, 'bluestore zero block detection': True, 'crush location': 'root=default host=host-$id', 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 240, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(SLOW_OPS\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(OBJECT_MISPLACED\\)', 'slow request', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request', 'OSD bench result', 'OSD_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': True} 2026-02-24T19:15:55.085 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68689', 'branch': 'wip-yuri3-testing-2026-02-19-1610-tentacle', 'description': 'rados/verify/{centos_latest ceph clusters/fixed-4 d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/{bluestore/{alloc$/{btree} base mem$/{normal-2} onode-segment$/{none} write$/{random/{compr$/{no$/{no}} random}}}} rados read-affinity/balance tasks/rados_api_tests validater/valgrind}', 'email': None, 'first_in_suite': False, 'flavor': 'default', 'job_id': '68689', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri3-testing-2026-02-19-1610-tentacle'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20, 'rados replica read policy': 'balance'}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 160, 'osd op thread timeout': 150}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'btree', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore onode segment size': 0, 'bluestore write v2 random': True, 'bluestore zero block detection': True, 'crush location': 'root=default host=host-$id', 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 240, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(SLOW_OPS\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(OBJECT_MISPLACED\\)', 'slow request', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request', 'OSD bench result', 'OSD_DOWN'], 'mon_bind_msgr2': False, 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155', 'stop-daemons-timeout': 1200, 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes'], 'osd': ['--tool=memcheck']}}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri3-testing-2026-02-19-1610-tentacle', 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155'}}, 'owner': 'scheduled_jayaprakash@soko04.front.sepia.ceph.com', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'], ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'], ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'], ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0']], 'seed': 6877, 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-yuri3-testing-2026-02-19-1610-tentacle', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_36d388f27052dd940bdbaf543bb05bdba0acc155/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155', 'targets': {'trial014.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEUziiRjBQ1cILcOI2uOUvy1ubzob1BZdgOIoPIkwqpA2IXAJogLkMVQEbFgvtBxFKO44YOycy5loFF8H1XYxvM=', 'trial044.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBL5D7O7r2d+Ktb7M4R0omsY7nyb4JfZj7bV2T/t59h4n69VWQIGzcgCsgNvwKeWH9tHkhvLl0zTEPMyuj5AoqU=', 'trial170.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIOjlSQitrhMfOj2aGeYZ/E5/55CbgHub8fqPVxpD1+FBeCWmNl0evsYukAcxqc/0sI179zjVdAsDvNbUpypEfY=', 'trial195.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK0cjOXAWZ+cMmau4pm7oPp5k/OMQluyIBO6RU4wa1GoJsnskJOLkQtGEMBcYhclHsdis4WVIWdF1QxuuAKg4qs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'workunit': {'clients': {'client.0': ['rados/test.sh']}, 'env': {'ALLOW_TIMEOUTS': '1'}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["-- Don't run this test on tiny clusters\nif py_len(yaml.roles) < 4 then reject() end\n"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-24_16:27:17', 'tube': 'trial', 'user': 'jayaprakash', 'verbose': False, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.904699'} 2026-02-24T19:15:55.086 DEBUG:teuthology.orchestra.run.trial014:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-24T19:15:55.098 DEBUG:teuthology.orchestra.run.trial044:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-24T19:15:55.104 DEBUG:teuthology.orchestra.run.trial170:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-24T19:15:55.106 DEBUG:teuthology.orchestra.run.trial195:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-24T19:15:55.122 DEBUG:teuthology.orchestra.run.trial014:> sudo install -d -m0777 -- /var/run/ceph 2026-02-24T19:15:55.154 DEBUG:teuthology.orchestra.run.trial044:> sudo install -d -m0777 -- /var/run/ceph 2026-02-24T19:15:55.159 DEBUG:teuthology.orchestra.run.trial170:> sudo install -d -m0777 -- /var/run/ceph 2026-02-24T19:15:55.162 DEBUG:teuthology.orchestra.run.trial195:> sudo install -d -m0777 -- /var/run/ceph 2026-02-24T19:15:55.186 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-24T19:15:55.186 DEBUG:teuthology.orchestra.run.trial014:> dd if=/scratch_devs of=/dev/stdout 2026-02-24T19:15:55.233 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-24T19:15:55.233 DEBUG:teuthology.orchestra.run.trial014:> stat /dev/vg_nvme/lv_1 2026-02-24T19:15:55.289 INFO:teuthology.orchestra.run.trial014.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-24T19:15:55.290 INFO:teuthology.orchestra.run.trial014.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:15:55.290 INFO:teuthology.orchestra.run.trial014.stdout:Device: 6h/6d Inode: 907 Links: 1 2026-02-24T19:15:55.290 INFO:teuthology.orchestra.run.trial014.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:15:55.290 INFO:teuthology.orchestra.run.trial014.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:15:55.290 INFO:teuthology.orchestra.run.trial014.stdout:Access: 2026-02-24 18:27:52.423324430 +0000 2026-02-24T19:15:55.290 INFO:teuthology.orchestra.run.trial014.stdout:Modify: 2026-02-24 18:25:35.819667416 +0000 2026-02-24T19:15:55.290 INFO:teuthology.orchestra.run.trial014.stdout:Change: 2026-02-24 18:25:35.819667416 +0000 2026-02-24T19:15:55.290 INFO:teuthology.orchestra.run.trial014.stdout: Birth: 2026-02-24 18:25:35.819667416 +0000 2026-02-24T19:15:55.291 DEBUG:teuthology.orchestra.run.trial014:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-24T19:15:55.351 INFO:teuthology.orchestra.run.trial014.stderr:1+0 records in 2026-02-24T19:15:55.351 INFO:teuthology.orchestra.run.trial014.stderr:1+0 records out 2026-02-24T19:15:55.352 INFO:teuthology.orchestra.run.trial014.stderr:512 bytes copied, 0.00015149 s, 3.4 MB/s 2026-02-24T19:15:55.353 DEBUG:teuthology.orchestra.run.trial014:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-24T19:15:55.410 DEBUG:teuthology.orchestra.run.trial014:> stat /dev/vg_nvme/lv_2 2026-02-24T19:15:55.466 INFO:teuthology.orchestra.run.trial014.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-24T19:15:55.466 INFO:teuthology.orchestra.run.trial014.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:15:55.466 INFO:teuthology.orchestra.run.trial014.stdout:Device: 6h/6d Inode: 936 Links: 1 2026-02-24T19:15:55.466 INFO:teuthology.orchestra.run.trial014.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:15:55.467 INFO:teuthology.orchestra.run.trial014.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:15:55.467 INFO:teuthology.orchestra.run.trial014.stdout:Access: 2026-02-24 18:27:52.423324430 +0000 2026-02-24T19:15:55.467 INFO:teuthology.orchestra.run.trial014.stdout:Modify: 2026-02-24 18:25:36.050658983 +0000 2026-02-24T19:15:55.467 INFO:teuthology.orchestra.run.trial014.stdout:Change: 2026-02-24 18:25:36.050658983 +0000 2026-02-24T19:15:55.467 INFO:teuthology.orchestra.run.trial014.stdout: Birth: 2026-02-24 18:25:36.050658983 +0000 2026-02-24T19:15:55.467 DEBUG:teuthology.orchestra.run.trial014:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-24T19:15:55.529 INFO:teuthology.orchestra.run.trial014.stderr:1+0 records in 2026-02-24T19:15:55.529 INFO:teuthology.orchestra.run.trial014.stderr:1+0 records out 2026-02-24T19:15:55.529 INFO:teuthology.orchestra.run.trial014.stderr:512 bytes copied, 0.000164174 s, 3.1 MB/s 2026-02-24T19:15:55.530 DEBUG:teuthology.orchestra.run.trial014:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-24T19:15:55.588 DEBUG:teuthology.orchestra.run.trial014:> stat /dev/vg_nvme/lv_3 2026-02-24T19:15:55.644 INFO:teuthology.orchestra.run.trial014.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-24T19:15:55.644 INFO:teuthology.orchestra.run.trial014.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:15:55.644 INFO:teuthology.orchestra.run.trial014.stdout:Device: 6h/6d Inode: 964 Links: 1 2026-02-24T19:15:55.644 INFO:teuthology.orchestra.run.trial014.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:15:55.645 INFO:teuthology.orchestra.run.trial014.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:15:55.645 INFO:teuthology.orchestra.run.trial014.stdout:Access: 2026-02-24 18:27:52.424324393 +0000 2026-02-24T19:15:55.645 INFO:teuthology.orchestra.run.trial014.stdout:Modify: 2026-02-24 18:25:36.292650148 +0000 2026-02-24T19:15:55.645 INFO:teuthology.orchestra.run.trial014.stdout:Change: 2026-02-24 18:25:36.292650148 +0000 2026-02-24T19:15:55.645 INFO:teuthology.orchestra.run.trial014.stdout: Birth: 2026-02-24 18:25:36.292650148 +0000 2026-02-24T19:15:55.645 DEBUG:teuthology.orchestra.run.trial014:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-24T19:15:55.707 INFO:teuthology.orchestra.run.trial014.stderr:1+0 records in 2026-02-24T19:15:55.707 INFO:teuthology.orchestra.run.trial014.stderr:1+0 records out 2026-02-24T19:15:55.707 INFO:teuthology.orchestra.run.trial014.stderr:512 bytes copied, 0.000145179 s, 3.5 MB/s 2026-02-24T19:15:55.708 DEBUG:teuthology.orchestra.run.trial014:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-24T19:15:55.765 DEBUG:teuthology.orchestra.run.trial014:> stat /dev/vg_nvme/lv_4 2026-02-24T19:15:55.821 INFO:teuthology.orchestra.run.trial014.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-24T19:15:55.821 INFO:teuthology.orchestra.run.trial014.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:15:55.822 INFO:teuthology.orchestra.run.trial014.stdout:Device: 6h/6d Inode: 994 Links: 1 2026-02-24T19:15:55.822 INFO:teuthology.orchestra.run.trial014.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:15:55.822 INFO:teuthology.orchestra.run.trial014.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:15:55.822 INFO:teuthology.orchestra.run.trial014.stdout:Access: 2026-02-24 18:27:52.424324393 +0000 2026-02-24T19:15:55.822 INFO:teuthology.orchestra.run.trial014.stdout:Modify: 2026-02-24 18:25:36.508642261 +0000 2026-02-24T19:15:55.822 INFO:teuthology.orchestra.run.trial014.stdout:Change: 2026-02-24 18:25:36.508642261 +0000 2026-02-24T19:15:55.822 INFO:teuthology.orchestra.run.trial014.stdout: Birth: 2026-02-24 18:25:36.508642261 +0000 2026-02-24T19:15:55.822 DEBUG:teuthology.orchestra.run.trial014:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-24T19:15:55.883 INFO:teuthology.orchestra.run.trial014.stderr:1+0 records in 2026-02-24T19:15:55.883 INFO:teuthology.orchestra.run.trial014.stderr:1+0 records out 2026-02-24T19:15:55.883 INFO:teuthology.orchestra.run.trial014.stderr:512 bytes copied, 0.000132045 s, 3.9 MB/s 2026-02-24T19:15:55.885 DEBUG:teuthology.orchestra.run.trial014:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-24T19:15:55.942 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-24T19:15:55.942 DEBUG:teuthology.orchestra.run.trial044:> set -ex 2026-02-24T19:15:55.942 DEBUG:teuthology.orchestra.run.trial044:> dd if=/scratch_devs of=/dev/stdout 2026-02-24T19:15:55.961 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-24T19:15:55.961 DEBUG:teuthology.orchestra.run.trial044:> stat /dev/vg_nvme/lv_1 2026-02-24T19:15:56.017 INFO:teuthology.orchestra.run.trial044.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-24T19:15:56.017 INFO:teuthology.orchestra.run.trial044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:15:56.017 INFO:teuthology.orchestra.run.trial044.stdout:Device: 6h/6d Inode: 910 Links: 1 2026-02-24T19:15:56.017 INFO:teuthology.orchestra.run.trial044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:15:56.017 INFO:teuthology.orchestra.run.trial044.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:15:56.017 INFO:teuthology.orchestra.run.trial044.stdout:Access: 2026-02-24 18:28:10.818410074 +0000 2026-02-24T19:15:56.017 INFO:teuthology.orchestra.run.trial044.stdout:Modify: 2026-02-24 18:25:37.082407846 +0000 2026-02-24T19:15:56.017 INFO:teuthology.orchestra.run.trial044.stdout:Change: 2026-02-24 18:25:37.082407846 +0000 2026-02-24T19:15:56.018 INFO:teuthology.orchestra.run.trial044.stdout: Birth: 2026-02-24 18:25:37.082407846 +0000 2026-02-24T19:15:56.018 DEBUG:teuthology.orchestra.run.trial044:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-24T19:15:56.079 INFO:teuthology.orchestra.run.trial044.stderr:1+0 records in 2026-02-24T19:15:56.080 INFO:teuthology.orchestra.run.trial044.stderr:1+0 records out 2026-02-24T19:15:56.080 INFO:teuthology.orchestra.run.trial044.stderr:512 bytes copied, 0.000169864 s, 3.0 MB/s 2026-02-24T19:15:56.081 DEBUG:teuthology.orchestra.run.trial044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-24T19:15:56.138 DEBUG:teuthology.orchestra.run.trial044:> stat /dev/vg_nvme/lv_2 2026-02-24T19:15:56.195 INFO:teuthology.orchestra.run.trial044.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-24T19:15:56.195 INFO:teuthology.orchestra.run.trial044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:15:56.195 INFO:teuthology.orchestra.run.trial044.stdout:Device: 6h/6d Inode: 937 Links: 1 2026-02-24T19:15:56.195 INFO:teuthology.orchestra.run.trial044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:15:56.195 INFO:teuthology.orchestra.run.trial044.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:15:56.195 INFO:teuthology.orchestra.run.trial044.stdout:Access: 2026-02-24 18:28:10.818410074 +0000 2026-02-24T19:15:56.196 INFO:teuthology.orchestra.run.trial044.stdout:Modify: 2026-02-24 18:25:37.322400088 +0000 2026-02-24T19:15:56.196 INFO:teuthology.orchestra.run.trial044.stdout:Change: 2026-02-24 18:25:37.322400088 +0000 2026-02-24T19:15:56.196 INFO:teuthology.orchestra.run.trial044.stdout: Birth: 2026-02-24 18:25:37.322400088 +0000 2026-02-24T19:15:56.196 DEBUG:teuthology.orchestra.run.trial044:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-24T19:15:56.257 INFO:teuthology.orchestra.run.trial044.stderr:1+0 records in 2026-02-24T19:15:56.257 INFO:teuthology.orchestra.run.trial044.stderr:1+0 records out 2026-02-24T19:15:56.258 INFO:teuthology.orchestra.run.trial044.stderr:512 bytes copied, 0.000144788 s, 3.5 MB/s 2026-02-24T19:15:56.259 DEBUG:teuthology.orchestra.run.trial044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-24T19:15:56.315 DEBUG:teuthology.orchestra.run.trial044:> stat /dev/vg_nvme/lv_3 2026-02-24T19:15:56.372 INFO:teuthology.orchestra.run.trial044.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-24T19:15:56.372 INFO:teuthology.orchestra.run.trial044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:15:56.372 INFO:teuthology.orchestra.run.trial044.stdout:Device: 6h/6d Inode: 963 Links: 1 2026-02-24T19:15:56.372 INFO:teuthology.orchestra.run.trial044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:15:56.372 INFO:teuthology.orchestra.run.trial044.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:15:56.372 INFO:teuthology.orchestra.run.trial044.stdout:Access: 2026-02-24 18:28:10.818410074 +0000 2026-02-24T19:15:56.372 INFO:teuthology.orchestra.run.trial044.stdout:Modify: 2026-02-24 18:25:37.552392652 +0000 2026-02-24T19:15:56.372 INFO:teuthology.orchestra.run.trial044.stdout:Change: 2026-02-24 18:25:37.552392652 +0000 2026-02-24T19:15:56.372 INFO:teuthology.orchestra.run.trial044.stdout: Birth: 2026-02-24 18:25:37.552392652 +0000 2026-02-24T19:15:56.373 DEBUG:teuthology.orchestra.run.trial044:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-24T19:15:56.435 INFO:teuthology.orchestra.run.trial044.stderr:1+0 records in 2026-02-24T19:15:56.435 INFO:teuthology.orchestra.run.trial044.stderr:1+0 records out 2026-02-24T19:15:56.435 INFO:teuthology.orchestra.run.trial044.stderr:512 bytes copied, 0.000160777 s, 3.2 MB/s 2026-02-24T19:15:56.436 DEBUG:teuthology.orchestra.run.trial044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-24T19:15:56.493 DEBUG:teuthology.orchestra.run.trial044:> stat /dev/vg_nvme/lv_4 2026-02-24T19:15:56.548 INFO:teuthology.orchestra.run.trial044.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-24T19:15:56.548 INFO:teuthology.orchestra.run.trial044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:15:56.549 INFO:teuthology.orchestra.run.trial044.stdout:Device: 6h/6d Inode: 993 Links: 1 2026-02-24T19:15:56.549 INFO:teuthology.orchestra.run.trial044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:15:56.549 INFO:teuthology.orchestra.run.trial044.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:15:56.549 INFO:teuthology.orchestra.run.trial044.stdout:Access: 2026-02-24 18:28:10.819410058 +0000 2026-02-24T19:15:56.549 INFO:teuthology.orchestra.run.trial044.stdout:Modify: 2026-02-24 18:25:37.790384958 +0000 2026-02-24T19:15:56.549 INFO:teuthology.orchestra.run.trial044.stdout:Change: 2026-02-24 18:25:37.790384958 +0000 2026-02-24T19:15:56.549 INFO:teuthology.orchestra.run.trial044.stdout: Birth: 2026-02-24 18:25:37.790384958 +0000 2026-02-24T19:15:56.549 DEBUG:teuthology.orchestra.run.trial044:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-24T19:15:56.610 INFO:teuthology.orchestra.run.trial044.stderr:1+0 records in 2026-02-24T19:15:56.610 INFO:teuthology.orchestra.run.trial044.stderr:1+0 records out 2026-02-24T19:15:56.610 INFO:teuthology.orchestra.run.trial044.stderr:512 bytes copied, 0.000146481 s, 3.5 MB/s 2026-02-24T19:15:56.612 DEBUG:teuthology.orchestra.run.trial044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-24T19:15:56.668 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-24T19:15:56.668 DEBUG:teuthology.orchestra.run.trial170:> set -ex 2026-02-24T19:15:56.668 DEBUG:teuthology.orchestra.run.trial170:> dd if=/scratch_devs of=/dev/stdout 2026-02-24T19:15:56.686 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-24T19:15:56.687 DEBUG:teuthology.orchestra.run.trial170:> stat /dev/vg_nvme/lv_1 2026-02-24T19:15:56.742 INFO:teuthology.orchestra.run.trial170.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-24T19:15:56.743 INFO:teuthology.orchestra.run.trial170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:15:56.743 INFO:teuthology.orchestra.run.trial170.stdout:Device: 6h/6d Inode: 909 Links: 1 2026-02-24T19:15:56.743 INFO:teuthology.orchestra.run.trial170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:15:56.743 INFO:teuthology.orchestra.run.trial170.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:15:56.743 INFO:teuthology.orchestra.run.trial170.stdout:Access: 2026-02-24 18:28:14.184157784 +0000 2026-02-24T19:15:56.743 INFO:teuthology.orchestra.run.trial170.stdout:Modify: 2026-02-24 18:25:35.585656376 +0000 2026-02-24T19:15:56.743 INFO:teuthology.orchestra.run.trial170.stdout:Change: 2026-02-24 18:25:35.585656376 +0000 2026-02-24T19:15:56.743 INFO:teuthology.orchestra.run.trial170.stdout: Birth: 2026-02-24 18:25:35.585656376 +0000 2026-02-24T19:15:56.744 DEBUG:teuthology.orchestra.run.trial170:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-24T19:15:56.805 INFO:teuthology.orchestra.run.trial170.stderr:1+0 records in 2026-02-24T19:15:56.805 INFO:teuthology.orchestra.run.trial170.stderr:1+0 records out 2026-02-24T19:15:56.805 INFO:teuthology.orchestra.run.trial170.stderr:512 bytes copied, 0.00015602 s, 3.3 MB/s 2026-02-24T19:15:56.806 DEBUG:teuthology.orchestra.run.trial170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-24T19:15:56.863 DEBUG:teuthology.orchestra.run.trial170:> stat /dev/vg_nvme/lv_2 2026-02-24T19:15:56.920 INFO:teuthology.orchestra.run.trial170.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-24T19:15:56.920 INFO:teuthology.orchestra.run.trial170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:15:56.920 INFO:teuthology.orchestra.run.trial170.stdout:Device: 6h/6d Inode: 937 Links: 1 2026-02-24T19:15:56.920 INFO:teuthology.orchestra.run.trial170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:15:56.920 INFO:teuthology.orchestra.run.trial170.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:15:56.920 INFO:teuthology.orchestra.run.trial170.stdout:Access: 2026-02-24 18:28:14.184157784 +0000 2026-02-24T19:15:56.920 INFO:teuthology.orchestra.run.trial170.stdout:Modify: 2026-02-24 18:25:35.815650061 +0000 2026-02-24T19:15:56.921 INFO:teuthology.orchestra.run.trial170.stdout:Change: 2026-02-24 18:25:35.815650061 +0000 2026-02-24T19:15:56.921 INFO:teuthology.orchestra.run.trial170.stdout: Birth: 2026-02-24 18:25:35.815650061 +0000 2026-02-24T19:15:56.921 DEBUG:teuthology.orchestra.run.trial170:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-24T19:15:56.983 INFO:teuthology.orchestra.run.trial170.stderr:1+0 records in 2026-02-24T19:15:56.983 INFO:teuthology.orchestra.run.trial170.stderr:1+0 records out 2026-02-24T19:15:56.983 INFO:teuthology.orchestra.run.trial170.stderr:512 bytes copied, 0.000146111 s, 3.5 MB/s 2026-02-24T19:15:56.984 DEBUG:teuthology.orchestra.run.trial170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-24T19:15:57.041 DEBUG:teuthology.orchestra.run.trial170:> stat /dev/vg_nvme/lv_3 2026-02-24T19:15:57.097 INFO:teuthology.orchestra.run.trial170.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-24T19:15:57.098 INFO:teuthology.orchestra.run.trial170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:15:57.098 INFO:teuthology.orchestra.run.trial170.stdout:Device: 6h/6d Inode: 964 Links: 1 2026-02-24T19:15:57.098 INFO:teuthology.orchestra.run.trial170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:15:57.098 INFO:teuthology.orchestra.run.trial170.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:15:57.098 INFO:teuthology.orchestra.run.trial170.stdout:Access: 2026-02-24 18:28:14.184157784 +0000 2026-02-24T19:15:57.098 INFO:teuthology.orchestra.run.trial170.stdout:Modify: 2026-02-24 18:25:36.068643113 +0000 2026-02-24T19:15:57.098 INFO:teuthology.orchestra.run.trial170.stdout:Change: 2026-02-24 18:25:36.068643113 +0000 2026-02-24T19:15:57.098 INFO:teuthology.orchestra.run.trial170.stdout: Birth: 2026-02-24 18:25:36.068643113 +0000 2026-02-24T19:15:57.099 DEBUG:teuthology.orchestra.run.trial170:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-24T19:15:57.160 INFO:teuthology.orchestra.run.trial170.stderr:1+0 records in 2026-02-24T19:15:57.160 INFO:teuthology.orchestra.run.trial170.stderr:1+0 records out 2026-02-24T19:15:57.160 INFO:teuthology.orchestra.run.trial170.stderr:512 bytes copied, 0.000160568 s, 3.2 MB/s 2026-02-24T19:15:57.161 DEBUG:teuthology.orchestra.run.trial170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-24T19:15:57.218 DEBUG:teuthology.orchestra.run.trial170:> stat /dev/vg_nvme/lv_4 2026-02-24T19:15:57.276 INFO:teuthology.orchestra.run.trial170.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-24T19:15:57.276 INFO:teuthology.orchestra.run.trial170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:15:57.276 INFO:teuthology.orchestra.run.trial170.stdout:Device: 6h/6d Inode: 994 Links: 1 2026-02-24T19:15:57.276 INFO:teuthology.orchestra.run.trial170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:15:57.277 INFO:teuthology.orchestra.run.trial170.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:15:57.277 INFO:teuthology.orchestra.run.trial170.stdout:Access: 2026-02-24 18:28:14.185157770 +0000 2026-02-24T19:15:57.277 INFO:teuthology.orchestra.run.trial170.stdout:Modify: 2026-02-24 18:25:36.313636387 +0000 2026-02-24T19:15:57.277 INFO:teuthology.orchestra.run.trial170.stdout:Change: 2026-02-24 18:25:36.313636387 +0000 2026-02-24T19:15:57.277 INFO:teuthology.orchestra.run.trial170.stdout: Birth: 2026-02-24 18:25:36.313636387 +0000 2026-02-24T19:15:57.277 DEBUG:teuthology.orchestra.run.trial170:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-24T19:15:57.339 INFO:teuthology.orchestra.run.trial170.stderr:1+0 records in 2026-02-24T19:15:57.339 INFO:teuthology.orchestra.run.trial170.stderr:1+0 records out 2026-02-24T19:15:57.339 INFO:teuthology.orchestra.run.trial170.stderr:512 bytes copied, 0.000158695 s, 3.2 MB/s 2026-02-24T19:15:57.340 DEBUG:teuthology.orchestra.run.trial170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-24T19:15:57.397 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-24T19:15:57.397 DEBUG:teuthology.orchestra.run.trial195:> set -ex 2026-02-24T19:15:57.398 DEBUG:teuthology.orchestra.run.trial195:> dd if=/scratch_devs of=/dev/stdout 2026-02-24T19:15:57.416 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-24T19:15:57.416 DEBUG:teuthology.orchestra.run.trial195:> stat /dev/vg_nvme/lv_1 2026-02-24T19:15:57.473 INFO:teuthology.orchestra.run.trial195.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-24T19:15:57.473 INFO:teuthology.orchestra.run.trial195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:15:57.473 INFO:teuthology.orchestra.run.trial195.stdout:Device: 6h/6d Inode: 957 Links: 1 2026-02-24T19:15:57.473 INFO:teuthology.orchestra.run.trial195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:15:57.473 INFO:teuthology.orchestra.run.trial195.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:15:57.473 INFO:teuthology.orchestra.run.trial195.stdout:Access: 2026-02-24 18:28:09.726256289 +0000 2026-02-24T19:15:57.473 INFO:teuthology.orchestra.run.trial195.stdout:Modify: 2026-02-24 18:25:34.965710264 +0000 2026-02-24T19:15:57.473 INFO:teuthology.orchestra.run.trial195.stdout:Change: 2026-02-24 18:25:34.965710264 +0000 2026-02-24T19:15:57.474 INFO:teuthology.orchestra.run.trial195.stdout: Birth: 2026-02-24 18:25:34.965710264 +0000 2026-02-24T19:15:57.474 DEBUG:teuthology.orchestra.run.trial195:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-24T19:15:57.536 INFO:teuthology.orchestra.run.trial195.stderr:1+0 records in 2026-02-24T19:15:57.536 INFO:teuthology.orchestra.run.trial195.stderr:1+0 records out 2026-02-24T19:15:57.536 INFO:teuthology.orchestra.run.trial195.stderr:512 bytes copied, 0.000169695 s, 3.0 MB/s 2026-02-24T19:15:57.537 DEBUG:teuthology.orchestra.run.trial195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-24T19:15:57.594 DEBUG:teuthology.orchestra.run.trial195:> stat /dev/vg_nvme/lv_2 2026-02-24T19:15:57.650 INFO:teuthology.orchestra.run.trial195.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-24T19:15:57.651 INFO:teuthology.orchestra.run.trial195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:15:57.651 INFO:teuthology.orchestra.run.trial195.stdout:Device: 6h/6d Inode: 982 Links: 1 2026-02-24T19:15:57.651 INFO:teuthology.orchestra.run.trial195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:15:57.651 INFO:teuthology.orchestra.run.trial195.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:15:57.651 INFO:teuthology.orchestra.run.trial195.stdout:Access: 2026-02-24 18:28:09.727256251 +0000 2026-02-24T19:15:57.651 INFO:teuthology.orchestra.run.trial195.stdout:Modify: 2026-02-24 18:25:35.205700939 +0000 2026-02-24T19:15:57.651 INFO:teuthology.orchestra.run.trial195.stdout:Change: 2026-02-24 18:25:35.205700939 +0000 2026-02-24T19:15:57.651 INFO:teuthology.orchestra.run.trial195.stdout: Birth: 2026-02-24 18:25:35.205700939 +0000 2026-02-24T19:15:57.652 DEBUG:teuthology.orchestra.run.trial195:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-24T19:15:57.713 INFO:teuthology.orchestra.run.trial195.stderr:1+0 records in 2026-02-24T19:15:57.713 INFO:teuthology.orchestra.run.trial195.stderr:1+0 records out 2026-02-24T19:15:57.713 INFO:teuthology.orchestra.run.trial195.stderr:512 bytes copied, 0.000164936 s, 3.1 MB/s 2026-02-24T19:15:57.714 DEBUG:teuthology.orchestra.run.trial195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-24T19:15:57.771 DEBUG:teuthology.orchestra.run.trial195:> stat /dev/vg_nvme/lv_3 2026-02-24T19:15:57.827 INFO:teuthology.orchestra.run.trial195.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-24T19:15:57.828 INFO:teuthology.orchestra.run.trial195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:15:57.828 INFO:teuthology.orchestra.run.trial195.stdout:Device: 6h/6d Inode: 1012 Links: 1 2026-02-24T19:15:57.828 INFO:teuthology.orchestra.run.trial195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:15:57.828 INFO:teuthology.orchestra.run.trial195.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:15:57.828 INFO:teuthology.orchestra.run.trial195.stdout:Access: 2026-02-24 18:28:09.727256251 +0000 2026-02-24T19:15:57.828 INFO:teuthology.orchestra.run.trial195.stdout:Modify: 2026-02-24 18:25:35.455691226 +0000 2026-02-24T19:15:57.828 INFO:teuthology.orchestra.run.trial195.stdout:Change: 2026-02-24 18:25:35.455691226 +0000 2026-02-24T19:15:57.828 INFO:teuthology.orchestra.run.trial195.stdout: Birth: 2026-02-24 18:25:35.455691226 +0000 2026-02-24T19:15:57.829 DEBUG:teuthology.orchestra.run.trial195:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-24T19:15:57.890 INFO:teuthology.orchestra.run.trial195.stderr:1+0 records in 2026-02-24T19:15:57.890 INFO:teuthology.orchestra.run.trial195.stderr:1+0 records out 2026-02-24T19:15:57.890 INFO:teuthology.orchestra.run.trial195.stderr:512 bytes copied, 0.000145691 s, 3.5 MB/s 2026-02-24T19:15:57.892 DEBUG:teuthology.orchestra.run.trial195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-24T19:15:57.949 DEBUG:teuthology.orchestra.run.trial195:> stat /dev/vg_nvme/lv_4 2026-02-24T19:15:58.005 INFO:teuthology.orchestra.run.trial195.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-24T19:15:58.005 INFO:teuthology.orchestra.run.trial195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:15:58.006 INFO:teuthology.orchestra.run.trial195.stdout:Device: 6h/6d Inode: 1040 Links: 1 2026-02-24T19:15:58.006 INFO:teuthology.orchestra.run.trial195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:15:58.006 INFO:teuthology.orchestra.run.trial195.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:15:58.006 INFO:teuthology.orchestra.run.trial195.stdout:Access: 2026-02-24 18:28:09.727256251 +0000 2026-02-24T19:15:58.006 INFO:teuthology.orchestra.run.trial195.stdout:Modify: 2026-02-24 18:25:35.693681979 +0000 2026-02-24T19:15:58.006 INFO:teuthology.orchestra.run.trial195.stdout:Change: 2026-02-24 18:25:35.693681979 +0000 2026-02-24T19:15:58.006 INFO:teuthology.orchestra.run.trial195.stdout: Birth: 2026-02-24 18:25:35.693681979 +0000 2026-02-24T19:15:58.006 DEBUG:teuthology.orchestra.run.trial195:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-24T19:15:58.068 INFO:teuthology.orchestra.run.trial195.stderr:1+0 records in 2026-02-24T19:15:58.068 INFO:teuthology.orchestra.run.trial195.stderr:1+0 records out 2026-02-24T19:15:58.068 INFO:teuthology.orchestra.run.trial195.stderr:512 bytes copied, 0.000144439 s, 3.5 MB/s 2026-02-24T19:15:58.069 DEBUG:teuthology.orchestra.run.trial195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-24T19:15:58.126 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-24T19:15:58.126 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial014.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial044.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial170.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial195.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'}} 2026-02-24T19:15:58.126 INFO:tasks.ceph:Generating config... 2026-02-24T19:15:58.129 INFO:tasks.ceph:[client] debug monc = 20 2026-02-24T19:15:58.129 INFO:tasks.ceph:[client] debug ms = 1 2026-02-24T19:15:58.129 INFO:tasks.ceph:[client] debug objecter = 20 2026-02-24T19:15:58.129 INFO:tasks.ceph:[client] debug rados = 20 2026-02-24T19:15:58.129 INFO:tasks.ceph:[client] rados replica read policy = balance 2026-02-24T19:15:58.129 INFO:tasks.ceph:[global] mon client directed command retry = 5 2026-02-24T19:15:58.129 INFO:tasks.ceph:[global] mon election default strategy = 3 2026-02-24T19:15:58.130 INFO:tasks.ceph:[global] ms bind msgr2 = False 2026-02-24T19:15:58.130 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2026-02-24T19:15:58.130 INFO:tasks.ceph:[global] ms type = async 2026-02-24T19:15:58.130 INFO:tasks.ceph:[global] osd heartbeat grace = 160 2026-02-24T19:15:58.130 INFO:tasks.ceph:[global] osd op thread timeout = 150 2026-02-24T19:15:58.130 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-24T19:15:58.130 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-24T19:15:58.130 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-24T19:15:58.130 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-24T19:15:58.130 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-24T19:15:58.130 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2026-02-24T19:15:58.130 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2026-02-24T19:15:58.131 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2026-02-24T19:15:58.131 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2026-02-24T19:15:58.131 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2026-02-24T19:15:58.131 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-24T19:15:58.131 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2026-02-24T19:15:58.131 INFO:tasks.ceph:[mon] paxos service trim min = 10 2026-02-24T19:15:58.131 INFO:tasks.ceph:[osd] bdev async discard = True 2026-02-24T19:15:58.131 INFO:tasks.ceph:[osd] bdev enable discard = True 2026-02-24T19:15:58.131 INFO:tasks.ceph:[osd] bluestore allocator = btree 2026-02-24T19:15:58.131 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-24T19:15:58.131 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-24T19:15:58.131 INFO:tasks.ceph:[osd] bluestore onode segment size = 0 2026-02-24T19:15:58.131 INFO:tasks.ceph:[osd] bluestore write v2 random = True 2026-02-24T19:15:58.132 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-24T19:15:58.132 INFO:tasks.ceph:[osd] crush location = root=default host=host-$id 2026-02-24T19:15:58.132 INFO:tasks.ceph:[osd] debug bluefs = 1 2026-02-24T19:15:58.132 INFO:tasks.ceph:[osd] debug bluestore = 1 2026-02-24T19:15:58.132 INFO:tasks.ceph:[osd] debug monc = 20 2026-02-24T19:15:58.132 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-24T19:15:58.132 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-24T19:15:58.132 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-24T19:15:58.132 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-24T19:15:58.132 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-24T19:15:58.132 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-24T19:15:58.132 INFO:tasks.ceph:[osd] osd class default list = * 2026-02-24T19:15:58.133 INFO:tasks.ceph:[osd] osd class load list = * 2026-02-24T19:15:58.133 INFO:tasks.ceph:[osd] osd client watch timeout = 240 2026-02-24T19:15:58.133 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-24T19:15:58.133 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-24T19:15:58.133 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-24T19:15:58.133 INFO:tasks.ceph:[osd] osd fast shutdown = False 2026-02-24T19:15:58.133 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-24T19:15:58.133 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-24T19:15:58.133 INFO:tasks.ceph:[osd] osd mclock skip benchmark = True 2026-02-24T19:15:58.133 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-24T19:15:58.134 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-24T19:15:58.134 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-24T19:15:58.134 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2026-02-24T19:15:58.134 INFO:tasks.ceph:Setting up mon.a... 2026-02-24T19:15:58.134 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-24T19:15:58.171 INFO:teuthology.orchestra.run.trial014.stdout:creating /etc/ceph/ceph.keyring 2026-02-24T19:15:58.173 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-24T19:15:58.249 DEBUG:teuthology.orchestra.run.trial014:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-24T19:15:58.312 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '[v1:10.20.193.14:6789]'), ('mon.b', '[v1:10.20.193.44:6789]'), ('mon.c', '[v1:10.20.193.170:6789]')] 2026-02-24T19:15:58.313 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '[v1:10.20.193.14:6789],[v1:10.20.193.44:6789],[v1:10.20.193.170:6789]', 'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 160, 'osd op thread timeout': 150}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'btree', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore onode segment size': 0, 'bluestore write v2 random': True, 'bluestore zero block detection': True, 'crush location': 'root=default host=host-$id', 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 240, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20, 'rados replica read policy': 'balance'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}} 2026-02-24T19:15:58.315 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-24T19:15:58.315 DEBUG:teuthology.orchestra.run.trial014:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-24T19:15:58.368 DEBUG:teuthology.orchestra.run.trial014:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --addv a '[v1:10.20.193.14:6789]' --addv b '[v1:10.20.193.44:6789]' --addv c '[v1:10.20.193.170:6789]' --print /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:15:58.441 INFO:teuthology.orchestra.run.trial014.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:15:58.441 INFO:teuthology.orchestra.run.trial014.stdout:monmaptool: generated fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:15:58.441 INFO:teuthology.orchestra.run.trial014.stdout:setting min_mon_release = tentacle 2026-02-24T19:15:58.441 INFO:teuthology.orchestra.run.trial014.stdout:epoch 0 2026-02-24T19:15:58.441 INFO:teuthology.orchestra.run.trial014.stdout:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:15:58.442 INFO:teuthology.orchestra.run.trial014.stdout:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:15:58.442 INFO:teuthology.orchestra.run.trial014.stdout:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:15:58.442 INFO:teuthology.orchestra.run.trial014.stdout:min_mon_release 20 (tentacle) 2026-02-24T19:15:58.442 INFO:teuthology.orchestra.run.trial014.stdout:election_strategy: 3 2026-02-24T19:15:58.442 INFO:teuthology.orchestra.run.trial014.stdout:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:15:58.442 INFO:teuthology.orchestra.run.trial014.stdout:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:15:58.442 INFO:teuthology.orchestra.run.trial014.stdout:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:15:58.442 INFO:teuthology.orchestra.run.trial014.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2026-02-24T19:15:58.444 DEBUG:teuthology.orchestra.run.trial014:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-24T19:15:58.498 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 829a649b-54c9-463b-96b9-ffa203d49fa7... 2026-02-24T19:15:58.500 DEBUG:teuthology.orchestra.run.trial014:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-24T19:15:58.540 DEBUG:teuthology.orchestra.run.trial044:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-24T19:15:58.543 DEBUG:teuthology.orchestra.run.trial170:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-24T19:15:58.546 DEBUG:teuthology.orchestra.run.trial195:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-24T19:15:58.576 INFO:teuthology.orchestra.run.trial014.stdout:[global] 2026-02-24T19:15:58.576 INFO:teuthology.orchestra.run.trial014.stdout: chdir = "" 2026-02-24T19:15:58.576 INFO:teuthology.orchestra.run.trial014.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-24T19:15:58.576 INFO:teuthology.orchestra.run.trial014.stdout: auth supported = cephx 2026-02-24T19:15:58.576 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:58.576 INFO:teuthology.orchestra.run.trial014.stdout: filestore xattr use omap = true 2026-02-24T19:15:58.576 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:58.576 INFO:teuthology.orchestra.run.trial014.stdout: mon clock drift allowed = 1.000 2026-02-24T19:15:58.576 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:58.577 INFO:teuthology.orchestra.run.trial014.stdout: osd crush chooseleaf type = 0 2026-02-24T19:15:58.577 INFO:teuthology.orchestra.run.trial014.stdout: auth debug = true 2026-02-24T19:15:58.577 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:58.577 INFO:teuthology.orchestra.run.trial014.stdout: ms die on old message = true 2026-02-24T19:15:58.577 INFO:teuthology.orchestra.run.trial014.stdout: ms die on bug = true 2026-02-24T19:15:58.577 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:58.577 INFO:teuthology.orchestra.run.trial014.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-24T19:15:58.577 INFO:teuthology.orchestra.run.trial014.stdout: mon pg warn max object skew = 0 2026-02-24T19:15:58.577 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:58.577 INFO:teuthology.orchestra.run.trial014.stdout: # disable pg_autoscaler by default for new pools 2026-02-24T19:15:58.577 INFO:teuthology.orchestra.run.trial014.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-24T19:15:58.577 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:58.578 INFO:teuthology.orchestra.run.trial014.stdout: osd pool default size = 2 2026-02-24T19:15:58.578 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:58.578 INFO:teuthology.orchestra.run.trial014.stdout: mon osd allow primary affinity = true 2026-02-24T19:15:58.578 INFO:teuthology.orchestra.run.trial014.stdout: mon osd allow pg remap = true 2026-02-24T19:15:58.578 INFO:teuthology.orchestra.run.trial014.stdout: mon warn on legacy crush tunables = false 2026-02-24T19:15:58.578 INFO:teuthology.orchestra.run.trial014.stdout: mon warn on crush straw calc version zero = false 2026-02-24T19:15:58.578 INFO:teuthology.orchestra.run.trial014.stdout: mon warn on no sortbitwise = false 2026-02-24T19:15:58.578 INFO:teuthology.orchestra.run.trial014.stdout: mon warn on osd down out interval zero = false 2026-02-24T19:15:58.578 INFO:teuthology.orchestra.run.trial014.stdout: mon warn on too few osds = false 2026-02-24T19:15:58.578 INFO:teuthology.orchestra.run.trial014.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-24T19:15:58.578 INFO:teuthology.orchestra.run.trial014.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-24T19:15:58.578 INFO:teuthology.orchestra.run.trial014.stdout: mon_allow_pool_size_one = true 2026-02-24T19:15:58.579 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:58.579 INFO:teuthology.orchestra.run.trial014.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-24T19:15:58.579 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:58.579 INFO:teuthology.orchestra.run.trial014.stdout: osd default data pool replay window = 5 2026-02-24T19:15:58.579 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:58.579 INFO:teuthology.orchestra.run.trial014.stdout: mon allow pool delete = true 2026-02-24T19:15:58.579 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:58.579 INFO:teuthology.orchestra.run.trial014.stdout: mon cluster log file level = debug 2026-02-24T19:15:58.579 INFO:teuthology.orchestra.run.trial014.stdout: debug asserts on shutdown = true 2026-02-24T19:15:58.579 INFO:teuthology.orchestra.run.trial014.stdout: mon health detail to clog = false 2026-02-24T19:15:58.579 INFO:teuthology.orchestra.run.trial014.stdout: mon host = "[v1:10.20.193.14:6789],[v1:10.20.193.44:6789],[v1:10.20.193.170:6789]" 2026-02-24T19:15:58.579 INFO:teuthology.orchestra.run.trial014.stdout: mon client directed command retry = 5 2026-02-24T19:15:58.580 INFO:teuthology.orchestra.run.trial014.stdout: mon election default strategy = 3 2026-02-24T19:15:58.580 INFO:teuthology.orchestra.run.trial014.stdout: ms bind msgr2 = False 2026-02-24T19:15:58.580 INFO:teuthology.orchestra.run.trial014.stdout: ms inject socket failures = 5000 2026-02-24T19:15:58.580 INFO:teuthology.orchestra.run.trial014.stdout: ms type = async 2026-02-24T19:15:58.580 INFO:teuthology.orchestra.run.trial014.stdout: osd heartbeat grace = 160 2026-02-24T19:15:58.580 INFO:teuthology.orchestra.run.trial014.stdout: osd op thread timeout = 150 2026-02-24T19:15:58.580 INFO:teuthology.orchestra.run.trial014.stdout: fsid = 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:15:58.580 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:58.580 INFO:teuthology.orchestra.run.trial014.stdout:[osd] 2026-02-24T19:15:58.580 INFO:teuthology.orchestra.run.trial014.stdout: osd journal size = 100 2026-02-24T19:15:58.580 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:58.580 INFO:teuthology.orchestra.run.trial014.stdout: osd scrub load threshold = 5.0 2026-02-24T19:15:58.580 INFO:teuthology.orchestra.run.trial014.stdout: osd scrub max interval = 600 2026-02-24T19:15:58.581 INFO:teuthology.orchestra.run.trial014.stdout: osd mclock profile = high_recovery_ops 2026-02-24T19:15:58.581 INFO:teuthology.orchestra.run.trial014.stdout: osd mclock skip benchmark = True 2026-02-24T19:15:58.581 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:58.581 INFO:teuthology.orchestra.run.trial014.stdout: osd recover clone overlap = true 2026-02-24T19:15:58.581 INFO:teuthology.orchestra.run.trial014.stdout: osd recovery max chunk = 1048576 2026-02-24T19:15:58.581 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:58.581 INFO:teuthology.orchestra.run.trial014.stdout: osd debug shutdown = true 2026-02-24T19:15:58.581 INFO:teuthology.orchestra.run.trial014.stdout: osd debug op order = true 2026-02-24T19:15:58.581 INFO:teuthology.orchestra.run.trial014.stdout: osd debug verify stray on activate = true 2026-02-24T19:15:58.581 INFO:teuthology.orchestra.run.trial014.stdout: osd debug trim objects = true 2026-02-24T19:15:58.581 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:58.581 INFO:teuthology.orchestra.run.trial014.stdout: osd open classes on start = true 2026-02-24T19:15:58.582 INFO:teuthology.orchestra.run.trial014.stdout: osd debug pg log writeout = true 2026-02-24T19:15:58.582 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:58.582 INFO:teuthology.orchestra.run.trial014.stdout: osd deep scrub update digest min age = 30 2026-02-24T19:15:58.582 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:58.582 INFO:teuthology.orchestra.run.trial014.stdout: osd map max advance = 10 2026-02-24T19:15:58.582 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:58.582 INFO:teuthology.orchestra.run.trial014.stdout: journal zero on create = true 2026-02-24T19:15:58.582 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:58.582 INFO:teuthology.orchestra.run.trial014.stdout: filestore ondisk finisher threads = 3 2026-02-24T19:15:58.582 INFO:teuthology.orchestra.run.trial014.stdout: filestore apply finisher threads = 3 2026-02-24T19:15:58.582 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:58.582 INFO:teuthology.orchestra.run.trial014.stdout: bdev debug aio = true 2026-02-24T19:15:58.582 INFO:teuthology.orchestra.run.trial014.stdout: osd debug misdirected ops = true 2026-02-24T19:15:58.583 INFO:teuthology.orchestra.run.trial014.stdout: bdev async discard = True 2026-02-24T19:15:58.583 INFO:teuthology.orchestra.run.trial014.stdout: bdev enable discard = True 2026-02-24T19:15:58.583 INFO:teuthology.orchestra.run.trial014.stdout: bluestore allocator = btree 2026-02-24T19:15:58.583 INFO:teuthology.orchestra.run.trial014.stdout: bluestore block size = 96636764160 2026-02-24T19:15:58.583 INFO:teuthology.orchestra.run.trial014.stdout: bluestore fsck on mount = True 2026-02-24T19:15:58.583 INFO:teuthology.orchestra.run.trial014.stdout: bluestore onode segment size = 0 2026-02-24T19:15:58.583 INFO:teuthology.orchestra.run.trial014.stdout: bluestore write v2 random = True 2026-02-24T19:15:58.583 INFO:teuthology.orchestra.run.trial014.stdout: bluestore zero block detection = True 2026-02-24T19:15:58.583 INFO:teuthology.orchestra.run.trial014.stdout: crush location = root=default host=host-$id 2026-02-24T19:15:58.583 INFO:teuthology.orchestra.run.trial014.stdout: debug bluefs = 1 2026-02-24T19:15:58.583 INFO:teuthology.orchestra.run.trial014.stdout: debug bluestore = 1 2026-02-24T19:15:58.583 INFO:teuthology.orchestra.run.trial014.stdout: debug monc = 20 2026-02-24T19:15:58.583 INFO:teuthology.orchestra.run.trial014.stdout: debug ms = 1 2026-02-24T19:15:58.584 INFO:teuthology.orchestra.run.trial014.stdout: debug osd = 20 2026-02-24T19:15:58.584 INFO:teuthology.orchestra.run.trial014.stdout: debug rocksdb = 10 2026-02-24T19:15:58.584 INFO:teuthology.orchestra.run.trial014.stdout: mon osd backfillfull_ratio = 0.85 2026-02-24T19:15:58.584 INFO:teuthology.orchestra.run.trial014.stdout: mon osd full ratio = 0.9 2026-02-24T19:15:58.584 INFO:teuthology.orchestra.run.trial014.stdout: mon osd nearfull ratio = 0.8 2026-02-24T19:15:58.584 INFO:teuthology.orchestra.run.trial014.stdout: osd class default list = * 2026-02-24T19:15:58.584 INFO:teuthology.orchestra.run.trial014.stdout: osd class load list = * 2026-02-24T19:15:58.584 INFO:teuthology.orchestra.run.trial014.stdout: osd client watch timeout = 240 2026-02-24T19:15:58.584 INFO:teuthology.orchestra.run.trial014.stdout: osd debug verify cached snaps = True 2026-02-24T19:15:58.584 INFO:teuthology.orchestra.run.trial014.stdout: osd debug verify missing on start = True 2026-02-24T19:15:58.584 INFO:teuthology.orchestra.run.trial014.stdout: osd failsafe full ratio = 0.95 2026-02-24T19:15:58.584 INFO:teuthology.orchestra.run.trial014.stdout: osd fast shutdown = False 2026-02-24T19:15:58.584 INFO:teuthology.orchestra.run.trial014.stdout: osd mclock override recovery settings = True 2026-02-24T19:15:58.585 INFO:teuthology.orchestra.run.trial014.stdout: osd objectstore = bluestore 2026-02-24T19:15:58.585 INFO:teuthology.orchestra.run.trial014.stdout: osd op queue = debug_random 2026-02-24T19:15:58.585 INFO:teuthology.orchestra.run.trial014.stdout: osd op queue cut off = debug_random 2026-02-24T19:15:58.585 INFO:teuthology.orchestra.run.trial014.stdout: osd shutdown pgref assert = True 2026-02-24T19:15:58.585 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:58.585 INFO:teuthology.orchestra.run.trial014.stdout:[mgr] 2026-02-24T19:15:58.585 INFO:teuthology.orchestra.run.trial014.stdout: debug ms = 1 2026-02-24T19:15:58.585 INFO:teuthology.orchestra.run.trial014.stdout: debug mgr = 20 2026-02-24T19:15:58.585 INFO:teuthology.orchestra.run.trial014.stdout: debug mon = 20 2026-02-24T19:15:58.585 INFO:teuthology.orchestra.run.trial014.stdout: debug auth = 20 2026-02-24T19:15:58.585 INFO:teuthology.orchestra.run.trial014.stdout: mon reweight min pgs per osd = 4 2026-02-24T19:15:58.585 INFO:teuthology.orchestra.run.trial014.stdout: mon reweight min bytes per osd = 10 2026-02-24T19:15:58.585 INFO:teuthology.orchestra.run.trial014.stdout: mgr/telemetry/nag = false 2026-02-24T19:15:58.586 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:58.586 INFO:teuthology.orchestra.run.trial014.stdout:[mon] 2026-02-24T19:15:58.586 INFO:teuthology.orchestra.run.trial014.stdout: debug ms = 1 2026-02-24T19:15:58.586 INFO:teuthology.orchestra.run.trial014.stdout: debug mon = 20 2026-02-24T19:15:58.586 INFO:teuthology.orchestra.run.trial014.stdout: debug paxos = 20 2026-02-24T19:15:58.586 INFO:teuthology.orchestra.run.trial014.stdout: debug auth = 20 2026-02-24T19:15:58.586 INFO:teuthology.orchestra.run.trial014.stdout: mon data avail warn = 5 2026-02-24T19:15:58.586 INFO:teuthology.orchestra.run.trial014.stdout: mon mgr mkfs grace = 240 2026-02-24T19:15:58.586 INFO:teuthology.orchestra.run.trial014.stdout: mon reweight min pgs per osd = 4 2026-02-24T19:15:58.586 INFO:teuthology.orchestra.run.trial014.stdout: mon osd reporter subtree level = osd 2026-02-24T19:15:58.586 INFO:teuthology.orchestra.run.trial014.stdout: mon osd prime pg temp = true 2026-02-24T19:15:58.586 INFO:teuthology.orchestra.run.trial014.stdout: mon reweight min bytes per osd = 10 2026-02-24T19:15:58.586 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:58.587 INFO:teuthology.orchestra.run.trial014.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-24T19:15:58.587 INFO:teuthology.orchestra.run.trial014.stdout: auth mon ticket ttl = 660 # 11m 2026-02-24T19:15:58.587 INFO:teuthology.orchestra.run.trial014.stdout: auth service ticket ttl = 240 # 4m 2026-02-24T19:15:58.587 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:58.587 INFO:teuthology.orchestra.run.trial014.stdout: # don't complain about insecure global_id in the test suite 2026-02-24T19:15:58.587 INFO:teuthology.orchestra.run.trial014.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-24T19:15:58.587 INFO:teuthology.orchestra.run.trial014.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-24T19:15:58.587 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:58.587 INFO:teuthology.orchestra.run.trial014.stdout: # 1m isn't quite enough 2026-02-24T19:15:58.587 INFO:teuthology.orchestra.run.trial014.stdout: mon_down_mkfs_grace = 2m 2026-02-24T19:15:58.587 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:58.587 INFO:teuthology.orchestra.run.trial014.stdout: mon_warn_on_filestore_osds = false 2026-02-24T19:15:58.588 INFO:teuthology.orchestra.run.trial014.stdout: mon min osdmap epochs = 50 2026-02-24T19:15:58.588 INFO:teuthology.orchestra.run.trial014.stdout: mon osd crush smoke test = False 2026-02-24T19:15:58.588 INFO:teuthology.orchestra.run.trial014.stdout: mon osdmap full prune interval = 2 2026-02-24T19:15:58.588 INFO:teuthology.orchestra.run.trial014.stdout: mon osdmap full prune min = 15 2026-02-24T19:15:58.588 INFO:teuthology.orchestra.run.trial014.stdout: mon osdmap full prune txsize = 2 2026-02-24T19:15:58.588 INFO:teuthology.orchestra.run.trial014.stdout: mon scrub interval = 300 2026-02-24T19:15:58.588 INFO:teuthology.orchestra.run.trial014.stdout: mon warn on pool no app = False 2026-02-24T19:15:58.588 INFO:teuthology.orchestra.run.trial014.stdout: paxos service trim min = 10 2026-02-24T19:15:58.588 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:15:58.588 INFO:teuthology.orchestra.run.trial014.stdout:[client] 2026-02-24T19:15:58.588 INFO:teuthology.orchestra.run.trial014.stdout: rgw cache enabled = true 2026-02-24T19:15:58.588 INFO:teuthology.orchestra.run.trial014.stdout: rgw enable ops log = true 2026-02-24T19:15:58.588 INFO:teuthology.orchestra.run.trial014.stdout: rgw enable usage log = true 2026-02-24T19:15:58.589 INFO:teuthology.orchestra.run.trial014.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-24T19:15:58.589 INFO:teuthology.orchestra.run.trial014.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-24T19:15:58.589 INFO:teuthology.orchestra.run.trial014.stdout: debug monc = 20 2026-02-24T19:15:58.589 INFO:teuthology.orchestra.run.trial014.stdout: debug ms = 1 2026-02-24T19:15:58.589 INFO:teuthology.orchestra.run.trial014.stdout: debug objecter = 20 2026-02-24T19:15:58.589 INFO:teuthology.orchestra.run.trial014.stdout: debug rados = 20 2026-02-24T19:15:58.589 INFO:teuthology.orchestra.run.trial014.stdout: rados replica read policy = balance 2026-02-24T19:15:58.589 INFO:teuthology.orchestra.run.trial014.stdout:[mon.a] 2026-02-24T19:15:58.589 INFO:teuthology.orchestra.run.trial014.stdout:[mon.b] 2026-02-24T19:15:58.589 INFO:teuthology.orchestra.run.trial014.stdout:[mon.c] 2026-02-24T19:15:58.590 INFO:teuthology.orchestra.run.trial195.stdout:[global] 2026-02-24T19:15:58.590 INFO:teuthology.orchestra.run.trial195.stdout: chdir = "" 2026-02-24T19:15:58.591 INFO:teuthology.orchestra.run.trial195.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-24T19:15:58.591 INFO:teuthology.orchestra.run.trial195.stdout: auth supported = cephx 2026-02-24T19:15:58.591 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:15:58.591 INFO:teuthology.orchestra.run.trial195.stdout: filestore xattr use omap = true 2026-02-24T19:15:58.591 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:15:58.591 INFO:teuthology.orchestra.run.trial195.stdout: mon clock drift allowed = 1.000 2026-02-24T19:15:58.591 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:15:58.591 INFO:teuthology.orchestra.run.trial195.stdout: osd crush chooseleaf type = 0 2026-02-24T19:15:58.591 INFO:teuthology.orchestra.run.trial195.stdout: auth debug = true 2026-02-24T19:15:58.591 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:15:58.591 INFO:teuthology.orchestra.run.trial195.stdout: ms die on old message = true 2026-02-24T19:15:58.592 INFO:teuthology.orchestra.run.trial195.stdout: ms die on bug = true 2026-02-24T19:15:58.592 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:15:58.592 INFO:teuthology.orchestra.run.trial195.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-24T19:15:58.592 INFO:teuthology.orchestra.run.trial195.stdout: mon pg warn max object skew = 0 2026-02-24T19:15:58.592 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:15:58.592 INFO:teuthology.orchestra.run.trial195.stdout: # disable pg_autoscaler by default for new pools 2026-02-24T19:15:58.592 INFO:teuthology.orchestra.run.trial195.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-24T19:15:58.592 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:15:58.592 INFO:teuthology.orchestra.run.trial195.stdout: osd pool default size = 2 2026-02-24T19:15:58.592 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:15:58.592 INFO:teuthology.orchestra.run.trial195.stdout: mon osd allow primary affinity = true 2026-02-24T19:15:58.592 INFO:teuthology.orchestra.run.trial195.stdout: mon osd allow pg remap = true 2026-02-24T19:15:58.592 INFO:teuthology.orchestra.run.trial195.stdout: mon warn on legacy crush tunables = false 2026-02-24T19:15:58.593 INFO:teuthology.orchestra.run.trial195.stdout: mon warn on crush straw calc version zero = false 2026-02-24T19:15:58.593 INFO:teuthology.orchestra.run.trial195.stdout: mon warn on no sortbitwise = false 2026-02-24T19:15:58.593 INFO:teuthology.orchestra.run.trial195.stdout: mon warn on osd down out interval zero = false 2026-02-24T19:15:58.593 INFO:teuthology.orchestra.run.trial195.stdout: mon warn on too few osds = false 2026-02-24T19:15:58.593 INFO:teuthology.orchestra.run.trial195.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-24T19:15:58.593 INFO:teuthology.orchestra.run.trial195.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-24T19:15:58.593 INFO:teuthology.orchestra.run.trial195.stdout: mon_allow_pool_size_one = true 2026-02-24T19:15:58.593 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:15:58.593 INFO:teuthology.orchestra.run.trial195.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-24T19:15:58.593 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:15:58.593 INFO:teuthology.orchestra.run.trial195.stdout: osd default data pool replay window = 5 2026-02-24T19:15:58.593 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:15:58.593 INFO:teuthology.orchestra.run.trial195.stdout: mon allow pool delete = true 2026-02-24T19:15:58.594 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:15:58.594 INFO:teuthology.orchestra.run.trial195.stdout: mon cluster log file level = debug 2026-02-24T19:15:58.594 INFO:teuthology.orchestra.run.trial195.stdout: debug asserts on shutdown = true 2026-02-24T19:15:58.594 INFO:teuthology.orchestra.run.trial195.stdout: mon health detail to clog = false 2026-02-24T19:15:58.594 INFO:teuthology.orchestra.run.trial195.stdout: mon host = "[v1:10.20.193.14:6789],[v1:10.20.193.44:6789],[v1:10.20.193.170:6789]" 2026-02-24T19:15:58.594 INFO:teuthology.orchestra.run.trial195.stdout: mon client directed command retry = 5 2026-02-24T19:15:58.594 INFO:teuthology.orchestra.run.trial195.stdout: mon election default strategy = 3 2026-02-24T19:15:58.594 INFO:teuthology.orchestra.run.trial195.stdout: ms bind msgr2 = False 2026-02-24T19:15:58.594 INFO:teuthology.orchestra.run.trial195.stdout: ms inject socket failures = 5000 2026-02-24T19:15:58.594 INFO:teuthology.orchestra.run.trial195.stdout: ms type = async 2026-02-24T19:15:58.594 INFO:teuthology.orchestra.run.trial195.stdout: osd heartbeat grace = 160 2026-02-24T19:15:58.594 INFO:teuthology.orchestra.run.trial195.stdout: osd op thread timeout = 150 2026-02-24T19:15:58.595 INFO:teuthology.orchestra.run.trial195.stdout: fsid = 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:15:58.595 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:15:58.595 INFO:teuthology.orchestra.run.trial195.stdout:[osd] 2026-02-24T19:15:58.595 INFO:teuthology.orchestra.run.trial195.stdout: osd journal size = 100 2026-02-24T19:15:58.595 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:15:58.595 INFO:teuthology.orchestra.run.trial195.stdout: osd scrub load threshold = 5.0 2026-02-24T19:15:58.595 INFO:teuthology.orchestra.run.trial195.stdout: osd scrub max interval = 600 2026-02-24T19:15:58.595 INFO:teuthology.orchestra.run.trial195.stdout: osd mclock profile = high_recovery_ops 2026-02-24T19:15:58.595 INFO:teuthology.orchestra.run.trial195.stdout: osd mclock skip benchmark = True 2026-02-24T19:15:58.595 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:15:58.595 INFO:teuthology.orchestra.run.trial195.stdout: osd recover clone overlap = true 2026-02-24T19:15:58.595 INFO:teuthology.orchestra.run.trial195.stdout: osd recovery max chunk = 1048576 2026-02-24T19:15:58.596 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:15:58.596 INFO:teuthology.orchestra.run.trial195.stdout: osd debug shutdown = true 2026-02-24T19:15:58.596 INFO:teuthology.orchestra.run.trial195.stdout: osd debug op order = true 2026-02-24T19:15:58.596 INFO:teuthology.orchestra.run.trial195.stdout: osd debug verify stray on activate = true 2026-02-24T19:15:58.596 INFO:teuthology.orchestra.run.trial195.stdout: osd debug trim objects = true 2026-02-24T19:15:58.596 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:15:58.596 INFO:teuthology.orchestra.run.trial195.stdout: osd open classes on start = true 2026-02-24T19:15:58.596 INFO:teuthology.orchestra.run.trial195.stdout: osd debug pg log writeout = true 2026-02-24T19:15:58.596 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:15:58.596 INFO:teuthology.orchestra.run.trial195.stdout: osd deep scrub update digest min age = 30 2026-02-24T19:15:58.596 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:15:58.596 INFO:teuthology.orchestra.run.trial195.stdout: osd map max advance = 10 2026-02-24T19:15:58.596 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:15:58.597 INFO:teuthology.orchestra.run.trial195.stdout: journal zero on create = true 2026-02-24T19:15:58.597 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:15:58.597 INFO:teuthology.orchestra.run.trial195.stdout: filestore ondisk finisher threads = 3 2026-02-24T19:15:58.597 INFO:teuthology.orchestra.run.trial195.stdout: filestore apply finisher threads = 3 2026-02-24T19:15:58.597 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:15:58.597 INFO:teuthology.orchestra.run.trial195.stdout: bdev debug aio = true 2026-02-24T19:15:58.597 INFO:teuthology.orchestra.run.trial195.stdout: osd debug misdirected ops = true 2026-02-24T19:15:58.597 INFO:teuthology.orchestra.run.trial195.stdout: bdev async discard = True 2026-02-24T19:15:58.597 INFO:teuthology.orchestra.run.trial195.stdout: bdev enable discard = True 2026-02-24T19:15:58.597 INFO:teuthology.orchestra.run.trial195.stdout: bluestore allocator = btree 2026-02-24T19:15:58.597 INFO:teuthology.orchestra.run.trial195.stdout: bluestore block size = 96636764160 2026-02-24T19:15:58.597 INFO:teuthology.orchestra.run.trial195.stdout: bluestore fsck on mount = True 2026-02-24T19:15:58.597 INFO:teuthology.orchestra.run.trial195.stdout: bluestore onode segment size = 0 2026-02-24T19:15:58.598 INFO:teuthology.orchestra.run.trial195.stdout: bluestore write v2 random = True 2026-02-24T19:15:58.598 INFO:teuthology.orchestra.run.trial195.stdout: bluestore zero block detection = True 2026-02-24T19:15:58.598 INFO:teuthology.orchestra.run.trial195.stdout: crush location = root=default host=host-$id 2026-02-24T19:15:58.598 INFO:teuthology.orchestra.run.trial195.stdout: debug bluefs = 1 2026-02-24T19:15:58.598 INFO:teuthology.orchestra.run.trial195.stdout: debug bluestore = 1 2026-02-24T19:15:58.598 INFO:teuthology.orchestra.run.trial195.stdout: debug monc = 20 2026-02-24T19:15:58.598 INFO:teuthology.orchestra.run.trial195.stdout: debug ms = 1 2026-02-24T19:15:58.598 INFO:teuthology.orchestra.run.trial195.stdout: debug osd = 20 2026-02-24T19:15:58.598 INFO:teuthology.orchestra.run.trial195.stdout: debug rocksdb = 10 2026-02-24T19:15:58.598 INFO:teuthology.orchestra.run.trial195.stdout: mon osd backfillfull_ratio = 0.85 2026-02-24T19:15:58.598 INFO:teuthology.orchestra.run.trial195.stdout: mon osd full ratio = 0.9 2026-02-24T19:15:58.598 INFO:teuthology.orchestra.run.trial195.stdout: mon osd nearfull ratio = 0.8 2026-02-24T19:15:58.598 INFO:teuthology.orchestra.run.trial195.stdout: osd class default list = * 2026-02-24T19:15:58.599 INFO:teuthology.orchestra.run.trial195.stdout: osd class load list = * 2026-02-24T19:15:58.599 INFO:teuthology.orchestra.run.trial195.stdout: osd client watch timeout = 240 2026-02-24T19:15:58.599 INFO:teuthology.orchestra.run.trial195.stdout: osd debug verify cached snaps = True 2026-02-24T19:15:58.599 INFO:teuthology.orchestra.run.trial195.stdout: osd debug verify missing on start = True 2026-02-24T19:15:58.599 INFO:teuthology.orchestra.run.trial195.stdout: osd failsafe full ratio = 0.95 2026-02-24T19:15:58.599 INFO:teuthology.orchestra.run.trial195.stdout: osd fast shutdown = False 2026-02-24T19:15:58.599 INFO:teuthology.orchestra.run.trial195.stdout: osd mclock override recovery settings = True 2026-02-24T19:15:58.599 INFO:teuthology.orchestra.run.trial195.stdout: osd objectstore = bluestore 2026-02-24T19:15:58.599 INFO:teuthology.orchestra.run.trial195.stdout: osd op queue = debug_random 2026-02-24T19:15:58.599 INFO:teuthology.orchestra.run.trial195.stdout: osd op queue cut off = debug_random 2026-02-24T19:15:58.599 INFO:teuthology.orchestra.run.trial195.stdout: osd shutdown pgref assert = True 2026-02-24T19:15:58.599 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:15:58.599 INFO:teuthology.orchestra.run.trial195.stdout:[mgr] 2026-02-24T19:15:58.600 INFO:teuthology.orchestra.run.trial195.stdout: debug ms = 1 2026-02-24T19:15:58.600 INFO:teuthology.orchestra.run.trial195.stdout: debug mgr = 20 2026-02-24T19:15:58.600 INFO:teuthology.orchestra.run.trial195.stdout: debug mon = 20 2026-02-24T19:15:58.600 INFO:teuthology.orchestra.run.trial195.stdout: debug auth = 20 2026-02-24T19:15:58.600 INFO:teuthology.orchestra.run.trial195.stdout: mon reweight min pgs per osd = 4 2026-02-24T19:15:58.600 INFO:teuthology.orchestra.run.trial195.stdout: mon reweight min bytes per osd = 10 2026-02-24T19:15:58.600 INFO:teuthology.orchestra.run.trial195.stdout: mgr/telemetry/nag = false 2026-02-24T19:15:58.600 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:15:58.600 INFO:teuthology.orchestra.run.trial195.stdout:[mon] 2026-02-24T19:15:58.600 INFO:teuthology.orchestra.run.trial195.stdout: debug ms = 1 2026-02-24T19:15:58.600 INFO:teuthology.orchestra.run.trial195.stdout: debug mon = 20 2026-02-24T19:15:58.600 INFO:teuthology.orchestra.run.trial195.stdout: debug paxos = 20 2026-02-24T19:15:58.601 INFO:teuthology.orchestra.run.trial195.stdout: debug auth = 20 2026-02-24T19:15:58.601 INFO:teuthology.orchestra.run.trial195.stdout: mon data avail warn = 5 2026-02-24T19:15:58.601 INFO:teuthology.orchestra.run.trial195.stdout: mon mgr mkfs grace = 240 2026-02-24T19:15:58.601 INFO:teuthology.orchestra.run.trial195.stdout: mon reweight min pgs per osd = 4 2026-02-24T19:15:58.601 INFO:teuthology.orchestra.run.trial195.stdout: mon osd reporter subtree level = osd 2026-02-24T19:15:58.601 INFO:teuthology.orchestra.run.trial195.stdout: mon osd prime pg temp = true 2026-02-24T19:15:58.601 INFO:teuthology.orchestra.run.trial195.stdout: mon reweight min bytes per osd = 10 2026-02-24T19:15:58.601 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:15:58.601 INFO:teuthology.orchestra.run.trial195.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-24T19:15:58.601 INFO:teuthology.orchestra.run.trial195.stdout: auth mon ticket ttl = 660 # 11m 2026-02-24T19:15:58.601 INFO:teuthology.orchestra.run.trial195.stdout: auth service ticket ttl = 240 # 4m 2026-02-24T19:15:58.601 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:15:58.601 INFO:teuthology.orchestra.run.trial195.stdout: # don't complain about insecure global_id in the test suite 2026-02-24T19:15:58.602 INFO:teuthology.orchestra.run.trial195.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-24T19:15:58.602 INFO:teuthology.orchestra.run.trial195.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-24T19:15:58.602 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:15:58.602 INFO:teuthology.orchestra.run.trial195.stdout: # 1m isn't quite enough 2026-02-24T19:15:58.602 INFO:teuthology.orchestra.run.trial195.stdout: mon_down_mkfs_grace = 2m 2026-02-24T19:15:58.602 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:15:58.602 INFO:teuthology.orchestra.run.trial195.stdout: mon_warn_on_filestore_osds = false 2026-02-24T19:15:58.602 INFO:teuthology.orchestra.run.trial195.stdout: mon min osdmap epochs = 50 2026-02-24T19:15:58.602 INFO:teuthology.orchestra.run.trial195.stdout: mon osd crush smoke test = False 2026-02-24T19:15:58.602 INFO:teuthology.orchestra.run.trial195.stdout: mon osdmap full prune interval = 2 2026-02-24T19:15:58.602 INFO:teuthology.orchestra.run.trial195.stdout: mon osdmap full prune min = 15 2026-02-24T19:15:58.602 INFO:teuthology.orchestra.run.trial195.stdout: mon osdmap full prune txsize = 2 2026-02-24T19:15:58.602 INFO:teuthology.orchestra.run.trial195.stdout: mon scrub interval = 300 2026-02-24T19:15:58.602 INFO:teuthology.orchestra.run.trial195.stdout: mon warn on pool no app = False 2026-02-24T19:15:58.603 INFO:teuthology.orchestra.run.trial195.stdout: paxos service trim min = 10 2026-02-24T19:15:58.603 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T19:15:58.603 INFO:teuthology.orchestra.run.trial195.stdout:[client] 2026-02-24T19:15:58.603 INFO:teuthology.orchestra.run.trial195.stdout: rgw cache enabled = true 2026-02-24T19:15:58.603 INFO:teuthology.orchestra.run.trial195.stdout: rgw enable ops log = true 2026-02-24T19:15:58.603 INFO:teuthology.orchestra.run.trial195.stdout: rgw enable usage log = true 2026-02-24T19:15:58.603 INFO:teuthology.orchestra.run.trial195.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-24T19:15:58.603 INFO:teuthology.orchestra.run.trial195.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-24T19:15:58.603 INFO:teuthology.orchestra.run.trial195.stdout: debug monc = 20 2026-02-24T19:15:58.603 INFO:teuthology.orchestra.run.trial195.stdout: debug ms = 1 2026-02-24T19:15:58.603 INFO:teuthology.orchestra.run.trial195.stdout: debug objecter = 20 2026-02-24T19:15:58.603 INFO:teuthology.orchestra.run.trial195.stdout: debug rados = 20 2026-02-24T19:15:58.604 INFO:teuthology.orchestra.run.trial195.stdout: rados replica read policy = balance 2026-02-24T19:15:58.604 INFO:teuthology.orchestra.run.trial195.stdout:[mon.a] 2026-02-24T19:15:58.604 INFO:teuthology.orchestra.run.trial195.stdout:[mon.b] 2026-02-24T19:15:58.604 INFO:teuthology.orchestra.run.trial195.stdout:[mon.c] 2026-02-24T19:15:58.604 INFO:teuthology.orchestra.run.trial170.stdout:[global] 2026-02-24T19:15:58.604 INFO:teuthology.orchestra.run.trial170.stdout: chdir = "" 2026-02-24T19:15:58.604 INFO:teuthology.orchestra.run.trial170.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-24T19:15:58.604 INFO:teuthology.orchestra.run.trial170.stdout: auth supported = cephx 2026-02-24T19:15:58.604 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:58.604 INFO:teuthology.orchestra.run.trial170.stdout: filestore xattr use omap = true 2026-02-24T19:15:58.604 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:58.605 INFO:teuthology.orchestra.run.trial170.stdout: mon clock drift allowed = 1.000 2026-02-24T19:15:58.605 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:58.605 INFO:teuthology.orchestra.run.trial170.stdout: osd crush chooseleaf type = 0 2026-02-24T19:15:58.605 INFO:teuthology.orchestra.run.trial170.stdout: auth debug = true 2026-02-24T19:15:58.605 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:58.605 INFO:teuthology.orchestra.run.trial170.stdout: ms die on old message = true 2026-02-24T19:15:58.605 INFO:teuthology.orchestra.run.trial170.stdout: ms die on bug = true 2026-02-24T19:15:58.605 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:58.605 INFO:teuthology.orchestra.run.trial170.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-24T19:15:58.605 INFO:teuthology.orchestra.run.trial170.stdout: mon pg warn max object skew = 0 2026-02-24T19:15:58.605 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:58.605 INFO:teuthology.orchestra.run.trial170.stdout: # disable pg_autoscaler by default for new pools 2026-02-24T19:15:58.606 INFO:teuthology.orchestra.run.trial170.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-24T19:15:58.606 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:58.606 INFO:teuthology.orchestra.run.trial170.stdout: osd pool default size = 2 2026-02-24T19:15:58.606 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:58.606 INFO:teuthology.orchestra.run.trial170.stdout: mon osd allow primary affinity = true 2026-02-24T19:15:58.606 INFO:teuthology.orchestra.run.trial170.stdout: mon osd allow pg remap = true 2026-02-24T19:15:58.606 INFO:teuthology.orchestra.run.trial170.stdout: mon warn on legacy crush tunables = false 2026-02-24T19:15:58.606 INFO:teuthology.orchestra.run.trial170.stdout: mon warn on crush straw calc version zero = false 2026-02-24T19:15:58.606 INFO:teuthology.orchestra.run.trial170.stdout: mon warn on no sortbitwise = false 2026-02-24T19:15:58.606 INFO:teuthology.orchestra.run.trial170.stdout: mon warn on osd down out interval zero = false 2026-02-24T19:15:58.606 INFO:teuthology.orchestra.run.trial170.stdout: mon warn on too few osds = false 2026-02-24T19:15:58.606 INFO:teuthology.orchestra.run.trial170.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-24T19:15:58.606 INFO:teuthology.orchestra.run.trial170.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-24T19:15:58.606 INFO:teuthology.orchestra.run.trial170.stdout: mon_allow_pool_size_one = true 2026-02-24T19:15:58.607 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:58.607 INFO:teuthology.orchestra.run.trial170.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-24T19:15:58.607 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:58.607 INFO:teuthology.orchestra.run.trial170.stdout: osd default data pool replay window = 5 2026-02-24T19:15:58.607 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:58.607 INFO:teuthology.orchestra.run.trial170.stdout: mon allow pool delete = true 2026-02-24T19:15:58.607 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:58.607 INFO:teuthology.orchestra.run.trial170.stdout: mon cluster log file level = debug 2026-02-24T19:15:58.607 INFO:teuthology.orchestra.run.trial170.stdout: debug asserts on shutdown = true 2026-02-24T19:15:58.607 INFO:teuthology.orchestra.run.trial170.stdout: mon health detail to clog = false 2026-02-24T19:15:58.607 INFO:teuthology.orchestra.run.trial170.stdout: mon host = "[v1:10.20.193.14:6789],[v1:10.20.193.44:6789],[v1:10.20.193.170:6789]" 2026-02-24T19:15:58.607 INFO:teuthology.orchestra.run.trial170.stdout: mon client directed command retry = 5 2026-02-24T19:15:58.608 INFO:teuthology.orchestra.run.trial170.stdout: mon election default strategy = 3 2026-02-24T19:15:58.608 INFO:teuthology.orchestra.run.trial170.stdout: ms bind msgr2 = False 2026-02-24T19:15:58.608 INFO:teuthology.orchestra.run.trial170.stdout: ms inject socket failures = 5000 2026-02-24T19:15:58.608 INFO:teuthology.orchestra.run.trial170.stdout: ms type = async 2026-02-24T19:15:58.608 INFO:teuthology.orchestra.run.trial170.stdout: osd heartbeat grace = 160 2026-02-24T19:15:58.608 INFO:teuthology.orchestra.run.trial170.stdout: osd op thread timeout = 150 2026-02-24T19:15:58.608 INFO:teuthology.orchestra.run.trial170.stdout: fsid = 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:15:58.608 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:58.608 INFO:teuthology.orchestra.run.trial170.stdout:[osd] 2026-02-24T19:15:58.608 INFO:teuthology.orchestra.run.trial170.stdout: osd journal size = 100 2026-02-24T19:15:58.608 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:58.608 INFO:teuthology.orchestra.run.trial170.stdout: osd scrub load threshold = 5.0 2026-02-24T19:15:58.608 INFO:teuthology.orchestra.run.trial170.stdout: osd scrub max interval = 600 2026-02-24T19:15:58.608 INFO:teuthology.orchestra.run.trial170.stdout: osd mclock profile = high_recovery_ops 2026-02-24T19:15:58.609 INFO:teuthology.orchestra.run.trial170.stdout: osd mclock skip benchmark = True 2026-02-24T19:15:58.609 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:58.609 INFO:teuthology.orchestra.run.trial170.stdout: osd recover clone overlap = true 2026-02-24T19:15:58.609 INFO:teuthology.orchestra.run.trial170.stdout: osd recovery max chunk = 1048576 2026-02-24T19:15:58.609 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:58.609 INFO:teuthology.orchestra.run.trial170.stdout: osd debug shutdown = true 2026-02-24T19:15:58.609 INFO:teuthology.orchestra.run.trial170.stdout: osd debug op order = true 2026-02-24T19:15:58.609 INFO:teuthology.orchestra.run.trial170.stdout: osd debug verify stray on activate = true 2026-02-24T19:15:58.609 INFO:teuthology.orchestra.run.trial170.stdout: osd debug trim objects = true 2026-02-24T19:15:58.609 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:58.609 INFO:teuthology.orchestra.run.trial170.stdout: osd open classes on start = true 2026-02-24T19:15:58.609 INFO:teuthology.orchestra.run.trial170.stdout: osd debug pg log writeout = true 2026-02-24T19:15:58.609 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:58.609 INFO:teuthology.orchestra.run.trial170.stdout: osd deep scrub update digest min age = 30 2026-02-24T19:15:58.610 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:58.610 INFO:teuthology.orchestra.run.trial170.stdout: osd map max advance = 10 2026-02-24T19:15:58.610 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:58.610 INFO:teuthology.orchestra.run.trial170.stdout: journal zero on create = true 2026-02-24T19:15:58.610 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:58.610 INFO:teuthology.orchestra.run.trial170.stdout: filestore ondisk finisher threads = 3 2026-02-24T19:15:58.610 INFO:teuthology.orchestra.run.trial170.stdout: filestore apply finisher threads = 3 2026-02-24T19:15:58.610 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:58.610 INFO:teuthology.orchestra.run.trial170.stdout: bdev debug aio = true 2026-02-24T19:15:58.610 INFO:teuthology.orchestra.run.trial170.stdout: osd debug misdirected ops = true 2026-02-24T19:15:58.610 INFO:teuthology.orchestra.run.trial170.stdout: bdev async discard = True 2026-02-24T19:15:58.610 INFO:teuthology.orchestra.run.trial170.stdout: bdev enable discard = True 2026-02-24T19:15:58.610 INFO:teuthology.orchestra.run.trial170.stdout: bluestore allocator = btree 2026-02-24T19:15:58.610 INFO:teuthology.orchestra.run.trial170.stdout: bluestore block size = 96636764160 2026-02-24T19:15:58.610 INFO:teuthology.orchestra.run.trial170.stdout: bluestore fsck on mount = True 2026-02-24T19:15:58.611 INFO:teuthology.orchestra.run.trial170.stdout: bluestore onode segment size = 0 2026-02-24T19:15:58.611 INFO:teuthology.orchestra.run.trial170.stdout: bluestore write v2 random = True 2026-02-24T19:15:58.611 INFO:teuthology.orchestra.run.trial170.stdout: bluestore zero block detection = True 2026-02-24T19:15:58.611 INFO:teuthology.orchestra.run.trial170.stdout: crush location = root=default host=host-$id 2026-02-24T19:15:58.611 INFO:teuthology.orchestra.run.trial170.stdout: debug bluefs = 1 2026-02-24T19:15:58.611 INFO:teuthology.orchestra.run.trial170.stdout: debug bluestore = 1 2026-02-24T19:15:58.611 INFO:teuthology.orchestra.run.trial170.stdout: debug monc = 20 2026-02-24T19:15:58.611 INFO:teuthology.orchestra.run.trial170.stdout: debug ms = 1 2026-02-24T19:15:58.611 INFO:teuthology.orchestra.run.trial170.stdout: debug osd = 20 2026-02-24T19:15:58.611 INFO:teuthology.orchestra.run.trial170.stdout: debug rocksdb = 10 2026-02-24T19:15:58.611 INFO:teuthology.orchestra.run.trial170.stdout: mon osd backfillfull_ratio = 0.85 2026-02-24T19:15:58.611 INFO:teuthology.orchestra.run.trial170.stdout: mon osd full ratio = 0.9 2026-02-24T19:15:58.611 INFO:teuthology.orchestra.run.trial170.stdout: mon osd nearfull ratio = 0.8 2026-02-24T19:15:58.611 INFO:teuthology.orchestra.run.trial170.stdout: osd class default list = * 2026-02-24T19:15:58.611 INFO:teuthology.orchestra.run.trial170.stdout: osd class load list = * 2026-02-24T19:15:58.612 INFO:teuthology.orchestra.run.trial170.stdout: osd client watch timeout = 240 2026-02-24T19:15:58.612 INFO:teuthology.orchestra.run.trial170.stdout: osd debug verify cached snaps = True 2026-02-24T19:15:58.612 INFO:teuthology.orchestra.run.trial170.stdout: osd debug verify missing on start = True 2026-02-24T19:15:58.612 INFO:teuthology.orchestra.run.trial170.stdout: osd failsafe full ratio = 0.95 2026-02-24T19:15:58.612 INFO:teuthology.orchestra.run.trial170.stdout: osd fast shutdown = False 2026-02-24T19:15:58.612 INFO:teuthology.orchestra.run.trial170.stdout: osd mclock override recovery settings = True 2026-02-24T19:15:58.612 INFO:teuthology.orchestra.run.trial170.stdout: osd objectstore = bluestore 2026-02-24T19:15:58.612 INFO:teuthology.orchestra.run.trial170.stdout: osd op queue = debug_random 2026-02-24T19:15:58.612 INFO:teuthology.orchestra.run.trial170.stdout: osd op queue cut off = debug_random 2026-02-24T19:15:58.612 INFO:teuthology.orchestra.run.trial170.stdout: osd shutdown pgref assert = True 2026-02-24T19:15:58.612 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:58.612 INFO:teuthology.orchestra.run.trial170.stdout:[mgr] 2026-02-24T19:15:58.612 INFO:teuthology.orchestra.run.trial170.stdout: debug ms = 1 2026-02-24T19:15:58.612 INFO:teuthology.orchestra.run.trial170.stdout: debug mgr = 20 2026-02-24T19:15:58.612 INFO:teuthology.orchestra.run.trial170.stdout: debug mon = 20 2026-02-24T19:15:58.612 INFO:teuthology.orchestra.run.trial170.stdout: debug auth = 20 2026-02-24T19:15:58.613 INFO:teuthology.orchestra.run.trial170.stdout: mon reweight min pgs per osd = 4 2026-02-24T19:15:58.613 INFO:teuthology.orchestra.run.trial170.stdout: mon reweight min bytes per osd = 10 2026-02-24T19:15:58.613 INFO:teuthology.orchestra.run.trial170.stdout: mgr/telemetry/nag = false 2026-02-24T19:15:58.613 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:58.613 INFO:teuthology.orchestra.run.trial170.stdout:[mon] 2026-02-24T19:15:58.613 INFO:teuthology.orchestra.run.trial170.stdout: debug ms = 1 2026-02-24T19:15:58.613 INFO:teuthology.orchestra.run.trial170.stdout: debug mon = 20 2026-02-24T19:15:58.613 INFO:teuthology.orchestra.run.trial170.stdout: debug paxos = 20 2026-02-24T19:15:58.613 INFO:teuthology.orchestra.run.trial170.stdout: debug auth = 20 2026-02-24T19:15:58.613 INFO:teuthology.orchestra.run.trial170.stdout: mon data avail warn = 5 2026-02-24T19:15:58.613 INFO:teuthology.orchestra.run.trial170.stdout: mon mgr mkfs grace = 240 2026-02-24T19:15:58.613 INFO:teuthology.orchestra.run.trial170.stdout: mon reweight min pgs per osd = 4 2026-02-24T19:15:58.613 INFO:teuthology.orchestra.run.trial170.stdout: mon osd reporter subtree level = osd 2026-02-24T19:15:58.613 INFO:teuthology.orchestra.run.trial170.stdout: mon osd prime pg temp = true 2026-02-24T19:15:58.613 INFO:teuthology.orchestra.run.trial170.stdout: mon reweight min bytes per osd = 10 2026-02-24T19:15:58.613 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:58.614 INFO:teuthology.orchestra.run.trial170.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-24T19:15:58.614 INFO:teuthology.orchestra.run.trial170.stdout: auth mon ticket ttl = 660 # 11m 2026-02-24T19:15:58.614 INFO:teuthology.orchestra.run.trial170.stdout: auth service ticket ttl = 240 # 4m 2026-02-24T19:15:58.614 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:58.614 INFO:teuthology.orchestra.run.trial170.stdout: # don't complain about insecure global_id in the test suite 2026-02-24T19:15:58.614 INFO:teuthology.orchestra.run.trial170.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-24T19:15:58.614 INFO:teuthology.orchestra.run.trial170.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-24T19:15:58.614 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:58.614 INFO:teuthology.orchestra.run.trial170.stdout: # 1m isn't quite enough 2026-02-24T19:15:58.614 INFO:teuthology.orchestra.run.trial170.stdout: mon_down_mkfs_grace = 2m 2026-02-24T19:15:58.614 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:58.614 INFO:teuthology.orchestra.run.trial170.stdout: mon_warn_on_filestore_osds = false 2026-02-24T19:15:58.614 INFO:teuthology.orchestra.run.trial170.stdout: mon min osdmap epochs = 50 2026-02-24T19:15:58.614 INFO:teuthology.orchestra.run.trial170.stdout: mon osd crush smoke test = False 2026-02-24T19:15:58.614 INFO:teuthology.orchestra.run.trial170.stdout: mon osdmap full prune interval = 2 2026-02-24T19:15:58.614 INFO:teuthology.orchestra.run.trial170.stdout: mon osdmap full prune min = 15 2026-02-24T19:15:58.615 INFO:teuthology.orchestra.run.trial170.stdout: mon osdmap full prune txsize = 2 2026-02-24T19:15:58.615 INFO:teuthology.orchestra.run.trial170.stdout: mon scrub interval = 300 2026-02-24T19:15:58.615 INFO:teuthology.orchestra.run.trial170.stdout: mon warn on pool no app = False 2026-02-24T19:15:58.615 INFO:teuthology.orchestra.run.trial170.stdout: paxos service trim min = 10 2026-02-24T19:15:58.615 INFO:teuthology.orchestra.run.trial170.stdout: 2026-02-24T19:15:58.615 INFO:teuthology.orchestra.run.trial170.stdout:[client] 2026-02-24T19:15:58.615 INFO:teuthology.orchestra.run.trial170.stdout: rgw cache enabled = true 2026-02-24T19:15:58.615 INFO:teuthology.orchestra.run.trial170.stdout: rgw enable ops log = true 2026-02-24T19:15:58.615 INFO:teuthology.orchestra.run.trial170.stdout: rgw enable usage log = true 2026-02-24T19:15:58.615 INFO:teuthology.orchestra.run.trial170.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-24T19:15:58.615 INFO:teuthology.orchestra.run.trial170.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-24T19:15:58.615 INFO:teuthology.orchestra.run.trial170.stdout: debug monc = 20 2026-02-24T19:15:58.615 INFO:teuthology.orchestra.run.trial170.stdout: debug ms = 1 2026-02-24T19:15:58.615 INFO:teuthology.orchestra.run.trial170.stdout: debug objecter = 20 2026-02-24T19:15:58.615 INFO:teuthology.orchestra.run.trial170.stdout: debug rados = 20 2026-02-24T19:15:58.615 INFO:teuthology.orchestra.run.trial170.stdout: rados replica read policy = balance 2026-02-24T19:15:58.615 INFO:teuthology.orchestra.run.trial170.stdout:[mon.a] 2026-02-24T19:15:58.615 INFO:teuthology.orchestra.run.trial170.stdout:[mon.b] 2026-02-24T19:15:58.616 INFO:teuthology.orchestra.run.trial170.stdout:[mon.c] 2026-02-24T19:15:58.616 INFO:teuthology.orchestra.run.trial044.stdout:[global] 2026-02-24T19:15:58.616 INFO:teuthology.orchestra.run.trial044.stdout: chdir = "" 2026-02-24T19:15:58.616 INFO:teuthology.orchestra.run.trial044.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-24T19:15:58.616 INFO:teuthology.orchestra.run.trial044.stdout: auth supported = cephx 2026-02-24T19:15:58.616 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:15:58.616 INFO:teuthology.orchestra.run.trial044.stdout: filestore xattr use omap = true 2026-02-24T19:15:58.616 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:15:58.616 INFO:teuthology.orchestra.run.trial044.stdout: mon clock drift allowed = 1.000 2026-02-24T19:15:58.616 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:15:58.616 INFO:teuthology.orchestra.run.trial044.stdout: osd crush chooseleaf type = 0 2026-02-24T19:15:58.616 INFO:teuthology.orchestra.run.trial044.stdout: auth debug = true 2026-02-24T19:15:58.616 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:15:58.616 INFO:teuthology.orchestra.run.trial044.stdout: ms die on old message = true 2026-02-24T19:15:58.616 INFO:teuthology.orchestra.run.trial044.stdout: ms die on bug = true 2026-02-24T19:15:58.616 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:15:58.617 INFO:teuthology.orchestra.run.trial044.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-24T19:15:58.617 INFO:teuthology.orchestra.run.trial044.stdout: mon pg warn max object skew = 0 2026-02-24T19:15:58.617 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:15:58.617 INFO:teuthology.orchestra.run.trial044.stdout: # disable pg_autoscaler by default for new pools 2026-02-24T19:15:58.617 INFO:teuthology.orchestra.run.trial044.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-24T19:15:58.617 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:15:58.617 INFO:teuthology.orchestra.run.trial044.stdout: osd pool default size = 2 2026-02-24T19:15:58.617 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:15:58.617 INFO:teuthology.orchestra.run.trial044.stdout: mon osd allow primary affinity = true 2026-02-24T19:15:58.617 INFO:teuthology.orchestra.run.trial044.stdout: mon osd allow pg remap = true 2026-02-24T19:15:58.617 INFO:teuthology.orchestra.run.trial044.stdout: mon warn on legacy crush tunables = false 2026-02-24T19:15:58.617 INFO:teuthology.orchestra.run.trial044.stdout: mon warn on crush straw calc version zero = false 2026-02-24T19:15:58.617 INFO:teuthology.orchestra.run.trial044.stdout: mon warn on no sortbitwise = false 2026-02-24T19:15:58.617 INFO:teuthology.orchestra.run.trial044.stdout: mon warn on osd down out interval zero = false 2026-02-24T19:15:58.617 INFO:teuthology.orchestra.run.trial044.stdout: mon warn on too few osds = false 2026-02-24T19:15:58.617 INFO:teuthology.orchestra.run.trial044.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-24T19:15:58.617 INFO:teuthology.orchestra.run.trial044.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-24T19:15:58.617 INFO:teuthology.orchestra.run.trial044.stdout: mon_allow_pool_size_one = true 2026-02-24T19:15:58.618 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:15:58.618 INFO:teuthology.orchestra.run.trial044.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-24T19:15:58.618 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:15:58.618 INFO:teuthology.orchestra.run.trial044.stdout: osd default data pool replay window = 5 2026-02-24T19:15:58.618 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:15:58.618 INFO:teuthology.orchestra.run.trial044.stdout: mon allow pool delete = true 2026-02-24T19:15:58.618 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:15:58.618 INFO:teuthology.orchestra.run.trial044.stdout: mon cluster log file level = debug 2026-02-24T19:15:58.618 INFO:teuthology.orchestra.run.trial044.stdout: debug asserts on shutdown = true 2026-02-24T19:15:58.618 INFO:teuthology.orchestra.run.trial044.stdout: mon health detail to clog = false 2026-02-24T19:15:58.618 INFO:teuthology.orchestra.run.trial044.stdout: mon host = "[v1:10.20.193.14:6789],[v1:10.20.193.44:6789],[v1:10.20.193.170:6789]" 2026-02-24T19:15:58.618 INFO:teuthology.orchestra.run.trial044.stdout: mon client directed command retry = 5 2026-02-24T19:15:58.618 INFO:teuthology.orchestra.run.trial044.stdout: mon election default strategy = 3 2026-02-24T19:15:58.618 INFO:teuthology.orchestra.run.trial044.stdout: ms bind msgr2 = False 2026-02-24T19:15:58.618 INFO:teuthology.orchestra.run.trial044.stdout: ms inject socket failures = 5000 2026-02-24T19:15:58.618 INFO:teuthology.orchestra.run.trial044.stdout: ms type = async 2026-02-24T19:15:58.618 INFO:teuthology.orchestra.run.trial044.stdout: osd heartbeat grace = 160 2026-02-24T19:15:58.618 INFO:teuthology.orchestra.run.trial044.stdout: osd op thread timeout = 150 2026-02-24T19:15:58.618 INFO:teuthology.orchestra.run.trial044.stdout: fsid = 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:15:58.619 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:15:58.619 INFO:teuthology.orchestra.run.trial044.stdout:[osd] 2026-02-24T19:15:58.619 INFO:teuthology.orchestra.run.trial044.stdout: osd journal size = 100 2026-02-24T19:15:58.619 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:15:58.619 INFO:teuthology.orchestra.run.trial044.stdout: osd scrub load threshold = 5.0 2026-02-24T19:15:58.619 INFO:teuthology.orchestra.run.trial044.stdout: osd scrub max interval = 600 2026-02-24T19:15:58.619 INFO:teuthology.orchestra.run.trial044.stdout: osd mclock profile = high_recovery_ops 2026-02-24T19:15:58.619 INFO:teuthology.orchestra.run.trial044.stdout: osd mclock skip benchmark = True 2026-02-24T19:15:58.619 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:15:58.619 INFO:teuthology.orchestra.run.trial044.stdout: osd recover clone overlap = true 2026-02-24T19:15:58.619 INFO:teuthology.orchestra.run.trial044.stdout: osd recovery max chunk = 1048576 2026-02-24T19:15:58.619 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:15:58.619 INFO:teuthology.orchestra.run.trial044.stdout: osd debug shutdown = true 2026-02-24T19:15:58.619 INFO:teuthology.orchestra.run.trial044.stdout: osd debug op order = true 2026-02-24T19:15:58.619 INFO:teuthology.orchestra.run.trial044.stdout: osd debug verify stray on activate = true 2026-02-24T19:15:58.619 INFO:teuthology.orchestra.run.trial044.stdout: osd debug trim objects = true 2026-02-24T19:15:58.619 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:15:58.619 INFO:teuthology.orchestra.run.trial044.stdout: osd open classes on start = true 2026-02-24T19:15:58.619 INFO:teuthology.orchestra.run.trial044.stdout: osd debug pg log writeout = true 2026-02-24T19:15:58.619 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:15:58.620 INFO:teuthology.orchestra.run.trial044.stdout: osd deep scrub update digest min age = 30 2026-02-24T19:15:58.620 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:15:58.620 INFO:teuthology.orchestra.run.trial044.stdout: osd map max advance = 10 2026-02-24T19:15:58.620 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:15:58.620 INFO:teuthology.orchestra.run.trial044.stdout: journal zero on create = true 2026-02-24T19:15:58.620 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:15:58.620 INFO:teuthology.orchestra.run.trial044.stdout: filestore ondisk finisher threads = 3 2026-02-24T19:15:58.620 INFO:teuthology.orchestra.run.trial044.stdout: filestore apply finisher threads = 3 2026-02-24T19:15:58.620 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:15:58.620 INFO:teuthology.orchestra.run.trial044.stdout: bdev debug aio = true 2026-02-24T19:15:58.620 INFO:teuthology.orchestra.run.trial044.stdout: osd debug misdirected ops = true 2026-02-24T19:15:58.620 INFO:teuthology.orchestra.run.trial044.stdout: bdev async discard = True 2026-02-24T19:15:58.620 INFO:teuthology.orchestra.run.trial044.stdout: bdev enable discard = True 2026-02-24T19:15:58.620 INFO:teuthology.orchestra.run.trial044.stdout: bluestore allocator = btree 2026-02-24T19:15:58.620 INFO:teuthology.orchestra.run.trial044.stdout: bluestore block size = 96636764160 2026-02-24T19:15:58.620 INFO:teuthology.orchestra.run.trial044.stdout: bluestore fsck on mount = True 2026-02-24T19:15:58.620 INFO:teuthology.orchestra.run.trial044.stdout: bluestore onode segment size = 0 2026-02-24T19:15:58.620 INFO:teuthology.orchestra.run.trial044.stdout: bluestore write v2 random = True 2026-02-24T19:15:58.620 INFO:teuthology.orchestra.run.trial044.stdout: bluestore zero block detection = True 2026-02-24T19:15:58.620 INFO:teuthology.orchestra.run.trial044.stdout: crush location = root=default host=host-$id 2026-02-24T19:15:58.621 INFO:teuthology.orchestra.run.trial044.stdout: debug bluefs = 1 2026-02-24T19:15:58.621 INFO:teuthology.orchestra.run.trial044.stdout: debug bluestore = 1 2026-02-24T19:15:58.621 INFO:teuthology.orchestra.run.trial044.stdout: debug monc = 20 2026-02-24T19:15:58.621 INFO:teuthology.orchestra.run.trial044.stdout: debug ms = 1 2026-02-24T19:15:58.621 INFO:teuthology.orchestra.run.trial044.stdout: debug osd = 20 2026-02-24T19:15:58.621 INFO:teuthology.orchestra.run.trial044.stdout: debug rocksdb = 10 2026-02-24T19:15:58.621 INFO:teuthology.orchestra.run.trial044.stdout: mon osd backfillfull_ratio = 0.85 2026-02-24T19:15:58.621 INFO:teuthology.orchestra.run.trial044.stdout: mon osd full ratio = 0.9 2026-02-24T19:15:58.621 INFO:teuthology.orchestra.run.trial044.stdout: mon osd nearfull ratio = 0.8 2026-02-24T19:15:58.621 INFO:teuthology.orchestra.run.trial044.stdout: osd class default list = * 2026-02-24T19:15:58.621 INFO:teuthology.orchestra.run.trial044.stdout: osd class load list = * 2026-02-24T19:15:58.621 INFO:teuthology.orchestra.run.trial044.stdout: osd client watch timeout = 240 2026-02-24T19:15:58.621 INFO:teuthology.orchestra.run.trial044.stdout: osd debug verify cached snaps = True 2026-02-24T19:15:58.621 INFO:teuthology.orchestra.run.trial044.stdout: osd debug verify missing on start = True 2026-02-24T19:15:58.621 INFO:teuthology.orchestra.run.trial044.stdout: osd failsafe full ratio = 0.95 2026-02-24T19:15:58.621 INFO:teuthology.orchestra.run.trial044.stdout: osd fast shutdown = False 2026-02-24T19:15:58.621 INFO:teuthology.orchestra.run.trial044.stdout: osd mclock override recovery settings = True 2026-02-24T19:15:58.621 INFO:teuthology.orchestra.run.trial044.stdout: osd objectstore = bluestore 2026-02-24T19:15:58.621 INFO:teuthology.orchestra.run.trial044.stdout: osd op queue = debug_random 2026-02-24T19:15:58.621 INFO:teuthology.orchestra.run.trial044.stdout: osd op queue cut off = debug_random 2026-02-24T19:15:58.621 INFO:teuthology.orchestra.run.trial044.stdout: osd shutdown pgref assert = True 2026-02-24T19:15:58.622 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:15:58.622 INFO:teuthology.orchestra.run.trial044.stdout:[mgr] 2026-02-24T19:15:58.622 INFO:teuthology.orchestra.run.trial044.stdout: debug ms = 1 2026-02-24T19:15:58.622 INFO:teuthology.orchestra.run.trial044.stdout: debug mgr = 20 2026-02-24T19:15:58.622 INFO:teuthology.orchestra.run.trial044.stdout: debug mon = 20 2026-02-24T19:15:58.622 INFO:teuthology.orchestra.run.trial044.stdout: debug auth = 20 2026-02-24T19:15:58.622 INFO:teuthology.orchestra.run.trial044.stdout: mon reweight min pgs per osd = 4 2026-02-24T19:15:58.622 INFO:teuthology.orchestra.run.trial044.stdout: mon reweight min bytes per osd = 10 2026-02-24T19:15:58.622 INFO:teuthology.orchestra.run.trial044.stdout: mgr/telemetry/nag = false 2026-02-24T19:15:58.622 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:15:58.622 INFO:teuthology.orchestra.run.trial044.stdout:[mon] 2026-02-24T19:15:58.622 INFO:teuthology.orchestra.run.trial044.stdout: debug ms = 1 2026-02-24T19:15:58.622 INFO:teuthology.orchestra.run.trial044.stdout: debug mon = 20 2026-02-24T19:15:58.622 INFO:teuthology.orchestra.run.trial044.stdout: debug paxos = 20 2026-02-24T19:15:58.622 INFO:teuthology.orchestra.run.trial044.stdout: debug auth = 20 2026-02-24T19:15:58.622 INFO:teuthology.orchestra.run.trial044.stdout: mon data avail warn = 5 2026-02-24T19:15:58.622 INFO:teuthology.orchestra.run.trial044.stdout: mon mgr mkfs grace = 240 2026-02-24T19:15:58.622 INFO:teuthology.orchestra.run.trial044.stdout: mon reweight min pgs per osd = 4 2026-02-24T19:15:58.622 INFO:teuthology.orchestra.run.trial044.stdout: mon osd reporter subtree level = osd 2026-02-24T19:15:58.622 INFO:teuthology.orchestra.run.trial044.stdout: mon osd prime pg temp = true 2026-02-24T19:15:58.622 INFO:teuthology.orchestra.run.trial044.stdout: mon reweight min bytes per osd = 10 2026-02-24T19:15:58.623 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:15:58.623 INFO:teuthology.orchestra.run.trial044.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-24T19:15:58.623 INFO:teuthology.orchestra.run.trial044.stdout: auth mon ticket ttl = 660 # 11m 2026-02-24T19:15:58.623 INFO:teuthology.orchestra.run.trial044.stdout: auth service ticket ttl = 240 # 4m 2026-02-24T19:15:58.623 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:15:58.623 INFO:teuthology.orchestra.run.trial044.stdout: # don't complain about insecure global_id in the test suite 2026-02-24T19:15:58.623 INFO:teuthology.orchestra.run.trial044.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-24T19:15:58.623 INFO:teuthology.orchestra.run.trial044.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-24T19:15:58.623 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:15:58.623 INFO:teuthology.orchestra.run.trial044.stdout: # 1m isn't quite enough 2026-02-24T19:15:58.623 INFO:teuthology.orchestra.run.trial044.stdout: mon_down_mkfs_grace = 2m 2026-02-24T19:15:58.623 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:15:58.623 INFO:teuthology.orchestra.run.trial044.stdout: mon_warn_on_filestore_osds = false 2026-02-24T19:15:58.623 INFO:teuthology.orchestra.run.trial044.stdout: mon min osdmap epochs = 50 2026-02-24T19:15:58.623 INFO:teuthology.orchestra.run.trial044.stdout: mon osd crush smoke test = False 2026-02-24T19:15:58.623 INFO:teuthology.orchestra.run.trial044.stdout: mon osdmap full prune interval = 2 2026-02-24T19:15:58.623 INFO:teuthology.orchestra.run.trial044.stdout: mon osdmap full prune min = 15 2026-02-24T19:15:58.623 INFO:teuthology.orchestra.run.trial044.stdout: mon osdmap full prune txsize = 2 2026-02-24T19:15:58.623 INFO:teuthology.orchestra.run.trial044.stdout: mon scrub interval = 300 2026-02-24T19:15:58.623 INFO:teuthology.orchestra.run.trial044.stdout: mon warn on pool no app = False 2026-02-24T19:15:58.623 INFO:teuthology.orchestra.run.trial044.stdout: paxos service trim min = 10 2026-02-24T19:15:58.623 INFO:teuthology.orchestra.run.trial044.stdout: 2026-02-24T19:15:58.624 INFO:teuthology.orchestra.run.trial044.stdout:[client] 2026-02-24T19:15:58.624 INFO:teuthology.orchestra.run.trial044.stdout: rgw cache enabled = true 2026-02-24T19:15:58.624 INFO:teuthology.orchestra.run.trial044.stdout: rgw enable ops log = true 2026-02-24T19:15:58.624 INFO:teuthology.orchestra.run.trial044.stdout: rgw enable usage log = true 2026-02-24T19:15:58.624 INFO:teuthology.orchestra.run.trial044.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-24T19:15:58.624 INFO:teuthology.orchestra.run.trial044.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-24T19:15:58.624 INFO:teuthology.orchestra.run.trial044.stdout: debug monc = 20 2026-02-24T19:15:58.624 INFO:teuthology.orchestra.run.trial044.stdout: debug ms = 1 2026-02-24T19:15:58.624 INFO:teuthology.orchestra.run.trial044.stdout: debug objecter = 20 2026-02-24T19:15:58.624 INFO:teuthology.orchestra.run.trial044.stdout: debug rados = 20 2026-02-24T19:15:58.624 INFO:teuthology.orchestra.run.trial044.stdout: rados replica read policy = balance 2026-02-24T19:15:58.624 INFO:teuthology.orchestra.run.trial044.stdout:[mon.a] 2026-02-24T19:15:58.624 INFO:teuthology.orchestra.run.trial044.stdout:[mon.b] 2026-02-24T19:15:58.624 INFO:teuthology.orchestra.run.trial044.stdout:[mon.c] 2026-02-24T19:15:58.626 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-24T19:15:58.626 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-24T19:15:58.708 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-24T19:15:58.708 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-24T19:15:58.708 DEBUG:teuthology.orchestra.run.trial014:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-24T19:15:58.764 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-24T19:15:58.764 DEBUG:teuthology.orchestra.run.trial014:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-24T19:15:58.820 INFO:tasks.ceph:Sending monmap to node ubuntu@trial014.front.sepia.ceph.com 2026-02-24T19:15:58.820 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-24T19:15:58.821 DEBUG:teuthology.orchestra.run.trial014:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-24T19:15:58.821 DEBUG:teuthology.orchestra.run.trial014:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-24T19:15:58.892 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-24T19:15:58.893 DEBUG:teuthology.orchestra.run.trial014:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:15:58.948 INFO:tasks.ceph:Sending monmap to node ubuntu@trial044.front.sepia.ceph.com 2026-02-24T19:15:58.949 DEBUG:teuthology.orchestra.run.trial044:> set -ex 2026-02-24T19:15:58.949 DEBUG:teuthology.orchestra.run.trial044:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-24T19:15:58.949 DEBUG:teuthology.orchestra.run.trial044:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-24T19:15:58.982 DEBUG:teuthology.orchestra.run.trial044:> set -ex 2026-02-24T19:15:58.983 DEBUG:teuthology.orchestra.run.trial044:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:15:59.039 INFO:tasks.ceph:Sending monmap to node ubuntu@trial170.front.sepia.ceph.com 2026-02-24T19:15:59.039 DEBUG:teuthology.orchestra.run.trial170:> set -ex 2026-02-24T19:15:59.040 DEBUG:teuthology.orchestra.run.trial170:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-24T19:15:59.040 DEBUG:teuthology.orchestra.run.trial170:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-24T19:15:59.075 DEBUG:teuthology.orchestra.run.trial170:> set -ex 2026-02-24T19:15:59.075 DEBUG:teuthology.orchestra.run.trial170:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:15:59.131 INFO:tasks.ceph:Sending monmap to node ubuntu@trial195.front.sepia.ceph.com 2026-02-24T19:15:59.132 DEBUG:teuthology.orchestra.run.trial195:> set -ex 2026-02-24T19:15:59.132 DEBUG:teuthology.orchestra.run.trial195:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-24T19:15:59.132 DEBUG:teuthology.orchestra.run.trial195:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-24T19:15:59.165 DEBUG:teuthology.orchestra.run.trial195:> set -ex 2026-02-24T19:15:59.166 DEBUG:teuthology.orchestra.run.trial195:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:15:59.221 INFO:tasks.ceph:Setting up mon nodes... 2026-02-24T19:15:59.222 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-24T19:15:59.222 DEBUG:teuthology.orchestra.run.trial014:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2026-02-24T19:15:59.267 INFO:teuthology.orchestra.run.trial014.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2026-02-24T19:15:59.269 DEBUG:teuthology.orchestra.run.trial195:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-24T19:15:59.314 INFO:teuthology.orchestra.run.trial195.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-24T19:15:59.316 INFO:tasks.ceph:Setting up mds nodes... 2026-02-24T19:15:59.316 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-24T19:15:59.317 DEBUG:teuthology.orchestra.run.trial195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-24T19:15:59.351 INFO:teuthology.orchestra.run.trial195.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-24T19:15:59.362 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-24T19:15:59.363 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial014.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial044.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial170.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial195.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'}} 2026-02-24T19:15:59.363 DEBUG:teuthology.orchestra.run.trial014:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-24T19:15:59.388 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-24T19:15:59.388 INFO:tasks.ceph:role: osd.0 2026-02-24T19:15:59.388 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial014.front.sepia.ceph.com 2026-02-24T19:15:59.388 DEBUG:teuthology.orchestra.run.trial014:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-24T19:15:59.452 INFO:teuthology.orchestra.run.trial014.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:15:59.452 INFO:teuthology.orchestra.run.trial014.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:15:59.452 INFO:teuthology.orchestra.run.trial014.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:15:59.452 INFO:teuthology.orchestra.run.trial014.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:15:59.453 INFO:teuthology.orchestra.run.trial014.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:15:59.453 INFO:teuthology.orchestra.run.trial014.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:15:59.453 INFO:teuthology.orchestra.run.trial014.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:15:59.453 INFO:teuthology.orchestra.run.trial014.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:15:59.453 INFO:teuthology.orchestra.run.trial014.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:15:59.453 INFO:teuthology.orchestra.run.trial014.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:00.026 INFO:teuthology.orchestra.run.trial014.stdout:Discarding blocks...Done. 2026-02-24T19:16:00.028 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial014.front.sepia.ceph.com -o noatime 2026-02-24T19:16:00.028 DEBUG:teuthology.orchestra.run.trial014:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-24T19:16:00.097 DEBUG:teuthology.orchestra.run.trial014:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-24T19:16:00.165 DEBUG:teuthology.orchestra.run.trial014:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2026-02-24T19:16:00.229 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:00.229 INFO:tasks.ceph:role: osd.4 2026-02-24T19:16:00.229 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial014.front.sepia.ceph.com 2026-02-24T19:16:00.229 DEBUG:teuthology.orchestra.run.trial014:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-24T19:16:00.295 INFO:teuthology.orchestra.run.trial014.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:00.295 INFO:teuthology.orchestra.run.trial014.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:00.295 INFO:teuthology.orchestra.run.trial014.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:00.295 INFO:teuthology.orchestra.run.trial014.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:00.295 INFO:teuthology.orchestra.run.trial014.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:00.295 INFO:teuthology.orchestra.run.trial014.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:00.295 INFO:teuthology.orchestra.run.trial014.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:00.295 INFO:teuthology.orchestra.run.trial014.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:00.295 INFO:teuthology.orchestra.run.trial014.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:00.295 INFO:teuthology.orchestra.run.trial014.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:00.854 INFO:teuthology.orchestra.run.trial014.stdout:Discarding blocks...Done. 2026-02-24T19:16:00.857 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial014.front.sepia.ceph.com -o noatime 2026-02-24T19:16:00.857 DEBUG:teuthology.orchestra.run.trial014:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2026-02-24T19:16:00.925 DEBUG:teuthology.orchestra.run.trial014:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2026-02-24T19:16:00.992 DEBUG:teuthology.orchestra.run.trial014:> sudo mkdir -p /var/lib/ceph/osd/ceph-8 2026-02-24T19:16:01.056 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:01.056 INFO:tasks.ceph:role: osd.8 2026-02-24T19:16:01.056 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial014.front.sepia.ceph.com 2026-02-24T19:16:01.057 DEBUG:teuthology.orchestra.run.trial014:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-24T19:16:01.122 INFO:teuthology.orchestra.run.trial014.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:01.122 INFO:teuthology.orchestra.run.trial014.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:01.122 INFO:teuthology.orchestra.run.trial014.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:01.122 INFO:teuthology.orchestra.run.trial014.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:01.122 INFO:teuthology.orchestra.run.trial014.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:01.122 INFO:teuthology.orchestra.run.trial014.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:01.122 INFO:teuthology.orchestra.run.trial014.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:01.122 INFO:teuthology.orchestra.run.trial014.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:01.122 INFO:teuthology.orchestra.run.trial014.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:01.123 INFO:teuthology.orchestra.run.trial014.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:01.680 INFO:teuthology.orchestra.run.trial014.stdout:Discarding blocks...Done. 2026-02-24T19:16:01.682 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial014.front.sepia.ceph.com -o noatime 2026-02-24T19:16:01.682 DEBUG:teuthology.orchestra.run.trial014:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-8 2026-02-24T19:16:01.750 DEBUG:teuthology.orchestra.run.trial014:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-8 2026-02-24T19:16:01.818 DEBUG:teuthology.orchestra.run.trial014:> sudo mkdir -p /var/lib/ceph/osd/ceph-12 2026-02-24T19:16:01.883 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:01.883 INFO:tasks.ceph:role: osd.12 2026-02-24T19:16:01.883 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial014.front.sepia.ceph.com 2026-02-24T19:16:01.883 DEBUG:teuthology.orchestra.run.trial014:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-24T19:16:01.948 INFO:teuthology.orchestra.run.trial014.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:01.948 INFO:teuthology.orchestra.run.trial014.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:01.949 INFO:teuthology.orchestra.run.trial014.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:01.949 INFO:teuthology.orchestra.run.trial014.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:01.949 INFO:teuthology.orchestra.run.trial014.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:01.949 INFO:teuthology.orchestra.run.trial014.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:01.949 INFO:teuthology.orchestra.run.trial014.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:01.949 INFO:teuthology.orchestra.run.trial014.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:01.949 INFO:teuthology.orchestra.run.trial014.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:01.949 INFO:teuthology.orchestra.run.trial014.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:02.505 INFO:teuthology.orchestra.run.trial014.stdout:Discarding blocks...Done. 2026-02-24T19:16:02.508 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial014.front.sepia.ceph.com -o noatime 2026-02-24T19:16:02.508 DEBUG:teuthology.orchestra.run.trial014:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-12 2026-02-24T19:16:02.583 DEBUG:teuthology.orchestra.run.trial014:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-12 2026-02-24T19:16:02.649 DEBUG:teuthology.orchestra.run.trial014:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:02.728 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:02.726+0000 7ff54e851900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-24T19:16:02.729 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:02.726+0000 7ff54e851900 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-24T19:16:02.729 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:02.726+0000 7ff54e851900 -1 bdev(0x55bd9ebb5800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:02.729 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:02.726+0000 7ff54e851900 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-24T19:16:03.231 DEBUG:teuthology.orchestra.run.trial014:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-24T19:16:03.295 DEBUG:teuthology.orchestra.run.trial014:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:03.372 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:03.370+0000 7ff34100c900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2026-02-24T19:16:03.373 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:03.370+0000 7ff34100c900 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2026-02-24T19:16:03.373 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:03.371+0000 7ff34100c900 -1 bdev(0x55caaeb27800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:03.373 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:03.371+0000 7ff34100c900 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2026-02-24T19:16:03.858 DEBUG:teuthology.orchestra.run.trial014:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2026-02-24T19:16:03.924 DEBUG:teuthology.orchestra.run.trial014:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 8 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:04.001 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:03.999+0000 7f77bf859900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-8/keyring: can't open /var/lib/ceph/osd/ceph-8/keyring: (2) No such file or directory 2026-02-24T19:16:04.002 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:04.000+0000 7f77bf859900 -1 created new key in keyring /var/lib/ceph/osd/ceph-8/keyring 2026-02-24T19:16:04.002 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:04.000+0000 7f77bf859900 -1 bdev(0x55c03ce69800 /var/lib/ceph/osd/ceph-8/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:04.002 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:04.000+0000 7f77bf859900 -1 bluestore(/var/lib/ceph/osd/ceph-8) _read_fsid unparsable uuid 2026-02-24T19:16:04.510 DEBUG:teuthology.orchestra.run.trial014:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2026-02-24T19:16:04.574 DEBUG:teuthology.orchestra.run.trial014:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 12 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:04.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:04.651+0000 7fc469557900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-12/keyring: can't open /var/lib/ceph/osd/ceph-12/keyring: (2) No such file or directory 2026-02-24T19:16:04.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:04.651+0000 7fc469557900 -1 created new key in keyring /var/lib/ceph/osd/ceph-12/keyring 2026-02-24T19:16:04.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:04.651+0000 7fc469557900 -1 bdev(0x56022dd77800 /var/lib/ceph/osd/ceph-12/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:04.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:04.651+0000 7fc469557900 -1 bluestore(/var/lib/ceph/osd/ceph-12) _read_fsid unparsable uuid 2026-02-24T19:16:05.147 DEBUG:teuthology.orchestra.run.trial014:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-12 2026-02-24T19:16:05.212 DEBUG:teuthology.orchestra.run.trial044:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-24T19:16:05.238 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:05.238 INFO:tasks.ceph:role: osd.1 2026-02-24T19:16:05.238 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial044.front.sepia.ceph.com 2026-02-24T19:16:05.238 DEBUG:teuthology.orchestra.run.trial044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-24T19:16:05.303 INFO:teuthology.orchestra.run.trial044.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:05.303 INFO:teuthology.orchestra.run.trial044.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:05.303 INFO:teuthology.orchestra.run.trial044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:05.304 INFO:teuthology.orchestra.run.trial044.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:05.304 INFO:teuthology.orchestra.run.trial044.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:05.304 INFO:teuthology.orchestra.run.trial044.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:05.304 INFO:teuthology.orchestra.run.trial044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:05.304 INFO:teuthology.orchestra.run.trial044.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:05.304 INFO:teuthology.orchestra.run.trial044.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:05.304 INFO:teuthology.orchestra.run.trial044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:05.876 INFO:teuthology.orchestra.run.trial044.stdout:Discarding blocks...Done. 2026-02-24T19:16:05.878 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial044.front.sepia.ceph.com -o noatime 2026-02-24T19:16:05.878 DEBUG:teuthology.orchestra.run.trial044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2026-02-24T19:16:05.945 DEBUG:teuthology.orchestra.run.trial044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-24T19:16:06.012 DEBUG:teuthology.orchestra.run.trial044:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2026-02-24T19:16:06.075 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:06.075 INFO:tasks.ceph:role: osd.5 2026-02-24T19:16:06.075 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial044.front.sepia.ceph.com 2026-02-24T19:16:06.075 DEBUG:teuthology.orchestra.run.trial044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-24T19:16:06.139 INFO:teuthology.orchestra.run.trial044.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:06.139 INFO:teuthology.orchestra.run.trial044.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:06.140 INFO:teuthology.orchestra.run.trial044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:06.140 INFO:teuthology.orchestra.run.trial044.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:06.140 INFO:teuthology.orchestra.run.trial044.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:06.140 INFO:teuthology.orchestra.run.trial044.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:06.140 INFO:teuthology.orchestra.run.trial044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:06.140 INFO:teuthology.orchestra.run.trial044.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:06.140 INFO:teuthology.orchestra.run.trial044.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:06.140 INFO:teuthology.orchestra.run.trial044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:06.696 INFO:teuthology.orchestra.run.trial044.stdout:Discarding blocks...Done. 2026-02-24T19:16:06.698 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial044.front.sepia.ceph.com -o noatime 2026-02-24T19:16:06.698 DEBUG:teuthology.orchestra.run.trial044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2026-02-24T19:16:06.767 DEBUG:teuthology.orchestra.run.trial044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2026-02-24T19:16:06.834 DEBUG:teuthology.orchestra.run.trial044:> sudo mkdir -p /var/lib/ceph/osd/ceph-9 2026-02-24T19:16:06.898 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:06.899 INFO:tasks.ceph:role: osd.9 2026-02-24T19:16:06.899 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial044.front.sepia.ceph.com 2026-02-24T19:16:06.899 DEBUG:teuthology.orchestra.run.trial044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-24T19:16:06.963 INFO:teuthology.orchestra.run.trial044.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:06.964 INFO:teuthology.orchestra.run.trial044.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:06.964 INFO:teuthology.orchestra.run.trial044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:06.964 INFO:teuthology.orchestra.run.trial044.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:06.964 INFO:teuthology.orchestra.run.trial044.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:06.964 INFO:teuthology.orchestra.run.trial044.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:06.964 INFO:teuthology.orchestra.run.trial044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:06.964 INFO:teuthology.orchestra.run.trial044.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:06.964 INFO:teuthology.orchestra.run.trial044.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:06.964 INFO:teuthology.orchestra.run.trial044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:07.524 INFO:teuthology.orchestra.run.trial044.stdout:Discarding blocks...Done. 2026-02-24T19:16:07.526 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial044.front.sepia.ceph.com -o noatime 2026-02-24T19:16:07.527 DEBUG:teuthology.orchestra.run.trial044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-9 2026-02-24T19:16:07.594 DEBUG:teuthology.orchestra.run.trial044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-9 2026-02-24T19:16:07.659 DEBUG:teuthology.orchestra.run.trial044:> sudo mkdir -p /var/lib/ceph/osd/ceph-13 2026-02-24T19:16:07.724 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:07.724 INFO:tasks.ceph:role: osd.13 2026-02-24T19:16:07.724 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial044.front.sepia.ceph.com 2026-02-24T19:16:07.724 DEBUG:teuthology.orchestra.run.trial044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-24T19:16:07.788 INFO:teuthology.orchestra.run.trial044.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:07.788 INFO:teuthology.orchestra.run.trial044.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:07.788 INFO:teuthology.orchestra.run.trial044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:07.789 INFO:teuthology.orchestra.run.trial044.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:07.789 INFO:teuthology.orchestra.run.trial044.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:07.789 INFO:teuthology.orchestra.run.trial044.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:07.789 INFO:teuthology.orchestra.run.trial044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:07.789 INFO:teuthology.orchestra.run.trial044.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:07.789 INFO:teuthology.orchestra.run.trial044.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:07.789 INFO:teuthology.orchestra.run.trial044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:08.345 INFO:teuthology.orchestra.run.trial044.stdout:Discarding blocks...Done. 2026-02-24T19:16:08.347 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial044.front.sepia.ceph.com -o noatime 2026-02-24T19:16:08.347 DEBUG:teuthology.orchestra.run.trial044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-13 2026-02-24T19:16:08.425 DEBUG:teuthology.orchestra.run.trial044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-13 2026-02-24T19:16:08.493 DEBUG:teuthology.orchestra.run.trial044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:08.573 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-24T19:16:08.570+0000 7f3f46e6b900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-24T19:16:08.573 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-24T19:16:08.570+0000 7f3f46e6b900 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-24T19:16:08.573 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-24T19:16:08.570+0000 7f3f46e6b900 -1 bdev(0x562af143b800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:08.574 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-24T19:16:08.570+0000 7f3f46e6b900 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-24T19:16:09.058 DEBUG:teuthology.orchestra.run.trial044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-24T19:16:09.123 DEBUG:teuthology.orchestra.run.trial044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:09.200 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-24T19:16:09.197+0000 7f82d4015900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2026-02-24T19:16:09.201 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-24T19:16:09.198+0000 7f82d4015900 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2026-02-24T19:16:09.201 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-24T19:16:09.198+0000 7f82d4015900 -1 bdev(0x55eebc3f1800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:09.201 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-24T19:16:09.198+0000 7f82d4015900 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2026-02-24T19:16:09.670 DEBUG:teuthology.orchestra.run.trial044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2026-02-24T19:16:09.735 DEBUG:teuthology.orchestra.run.trial044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 9 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:09.812 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-24T19:16:09.810+0000 7fe19ae5d900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-9/keyring: can't open /var/lib/ceph/osd/ceph-9/keyring: (2) No such file or directory 2026-02-24T19:16:09.813 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-24T19:16:09.810+0000 7fe19ae5d900 -1 created new key in keyring /var/lib/ceph/osd/ceph-9/keyring 2026-02-24T19:16:09.813 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-24T19:16:09.810+0000 7fe19ae5d900 -1 bdev(0x55760be11800 /var/lib/ceph/osd/ceph-9/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:09.813 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-24T19:16:09.810+0000 7fe19ae5d900 -1 bluestore(/var/lib/ceph/osd/ceph-9) _read_fsid unparsable uuid 2026-02-24T19:16:10.305 DEBUG:teuthology.orchestra.run.trial044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2026-02-24T19:16:10.370 DEBUG:teuthology.orchestra.run.trial044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 13 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:10.447 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-24T19:16:10.446+0000 7faf69e7a900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-13/keyring: can't open /var/lib/ceph/osd/ceph-13/keyring: (2) No such file or directory 2026-02-24T19:16:10.448 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-24T19:16:10.446+0000 7faf69e7a900 -1 created new key in keyring /var/lib/ceph/osd/ceph-13/keyring 2026-02-24T19:16:10.448 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-24T19:16:10.446+0000 7faf69e7a900 -1 bdev(0x5581c9151800 /var/lib/ceph/osd/ceph-13/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:10.448 INFO:teuthology.orchestra.run.trial044.stderr:2026-02-24T19:16:10.446+0000 7faf69e7a900 -1 bluestore(/var/lib/ceph/osd/ceph-13) _read_fsid unparsable uuid 2026-02-24T19:16:10.938 DEBUG:teuthology.orchestra.run.trial044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-13 2026-02-24T19:16:11.003 DEBUG:teuthology.orchestra.run.trial170:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-24T19:16:11.029 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:11.029 INFO:tasks.ceph:role: osd.2 2026-02-24T19:16:11.029 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial170.front.sepia.ceph.com 2026-02-24T19:16:11.029 DEBUG:teuthology.orchestra.run.trial170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-24T19:16:11.094 INFO:teuthology.orchestra.run.trial170.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:11.094 INFO:teuthology.orchestra.run.trial170.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:11.094 INFO:teuthology.orchestra.run.trial170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:11.094 INFO:teuthology.orchestra.run.trial170.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:11.094 INFO:teuthology.orchestra.run.trial170.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:11.095 INFO:teuthology.orchestra.run.trial170.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:11.095 INFO:teuthology.orchestra.run.trial170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:11.095 INFO:teuthology.orchestra.run.trial170.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:11.095 INFO:teuthology.orchestra.run.trial170.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:11.095 INFO:teuthology.orchestra.run.trial170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:11.672 INFO:teuthology.orchestra.run.trial170.stdout:Discarding blocks...Done. 2026-02-24T19:16:11.674 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial170.front.sepia.ceph.com -o noatime 2026-02-24T19:16:11.674 DEBUG:teuthology.orchestra.run.trial170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2026-02-24T19:16:11.743 DEBUG:teuthology.orchestra.run.trial170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-24T19:16:11.811 DEBUG:teuthology.orchestra.run.trial170:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2026-02-24T19:16:11.874 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:11.874 INFO:tasks.ceph:role: osd.6 2026-02-24T19:16:11.875 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial170.front.sepia.ceph.com 2026-02-24T19:16:11.875 DEBUG:teuthology.orchestra.run.trial170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-24T19:16:11.939 INFO:teuthology.orchestra.run.trial170.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:11.939 INFO:teuthology.orchestra.run.trial170.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:11.940 INFO:teuthology.orchestra.run.trial170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:11.940 INFO:teuthology.orchestra.run.trial170.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:11.940 INFO:teuthology.orchestra.run.trial170.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:11.940 INFO:teuthology.orchestra.run.trial170.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:11.940 INFO:teuthology.orchestra.run.trial170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:11.940 INFO:teuthology.orchestra.run.trial170.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:11.940 INFO:teuthology.orchestra.run.trial170.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:11.940 INFO:teuthology.orchestra.run.trial170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:12.498 INFO:teuthology.orchestra.run.trial170.stdout:Discarding blocks...Done. 2026-02-24T19:16:12.501 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial170.front.sepia.ceph.com -o noatime 2026-02-24T19:16:12.501 DEBUG:teuthology.orchestra.run.trial170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2026-02-24T19:16:12.569 DEBUG:teuthology.orchestra.run.trial170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2026-02-24T19:16:12.635 DEBUG:teuthology.orchestra.run.trial170:> sudo mkdir -p /var/lib/ceph/osd/ceph-10 2026-02-24T19:16:12.698 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:12.698 INFO:tasks.ceph:role: osd.10 2026-02-24T19:16:12.699 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial170.front.sepia.ceph.com 2026-02-24T19:16:12.699 DEBUG:teuthology.orchestra.run.trial170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-24T19:16:12.763 INFO:teuthology.orchestra.run.trial170.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:12.763 INFO:teuthology.orchestra.run.trial170.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:12.763 INFO:teuthology.orchestra.run.trial170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:12.763 INFO:teuthology.orchestra.run.trial170.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:12.763 INFO:teuthology.orchestra.run.trial170.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:12.763 INFO:teuthology.orchestra.run.trial170.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:12.763 INFO:teuthology.orchestra.run.trial170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:12.764 INFO:teuthology.orchestra.run.trial170.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:12.764 INFO:teuthology.orchestra.run.trial170.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:12.764 INFO:teuthology.orchestra.run.trial170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:13.321 INFO:teuthology.orchestra.run.trial170.stdout:Discarding blocks...Done. 2026-02-24T19:16:13.323 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial170.front.sepia.ceph.com -o noatime 2026-02-24T19:16:13.324 DEBUG:teuthology.orchestra.run.trial170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-10 2026-02-24T19:16:13.390 DEBUG:teuthology.orchestra.run.trial170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-10 2026-02-24T19:16:13.458 DEBUG:teuthology.orchestra.run.trial170:> sudo mkdir -p /var/lib/ceph/osd/ceph-14 2026-02-24T19:16:13.521 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:13.521 INFO:tasks.ceph:role: osd.14 2026-02-24T19:16:13.521 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial170.front.sepia.ceph.com 2026-02-24T19:16:13.522 DEBUG:teuthology.orchestra.run.trial170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-24T19:16:13.586 INFO:teuthology.orchestra.run.trial170.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:13.586 INFO:teuthology.orchestra.run.trial170.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:13.586 INFO:teuthology.orchestra.run.trial170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:13.586 INFO:teuthology.orchestra.run.trial170.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:13.586 INFO:teuthology.orchestra.run.trial170.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:13.586 INFO:teuthology.orchestra.run.trial170.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:13.586 INFO:teuthology.orchestra.run.trial170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:13.586 INFO:teuthology.orchestra.run.trial170.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:13.586 INFO:teuthology.orchestra.run.trial170.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:13.587 INFO:teuthology.orchestra.run.trial170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:14.143 INFO:teuthology.orchestra.run.trial170.stdout:Discarding blocks...Done. 2026-02-24T19:16:14.145 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial170.front.sepia.ceph.com -o noatime 2026-02-24T19:16:14.145 DEBUG:teuthology.orchestra.run.trial170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-14 2026-02-24T19:16:14.222 DEBUG:teuthology.orchestra.run.trial170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-14 2026-02-24T19:16:14.289 DEBUG:teuthology.orchestra.run.trial170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:14.368 INFO:teuthology.orchestra.run.trial170.stderr:2026-02-24T19:16:14.367+0000 7f2db1573900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-24T19:16:14.369 INFO:teuthology.orchestra.run.trial170.stderr:2026-02-24T19:16:14.367+0000 7f2db1573900 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-24T19:16:14.369 INFO:teuthology.orchestra.run.trial170.stderr:2026-02-24T19:16:14.367+0000 7f2db1573900 -1 bdev(0x55a024451800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:14.369 INFO:teuthology.orchestra.run.trial170.stderr:2026-02-24T19:16:14.367+0000 7f2db1573900 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-24T19:16:14.861 DEBUG:teuthology.orchestra.run.trial170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-24T19:16:14.927 DEBUG:teuthology.orchestra.run.trial170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:15.006 INFO:teuthology.orchestra.run.trial170.stderr:2026-02-24T19:16:15.004+0000 7fbe2244d900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2026-02-24T19:16:15.006 INFO:teuthology.orchestra.run.trial170.stderr:2026-02-24T19:16:15.004+0000 7fbe2244d900 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2026-02-24T19:16:15.006 INFO:teuthology.orchestra.run.trial170.stderr:2026-02-24T19:16:15.004+0000 7fbe2244d900 -1 bdev(0x563efa809800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:15.007 INFO:teuthology.orchestra.run.trial170.stderr:2026-02-24T19:16:15.004+0000 7fbe2244d900 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2026-02-24T19:16:15.492 DEBUG:teuthology.orchestra.run.trial170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2026-02-24T19:16:15.557 DEBUG:teuthology.orchestra.run.trial170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 10 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:15.636 INFO:teuthology.orchestra.run.trial170.stderr:2026-02-24T19:16:15.634+0000 7f35d03c1900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-10/keyring: can't open /var/lib/ceph/osd/ceph-10/keyring: (2) No such file or directory 2026-02-24T19:16:15.636 INFO:teuthology.orchestra.run.trial170.stderr:2026-02-24T19:16:15.634+0000 7f35d03c1900 -1 created new key in keyring /var/lib/ceph/osd/ceph-10/keyring 2026-02-24T19:16:15.636 INFO:teuthology.orchestra.run.trial170.stderr:2026-02-24T19:16:15.634+0000 7f35d03c1900 -1 bdev(0x55904ced1800 /var/lib/ceph/osd/ceph-10/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:15.636 INFO:teuthology.orchestra.run.trial170.stderr:2026-02-24T19:16:15.634+0000 7f35d03c1900 -1 bluestore(/var/lib/ceph/osd/ceph-10) _read_fsid unparsable uuid 2026-02-24T19:16:16.107 DEBUG:teuthology.orchestra.run.trial170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-10 2026-02-24T19:16:16.172 DEBUG:teuthology.orchestra.run.trial170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 14 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:16.249 INFO:teuthology.orchestra.run.trial170.stderr:2026-02-24T19:16:16.247+0000 7f1913d6e900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-14/keyring: can't open /var/lib/ceph/osd/ceph-14/keyring: (2) No such file or directory 2026-02-24T19:16:16.250 INFO:teuthology.orchestra.run.trial170.stderr:2026-02-24T19:16:16.248+0000 7f1913d6e900 -1 created new key in keyring /var/lib/ceph/osd/ceph-14/keyring 2026-02-24T19:16:16.250 INFO:teuthology.orchestra.run.trial170.stderr:2026-02-24T19:16:16.248+0000 7f1913d6e900 -1 bdev(0x5651e1ac5800 /var/lib/ceph/osd/ceph-14/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:16.250 INFO:teuthology.orchestra.run.trial170.stderr:2026-02-24T19:16:16.248+0000 7f1913d6e900 -1 bluestore(/var/lib/ceph/osd/ceph-14) _read_fsid unparsable uuid 2026-02-24T19:16:16.711 DEBUG:teuthology.orchestra.run.trial170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-14 2026-02-24T19:16:16.776 DEBUG:teuthology.orchestra.run.trial195:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-24T19:16:16.802 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:16.802 INFO:tasks.ceph:role: osd.3 2026-02-24T19:16:16.802 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial195.front.sepia.ceph.com 2026-02-24T19:16:16.802 DEBUG:teuthology.orchestra.run.trial195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-24T19:16:16.867 INFO:teuthology.orchestra.run.trial195.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:16.867 INFO:teuthology.orchestra.run.trial195.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:16.867 INFO:teuthology.orchestra.run.trial195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:16.867 INFO:teuthology.orchestra.run.trial195.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:16.867 INFO:teuthology.orchestra.run.trial195.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:16.867 INFO:teuthology.orchestra.run.trial195.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:16.867 INFO:teuthology.orchestra.run.trial195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:16.867 INFO:teuthology.orchestra.run.trial195.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:16.867 INFO:teuthology.orchestra.run.trial195.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:16.868 INFO:teuthology.orchestra.run.trial195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:17.442 INFO:teuthology.orchestra.run.trial195.stdout:Discarding blocks...Done. 2026-02-24T19:16:17.444 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial195.front.sepia.ceph.com -o noatime 2026-02-24T19:16:17.444 DEBUG:teuthology.orchestra.run.trial195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2026-02-24T19:16:17.514 DEBUG:teuthology.orchestra.run.trial195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-24T19:16:17.581 DEBUG:teuthology.orchestra.run.trial195:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2026-02-24T19:16:17.645 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:17.646 INFO:tasks.ceph:role: osd.7 2026-02-24T19:16:17.646 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial195.front.sepia.ceph.com 2026-02-24T19:16:17.646 DEBUG:teuthology.orchestra.run.trial195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-24T19:16:17.710 INFO:teuthology.orchestra.run.trial195.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:17.710 INFO:teuthology.orchestra.run.trial195.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:17.710 INFO:teuthology.orchestra.run.trial195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:17.710 INFO:teuthology.orchestra.run.trial195.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:17.710 INFO:teuthology.orchestra.run.trial195.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:17.710 INFO:teuthology.orchestra.run.trial195.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:17.711 INFO:teuthology.orchestra.run.trial195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:17.711 INFO:teuthology.orchestra.run.trial195.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:17.711 INFO:teuthology.orchestra.run.trial195.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:17.711 INFO:teuthology.orchestra.run.trial195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:18.279 INFO:teuthology.orchestra.run.trial195.stdout:Discarding blocks...Done. 2026-02-24T19:16:18.281 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial195.front.sepia.ceph.com -o noatime 2026-02-24T19:16:18.282 DEBUG:teuthology.orchestra.run.trial195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-7 2026-02-24T19:16:18.349 DEBUG:teuthology.orchestra.run.trial195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2026-02-24T19:16:18.416 DEBUG:teuthology.orchestra.run.trial195:> sudo mkdir -p /var/lib/ceph/osd/ceph-11 2026-02-24T19:16:18.478 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:18.479 INFO:tasks.ceph:role: osd.11 2026-02-24T19:16:18.479 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial195.front.sepia.ceph.com 2026-02-24T19:16:18.479 DEBUG:teuthology.orchestra.run.trial195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-24T19:16:18.542 INFO:teuthology.orchestra.run.trial195.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:18.543 INFO:teuthology.orchestra.run.trial195.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:18.543 INFO:teuthology.orchestra.run.trial195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:18.543 INFO:teuthology.orchestra.run.trial195.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:18.543 INFO:teuthology.orchestra.run.trial195.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:18.543 INFO:teuthology.orchestra.run.trial195.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:18.543 INFO:teuthology.orchestra.run.trial195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:18.543 INFO:teuthology.orchestra.run.trial195.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:18.543 INFO:teuthology.orchestra.run.trial195.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:18.543 INFO:teuthology.orchestra.run.trial195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:19.103 INFO:teuthology.orchestra.run.trial195.stdout:Discarding blocks...Done. 2026-02-24T19:16:19.105 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial195.front.sepia.ceph.com -o noatime 2026-02-24T19:16:19.105 DEBUG:teuthology.orchestra.run.trial195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-11 2026-02-24T19:16:19.172 DEBUG:teuthology.orchestra.run.trial195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-11 2026-02-24T19:16:19.239 DEBUG:teuthology.orchestra.run.trial195:> sudo mkdir -p /var/lib/ceph/osd/ceph-15 2026-02-24T19:16:19.302 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:19.302 INFO:tasks.ceph:role: osd.15 2026-02-24T19:16:19.302 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial195.front.sepia.ceph.com 2026-02-24T19:16:19.302 DEBUG:teuthology.orchestra.run.trial195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-24T19:16:19.367 INFO:teuthology.orchestra.run.trial195.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:19.367 INFO:teuthology.orchestra.run.trial195.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:19.367 INFO:teuthology.orchestra.run.trial195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:19.367 INFO:teuthology.orchestra.run.trial195.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:19.367 INFO:teuthology.orchestra.run.trial195.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:19.367 INFO:teuthology.orchestra.run.trial195.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:19.368 INFO:teuthology.orchestra.run.trial195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:19.368 INFO:teuthology.orchestra.run.trial195.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:19.368 INFO:teuthology.orchestra.run.trial195.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:19.368 INFO:teuthology.orchestra.run.trial195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:19.925 INFO:teuthology.orchestra.run.trial195.stdout:Discarding blocks...Done. 2026-02-24T19:16:19.927 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial195.front.sepia.ceph.com -o noatime 2026-02-24T19:16:19.927 DEBUG:teuthology.orchestra.run.trial195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-15 2026-02-24T19:16:20.003 DEBUG:teuthology.orchestra.run.trial195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-15 2026-02-24T19:16:20.069 DEBUG:teuthology.orchestra.run.trial195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:20.148 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:20.146+0000 7f03d8db0900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-24T19:16:20.149 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:20.146+0000 7f03d8db0900 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-24T19:16:20.149 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:20.146+0000 7f03d8db0900 -1 bdev(0x5599aabf9800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:20.149 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:20.146+0000 7f03d8db0900 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-24T19:16:20.638 DEBUG:teuthology.orchestra.run.trial195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-24T19:16:20.703 DEBUG:teuthology.orchestra.run.trial195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:20.782 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:20.780+0000 7ffbdca0c900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2026-02-24T19:16:20.783 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:20.780+0000 7ffbdca0c900 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2026-02-24T19:16:20.783 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:20.780+0000 7ffbdca0c900 -1 bdev(0x55e4fe427800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:20.783 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:20.780+0000 7ffbdca0c900 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2026-02-24T19:16:21.282 DEBUG:teuthology.orchestra.run.trial195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2026-02-24T19:16:21.347 DEBUG:teuthology.orchestra.run.trial195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 11 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:21.426 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:21.424+0000 7f413da0c900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-11/keyring: can't open /var/lib/ceph/osd/ceph-11/keyring: (2) No such file or directory 2026-02-24T19:16:21.427 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:21.424+0000 7f413da0c900 -1 created new key in keyring /var/lib/ceph/osd/ceph-11/keyring 2026-02-24T19:16:21.427 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:21.424+0000 7f413da0c900 -1 bdev(0x55bc12e87800 /var/lib/ceph/osd/ceph-11/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:21.427 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:21.424+0000 7f413da0c900 -1 bluestore(/var/lib/ceph/osd/ceph-11) _read_fsid unparsable uuid 2026-02-24T19:16:21.900 DEBUG:teuthology.orchestra.run.trial195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-11 2026-02-24T19:16:21.965 DEBUG:teuthology.orchestra.run.trial195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 15 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:22.043 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:22.041+0000 7f96b1156900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-15/keyring: can't open /var/lib/ceph/osd/ceph-15/keyring: (2) No such file or directory 2026-02-24T19:16:22.044 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:22.041+0000 7f96b1156900 -1 created new key in keyring /var/lib/ceph/osd/ceph-15/keyring 2026-02-24T19:16:22.044 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:22.042+0000 7f96b1156900 -1 bdev(0x55693b3e9800 /var/lib/ceph/osd/ceph-15/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:22.044 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:22.042+0000 7f96b1156900 -1 bluestore(/var/lib/ceph/osd/ceph-15) _read_fsid unparsable uuid 2026-02-24T19:16:22.511 DEBUG:teuthology.orchestra.run.trial195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-15 2026-02-24T19:16:22.577 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-24T19:16:22.577 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-24T19:16:22.577 DEBUG:teuthology.orchestra.run.trial014:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2026-02-24T19:16:22.602 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-24T19:16:22.602 DEBUG:teuthology.orchestra.run.trial014:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-24T19:16:22.666 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-24T19:16:22.666 DEBUG:teuthology.orchestra.run.trial014:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2026-02-24T19:16:22.730 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-24T19:16:22.730 DEBUG:teuthology.orchestra.run.trial014:> sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2026-02-24T19:16:22.794 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-24T19:16:22.794 DEBUG:teuthology.orchestra.run.trial014:> sudo dd if=/var/lib/ceph/osd/ceph-12/keyring of=/dev/stdout 2026-02-24T19:16:22.858 DEBUG:teuthology.orchestra.run.trial044:> set -ex 2026-02-24T19:16:22.859 DEBUG:teuthology.orchestra.run.trial044:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-24T19:16:22.884 DEBUG:teuthology.orchestra.run.trial044:> set -ex 2026-02-24T19:16:22.884 DEBUG:teuthology.orchestra.run.trial044:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2026-02-24T19:16:22.947 DEBUG:teuthology.orchestra.run.trial044:> set -ex 2026-02-24T19:16:22.947 DEBUG:teuthology.orchestra.run.trial044:> sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2026-02-24T19:16:23.011 DEBUG:teuthology.orchestra.run.trial044:> set -ex 2026-02-24T19:16:23.011 DEBUG:teuthology.orchestra.run.trial044:> sudo dd if=/var/lib/ceph/osd/ceph-13/keyring of=/dev/stdout 2026-02-24T19:16:23.075 DEBUG:teuthology.orchestra.run.trial170:> set -ex 2026-02-24T19:16:23.075 DEBUG:teuthology.orchestra.run.trial170:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-24T19:16:23.101 DEBUG:teuthology.orchestra.run.trial170:> set -ex 2026-02-24T19:16:23.102 DEBUG:teuthology.orchestra.run.trial170:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2026-02-24T19:16:23.166 DEBUG:teuthology.orchestra.run.trial170:> set -ex 2026-02-24T19:16:23.166 DEBUG:teuthology.orchestra.run.trial170:> sudo dd if=/var/lib/ceph/osd/ceph-10/keyring of=/dev/stdout 2026-02-24T19:16:23.230 DEBUG:teuthology.orchestra.run.trial170:> set -ex 2026-02-24T19:16:23.230 DEBUG:teuthology.orchestra.run.trial170:> sudo dd if=/var/lib/ceph/osd/ceph-14/keyring of=/dev/stdout 2026-02-24T19:16:23.293 DEBUG:teuthology.orchestra.run.trial195:> set -ex 2026-02-24T19:16:23.293 DEBUG:teuthology.orchestra.run.trial195:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-24T19:16:23.319 DEBUG:teuthology.orchestra.run.trial195:> set -ex 2026-02-24T19:16:23.320 DEBUG:teuthology.orchestra.run.trial195:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-24T19:16:23.384 DEBUG:teuthology.orchestra.run.trial195:> set -ex 2026-02-24T19:16:23.384 DEBUG:teuthology.orchestra.run.trial195:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2026-02-24T19:16:23.448 DEBUG:teuthology.orchestra.run.trial195:> set -ex 2026-02-24T19:16:23.448 DEBUG:teuthology.orchestra.run.trial195:> sudo dd if=/var/lib/ceph/osd/ceph-11/keyring of=/dev/stdout 2026-02-24T19:16:23.513 DEBUG:teuthology.orchestra.run.trial195:> set -ex 2026-02-24T19:16:23.513 DEBUG:teuthology.orchestra.run.trial195:> sudo dd if=/var/lib/ceph/osd/ceph-15/keyring of=/dev/stdout 2026-02-24T19:16:23.578 DEBUG:teuthology.orchestra.run.trial195:> set -ex 2026-02-24T19:16:23.578 DEBUG:teuthology.orchestra.run.trial195:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-24T19:16:23.635 INFO:tasks.ceph:Adding keys to all mons... 2026-02-24T19:16:23.635 DEBUG:teuthology.orchestra.run.trial014:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-24T19:16:23.637 DEBUG:teuthology.orchestra.run.trial044:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-24T19:16:23.640 DEBUG:teuthology.orchestra.run.trial170:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-24T19:16:23.659 INFO:teuthology.orchestra.run.trial014.stdout:[mgr.y] 2026-02-24T19:16:23.659 INFO:teuthology.orchestra.run.trial014.stdout: key = AQDv+J1pj/DhDxAA7R9nA6iZYiLZG89XeZmvEQ== 2026-02-24T19:16:23.660 INFO:teuthology.orchestra.run.trial014.stdout:[osd.0] 2026-02-24T19:16:23.660 INFO:teuthology.orchestra.run.trial014.stdout: key = AQDy+J1pdctgKxAA/bmR7IYZjS8ZADL27VeSKQ== 2026-02-24T19:16:23.660 INFO:teuthology.orchestra.run.trial014.stdout:[osd.4] 2026-02-24T19:16:23.660 INFO:teuthology.orchestra.run.trial014.stdout: key = AQDz+J1pbRYxFhAAUrx3BWe5bDZ56urhNCJcjQ== 2026-02-24T19:16:23.660 INFO:teuthology.orchestra.run.trial014.stdout:[osd.8] 2026-02-24T19:16:23.660 INFO:teuthology.orchestra.run.trial014.stdout: key = AQD0+J1p6rwUABAAfgrI7cm7gqZ1Pe/OJnMXyg== 2026-02-24T19:16:23.660 INFO:teuthology.orchestra.run.trial014.stdout:[osd.12] 2026-02-24T19:16:23.660 INFO:teuthology.orchestra.run.trial014.stdout: key = AQD0+J1pwiHrJhAAy1kYFozW24TCOv7l4m27yg== 2026-02-24T19:16:23.660 INFO:teuthology.orchestra.run.trial014.stdout:[osd.1] 2026-02-24T19:16:23.660 INFO:teuthology.orchestra.run.trial014.stdout: key = AQD4+J1pHv0WIhAASkWzp5Ai4wj5zyqaxp/2Lw== 2026-02-24T19:16:23.660 INFO:teuthology.orchestra.run.trial014.stdout:[osd.5] 2026-02-24T19:16:23.661 INFO:teuthology.orchestra.run.trial014.stdout: key = AQD5+J1pYuvhCxAATsLqO/mjy5MzN7uNNTE1zg== 2026-02-24T19:16:23.661 INFO:teuthology.orchestra.run.trial014.stdout:[osd.9] 2026-02-24T19:16:23.661 INFO:teuthology.orchestra.run.trial014.stdout: key = AQD5+J1pXyNiMBAA8lees15waBqiOtjeqT0sWw== 2026-02-24T19:16:23.661 INFO:teuthology.orchestra.run.trial014.stdout:[osd.13] 2026-02-24T19:16:23.661 INFO:teuthology.orchestra.run.trial014.stdout: key = AQD6+J1peeaeGhAA4NR9bb3ezNoFlsh/VmLHPQ== 2026-02-24T19:16:23.661 INFO:teuthology.orchestra.run.trial014.stdout:[osd.2] 2026-02-24T19:16:23.661 INFO:teuthology.orchestra.run.trial014.stdout: key = AQD++J1pBnz5FRAA0ZKsYuG0AIdoJtWld8xqMg== 2026-02-24T19:16:23.661 INFO:teuthology.orchestra.run.trial014.stdout:[osd.6] 2026-02-24T19:16:23.661 INFO:teuthology.orchestra.run.trial014.stdout: key = AQD/+J1puuNZABAAU6Yw+dUwv/lGNWAvxDareQ== 2026-02-24T19:16:23.661 INFO:teuthology.orchestra.run.trial014.stdout:[osd.10] 2026-02-24T19:16:23.661 INFO:teuthology.orchestra.run.trial014.stdout: key = AQD/+J1pSd3hJRAApRh9NsSmw9WnVHBEfCt/Bg== 2026-02-24T19:16:23.661 INFO:teuthology.orchestra.run.trial014.stdout:[osd.14] 2026-02-24T19:16:23.662 INFO:teuthology.orchestra.run.trial014.stdout: key = AQAA+Z1pSQDfDhAAEBxIpWa++7WggyJTt9hcFg== 2026-02-24T19:16:23.662 INFO:teuthology.orchestra.run.trial014.stdout:[mgr.x] 2026-02-24T19:16:23.662 INFO:teuthology.orchestra.run.trial014.stdout: key = AQDv+J1pAzysEhAAB12JbGowoqgqY+8hK3HC8g== 2026-02-24T19:16:23.662 INFO:teuthology.orchestra.run.trial014.stdout:[osd.3] 2026-02-24T19:16:23.662 INFO:teuthology.orchestra.run.trial014.stdout: key = AQAE+Z1po/vPCBAA/MpvFTKbvfauJT9Sz3noEg== 2026-02-24T19:16:23.662 INFO:teuthology.orchestra.run.trial014.stdout:[osd.7] 2026-02-24T19:16:23.662 INFO:teuthology.orchestra.run.trial014.stdout: key = AQAE+Z1pEjmYLhAAQXYqsDDh7Cc+vWogWTsQEA== 2026-02-24T19:16:23.662 INFO:teuthology.orchestra.run.trial014.stdout:[osd.11] 2026-02-24T19:16:23.662 INFO:teuthology.orchestra.run.trial014.stdout: key = AQAF+Z1ppktlGRAAr/v8aUu4nSnmzpyfU9ZAmg== 2026-02-24T19:16:23.662 INFO:teuthology.orchestra.run.trial014.stdout:[osd.15] 2026-02-24T19:16:23.662 INFO:teuthology.orchestra.run.trial014.stdout: key = AQAG+Z1prAqVAhAAVjEHLbKtTim9lkL2srdQZw== 2026-02-24T19:16:23.662 INFO:teuthology.orchestra.run.trial014.stdout:[client.0] 2026-02-24T19:16:23.663 INFO:teuthology.orchestra.run.trial014.stdout: key = AQDv+J1pAb7qFBAAQZ1lhRLj0bDkWzcilkKCjw== 2026-02-24T19:16:23.664 INFO:teuthology.orchestra.run.trial044.stdout:[mgr.y] 2026-02-24T19:16:23.664 INFO:teuthology.orchestra.run.trial044.stdout: key = AQDv+J1pj/DhDxAA7R9nA6iZYiLZG89XeZmvEQ== 2026-02-24T19:16:23.664 INFO:teuthology.orchestra.run.trial044.stdout:[osd.0] 2026-02-24T19:16:23.665 INFO:teuthology.orchestra.run.trial044.stdout: key = AQDy+J1pdctgKxAA/bmR7IYZjS8ZADL27VeSKQ== 2026-02-24T19:16:23.665 INFO:teuthology.orchestra.run.trial044.stdout:[osd.4] 2026-02-24T19:16:23.665 INFO:teuthology.orchestra.run.trial044.stdout: key = AQDz+J1pbRYxFhAAUrx3BWe5bDZ56urhNCJcjQ== 2026-02-24T19:16:23.665 INFO:teuthology.orchestra.run.trial044.stdout:[osd.8] 2026-02-24T19:16:23.665 INFO:teuthology.orchestra.run.trial044.stdout: key = AQD0+J1p6rwUABAAfgrI7cm7gqZ1Pe/OJnMXyg== 2026-02-24T19:16:23.665 INFO:teuthology.orchestra.run.trial044.stdout:[osd.12] 2026-02-24T19:16:23.665 INFO:teuthology.orchestra.run.trial044.stdout: key = AQD0+J1pwiHrJhAAy1kYFozW24TCOv7l4m27yg== 2026-02-24T19:16:23.665 INFO:teuthology.orchestra.run.trial044.stdout:[osd.1] 2026-02-24T19:16:23.665 INFO:teuthology.orchestra.run.trial044.stdout: key = AQD4+J1pHv0WIhAASkWzp5Ai4wj5zyqaxp/2Lw== 2026-02-24T19:16:23.665 INFO:teuthology.orchestra.run.trial044.stdout:[osd.5] 2026-02-24T19:16:23.665 INFO:teuthology.orchestra.run.trial044.stdout: key = AQD5+J1pYuvhCxAATsLqO/mjy5MzN7uNNTE1zg== 2026-02-24T19:16:23.666 INFO:teuthology.orchestra.run.trial044.stdout:[osd.9] 2026-02-24T19:16:23.666 INFO:teuthology.orchestra.run.trial044.stdout: key = AQD5+J1pXyNiMBAA8lees15waBqiOtjeqT0sWw== 2026-02-24T19:16:23.666 INFO:teuthology.orchestra.run.trial044.stdout:[osd.13] 2026-02-24T19:16:23.666 INFO:teuthology.orchestra.run.trial044.stdout: key = AQD6+J1peeaeGhAA4NR9bb3ezNoFlsh/VmLHPQ== 2026-02-24T19:16:23.666 INFO:teuthology.orchestra.run.trial044.stdout:[osd.2] 2026-02-24T19:16:23.666 INFO:teuthology.orchestra.run.trial044.stdout: key = AQD++J1pBnz5FRAA0ZKsYuG0AIdoJtWld8xqMg== 2026-02-24T19:16:23.666 INFO:teuthology.orchestra.run.trial044.stdout:[osd.6] 2026-02-24T19:16:23.666 INFO:teuthology.orchestra.run.trial044.stdout: key = AQD/+J1puuNZABAAU6Yw+dUwv/lGNWAvxDareQ== 2026-02-24T19:16:23.666 INFO:teuthology.orchestra.run.trial044.stdout:[osd.10] 2026-02-24T19:16:23.666 INFO:teuthology.orchestra.run.trial044.stdout: key = AQD/+J1pSd3hJRAApRh9NsSmw9WnVHBEfCt/Bg== 2026-02-24T19:16:23.666 INFO:teuthology.orchestra.run.trial044.stdout:[osd.14] 2026-02-24T19:16:23.666 INFO:teuthology.orchestra.run.trial044.stdout: key = AQAA+Z1pSQDfDhAAEBxIpWa++7WggyJTt9hcFg== 2026-02-24T19:16:23.667 INFO:teuthology.orchestra.run.trial044.stdout:[mgr.x] 2026-02-24T19:16:23.667 INFO:teuthology.orchestra.run.trial044.stdout: key = AQDv+J1pAzysEhAAB12JbGowoqgqY+8hK3HC8g== 2026-02-24T19:16:23.667 INFO:teuthology.orchestra.run.trial044.stdout:[osd.3] 2026-02-24T19:16:23.667 INFO:teuthology.orchestra.run.trial044.stdout: key = AQAE+Z1po/vPCBAA/MpvFTKbvfauJT9Sz3noEg== 2026-02-24T19:16:23.667 INFO:teuthology.orchestra.run.trial044.stdout:[osd.7] 2026-02-24T19:16:23.667 INFO:teuthology.orchestra.run.trial044.stdout: key = AQAE+Z1pEjmYLhAAQXYqsDDh7Cc+vWogWTsQEA== 2026-02-24T19:16:23.667 INFO:teuthology.orchestra.run.trial044.stdout:[osd.11] 2026-02-24T19:16:23.667 INFO:teuthology.orchestra.run.trial044.stdout: key = AQAF+Z1ppktlGRAAr/v8aUu4nSnmzpyfU9ZAmg== 2026-02-24T19:16:23.667 INFO:teuthology.orchestra.run.trial044.stdout:[osd.15] 2026-02-24T19:16:23.667 INFO:teuthology.orchestra.run.trial044.stdout: key = AQAG+Z1prAqVAhAAVjEHLbKtTim9lkL2srdQZw== 2026-02-24T19:16:23.667 INFO:teuthology.orchestra.run.trial044.stdout:[client.0] 2026-02-24T19:16:23.667 INFO:teuthology.orchestra.run.trial044.stdout: key = AQDv+J1pAb7qFBAAQZ1lhRLj0bDkWzcilkKCjw== 2026-02-24T19:16:23.669 INFO:teuthology.orchestra.run.trial170.stdout:[mgr.y] 2026-02-24T19:16:23.669 INFO:teuthology.orchestra.run.trial170.stdout: key = AQDv+J1pj/DhDxAA7R9nA6iZYiLZG89XeZmvEQ== 2026-02-24T19:16:23.669 INFO:teuthology.orchestra.run.trial170.stdout:[osd.0] 2026-02-24T19:16:23.669 INFO:teuthology.orchestra.run.trial170.stdout: key = AQDy+J1pdctgKxAA/bmR7IYZjS8ZADL27VeSKQ== 2026-02-24T19:16:23.669 INFO:teuthology.orchestra.run.trial170.stdout:[osd.4] 2026-02-24T19:16:23.669 INFO:teuthology.orchestra.run.trial170.stdout: key = AQDz+J1pbRYxFhAAUrx3BWe5bDZ56urhNCJcjQ== 2026-02-24T19:16:23.669 INFO:teuthology.orchestra.run.trial170.stdout:[osd.8] 2026-02-24T19:16:23.669 INFO:teuthology.orchestra.run.trial170.stdout: key = AQD0+J1p6rwUABAAfgrI7cm7gqZ1Pe/OJnMXyg== 2026-02-24T19:16:23.669 INFO:teuthology.orchestra.run.trial170.stdout:[osd.12] 2026-02-24T19:16:23.669 INFO:teuthology.orchestra.run.trial170.stdout: key = AQD0+J1pwiHrJhAAy1kYFozW24TCOv7l4m27yg== 2026-02-24T19:16:23.669 INFO:teuthology.orchestra.run.trial170.stdout:[osd.1] 2026-02-24T19:16:23.670 INFO:teuthology.orchestra.run.trial170.stdout: key = AQD4+J1pHv0WIhAASkWzp5Ai4wj5zyqaxp/2Lw== 2026-02-24T19:16:23.670 INFO:teuthology.orchestra.run.trial170.stdout:[osd.5] 2026-02-24T19:16:23.670 INFO:teuthology.orchestra.run.trial170.stdout: key = AQD5+J1pYuvhCxAATsLqO/mjy5MzN7uNNTE1zg== 2026-02-24T19:16:23.670 INFO:teuthology.orchestra.run.trial170.stdout:[osd.9] 2026-02-24T19:16:23.670 INFO:teuthology.orchestra.run.trial170.stdout: key = AQD5+J1pXyNiMBAA8lees15waBqiOtjeqT0sWw== 2026-02-24T19:16:23.670 INFO:teuthology.orchestra.run.trial170.stdout:[osd.13] 2026-02-24T19:16:23.670 INFO:teuthology.orchestra.run.trial170.stdout: key = AQD6+J1peeaeGhAA4NR9bb3ezNoFlsh/VmLHPQ== 2026-02-24T19:16:23.670 INFO:teuthology.orchestra.run.trial170.stdout:[osd.2] 2026-02-24T19:16:23.670 INFO:teuthology.orchestra.run.trial170.stdout: key = AQD++J1pBnz5FRAA0ZKsYuG0AIdoJtWld8xqMg== 2026-02-24T19:16:23.670 INFO:teuthology.orchestra.run.trial170.stdout:[osd.6] 2026-02-24T19:16:23.670 INFO:teuthology.orchestra.run.trial170.stdout: key = AQD/+J1puuNZABAAU6Yw+dUwv/lGNWAvxDareQ== 2026-02-24T19:16:23.670 INFO:teuthology.orchestra.run.trial170.stdout:[osd.10] 2026-02-24T19:16:23.671 INFO:teuthology.orchestra.run.trial170.stdout: key = AQD/+J1pSd3hJRAApRh9NsSmw9WnVHBEfCt/Bg== 2026-02-24T19:16:23.671 INFO:teuthology.orchestra.run.trial170.stdout:[osd.14] 2026-02-24T19:16:23.671 INFO:teuthology.orchestra.run.trial170.stdout: key = AQAA+Z1pSQDfDhAAEBxIpWa++7WggyJTt9hcFg== 2026-02-24T19:16:23.671 INFO:teuthology.orchestra.run.trial170.stdout:[mgr.x] 2026-02-24T19:16:23.671 INFO:teuthology.orchestra.run.trial170.stdout: key = AQDv+J1pAzysEhAAB12JbGowoqgqY+8hK3HC8g== 2026-02-24T19:16:23.671 INFO:teuthology.orchestra.run.trial170.stdout:[osd.3] 2026-02-24T19:16:23.671 INFO:teuthology.orchestra.run.trial170.stdout: key = AQAE+Z1po/vPCBAA/MpvFTKbvfauJT9Sz3noEg== 2026-02-24T19:16:23.671 INFO:teuthology.orchestra.run.trial170.stdout:[osd.7] 2026-02-24T19:16:23.671 INFO:teuthology.orchestra.run.trial170.stdout: key = AQAE+Z1pEjmYLhAAQXYqsDDh7Cc+vWogWTsQEA== 2026-02-24T19:16:23.671 INFO:teuthology.orchestra.run.trial170.stdout:[osd.11] 2026-02-24T19:16:23.671 INFO:teuthology.orchestra.run.trial170.stdout: key = AQAF+Z1ppktlGRAAr/v8aUu4nSnmzpyfU9ZAmg== 2026-02-24T19:16:23.671 INFO:teuthology.orchestra.run.trial170.stdout:[osd.15] 2026-02-24T19:16:23.671 INFO:teuthology.orchestra.run.trial170.stdout: key = AQAG+Z1prAqVAhAAVjEHLbKtTim9lkL2srdQZw== 2026-02-24T19:16:23.672 INFO:teuthology.orchestra.run.trial170.stdout:[client.0] 2026-02-24T19:16:23.672 INFO:teuthology.orchestra.run.trial170.stdout: key = AQDv+J1pAb7qFBAAQZ1lhRLj0bDkWzcilkKCjw== 2026-02-24T19:16:23.672 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-24T19:16:23.706 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-24T19:16:23.709 DEBUG:teuthology.orchestra.run.trial170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-24T19:16:23.750 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:23.786 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:23.790 DEBUG:teuthology.orchestra.run.trial170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:23.830 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:23.866 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:23.870 DEBUG:teuthology.orchestra.run.trial170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:23.912 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:23.945 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:23.950 DEBUG:teuthology.orchestra.run.trial170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:23.991 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:24.026 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:24.030 DEBUG:teuthology.orchestra.run.trial170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:24.071 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:24.106 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:24.110 DEBUG:teuthology.orchestra.run.trial170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:24.150 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:24.185 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:24.190 DEBUG:teuthology.orchestra.run.trial170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:24.231 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:24.265 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:24.270 DEBUG:teuthology.orchestra.run.trial170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:24.311 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:24.344 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:24.351 DEBUG:teuthology.orchestra.run.trial170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:24.391 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:24.423 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:24.431 DEBUG:teuthology.orchestra.run.trial170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:24.470 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:24.503 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:24.510 DEBUG:teuthology.orchestra.run.trial170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:24.550 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:24.583 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:24.589 DEBUG:teuthology.orchestra.run.trial170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:24.628 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:24.663 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:24.668 DEBUG:teuthology.orchestra.run.trial170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:24.708 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-24T19:16:24.743 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-24T19:16:24.747 DEBUG:teuthology.orchestra.run.trial170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-24T19:16:24.789 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:24.823 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:24.826 DEBUG:teuthology.orchestra.run.trial170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:24.867 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:24.903 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:24.906 DEBUG:teuthology.orchestra.run.trial170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:24.947 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:24.983 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:24.986 DEBUG:teuthology.orchestra.run.trial170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:25.029 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:25.062 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:25.065 DEBUG:teuthology.orchestra.run.trial170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:25.109 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-24T19:16:25.142 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-24T19:16:25.144 DEBUG:teuthology.orchestra.run.trial170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-24T19:16:25.190 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-24T19:16:25.190 DEBUG:teuthology.orchestra.run.trial014:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-24T19:16:25.245 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-24T19:16:25.332 DEBUG:teuthology.orchestra.run.trial014:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-24T19:16:25.357 DEBUG:teuthology.orchestra.run.trial044:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2026-02-24T19:16:25.381 DEBUG:teuthology.orchestra.run.trial044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-24T19:16:25.469 DEBUG:teuthology.orchestra.run.trial044:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2026-02-24T19:16:25.493 DEBUG:teuthology.orchestra.run.trial170:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2026-02-24T19:16:25.519 DEBUG:teuthology.orchestra.run.trial170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-24T19:16:25.605 DEBUG:teuthology.orchestra.run.trial170:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2026-02-24T19:16:25.631 DEBUG:teuthology.orchestra.run.trial014:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:25.633 DEBUG:teuthology.orchestra.run.trial044:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:25.636 DEBUG:teuthology.orchestra.run.trial170:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:25.686 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-24T19:16:25.686 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2026-02-24T19:16:25.687 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-24T19:16:25.687 DEBUG:teuthology.orchestra.run.trial014:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2026-02-24T19:16:25.689 INFO:tasks.ceph.mon.a:Started 2026-02-24T19:16:25.689 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2026-02-24T19:16:25.689 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-24T19:16:25.689 DEBUG:teuthology.orchestra.run.trial044:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2026-02-24T19:16:25.692 INFO:tasks.ceph.mon.b:Started 2026-02-24T19:16:25.692 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2026-02-24T19:16:25.692 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-24T19:16:25.692 DEBUG:teuthology.orchestra.run.trial170:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2026-02-24T19:16:25.728 INFO:tasks.ceph.mon.c:Started 2026-02-24T19:16:25.728 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-24T19:16:25.728 INFO:tasks.ceph.mgr.y:Restarting daemon 2026-02-24T19:16:25.728 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2026-02-24T19:16:25.730 INFO:tasks.ceph.mgr.y:Started 2026-02-24T19:16:25.731 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-24T19:16:25.731 DEBUG:teuthology.orchestra.run.trial195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2026-02-24T19:16:25.734 INFO:tasks.ceph.mgr.x:Started 2026-02-24T19:16:25.734 DEBUG:tasks.ceph:set 0 configs 2026-02-24T19:16:25.734 DEBUG:teuthology.orchestra.run.trial014:> sudo ceph --cluster ceph config dump 2026-02-24T19:16:25.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:25.796+0000 7f70790fe640 10 monclient: get_monmap_and_config 2026-02-24T19:16:25.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:25.796+0000 7f70790fe640 10 monclient: build_initial_monmap 2026-02-24T19:16:25.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:25.796+0000 7f70790fe640 10 monclient: monmap: 2026-02-24T19:16:25.799 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:16:25.800 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:25.800 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:16:25.798327+0000 2026-02-24T19:16:25.800 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:16:25.798327+0000 2026-02-24T19:16:25.800 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:25.800 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:16:25.800 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:25.800 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:25.800 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:25.800 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:16:25.800 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:25.797+0000 7f70790fe640 1 Processor -- start 2026-02-24T19:16:25.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:25.797+0000 7f70790fe640 1 -- start start 2026-02-24T19:16:25.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:25.797+0000 7f70790fe640 10 monclient: init 2026-02-24T19:16:25.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:25.797+0000 7f70790fe640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:25.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:25.797+0000 7f70790fe640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:16:25.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:25.797+0000 7f70790fe640 10 monclient(hunting): picked mon.noname-a con 0x7f707415afb0 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:25.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:25.797+0000 7f70790fe640 10 monclient(hunting): picked mon.noname-c con 0x7f70740a9e80 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:25.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:25.797+0000 7f70790fe640 10 monclient(hunting): picked mon.noname-b con 0x7f7074164a50 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:25.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:25.797+0000 7f70790fe640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70740b0e70 con 0x7f707415afb0 2026-02-24T19:16:25.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:25.797+0000 7f70790fe640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70740b1150 con 0x7f7074164a50 2026-02-24T19:16:25.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:25.797+0000 7f70790fe640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70740b1430 con 0x7f70740a9e80 2026-02-24T19:16:25.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:25.797+0000 7f70790fe640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:25.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:25.797+0000 7f70790fe640 10 monclient(hunting): authenticate will time out at 3560.479696s 2026-02-24T19:16:25.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:25.797+0000 7f7073fff640 1 -- >> v1:10.20.193.14:6789/0 conn(0x7f707415afb0 legacy=0x7f70740b1f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.14:6789/0 2026-02-24T19:16:25.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:25.804+0000 7f70788fd640 1 -- >> v1:10.20.193.44:6789/0 conn(0x7f7074164a50 legacy=0x7f70740ac300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.44:6789/0 2026-02-24T19:16:25.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:25.804+0000 7f70737fe640 1 -- >> v1:10.20.193.170:6789/0 conn(0x7f70740a9e80 legacy=0x7f7074164340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.170:6789/0 2026-02-24T19:16:26.001 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:25.999+0000 7f7073fff640 1 -- >> v1:10.20.193.14:6789/0 conn(0x7f707415afb0 legacy=0x7f70740b1f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.14:6789/0 2026-02-24T19:16:26.008 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:26.006+0000 7f70737fe640 1 -- >> v1:10.20.193.170:6789/0 conn(0x7f70740a9e80 legacy=0x7f7074164340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.170:6789/0 2026-02-24T19:16:26.008 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:26.006+0000 7f70788fd640 1 -- >> v1:10.20.193.44:6789/0 conn(0x7f7074164a50 legacy=0x7f70740ac300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.44:6789/0 2026-02-24T19:16:26.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:26.400+0000 7f7073fff640 1 -- >> v1:10.20.193.14:6789/0 conn(0x7f707415afb0 legacy=0x7f70740b1f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.14:6789/0 2026-02-24T19:16:26.409 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:26.407+0000 7f70737fe640 1 -- >> v1:10.20.193.170:6789/0 conn(0x7f70740a9e80 legacy=0x7f7074164340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.170:6789/0 2026-02-24T19:16:26.410 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:26.407+0000 7f70788fd640 1 -- >> v1:10.20.193.44:6789/0 conn(0x7f7074164a50 legacy=0x7f70740ac300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.44:6789/0 2026-02-24T19:16:27.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:27.201+0000 7f7073fff640 1 -- >> v1:10.20.193.14:6789/0 conn(0x7f707415afb0 legacy=0x7f70740b1f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.14:6789/0 2026-02-24T19:16:27.210 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:27.208+0000 7f70737fe640 1 -- >> v1:10.20.193.170:6789/0 conn(0x7f70740a9e80 legacy=0x7f7074164340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.170:6789/0 2026-02-24T19:16:27.210 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:27.208+0000 7f70788fd640 1 -- >> v1:10.20.193.44:6789/0 conn(0x7f7074164a50 legacy=0x7f70740ac300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.44:6789/0 2026-02-24T19:16:27.769 INFO:tasks.ceph.mon.a.trial014.stderr:--00:00:00:02.031 43987-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/1e/3d21c9a1f16a7f75d984e00627141ae686aefc.debug 2026-02-24T19:16:27.773 INFO:tasks.ceph.mon.b.trial044.stderr:--00:00:00:02.033 44761-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/1e/3d21c9a1f16a7f75d984e00627141ae686aefc.debug 2026-02-24T19:16:27.812 INFO:tasks.ceph.mon.c.trial170.stderr:--00:00:00:02.034 44590-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/1e/3d21c9a1f16a7f75d984e00627141ae686aefc.debug 2026-02-24T19:16:28.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:28.797+0000 7f7071ffb640 10 monclient(hunting): tick 2026-02-24T19:16:28.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:28.797+0000 7f7071ffb640 10 monclient(hunting): _check_auth_tickets 2026-02-24T19:16:28.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:28.797+0000 7f7071ffb640 1 monclient(hunting): continuing hunt 2026-02-24T19:16:28.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:28.797+0000 7f7071ffb640 10 monclient(hunting): _reopen_session rank -1 2026-02-24T19:16:28.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:28.797+0000 7f7071ffb640 1 -- >> v1:10.20.193.170:6789/0 conn(0x7f70740a9e80 legacy=0x7f7074164340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T19:16:28.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:28.797+0000 7f7071ffb640 1 -- >> v1:10.20.193.44:6789/0 conn(0x7f7074164a50 legacy=0x7f70740ac300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T19:16:28.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:28.797+0000 7f7071ffb640 1 -- >> v1:10.20.193.14:6789/0 conn(0x7f707415afb0 legacy=0x7f70740b1f10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T19:16:28.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:28.797+0000 7f7071ffb640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:16:28.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:28.797+0000 7f7071ffb640 10 monclient(hunting): picked mon.noname-a con 0x7f707415afb0 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:28.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:28.797+0000 7f7071ffb640 10 monclient(hunting): picked mon.noname-b con 0x7f7074164a50 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:28.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:28.797+0000 7f7071ffb640 10 monclient(hunting): picked mon.noname-c con 0x7f70740a9e80 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:28.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:28.797+0000 7f7073fff640 1 -- >> v1:10.20.193.14:6789/0 conn(0x7f707415afb0 legacy=0x7f70500237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.14:6789/0 2026-02-24T19:16:28.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:28.797+0000 7f7071ffb640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70740b1710 con 0x7f707415afb0 2026-02-24T19:16:28.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:28.797+0000 7f7071ffb640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70740b0e70 con 0x7f7074164a50 2026-02-24T19:16:28.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:28.797+0000 7f7071ffb640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70740b1150 con 0x7f70740a9e80 2026-02-24T19:16:28.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:28.797+0000 7f7071ffb640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:28.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:28.797+0000 7f70737fe640 1 -- >> v1:10.20.193.44:6789/0 conn(0x7f7074164a50 legacy=0x7f7050044f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.44:6789/0 2026-02-24T19:16:28.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:28.797+0000 7f70788fd640 1 -- >> v1:10.20.193.170:6789/0 conn(0x7f70740a9e80 legacy=0x7f7050066760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.170:6789/0 2026-02-24T19:16:29.000 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:28.998+0000 7f7073fff640 1 -- >> v1:10.20.193.14:6789/0 conn(0x7f707415afb0 legacy=0x7f70500237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.14:6789/0 2026-02-24T19:16:29.000 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:28.998+0000 7f70737fe640 1 -- >> v1:10.20.193.44:6789/0 conn(0x7f7074164a50 legacy=0x7f7050044f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.44:6789/0 2026-02-24T19:16:29.000 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:28.998+0000 7f70788fd640 1 -- >> v1:10.20.193.170:6789/0 conn(0x7f70740a9e80 legacy=0x7f7050066760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.170:6789/0 2026-02-24T19:16:29.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:29.399+0000 7f7073fff640 1 -- >> v1:10.20.193.14:6789/0 conn(0x7f707415afb0 legacy=0x7f70500237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.14:6789/0 2026-02-24T19:16:29.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:29.399+0000 7f70737fe640 1 -- >> v1:10.20.193.44:6789/0 conn(0x7f7074164a50 legacy=0x7f7050044f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.44:6789/0 2026-02-24T19:16:29.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:29.399+0000 7f70788fd640 1 -- >> v1:10.20.193.170:6789/0 conn(0x7f70740a9e80 legacy=0x7f7050066760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.170:6789/0 2026-02-24T19:16:30.202 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:30.200+0000 7f7073fff640 1 -- >> v1:10.20.193.14:6789/0 conn(0x7f707415afb0 legacy=0x7f70500237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.14:6789/0 2026-02-24T19:16:30.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:30.200+0000 7f70737fe640 1 -- >> v1:10.20.193.44:6789/0 conn(0x7f7074164a50 legacy=0x7f7050044f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.44:6789/0 2026-02-24T19:16:30.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:30.200+0000 7f70788fd640 1 -- >> v1:10.20.193.170:6789/0 conn(0x7f70740a9e80 legacy=0x7f7050066760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.170:6789/0 2026-02-24T19:16:31.800 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:31.797+0000 7f7071ffb640 10 monclient(hunting): tick 2026-02-24T19:16:31.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:31.797+0000 7f7071ffb640 10 monclient(hunting): _check_auth_tickets 2026-02-24T19:16:31.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:31.797+0000 7f7071ffb640 1 monclient(hunting): continuing hunt 2026-02-24T19:16:31.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:31.797+0000 7f7071ffb640 10 monclient(hunting): _reopen_session rank -1 2026-02-24T19:16:31.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:31.797+0000 7f7071ffb640 1 -- >> v1:10.20.193.170:6789/0 conn(0x7f70740a9e80 legacy=0x7f7050066760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T19:16:31.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:31.797+0000 7f7071ffb640 1 -- >> v1:10.20.193.44:6789/0 conn(0x7f7074164a50 legacy=0x7f7050044f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T19:16:31.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:31.797+0000 7f7071ffb640 1 -- >> v1:10.20.193.14:6789/0 conn(0x7f707415afb0 legacy=0x7f70500237c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T19:16:31.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:31.797+0000 7f7071ffb640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:16:31.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:31.797+0000 7f7071ffb640 10 monclient(hunting): picked mon.noname-c con 0x7f70740a9e80 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:31.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:31.797+0000 7f7071ffb640 10 monclient(hunting): picked mon.noname-b con 0x7f7074164a50 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:31.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:31.797+0000 7f7071ffb640 10 monclient(hunting): picked mon.noname-a con 0x7f707415afb0 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:31.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:31.797+0000 7f7071ffb640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70740b1430 con 0x7f707415afb0 2026-02-24T19:16:31.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:31.797+0000 7f7071ffb640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70740b1710 con 0x7f7074164a50 2026-02-24T19:16:31.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:31.797+0000 7f7071ffb640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70740b0e70 con 0x7f70740a9e80 2026-02-24T19:16:31.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:31.797+0000 7f7071ffb640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:31.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:31.797+0000 7f70788fd640 1 -- >> v1:10.20.193.14:6789/0 conn(0x7f707415afb0 legacy=0x7f705006a060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.14:6789/0 2026-02-24T19:16:31.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:31.797+0000 7f70737fe640 1 -- >> v1:10.20.193.44:6789/0 conn(0x7f7074164a50 legacy=0x7f7050044f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.44:6789/0 2026-02-24T19:16:31.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:31.797+0000 7f7073fff640 1 -- >> v1:10.20.193.170:6789/0 conn(0x7f70740a9e80 legacy=0x7f7050066760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.170:6789/0 2026-02-24T19:16:32.000 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:31.999+0000 7f70788fd640 1 -- >> v1:10.20.193.14:6789/0 conn(0x7f707415afb0 legacy=0x7f705006a060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.14:6789/0 2026-02-24T19:16:32.000 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:31.999+0000 7f70737fe640 1 -- >> v1:10.20.193.44:6789/0 conn(0x7f7074164a50 legacy=0x7f7050044f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.44:6789/0 2026-02-24T19:16:32.000 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:31.999+0000 7f7073fff640 1 -- >> v1:10.20.193.170:6789/0 conn(0x7f70740a9e80 legacy=0x7f7050066760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.170:6789/0 2026-02-24T19:16:32.031 INFO:tasks.ceph.mon.a.trial014.stderr:--00:00:00:06.293 43987-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/b7/b7bf14e7464905da65890c8b4fe846bf738441.debug 2026-02-24T19:16:32.062 INFO:tasks.ceph.mon.c.trial170.stderr:--00:00:00:06.284 44590-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/b7/b7bf14e7464905da65890c8b4fe846bf738441.debug 2026-02-24T19:16:32.070 INFO:tasks.ceph.mon.b.trial044.stderr:--00:00:00:06.329 44761-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/b7/b7bf14e7464905da65890c8b4fe846bf738441.debug 2026-02-24T19:16:32.401 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:32.400+0000 7f70788fd640 1 -- >> v1:10.20.193.14:6789/0 conn(0x7f707415afb0 legacy=0x7f705006a060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.14:6789/0 2026-02-24T19:16:32.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:32.400+0000 7f70737fe640 1 -- >> v1:10.20.193.44:6789/0 conn(0x7f7074164a50 legacy=0x7f7050044f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.44:6789/0 2026-02-24T19:16:32.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:32.400+0000 7f7073fff640 1 -- >> v1:10.20.193.170:6789/0 conn(0x7f70740a9e80 legacy=0x7f7050066760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.170:6789/0 2026-02-24T19:16:33.202 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:33.201+0000 7f7073fff640 1 -- >> v1:10.20.193.170:6789/0 conn(0x7f70740a9e80 legacy=0x7f7050066760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.170:6789/0 2026-02-24T19:16:33.202 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:33.201+0000 7f70788fd640 1 -- >> v1:10.20.193.14:6789/0 conn(0x7f707415afb0 legacy=0x7f705006a060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.14:6789/0 2026-02-24T19:16:33.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:33.201+0000 7f70737fe640 1 -- >> v1:10.20.193.44:6789/0 conn(0x7f7074164a50 legacy=0x7f7050044f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.44:6789/0 2026-02-24T19:16:33.535 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:00:07.797 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:16:33.568 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:00:07.790 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:16:33.576 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:00:07.835 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:16:33.684 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:00:07.946 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:16:33.717 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:00:07.939 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:16:33.726 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:00:07.985 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:16:34.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:34.798+0000 7f7071ffb640 10 monclient(hunting): tick 2026-02-24T19:16:34.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:34.798+0000 7f7071ffb640 10 monclient(hunting): _check_auth_tickets 2026-02-24T19:16:34.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:34.798+0000 7f7071ffb640 1 monclient(hunting): continuing hunt 2026-02-24T19:16:34.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:34.798+0000 7f7071ffb640 10 monclient(hunting): _reopen_session rank -1 2026-02-24T19:16:34.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:34.799+0000 7f7071ffb640 1 -- >> v1:10.20.193.170:6789/0 conn(0x7f70740a9e80 legacy=0x7f7050066760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T19:16:34.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:34.799+0000 7f7071ffb640 1 -- >> v1:10.20.193.44:6789/0 conn(0x7f7074164a50 legacy=0x7f7050044f10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T19:16:34.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:34.799+0000 7f7071ffb640 1 -- >> v1:10.20.193.14:6789/0 conn(0x7f707415afb0 legacy=0x7f705006a060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T19:16:34.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:34.799+0000 7f7071ffb640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:16:34.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:34.799+0000 7f7071ffb640 10 monclient(hunting): picked mon.noname-a con 0x7f707415afb0 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:34.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:34.799+0000 7f7071ffb640 10 monclient(hunting): picked mon.noname-b con 0x7f7074164a50 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:34.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:34.799+0000 7f7071ffb640 10 monclient(hunting): picked mon.noname-c con 0x7f70740a9e80 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:34.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:34.799+0000 7f7071ffb640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70740b1150 con 0x7f707415afb0 2026-02-24T19:16:34.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:34.799+0000 7f7071ffb640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70740b1430 con 0x7f7074164a50 2026-02-24T19:16:34.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:34.799+0000 7f7071ffb640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70740b1710 con 0x7f70740a9e80 2026-02-24T19:16:34.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:34.799+0000 7f7071ffb640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:34.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:34.799+0000 7f70788fd640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7f70740a9e80 0x7f7050066760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:37190/0 (socket says 10.20.193.14:37190) 2026-02-24T19:16:34.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:34.799+0000 7f70788fd640 1 -- 10.20.193.14:0/4288280154 learned_addr learned my addr 10.20.193.14:0/4288280154 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:16:37.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:37.799+0000 7f7071ffb640 10 monclient(hunting): tick 2026-02-24T19:16:37.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:37.799+0000 7f7071ffb640 10 monclient(hunting): _check_auth_tickets 2026-02-24T19:16:37.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:37.799+0000 7f7071ffb640 1 monclient(hunting): continuing hunt 2026-02-24T19:16:37.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:37.799+0000 7f7071ffb640 10 monclient(hunting): _reopen_session rank -1 2026-02-24T19:16:37.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:37.799+0000 7f7071ffb640 1 -- 10.20.193.14:0/4288280154 >> v1:10.20.193.170:6789/0 conn(0x7f70740a9e80 legacy=0x7f7050066760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:37.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:37.799+0000 7f7071ffb640 1 -- 10.20.193.14:0/4288280154 >> v1:10.20.193.44:6789/0 conn(0x7f7074164a50 legacy=0x7f7050044f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:37.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:37.799+0000 7f7071ffb640 1 -- 10.20.193.14:0/4288280154 >> v1:10.20.193.14:6789/0 conn(0x7f707415afb0 legacy=0x7f705006a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:37.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:37.799+0000 7f7071ffb640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:16:37.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:37.799+0000 7f7071ffb640 10 monclient(hunting): picked mon.noname-c con 0x7f70740a9e80 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:37.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:37.799+0000 7f7071ffb640 10 monclient(hunting): picked mon.noname-b con 0x7f7074164a50 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:37.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:37.799+0000 7f7071ffb640 10 monclient(hunting): picked mon.noname-a con 0x7f707415afb0 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:37.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:37.799+0000 7f7071ffb640 1 -- 10.20.193.14:0/4288280154 --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70740b0e70 con 0x7f707415afb0 2026-02-24T19:16:37.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:37.799+0000 7f7071ffb640 1 -- 10.20.193.14:0/4288280154 --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7050024990 con 0x7f7074164a50 2026-02-24T19:16:37.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:37.799+0000 7f7071ffb640 1 -- 10.20.193.14:0/4288280154 --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7050024c20 con 0x7f70740a9e80 2026-02-24T19:16:37.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:37.799+0000 7f7071ffb640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:40.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:40.799+0000 7f7071ffb640 10 monclient(hunting): tick 2026-02-24T19:16:40.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:40.799+0000 7f7071ffb640 10 monclient(hunting): _check_auth_tickets 2026-02-24T19:16:40.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:40.799+0000 7f7071ffb640 1 monclient(hunting): continuing hunt 2026-02-24T19:16:40.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:40.799+0000 7f7071ffb640 10 monclient(hunting): _reopen_session rank -1 2026-02-24T19:16:40.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:40.799+0000 7f7071ffb640 1 -- 10.20.193.14:0/4288280154 >> v1:10.20.193.170:6789/0 conn(0x7f70740a9e80 legacy=0x7f7050066760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:40.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:40.799+0000 7f7071ffb640 1 -- 10.20.193.14:0/4288280154 >> v1:10.20.193.44:6789/0 conn(0x7f7074164a50 legacy=0x7f7050044f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:40.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:40.799+0000 7f7071ffb640 1 -- 10.20.193.14:0/4288280154 >> v1:10.20.193.14:6789/0 conn(0x7f707415afb0 legacy=0x7f705006a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:40.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:40.799+0000 7f7071ffb640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:16:40.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:40.799+0000 7f7071ffb640 10 monclient(hunting): picked mon.noname-a con 0x7f707415afb0 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:40.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:40.799+0000 7f7071ffb640 10 monclient(hunting): picked mon.noname-c con 0x7f70740a9e80 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:40.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:40.799+0000 7f7071ffb640 10 monclient(hunting): picked mon.noname-b con 0x7f7074164a50 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:40.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:40.799+0000 7f7071ffb640 1 -- 10.20.193.14:0/4288280154 --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f705006a770 con 0x7f707415afb0 2026-02-24T19:16:40.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:40.799+0000 7f7071ffb640 1 -- 10.20.193.14:0/4288280154 --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f705006a9c0 con 0x7f7074164a50 2026-02-24T19:16:40.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:40.799+0000 7f7071ffb640 1 -- 10.20.193.14:0/4288280154 --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f705006ac50 con 0x7f70740a9e80 2026-02-24T19:16:40.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:40.799+0000 7f7071ffb640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:41.188 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.186+0000 7f7072ffd640 1 -- 10.20.193.14:0/4288280154 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3501695952 0 0) 0x7f705006a770 con 0x7f707415afb0 2026-02-24T19:16:41.189 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.186+0000 7f7072ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:16:41.189 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.186+0000 7f7072ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:41.189 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.186+0000 7f7072ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:41.189 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.186+0000 7f7072ffd640 10 monclient(hunting): my global_id is 4101 2026-02-24T19:16:41.189 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.186+0000 7f7072ffd640 1 -- 10.20.193.14:0/4288280154 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7058003610 con 0x7f707415afb0 2026-02-24T19:16:41.210 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.208+0000 7f7072ffd640 1 -- 10.20.193.14:0/4288280154 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3850341358 0 0) 0x7f705006a9c0 con 0x7f7074164a50 2026-02-24T19:16:41.210 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.208+0000 7f7072ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:16:41.210 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.208+0000 7f7072ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:41.210 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.208+0000 7f7072ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:41.210 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.208+0000 7f7072ffd640 10 monclient(hunting): my global_id is 4105 2026-02-24T19:16:41.210 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.208+0000 7f7072ffd640 1 -- 10.20.193.14:0/4288280154 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f705006a770 con 0x7f7074164a50 2026-02-24T19:16:41.221 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.220+0000 7f7072ffd640 1 -- 10.20.193.14:0/4288280154 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1631162303 0 0) 0x7f705006ac50 con 0x7f70740a9e80 2026-02-24T19:16:41.221 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.220+0000 7f7072ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:16:41.221 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.220+0000 7f7072ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:41.221 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.220+0000 7f7072ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:41.221 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.220+0000 7f7072ffd640 10 monclient(hunting): my global_id is 4103 2026-02-24T19:16:41.221 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.220+0000 7f7072ffd640 1 -- 10.20.193.14:0/4288280154 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f705006a9c0 con 0x7f70740a9e80 2026-02-24T19:16:41.225 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.224+0000 7f7072ffd640 1 -- 10.20.193.14:0/4288280154 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1880171104 0 0) 0x7f7058003610 con 0x7f707415afb0 2026-02-24T19:16:41.225 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.224+0000 7f7072ffd640 1 -- 10.20.193.14:0/4288280154 >> v1:10.20.193.170:6789/0 conn(0x7f70740a9e80 legacy=0x7f7050066760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:41.226 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.224+0000 7f7072ffd640 1 -- 10.20.193.14:0/4288280154 >> v1:10.20.193.44:6789/0 conn(0x7f7074164a50 legacy=0x7f7050044f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:41.226 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.224+0000 7f7072ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:16:41.226 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.224+0000 7f7072ffd640 1 monclient: found mon.noname-a 2026-02-24T19:16:41.226 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.224+0000 7f7072ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:41.226 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.224+0000 7f7072ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:16:41.226 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.224+0000 7f7072ffd640 1 -- 10.20.193.14:0/4288280154 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f705006c080 con 0x7f707415afb0 2026-02-24T19:16:41.226 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.224+0000 7f7072ffd640 10 monclient: _finish_auth 0 2026-02-24T19:16:41.226 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.224+0000 7f7072ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:16:41.226 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.224+0000 7f7072ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:41.226 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.224+0000 7f70790fe640 5 monclient: authenticate success, global_id 4101 2026-02-24T19:16:41.226 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.224+0000 7f70790fe640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:16:41.227 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.225+0000 7f7072ffd640 1 -- 10.20.193.14:0/4288280154 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7060004140 con 0x7f707415afb0 2026-02-24T19:16:41.227 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.225+0000 7f7072ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:41.228 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.225+0000 7f7072ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:16:41.228 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.225+0000 7f7072ffd640 10 monclient: dump: 2026-02-24T19:16:41.228 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:16:41.228 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:41.228 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:41.228 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:41.228 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:41.228 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:16:41.228 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:41.228 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:41.229 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:41.229 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:16:41.229 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.225+0000 7f70790fe640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:16:41.246 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.242+0000 7f7072ffd640 1 -- 10.20.193.14:0/4288280154 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7060004350 con 0x7f707415afb0 2026-02-24T19:16:41.246 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.242+0000 7f7072ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:41.246 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.242+0000 7f7072ffd640 1 -- 10.20.193.14:0/4288280154 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7060004750 con 0x7f707415afb0 2026-02-24T19:16:41.246 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.242+0000 7f7072ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:41.246 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.242+0000 7f7072ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:16:41.247 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.242+0000 7f7072ffd640 10 monclient: dump: 2026-02-24T19:16:41.247 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:16:41.247 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:41.247 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:41.247 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:41.247 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:41.247 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:16:41.247 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:41.247 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:41.247 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:41.247 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:16:41.247 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.242+0000 7f70790fe640 10 monclient: get_monmap_and_config success 2026-02-24T19:16:41.248 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.242+0000 7f70790fe640 4 set_mon_vals no callback set 2026-02-24T19:16:41.248 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.242+0000 7f70790fe640 10 monclient: shutdown 2026-02-24T19:16:41.248 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.242+0000 7f70790fe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:41.248 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.242+0000 7f70790fe640 1 -- 10.20.193.14:0/4288280154 >> v1:10.20.193.14:6789/0 conn(0x7f707415afb0 legacy=0x7f705006a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:41.248 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.242+0000 7f70790fe640 1 -- 10.20.193.14:0/4288280154 shutdown_connections 2026-02-24T19:16:41.248 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.242+0000 7f70790fe640 1 -- 10.20.193.14:0/4288280154 >> 10.20.193.14:0/4288280154 conn(0x7f70740b42c0 msgr2=0x7f70740b4690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:41.248 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.242+0000 7f70790fe640 1 -- 10.20.193.14:0/4288280154 shutdown_connections 2026-02-24T19:16:41.248 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.242+0000 7f70790fe640 1 -- 10.20.193.14:0/4288280154 wait complete. 2026-02-24T19:16:41.248 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.243+0000 7f70790fe640 10 monclient: build_initial_monmap 2026-02-24T19:16:41.248 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.243+0000 7f70790fe640 10 monclient: monmap: 2026-02-24T19:16:41.248 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:16:41.249 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:16:41.249 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:16:41.249 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:16:41.249 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:41.249 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:16:41.249 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:41.249 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:41.249 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:41.249 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:16:41.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.243+0000 7f70790fe640 1 librados: starting msgr at 2026-02-24T19:16:41.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.243+0000 7f70790fe640 1 librados: starting objecter 2026-02-24T19:16:41.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.243+0000 7f70790fe640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:16:41.250 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.243+0000 7f70790fe640 1 Processor -- start 2026-02-24T19:16:41.250 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.243+0000 7f70790fe640 1 -- start start 2026-02-24T19:16:41.250 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.243+0000 7f70790fe640 1 librados: setting wanted keys 2026-02-24T19:16:41.250 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.243+0000 7f70790fe640 1 librados: calling monclient init 2026-02-24T19:16:41.250 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.243+0000 7f70790fe640 10 monclient: init 2026-02-24T19:16:41.250 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.244+0000 7f70790fe640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:41.250 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.244+0000 7f70790fe640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:16:41.250 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.244+0000 7f70790fe640 10 monclient(hunting): picked mon.noname-c con 0x7f70740a9e80 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:41.250 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.244+0000 7f70790fe640 10 monclient(hunting): picked mon.noname-a con 0x7f707415afb0 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:41.250 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.244+0000 7f70790fe640 10 monclient(hunting): picked mon.noname-b con 0x7f7074164a50 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:41.250 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.244+0000 7f70790fe640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f707413e0b0 con 0x7f707415afb0 2026-02-24T19:16:41.250 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.244+0000 7f70790fe640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f707413e390 con 0x7f7074164a50 2026-02-24T19:16:41.250 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.244+0000 7f70790fe640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f707413e670 con 0x7f70740a9e80 2026-02-24T19:16:41.251 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.244+0000 7f70790fe640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:41.251 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.244+0000 7f70790fe640 10 monclient(hunting): authenticate will time out at 3575.925067s 2026-02-24T19:16:41.251 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.244+0000 7f7073fff640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7f70740a9e80 0x7f707413d740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:48372/0 (socket says 10.20.193.14:48372) 2026-02-24T19:16:41.251 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.244+0000 7f7073fff640 1 -- 10.20.193.14:0/2392464648 learned_addr learned my addr 10.20.193.14:0/2392464648 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:16:41.251 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.244+0000 7f7070ff9640 10 client.?.objecter ms_handle_connect 0x7f70740a9e80 2026-02-24T19:16:41.251 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.244+0000 7f7070ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:41.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.252+0000 7f7070ff9640 10 client.?.objecter ms_handle_connect 0x7f7074164a50 2026-02-24T19:16:41.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.252+0000 7f7070ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:41.268 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.267+0000 7f7070ff9640 10 client.?.objecter ms_handle_connect 0x7f707415afb0 2026-02-24T19:16:41.268 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.267+0000 7f7070ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:41.273 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.272+0000 7f7070ff9640 1 -- 10.20.193.14:0/2392464648 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3836541415 0 0) 0x7f707413e0b0 con 0x7f707415afb0 2026-02-24T19:16:41.273 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.272+0000 7f7070ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:16:41.273 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.272+0000 7f7070ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:41.273 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.272+0000 7f7070ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:41.274 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.272+0000 7f7070ff9640 10 monclient(hunting): my global_id is 4104 2026-02-24T19:16:41.274 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.272+0000 7f7070ff9640 1 -- 10.20.193.14:0/2392464648 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7044003610 con 0x7f707415afb0 2026-02-24T19:16:41.280 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.278+0000 7f7070ff9640 1 -- 10.20.193.14:0/2392464648 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 767841198 0 0) 0x7f707413e670 con 0x7f70740a9e80 2026-02-24T19:16:41.280 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.278+0000 7f7070ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:16:41.280 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.278+0000 7f7070ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:41.280 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.278+0000 7f7070ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:41.280 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.278+0000 7f7070ff9640 10 monclient(hunting): my global_id is 4109 2026-02-24T19:16:41.280 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.278+0000 7f7070ff9640 1 -- 10.20.193.14:0/2392464648 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f707413e0b0 con 0x7f70740a9e80 2026-02-24T19:16:41.281 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.279+0000 7f7070ff9640 1 -- 10.20.193.14:0/2392464648 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1972732429 0 0) 0x7f7044003610 con 0x7f707415afb0 2026-02-24T19:16:41.281 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.279+0000 7f7070ff9640 1 -- 10.20.193.14:0/2392464648 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f707413e670 con 0x7f707415afb0 2026-02-24T19:16:41.281 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.279+0000 7f7070ff9640 1 -- 10.20.193.14:0/2392464648 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7064004240 con 0x7f707415afb0 2026-02-24T19:16:41.281 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.279+0000 7f7070ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:41.281 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.279+0000 7f7070ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:16:41.281 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.279+0000 7f7070ff9640 10 monclient(hunting): dump: 2026-02-24T19:16:41.282 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:16:41.282 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:41.282 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:41.282 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:41.282 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:41.282 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:16:41.282 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:41.282 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:41.282 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:41.282 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:16:41.282 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.279+0000 7f7070ff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:16:41.285 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.284+0000 7f7070ff9640 1 -- 10.20.193.14:0/2392464648 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3486563886 0 0) 0x7f707413e390 con 0x7f7074164a50 2026-02-24T19:16:41.285 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.284+0000 7f7070ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:16:41.285 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.284+0000 7f7070ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:41.285 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.284+0000 7f7070ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:41.285 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.284+0000 7f7070ff9640 10 monclient(hunting): my global_id is 4114 2026-02-24T19:16:41.285 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.284+0000 7f7070ff9640 1 -- 10.20.193.14:0/2392464648 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7044003610 con 0x7f7074164a50 2026-02-24T19:16:41.290 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.288+0000 7f7070ff9640 1 -- 10.20.193.14:0/2392464648 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 785795540 0 0) 0x7f707413e670 con 0x7f707415afb0 2026-02-24T19:16:41.290 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.288+0000 7f7070ff9640 1 -- 10.20.193.14:0/2392464648 >> v1:10.20.193.170:6789/0 conn(0x7f70740a9e80 legacy=0x7f707413d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:41.290 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.288+0000 7f7070ff9640 1 -- 10.20.193.14:0/2392464648 >> v1:10.20.193.44:6789/0 conn(0x7f7074164a50 legacy=0x7f70740ae220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:41.290 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.288+0000 7f7070ff9640 10 monclient: _finish_hunting 0 2026-02-24T19:16:41.290 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.288+0000 7f7070ff9640 1 monclient: found mon.a 2026-02-24T19:16:41.290 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.288+0000 7f7070ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:41.290 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.288+0000 7f7070ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:16:41.290 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.288+0000 7f7070ff9640 1 -- 10.20.193.14:0/2392464648 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f707413e950 con 0x7f707415afb0 2026-02-24T19:16:41.290 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.288+0000 7f7070ff9640 10 monclient: _finish_auth 0 2026-02-24T19:16:41.291 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.288+0000 7f7070ff9640 10 monclient: _check_auth_tickets 2026-02-24T19:16:41.291 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.288+0000 7f7070ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:41.291 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.288+0000 7f70790fe640 5 monclient: authenticate success, global_id 4104 2026-02-24T19:16:41.291 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.288+0000 7f70790fe640 10 monclient: _renew_subs 2026-02-24T19:16:41.291 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.288+0000 7f70790fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:16:41.291 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.288+0000 7f70790fe640 1 -- 10.20.193.14:0/2392464648 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f70741602e0 con 0x7f707415afb0 2026-02-24T19:16:41.291 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.288+0000 7f70790fe640 10 client.4104.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:16:41.291 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.288+0000 7f70790fe640 10 monclient: _renew_subs 2026-02-24T19:16:41.291 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.288+0000 7f70790fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:16:41.291 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.288+0000 7f70790fe640 1 -- 10.20.193.14:0/2392464648 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7074157a20 con 0x7f707415afb0 2026-02-24T19:16:41.291 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.288+0000 7f70790fe640 1 librados: init done 2026-02-24T19:16:41.291 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.288+0000 7f70790fe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:41.291 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.288+0000 7f70790fe640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:41.292 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.288+0000 7f70790fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:16:41.292 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.288+0000 7f70790fe640 1 -- 10.20.193.14:0/2392464648 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7074165460 con 0x7f707415afb0 2026-02-24T19:16:41.376 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.374+0000 7f7070ff9640 1 -- 10.20.193.14:0/2392464648 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f70640046c0 con 0x7f707415afb0 2026-02-24T19:16:41.377 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.374+0000 7f7070ff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:41.377 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.374+0000 7f7070ff9640 1 -- 10.20.193.14:0/2392464648 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7064004a90 con 0x7f707415afb0 2026-02-24T19:16:41.377 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.374+0000 7f7070ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:41.377 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.374+0000 7f7070ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:16:41.377 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.374+0000 7f7070ff9640 10 monclient: dump: 2026-02-24T19:16:41.377 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:16:41.377 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:41.377 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:41.377 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:41.377 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:41.378 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:16:41.378 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:41.378 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:41.378 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:41.378 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:16:41.378 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.374+0000 7f70727fc640 4 set_mon_vals no callback set 2026-02-24T19:16:41.378 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.374+0000 7f7070ff9640 1 -- 10.20.193.14:0/2392464648 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f7064005080 con 0x7f707415afb0 2026-02-24T19:16:41.378 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.374+0000 7f7070ff9640 1 -- 10.20.193.14:0/2392464648 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (unknown 1121324477 0 0) 0x7f7064006a40 con 0x7f707415afb0 2026-02-24T19:16:41.378 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.374+0000 7f7070ff9640 10 client.4104.objecter ms_dispatch2 0x7f7074000b90 osd_map(1..1 src has 1..1) 2026-02-24T19:16:41.378 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.374+0000 7f7070ff9640 3 client.4104.objecter handle_osd_map got epochs [1,1] > 0 2026-02-24T19:16:41.378 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.374+0000 7f7070ff9640 3 client.4104.objecter handle_osd_map decoding full epoch 1 2026-02-24T19:16:41.379 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.374+0000 7f7070ff9640 20 client.4104.objecter dump_active .. 0 homeless 2026-02-24T19:16:41.379 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.374+0000 7f7070ff9640 1 -- 10.20.193.14:0/2392464648 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7f7064019ee0 con 0x7f707415afb0 2026-02-24T19:16:41.379 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.374+0000 7f7070ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:41.379 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.374+0000 7f7070ff9640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:16:41.405 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.404+0000 7f70790fe640 10 start_mon_command cmd=[{"prefix": "config dump"}] 2026-02-24T19:16:41.405 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.404+0000 7f70790fe640 10 monclient: _send_command 2 [{"prefix": "config dump"}] 2026-02-24T19:16:41.406 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.404+0000 7f70790fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:16:41.406 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.404+0000 7f70790fe640 1 -- 10.20.193.14:0/2392464648 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "config dump"} v 0) -- 0x7f70740ac890 con 0x7f707415afb0 2026-02-24T19:16:41.439 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.438+0000 7f7070ff9640 1 -- 10.20.193.14:0/2392464648 <== mon.0 v1:10.20.193.14:6789/0 10 ==== mon_command_ack([{"prefix": "config dump"}]=0 v1) ==== 59+0+36 (unknown 4069917974 0 2919340917) 0x7f7064005b80 con 0x7f707415afb0 2026-02-24T19:16:41.440 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.438+0000 7f7070ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config dump"}] 2026-02-24T19:16:41.440 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.438+0000 7f7070ff9640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:16:41.440 INFO:teuthology.orchestra.run.trial014.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-24T19:16:41.442 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.439+0000 7f70790fe640 10 librados: watch_flush enter 2026-02-24T19:16:41.442 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.439+0000 7f70790fe640 10 librados: watch_flush exit 2026-02-24T19:16:41.442 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.439+0000 7f70790fe640 20 client.4104.objecter shutdown clearing up homeless session... 2026-02-24T19:16:41.442 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.439+0000 7f70790fe640 10 client.4104.objecter successfully canceled tick 2026-02-24T19:16:41.442 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.439+0000 7f70790fe640 10 monclient: shutdown 2026-02-24T19:16:41.442 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.439+0000 7f70790fe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:41.442 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.439+0000 7f70790fe640 1 -- 10.20.193.14:0/2392464648 >> v1:10.20.193.14:6789/0 conn(0x7f707415afb0 legacy=0x7f7074160800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:41.442 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.439+0000 7f70790fe640 1 -- 10.20.193.14:0/2392464648 shutdown_connections 2026-02-24T19:16:41.442 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.439+0000 7f70790fe640 1 -- 10.20.193.14:0/2392464648 >> 10.20.193.14:0/2392464648 conn(0x7f70740b42c0 msgr2=0x7f70740ab740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:41.442 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.439+0000 7f70790fe640 1 -- 10.20.193.14:0/2392464648 shutdown_connections 2026-02-24T19:16:41.443 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.439+0000 7f70790fe640 1 -- 10.20.193.14:0/2392464648 wait complete. 2026-02-24T19:16:41.443 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.439+0000 7f70790fe640 1 librados: shutdown 2026-02-24T19:16:41.449 INFO:tasks.ceph:Setting crush tunables to default 2026-02-24T19:16:41.449 DEBUG:teuthology.orchestra.run.trial014:> sudo ceph --cluster ceph osd crush tunables default 2026-02-24T19:16:41.514 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.513+0000 7fe9778ce640 10 monclient: get_monmap_and_config 2026-02-24T19:16:41.514 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.513+0000 7fe9778ce640 10 monclient: build_initial_monmap 2026-02-24T19:16:41.514 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.513+0000 7fe9778ce640 10 monclient: monmap: 2026-02-24T19:16:41.514 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:16:41.514 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:41.515 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:16:41.513727+0000 2026-02-24T19:16:41.515 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:16:41.513727+0000 2026-02-24T19:16:41.515 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:41.515 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:16:41.515 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:41.515 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:41.515 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:41.515 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:16:41.517 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.513+0000 7fe9778ce640 1 Processor -- start 2026-02-24T19:16:41.517 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.513+0000 7fe9778ce640 1 -- start start 2026-02-24T19:16:41.517 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.513+0000 7fe9778ce640 10 monclient: init 2026-02-24T19:16:41.517 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.514+0000 7fe9778ce640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:41.517 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.514+0000 7fe9778ce640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:16:41.517 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.514+0000 7fe9778ce640 10 monclient(hunting): picked mon.noname-c con 0x7fe9700b9f80 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:41.518 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.514+0000 7fe9778ce640 10 monclient(hunting): picked mon.noname-a con 0x7fe9700ba350 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:41.518 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.514+0000 7fe9778ce640 10 monclient(hunting): picked mon.noname-b con 0x7fe9700585e0 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:41.518 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.514+0000 7fe9778ce640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe970163930 con 0x7fe9700ba350 2026-02-24T19:16:41.518 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.514+0000 7fe9778ce640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe970163bb0 con 0x7fe9700585e0 2026-02-24T19:16:41.518 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.514+0000 7fe9778ce640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe970163e90 con 0x7fe9700b9f80 2026-02-24T19:16:41.518 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.514+0000 7fe9778ce640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:41.518 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.514+0000 7fe9778ce640 10 monclient(hunting): authenticate will time out at 3576.195168s 2026-02-24T19:16:41.518 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.514+0000 7fe975e44640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7fe9700585e0 0x7fe970166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:57294/0 (socket says 10.20.193.14:57294) 2026-02-24T19:16:41.518 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.514+0000 7fe975e44640 1 -- 10.20.193.14:0/4215987330 learned_addr learned my addr 10.20.193.14:0/4215987330 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:16:41.518 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.514+0000 7fe975643640 1 -- 10.20.193.14:0/4215987330 >> v1:10.20.193.170:6789/0 conn(0x7fe9700b9f80 legacy=0x7fe970163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-24T19:16:41.518 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.514+0000 7fe975643640 1 -- 10.20.193.14:0/4215987330 >> v1:10.20.193.170:6789/0 conn(0x7fe9700b9f80 legacy=0x7fe970163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-24T19:16:41.519 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.514+0000 7fe975643640 1 --1- 10.20.193.14:0/4215987330 >> v1:10.20.193.170:6789/0 conn(0x7fe9700b9f80 0x7fe970163220 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).handle_connect_reply_1 read connect reply failed 2026-02-24T19:16:41.540 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.538+0000 7fe95ffff640 1 -- 10.20.193.14:0/4215987330 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3018261006 0 0) 0x7fe964002910 con 0x7fe9700ba350 2026-02-24T19:16:41.540 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.538+0000 7fe95ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:16:41.540 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.538+0000 7fe95ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:41.540 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.538+0000 7fe95ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:41.540 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.538+0000 7fe95ffff640 10 monclient(hunting): my global_id is 4113 2026-02-24T19:16:41.540 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.538+0000 7fe95ffff640 1 -- 10.20.193.14:0/4215987330 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe958003610 con 0x7fe9700ba350 2026-02-24T19:16:41.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.540+0000 7fe95ffff640 1 -- 10.20.193.14:0/4215987330 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 58895206 0 0) 0x7fe958003610 con 0x7fe9700ba350 2026-02-24T19:16:41.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.540+0000 7fe95ffff640 1 -- 10.20.193.14:0/4215987330 >> v1:10.20.193.170:6789/0 conn(0x7fe9700b9f80 legacy=0x7fe970163220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T19:16:41.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.540+0000 7fe95ffff640 1 -- 10.20.193.14:0/4215987330 >> v1:10.20.193.44:6789/0 conn(0x7fe9700585e0 legacy=0x7fe970166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:41.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.540+0000 7fe95ffff640 10 monclient: _finish_hunting 0 2026-02-24T19:16:41.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.540+0000 7fe95ffff640 1 monclient: found mon.noname-a 2026-02-24T19:16:41.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.540+0000 7fe95ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:41.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.540+0000 7fe95ffff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:16:41.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.540+0000 7fe95ffff640 1 -- 10.20.193.14:0/4215987330 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9700573f0 con 0x7fe9700ba350 2026-02-24T19:16:41.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.540+0000 7fe95ffff640 10 monclient: _finish_auth 0 2026-02-24T19:16:41.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.540+0000 7fe95ffff640 10 monclient: _check_auth_tickets 2026-02-24T19:16:41.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.540+0000 7fe95ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:41.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.540+0000 7fe95ffff640 1 -- 10.20.193.14:0/4215987330 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fe964002fc0 con 0x7fe9700ba350 2026-02-24T19:16:41.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.540+0000 7fe95ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:41.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.540+0000 7fe95ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:16:41.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.540+0000 7fe95ffff640 10 monclient: dump: 2026-02-24T19:16:41.543 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:16:41.543 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:41.543 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:41.543 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:41.543 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:41.543 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:16:41.543 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:41.544 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:41.544 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:41.544 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:16:41.544 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.540+0000 7fe9778ce640 5 monclient: authenticate success, global_id 4113 2026-02-24T19:16:41.544 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.540+0000 7fe9778ce640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:16:41.548 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.541+0000 7fe95ffff640 1 -- 10.20.193.14:0/4215987330 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe9640031d0 con 0x7fe9700ba350 2026-02-24T19:16:41.548 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.541+0000 7fe95ffff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:41.548 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.541+0000 7fe95ffff640 1 -- 10.20.193.14:0/4215987330 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fe964003700 con 0x7fe9700ba350 2026-02-24T19:16:41.548 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.541+0000 7fe95ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:41.548 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.541+0000 7fe95ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:16:41.548 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.541+0000 7fe95ffff640 10 monclient: dump: 2026-02-24T19:16:41.548 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:16:41.548 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:41.548 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:41.548 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:41.549 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:41.549 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:16:41.549 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:41.549 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:41.549 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:41.549 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:16:41.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.541+0000 7fe9778ce640 10 monclient: get_monmap_and_config success 2026-02-24T19:16:41.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.541+0000 7fe9778ce640 4 set_mon_vals no callback set 2026-02-24T19:16:41.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.541+0000 7fe9778ce640 10 monclient: shutdown 2026-02-24T19:16:41.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.541+0000 7fe9778ce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:41.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.541+0000 7fe9778ce640 1 -- 10.20.193.14:0/4215987330 >> v1:10.20.193.14:6789/0 conn(0x7fe9700ba350 legacy=0x7fe970057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:41.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.541+0000 7fe9778ce640 1 -- 10.20.193.14:0/4215987330 shutdown_connections 2026-02-24T19:16:41.550 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.541+0000 7fe9778ce640 1 -- 10.20.193.14:0/4215987330 >> 10.20.193.14:0/4215987330 conn(0x7fe9700b7990 msgr2=0x7fe9700b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:41.550 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.541+0000 7fe9778ce640 1 -- 10.20.193.14:0/4215987330 shutdown_connections 2026-02-24T19:16:41.550 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.541+0000 7fe9778ce640 1 -- 10.20.193.14:0/4215987330 wait complete. 2026-02-24T19:16:41.550 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.541+0000 7fe9778ce640 10 monclient: build_initial_monmap 2026-02-24T19:16:41.550 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.541+0000 7fe9778ce640 10 monclient: monmap: 2026-02-24T19:16:41.550 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:16:41.550 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:16:41.550 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:16:41.550 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:16:41.550 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:41.550 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:16:41.551 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:41.551 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:41.551 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:41.551 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:16:41.551 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.542+0000 7fe9778ce640 1 librados: starting msgr at 2026-02-24T19:16:41.551 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.542+0000 7fe9778ce640 1 librados: starting objecter 2026-02-24T19:16:41.551 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.542+0000 7fe9778ce640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:16:41.551 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.542+0000 7fe9778ce640 1 Processor -- start 2026-02-24T19:16:41.551 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.542+0000 7fe9778ce640 1 -- start start 2026-02-24T19:16:41.551 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.542+0000 7fe9778ce640 1 librados: setting wanted keys 2026-02-24T19:16:41.551 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.542+0000 7fe9778ce640 1 librados: calling monclient init 2026-02-24T19:16:41.551 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.542+0000 7fe9778ce640 10 monclient: init 2026-02-24T19:16:41.551 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.542+0000 7fe9778ce640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:41.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.542+0000 7fe9778ce640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:16:41.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.542+0000 7fe9778ce640 10 monclient(hunting): picked mon.noname-c con 0x7fe9700585e0 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:41.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.542+0000 7fe9778ce640 10 monclient(hunting): picked mon.noname-b con 0x7fe9700b9f80 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:41.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.542+0000 7fe9778ce640 10 monclient(hunting): picked mon.noname-a con 0x7fe9700ba350 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:41.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.542+0000 7fe9778ce640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9701fc0f0 con 0x7fe9700ba350 2026-02-24T19:16:41.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.542+0000 7fe9778ce640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9701fb220 con 0x7fe9700b9f80 2026-02-24T19:16:41.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.542+0000 7fe9778ce640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe970166d40 con 0x7fe9700585e0 2026-02-24T19:16:41.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.542+0000 7fe9778ce640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:41.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.542+0000 7fe9778ce640 10 monclient(hunting): authenticate will time out at 3576.223655s 2026-02-24T19:16:41.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.542+0000 7fe975e44640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7fe9700ba350 0x7fe970156620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:51248/0 (socket says 10.20.193.14:51248) 2026-02-24T19:16:41.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.542+0000 7fe975e44640 1 -- 10.20.193.14:0/1643131480 learned_addr learned my addr 10.20.193.14:0/1643131480 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:16:41.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.543+0000 7fe95dffb640 10 client.?.objecter ms_handle_connect 0x7fe9700ba350 2026-02-24T19:16:41.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.543+0000 7fe95dffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:41.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.544+0000 7fe95dffb640 1 -- 10.20.193.14:0/1643131480 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1924566081 0 0) 0x7fe9701fc0f0 con 0x7fe9700ba350 2026-02-24T19:16:41.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.544+0000 7fe95dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:16:41.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.544+0000 7fe95dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:41.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.544+0000 7fe95dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:41.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.544+0000 7fe95dffb640 10 monclient(hunting): my global_id is 4116 2026-02-24T19:16:41.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.544+0000 7fe95dffb640 1 -- 10.20.193.14:0/1643131480 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe940003610 con 0x7fe9700ba350 2026-02-24T19:16:41.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.546+0000 7fe95dffb640 10 client.?.objecter ms_handle_connect 0x7fe9700b9f80 2026-02-24T19:16:41.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.546+0000 7fe95dffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:41.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.546+0000 7fe95dffb640 10 client.?.objecter ms_handle_connect 0x7fe9700585e0 2026-02-24T19:16:41.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.546+0000 7fe95dffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:41.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.546+0000 7fe95dffb640 1 -- 10.20.193.14:0/1643131480 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 930340419 0 0) 0x7fe940003610 con 0x7fe9700ba350 2026-02-24T19:16:41.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.546+0000 7fe95dffb640 1 -- 10.20.193.14:0/1643131480 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe9701fc0f0 con 0x7fe9700ba350 2026-02-24T19:16:41.554 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.549+0000 7fe95dffb640 1 -- 10.20.193.14:0/1643131480 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fe96c003440 con 0x7fe9700ba350 2026-02-24T19:16:41.554 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.549+0000 7fe95dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:41.554 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.549+0000 7fe95dffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:16:41.555 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.549+0000 7fe95dffb640 10 monclient(hunting): dump: 2026-02-24T19:16:41.555 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:16:41.555 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:41.555 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:41.555 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:41.555 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:41.555 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:16:41.555 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:41.555 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:41.555 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:41.555 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:16:41.556 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.549+0000 7fe95dffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:16:41.575 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.573+0000 7fe95dffb640 1 -- 10.20.193.14:0/1643131480 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3752074627 0 0) 0x7fe9701fc0f0 con 0x7fe9700ba350 2026-02-24T19:16:41.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.573+0000 7fe95dffb640 1 -- 10.20.193.14:0/1643131480 >> v1:10.20.193.170:6789/0 conn(0x7fe9700585e0 legacy=0x7fe9701fb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:41.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.573+0000 7fe95dffb640 1 -- 10.20.193.14:0/1643131480 >> v1:10.20.193.44:6789/0 conn(0x7fe9700b9f80 legacy=0x7fe970166630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:41.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.573+0000 7fe95dffb640 10 monclient: _finish_hunting 0 2026-02-24T19:16:41.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.573+0000 7fe95dffb640 1 monclient: found mon.a 2026-02-24T19:16:41.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.573+0000 7fe95dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:41.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.573+0000 7fe95dffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:16:41.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.573+0000 7fe95dffb640 1 -- 10.20.193.14:0/1643131480 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9701fec50 con 0x7fe9700ba350 2026-02-24T19:16:41.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.573+0000 7fe95dffb640 10 monclient: _finish_auth 0 2026-02-24T19:16:41.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.573+0000 7fe95dffb640 10 monclient: _check_auth_tickets 2026-02-24T19:16:41.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.573+0000 7fe95dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:41.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.573+0000 7fe9778ce640 5 monclient: authenticate success, global_id 4116 2026-02-24T19:16:41.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.573+0000 7fe9778ce640 10 monclient: _renew_subs 2026-02-24T19:16:41.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.573+0000 7fe9778ce640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:16:41.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.573+0000 7fe9778ce640 1 -- 10.20.193.14:0/1643131480 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe9701fef30 con 0x7fe9700ba350 2026-02-24T19:16:41.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.573+0000 7fe9778ce640 10 client.4116.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:16:41.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.573+0000 7fe9778ce640 10 monclient: _renew_subs 2026-02-24T19:16:41.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.573+0000 7fe9778ce640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:16:41.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.573+0000 7fe9778ce640 1 -- 10.20.193.14:0/1643131480 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe9701ff4f0 con 0x7fe9700ba350 2026-02-24T19:16:41.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.573+0000 7fe9778ce640 1 librados: init done 2026-02-24T19:16:41.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.574+0000 7fe9778ce640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:41.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.574+0000 7fe9778ce640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:41.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.574+0000 7fe9778ce640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:16:41.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.574+0000 7fe9778ce640 1 -- 10.20.193.14:0/1643131480 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9700b64c0 con 0x7fe9700ba350 2026-02-24T19:16:41.578 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.575+0000 7fe95dffb640 1 -- 10.20.193.14:0/1643131480 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe96c004c50 con 0x7fe9700ba350 2026-02-24T19:16:41.579 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.575+0000 7fe95dffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:41.579 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.575+0000 7fe95dffb640 1 -- 10.20.193.14:0/1643131480 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fe96c005060 con 0x7fe9700ba350 2026-02-24T19:16:41.579 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.575+0000 7fe95dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:41.579 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.575+0000 7fe95dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:16:41.579 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.575+0000 7fe95f7fe640 4 set_mon_vals no callback set 2026-02-24T19:16:41.579 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.575+0000 7fe95dffb640 10 monclient: dump: 2026-02-24T19:16:41.579 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:16:41.579 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:41.579 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:41.579 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:41.579 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:41.579 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:16:41.580 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:41.580 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:41.580 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:41.580 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:16:41.580 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.575+0000 7fe95dffb640 1 -- 10.20.193.14:0/1643131480 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7fe96c005650 con 0x7fe9700ba350 2026-02-24T19:16:41.580 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.575+0000 7fe95dffb640 1 -- 10.20.193.14:0/1643131480 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (unknown 1121324477 0 0) 0x7fe96c006ee0 con 0x7fe9700ba350 2026-02-24T19:16:41.580 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.575+0000 7fe95dffb640 10 client.4116.objecter ms_dispatch2 0x7fe970000b90 osd_map(1..1 src has 1..1) 2026-02-24T19:16:41.580 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.575+0000 7fe95dffb640 3 client.4116.objecter handle_osd_map got epochs [1,1] > 0 2026-02-24T19:16:41.580 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.575+0000 7fe95dffb640 3 client.4116.objecter handle_osd_map decoding full epoch 1 2026-02-24T19:16:41.580 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.575+0000 7fe95dffb640 20 client.4116.objecter dump_active .. 0 homeless 2026-02-24T19:16:41.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.604+0000 7fe95dffb640 1 -- 10.20.193.14:0/1643131480 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7fe96c0063e0 con 0x7fe9700ba350 2026-02-24T19:16:41.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.604+0000 7fe95dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:41.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.604+0000 7fe95dffb640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:16:41.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.635+0000 7fe9778ce640 10 start_mon_command cmd=[{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-24T19:16:41.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.635+0000 7fe9778ce640 10 monclient: _send_command 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-24T19:16:41.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.635+0000 7fe9778ce640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:16:41.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.635+0000 7fe9778ce640 1 -- 10.20.193.14:0/1643131480 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fe97015a1a0 con 0x7fe9700ba350 2026-02-24T19:16:41.713 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.712+0000 7fe95dffb640 1 -- 10.20.193.14:0/1643131480 <== mon.0 v1:10.20.193.14:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (unknown 2277712955 0 0) 0x7fe96c005970 con 0x7fe9700ba350 2026-02-24T19:16:41.714 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.712+0000 7fe95dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-24T19:16:41.714 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.712+0000 7fe95dffb640 10 monclient: _finish_command 2 = system:0 adjusted tunables profile to default 2026-02-24T19:16:41.714 INFO:teuthology.orchestra.run.trial014.stderr:adjusted tunables profile to default 2026-02-24T19:16:41.715 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.713+0000 7fe9778ce640 10 librados: watch_flush enter 2026-02-24T19:16:41.715 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.713+0000 7fe9778ce640 10 librados: watch_flush exit 2026-02-24T19:16:41.715 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.713+0000 7fe9778ce640 20 client.4116.objecter shutdown clearing up homeless session... 2026-02-24T19:16:41.715 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.713+0000 7fe9778ce640 10 client.4116.objecter successfully canceled tick 2026-02-24T19:16:41.716 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.713+0000 7fe9778ce640 10 monclient: shutdown 2026-02-24T19:16:41.716 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.713+0000 7fe9778ce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:41.716 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.713+0000 7fe9778ce640 1 -- 10.20.193.14:0/1643131480 >> v1:10.20.193.14:6789/0 conn(0x7fe9700ba350 legacy=0x7fe970156620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:41.716 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.713+0000 7fe9778ce640 1 -- 10.20.193.14:0/1643131480 shutdown_connections 2026-02-24T19:16:41.716 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.713+0000 7fe9778ce640 1 -- 10.20.193.14:0/1643131480 >> 10.20.193.14:0/1643131480 conn(0x7fe9700b7990 msgr2=0x7fe9700b66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:41.716 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.713+0000 7fe9778ce640 1 -- 10.20.193.14:0/1643131480 shutdown_connections 2026-02-24T19:16:41.716 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.713+0000 7fe9778ce640 1 -- 10.20.193.14:0/1643131480 wait complete. 2026-02-24T19:16:41.716 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:41.713+0000 7fe9778ce640 1 librados: shutdown 2026-02-24T19:16:41.722 INFO:tasks.ceph:check_enable_crimson: False 2026-02-24T19:16:41.722 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-24T19:16:41.723 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-24T19:16:41.723 DEBUG:teuthology.orchestra.run.trial014:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-24T19:16:41.746 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-24T19:16:41.746 DEBUG:teuthology.orchestra.run.trial014:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2026-02-24T19:16:41.811 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-24T19:16:41.812 DEBUG:teuthology.orchestra.run.trial014:> sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2026-02-24T19:16:41.876 DEBUG:teuthology.orchestra.run.trial014:> set -ex 2026-02-24T19:16:41.877 DEBUG:teuthology.orchestra.run.trial014:> sudo dd if=/var/lib/ceph/osd/ceph-12/fsid of=/dev/stdout 2026-02-24T19:16:41.940 DEBUG:teuthology.orchestra.run.trial044:> set -ex 2026-02-24T19:16:41.940 DEBUG:teuthology.orchestra.run.trial044:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-24T19:16:41.966 DEBUG:teuthology.orchestra.run.trial044:> set -ex 2026-02-24T19:16:41.966 DEBUG:teuthology.orchestra.run.trial044:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2026-02-24T19:16:42.030 DEBUG:teuthology.orchestra.run.trial044:> set -ex 2026-02-24T19:16:42.030 DEBUG:teuthology.orchestra.run.trial044:> sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2026-02-24T19:16:42.094 DEBUG:teuthology.orchestra.run.trial044:> set -ex 2026-02-24T19:16:42.094 DEBUG:teuthology.orchestra.run.trial044:> sudo dd if=/var/lib/ceph/osd/ceph-13/fsid of=/dev/stdout 2026-02-24T19:16:42.158 DEBUG:teuthology.orchestra.run.trial170:> set -ex 2026-02-24T19:16:42.158 DEBUG:teuthology.orchestra.run.trial170:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-24T19:16:42.186 DEBUG:teuthology.orchestra.run.trial170:> set -ex 2026-02-24T19:16:42.186 DEBUG:teuthology.orchestra.run.trial170:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2026-02-24T19:16:42.209 INFO:tasks.ceph.mgr.y.trial014.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-24T19:16:42.210 INFO:tasks.ceph.mgr.y.trial014.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-24T19:16:42.210 INFO:tasks.ceph.mgr.y.trial014.stderr: from numpy import show_config as show_numpy_config 2026-02-24T19:16:42.225 INFO:tasks.ceph.mgr.x.trial195.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-24T19:16:42.226 INFO:tasks.ceph.mgr.x.trial195.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-24T19:16:42.226 INFO:tasks.ceph.mgr.x.trial195.stderr: from numpy import show_config as show_numpy_config 2026-02-24T19:16:42.249 DEBUG:teuthology.orchestra.run.trial170:> set -ex 2026-02-24T19:16:42.249 DEBUG:teuthology.orchestra.run.trial170:> sudo dd if=/var/lib/ceph/osd/ceph-10/fsid of=/dev/stdout 2026-02-24T19:16:42.313 DEBUG:teuthology.orchestra.run.trial170:> set -ex 2026-02-24T19:16:42.313 DEBUG:teuthology.orchestra.run.trial170:> sudo dd if=/var/lib/ceph/osd/ceph-14/fsid of=/dev/stdout 2026-02-24T19:16:42.377 DEBUG:teuthology.orchestra.run.trial195:> set -ex 2026-02-24T19:16:42.377 DEBUG:teuthology.orchestra.run.trial195:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-24T19:16:42.402 DEBUG:teuthology.orchestra.run.trial195:> set -ex 2026-02-24T19:16:42.402 DEBUG:teuthology.orchestra.run.trial195:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2026-02-24T19:16:42.465 DEBUG:teuthology.orchestra.run.trial195:> set -ex 2026-02-24T19:16:42.465 DEBUG:teuthology.orchestra.run.trial195:> sudo dd if=/var/lib/ceph/osd/ceph-11/fsid of=/dev/stdout 2026-02-24T19:16:42.528 DEBUG:teuthology.orchestra.run.trial195:> set -ex 2026-02-24T19:16:42.528 DEBUG:teuthology.orchestra.run.trial195:> sudo dd if=/var/lib/ceph/osd/ceph-15/fsid of=/dev/stdout 2026-02-24T19:16:42.593 DEBUG:teuthology.orchestra.run.trial195:> sudo ceph --cluster ceph osd new 9a3fd69b-7f2a-443b-9ae1-673acfad8b00 0 2026-02-24T19:16:42.700 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.699+0000 7ffb6d7e3640 10 monclient: get_monmap_and_config 2026-02-24T19:16:42.700 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.699+0000 7ffb6d7e3640 10 monclient: build_initial_monmap 2026-02-24T19:16:42.700 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.699+0000 7ffb6d7e3640 10 monclient: monmap: 2026-02-24T19:16:42.700 INFO:teuthology.orchestra.run.trial195.stderr:epoch 0 2026-02-24T19:16:42.700 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:42.700 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:16:42.699736+0000 2026-02-24T19:16:42.700 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:16:42.699736+0000 2026-02-24T19:16:42.700 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:42.700 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:42.700 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:42.700 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:42.700 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:42.700 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:42.701 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.699+0000 7ffb6d7e3640 1 Processor -- start 2026-02-24T19:16:42.701 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.699+0000 7ffb6d7e3640 1 -- start start 2026-02-24T19:16:42.701 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.699+0000 7ffb6d7e3640 10 monclient: init 2026-02-24T19:16:42.701 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.699+0000 7ffb6d7e3640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:42.701 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.699+0000 7ffb6d7e3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:16:42.701 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.699+0000 7ffb6d7e3640 10 monclient(hunting): picked mon.noname-c con 0x7ffb68121db0 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:42.701 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.699+0000 7ffb6d7e3640 10 monclient(hunting): picked mon.noname-a con 0x7ffb68142a00 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:42.701 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.699+0000 7ffb6d7e3640 10 monclient(hunting): picked mon.noname-b con 0x7ffb68164710 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:42.701 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.699+0000 7ffb6d7e3640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb681864c0 con 0x7ffb68142a00 2026-02-24T19:16:42.701 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.699+0000 7ffb6d7e3640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb681876c0 con 0x7ffb68164710 2026-02-24T19:16:42.701 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.699+0000 7ffb6d7e3640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb681888c0 con 0x7ffb68121db0 2026-02-24T19:16:42.702 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.699+0000 7ffb6d7e3640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:42.702 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.699+0000 7ffb6d7e3640 10 monclient(hunting): authenticate will time out at 3571.334799s 2026-02-24T19:16:42.702 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.700+0000 7ffb667fc640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7ffb68142a00 0x7ffb68162e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.195:34034/0 (socket says 10.20.193.195:34034) 2026-02-24T19:16:42.702 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.700+0000 7ffb667fc640 1 -- 10.20.193.195:0/4200382149 learned_addr learned my addr 10.20.193.195:0/4200382149 (peer_addr_for_me v1:10.20.193.195:0/0) 2026-02-24T19:16:42.703 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.701+0000 7ffb65ffb640 1 -- 10.20.193.195:0/4200382149 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1492736845 0 0) 0x7ffb681864c0 con 0x7ffb68142a00 2026-02-24T19:16:42.703 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.701+0000 7ffb65ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:16:42.703 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.701+0000 7ffb65ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:42.703 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.701+0000 7ffb65ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:42.703 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.701+0000 7ffb65ffb640 10 monclient(hunting): my global_id is 4119 2026-02-24T19:16:42.703 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.701+0000 7ffb65ffb640 1 -- 10.20.193.195:0/4200382149 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb54003610 con 0x7ffb68142a00 2026-02-24T19:16:42.703 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.702+0000 7ffb65ffb640 1 -- 10.20.193.195:0/4200382149 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1514550437 0 0) 0x7ffb681888c0 con 0x7ffb68121db0 2026-02-24T19:16:42.703 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.702+0000 7ffb65ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:16:42.703 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.702+0000 7ffb65ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:42.703 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.702+0000 7ffb65ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:42.703 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.702+0000 7ffb65ffb640 10 monclient(hunting): my global_id is 4121 2026-02-24T19:16:42.703 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.702+0000 7ffb65ffb640 1 -- 10.20.193.195:0/4200382149 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb681864c0 con 0x7ffb68121db0 2026-02-24T19:16:42.703 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.702+0000 7ffb65ffb640 1 -- 10.20.193.195:0/4200382149 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2376314527 0 0) 0x7ffb681876c0 con 0x7ffb68164710 2026-02-24T19:16:42.703 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.702+0000 7ffb65ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:16:42.704 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.702+0000 7ffb65ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:42.704 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.702+0000 7ffb65ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:42.704 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.702+0000 7ffb65ffb640 10 monclient(hunting): my global_id is 4120 2026-02-24T19:16:42.704 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.702+0000 7ffb65ffb640 1 -- 10.20.193.195:0/4200382149 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb681888c0 con 0x7ffb68164710 2026-02-24T19:16:42.705 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.703+0000 7ffb65ffb640 1 -- 10.20.193.195:0/4200382149 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1809039227 0 0) 0x7ffb54003610 con 0x7ffb68142a00 2026-02-24T19:16:42.705 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.703+0000 7ffb65ffb640 1 -- 10.20.193.195:0/4200382149 >> v1:10.20.193.170:6789/0 conn(0x7ffb68121db0 legacy=0x7ffb68122180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:42.705 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.703+0000 7ffb65ffb640 1 -- 10.20.193.195:0/4200382149 >> v1:10.20.193.44:6789/0 conn(0x7ffb68164710 legacy=0x7ffb68184bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:42.705 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.703+0000 7ffb65ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:16:42.705 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.703+0000 7ffb65ffb640 1 monclient: found mon.noname-a 2026-02-24T19:16:42.705 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.703+0000 7ffb65ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:42.705 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.703+0000 7ffb65ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:16:42.705 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.703+0000 7ffb65ffb640 1 -- 10.20.193.195:0/4200382149 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb68189b60 con 0x7ffb68142a00 2026-02-24T19:16:42.705 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.703+0000 7ffb65ffb640 10 monclient: _finish_auth 0 2026-02-24T19:16:42.705 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.703+0000 7ffb65ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:16:42.705 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.703+0000 7ffb65ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:42.705 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.703+0000 7ffb65ffb640 1 -- 10.20.193.195:0/4200382149 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ffb50002df0 con 0x7ffb68142a00 2026-02-24T19:16:42.705 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.703+0000 7ffb65ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:42.705 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.703+0000 7ffb65ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:16:42.705 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.703+0000 7ffb65ffb640 10 monclient: dump: 2026-02-24T19:16:42.705 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:42.705 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:42.705 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:42.705 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:42.705 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:42.705 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:42.705 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:42.705 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:42.705 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:42.706 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:42.706 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.703+0000 7ffb6d7e3640 5 monclient: authenticate success, global_id 4119 2026-02-24T19:16:42.706 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.703+0000 7ffb6d7e3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:16:42.707 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.704+0000 7ffb65ffb640 1 -- 10.20.193.195:0/4200382149 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffb50003030 con 0x7ffb68142a00 2026-02-24T19:16:42.707 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.704+0000 7ffb65ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:42.707 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.704+0000 7ffb65ffb640 1 -- 10.20.193.195:0/4200382149 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ffb50003470 con 0x7ffb68142a00 2026-02-24T19:16:42.707 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.704+0000 7ffb65ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:42.707 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.704+0000 7ffb65ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:16:42.707 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.704+0000 7ffb65ffb640 10 monclient: dump: 2026-02-24T19:16:42.707 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:42.707 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:42.707 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:42.707 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:42.707 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:42.707 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:42.708 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:42.708 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:42.708 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:42.708 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:42.708 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.704+0000 7ffb6d7e3640 10 monclient: get_monmap_and_config success 2026-02-24T19:16:42.708 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.704+0000 7ffb6d7e3640 4 set_mon_vals no callback set 2026-02-24T19:16:42.708 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.704+0000 7ffb6d7e3640 10 monclient: shutdown 2026-02-24T19:16:42.708 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.704+0000 7ffb6d7e3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:42.708 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.704+0000 7ffb6d7e3640 1 -- 10.20.193.195:0/4200382149 >> v1:10.20.193.14:6789/0 conn(0x7ffb68142a00 legacy=0x7ffb68162e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:42.708 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.704+0000 7ffb6d7e3640 1 -- 10.20.193.195:0/4200382149 shutdown_connections 2026-02-24T19:16:42.708 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.704+0000 7ffb6d7e3640 1 -- 10.20.193.195:0/4200382149 >> 10.20.193.195:0/4200382149 conn(0x7ffb68057440 msgr2=0x7ffb68057840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:42.708 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.705+0000 7ffb6d7e3640 1 -- 10.20.193.195:0/4200382149 shutdown_connections 2026-02-24T19:16:42.708 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.705+0000 7ffb6d7e3640 1 -- 10.20.193.195:0/4200382149 wait complete. 2026-02-24T19:16:42.708 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.705+0000 7ffb6d7e3640 10 monclient: build_initial_monmap 2026-02-24T19:16:42.708 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.705+0000 7ffb6d7e3640 10 monclient: monmap: 2026-02-24T19:16:42.708 INFO:teuthology.orchestra.run.trial195.stderr:epoch 0 2026-02-24T19:16:42.708 INFO:teuthology.orchestra.run.trial195.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:16:42.708 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 0.000000 2026-02-24T19:16:42.708 INFO:teuthology.orchestra.run.trial195.stderr:created 0.000000 2026-02-24T19:16:42.708 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:42.708 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 1 2026-02-24T19:16:42.708 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:42.708 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:42.708 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:42.708 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:42.708 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.705+0000 7ffb6d7e3640 1 librados: starting msgr at 2026-02-24T19:16:42.709 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.705+0000 7ffb6d7e3640 1 librados: starting objecter 2026-02-24T19:16:42.709 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.705+0000 7ffb6d7e3640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:16:42.709 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.705+0000 7ffb6d7e3640 1 Processor -- start 2026-02-24T19:16:42.709 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.705+0000 7ffb6d7e3640 1 -- start start 2026-02-24T19:16:42.709 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.705+0000 7ffb6d7e3640 1 librados: setting wanted keys 2026-02-24T19:16:42.709 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.705+0000 7ffb6d7e3640 1 librados: calling monclient init 2026-02-24T19:16:42.709 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.705+0000 7ffb6d7e3640 10 monclient: init 2026-02-24T19:16:42.709 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.705+0000 7ffb6d7e3640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:42.709 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.705+0000 7ffb6d7e3640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:16:42.709 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.705+0000 7ffb6d7e3640 10 monclient(hunting): picked mon.noname-c con 0x7ffb68121db0 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:42.709 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.705+0000 7ffb6d7e3640 10 monclient(hunting): picked mon.noname-b con 0x7ffb68142a00 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:42.709 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.705+0000 7ffb6d7e3640 10 monclient(hunting): picked mon.noname-a con 0x7ffb68164710 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:42.709 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.705+0000 7ffb6d7e3640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb6811c8e0 con 0x7ffb68164710 2026-02-24T19:16:42.709 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.705+0000 7ffb6d7e3640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb6811cab0 con 0x7ffb68142a00 2026-02-24T19:16:42.709 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.705+0000 7ffb6d7e3640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb6811cc80 con 0x7ffb68121db0 2026-02-24T19:16:42.709 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.705+0000 7ffb6d7e3640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:42.709 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.705+0000 7ffb6d7e3640 10 monclient(hunting): authenticate will time out at 3571.340564s 2026-02-24T19:16:42.709 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.705+0000 7ffb677fe640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7ffb68164710 0x7ffb6811c1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.195:34046/0 (socket says 10.20.193.195:34046) 2026-02-24T19:16:42.709 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.705+0000 7ffb677fe640 1 -- 10.20.193.195:0/3802324024 learned_addr learned my addr 10.20.193.195:0/3802324024 (peer_addr_for_me v1:10.20.193.195:0/0) 2026-02-24T19:16:42.709 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.706+0000 7ffb477fe640 10 client.?.objecter ms_handle_connect 0x7ffb68164710 2026-02-24T19:16:42.709 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.706+0000 7ffb477fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:42.710 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.706+0000 7ffb477fe640 10 client.?.objecter ms_handle_connect 0x7ffb68142a00 2026-02-24T19:16:42.710 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.706+0000 7ffb477fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:42.710 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.707+0000 7ffb477fe640 1 -- 10.20.193.195:0/3802324024 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1426404094 0 0) 0x7ffb6811c8e0 con 0x7ffb68164710 2026-02-24T19:16:42.710 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.707+0000 7ffb477fe640 10 monclient(hunting): _negotiate 2026-02-24T19:16:42.710 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.707+0000 7ffb477fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:42.710 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.707+0000 7ffb477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:42.710 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.707+0000 7ffb477fe640 10 monclient(hunting): my global_id is 4122 2026-02-24T19:16:42.710 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.707+0000 7ffb477fe640 1 -- 10.20.193.195:0/3802324024 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb34003610 con 0x7ffb68164710 2026-02-24T19:16:42.710 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.707+0000 7ffb477fe640 1 -- 10.20.193.195:0/3802324024 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2983338911 0 0) 0x7ffb6811cab0 con 0x7ffb68142a00 2026-02-24T19:16:42.710 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.707+0000 7ffb477fe640 10 monclient(hunting): _negotiate 2026-02-24T19:16:42.710 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.707+0000 7ffb477fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:42.710 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.707+0000 7ffb477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:42.710 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.707+0000 7ffb477fe640 10 monclient(hunting): my global_id is 4123 2026-02-24T19:16:42.710 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.707+0000 7ffb477fe640 1 -- 10.20.193.195:0/3802324024 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb6811c8e0 con 0x7ffb68142a00 2026-02-24T19:16:42.711 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.709+0000 7ffb477fe640 1 -- 10.20.193.195:0/3802324024 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1302200850 0 0) 0x7ffb34003610 con 0x7ffb68164710 2026-02-24T19:16:42.711 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.709+0000 7ffb477fe640 1 -- 10.20.193.195:0/3802324024 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffb6811cab0 con 0x7ffb68164710 2026-02-24T19:16:42.711 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.709+0000 7ffb477fe640 1 -- 10.20.193.195:0/3802324024 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ffb58003470 con 0x7ffb68164710 2026-02-24T19:16:42.711 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.709+0000 7ffb477fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:42.711 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.709+0000 7ffb477fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:16:42.711 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.709+0000 7ffb477fe640 10 monclient(hunting): dump: 2026-02-24T19:16:42.711 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:42.711 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:42.711 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:42.711 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:42.711 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:42.711 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:42.711 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:42.711 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:42.711 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:42.711 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:42.711 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.709+0000 7ffb477fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:16:42.712 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.711+0000 7ffb477fe640 1 -- 10.20.193.195:0/3802324024 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1877910668 0 0) 0x7ffb6811cab0 con 0x7ffb68164710 2026-02-24T19:16:42.712 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.711+0000 7ffb477fe640 1 -- 10.20.193.195:0/3802324024 >> v1:10.20.193.170:6789/0 conn(0x7ffb68121db0 legacy=0x7ffb68184bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:42.712 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.711+0000 7ffb477fe640 1 -- 10.20.193.195:0/3802324024 >> v1:10.20.193.44:6789/0 conn(0x7ffb68142a00 legacy=0x7ffb68148830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:42.712 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.711+0000 7ffb477fe640 10 monclient: _finish_hunting 0 2026-02-24T19:16:42.712 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.711+0000 7ffb477fe640 1 monclient: found mon.a 2026-02-24T19:16:42.712 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.711+0000 7ffb477fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:42.712 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.711+0000 7ffb477fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:16:42.713 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.711+0000 7ffb477fe640 1 -- 10.20.193.195:0/3802324024 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb6811ce50 con 0x7ffb68164710 2026-02-24T19:16:42.713 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.711+0000 7ffb477fe640 10 monclient: _finish_auth 0 2026-02-24T19:16:42.713 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.711+0000 7ffb477fe640 10 monclient: _check_auth_tickets 2026-02-24T19:16:42.713 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.711+0000 7ffb477fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:42.713 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.711+0000 7ffb6d7e3640 5 monclient: authenticate success, global_id 4122 2026-02-24T19:16:42.713 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.711+0000 7ffb6d7e3640 10 monclient: _renew_subs 2026-02-24T19:16:42.713 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.711+0000 7ffb6d7e3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:16:42.713 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.711+0000 7ffb6d7e3640 1 -- 10.20.193.195:0/3802324024 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ffb68150010 con 0x7ffb68164710 2026-02-24T19:16:42.713 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.711+0000 7ffb6d7e3640 10 client.4122.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:16:42.713 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.711+0000 7ffb6d7e3640 10 monclient: _renew_subs 2026-02-24T19:16:42.713 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.711+0000 7ffb6d7e3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:16:42.713 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.711+0000 7ffb6d7e3640 1 -- 10.20.193.195:0/3802324024 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ffb68150600 con 0x7ffb68164710 2026-02-24T19:16:42.713 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.711+0000 7ffb6d7e3640 1 librados: init done 2026-02-24T19:16:42.713 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.711+0000 7ffb6d7e3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:42.713 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.711+0000 7ffb6d7e3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:42.713 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.711+0000 7ffb6d7e3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:16:42.713 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.711+0000 7ffb6d7e3640 1 -- 10.20.193.195:0/3802324024 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb68188de0 con 0x7ffb68164710 2026-02-24T19:16:42.714 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.712+0000 7ffb477fe640 1 -- 10.20.193.195:0/3802324024 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffb58003820 con 0x7ffb68164710 2026-02-24T19:16:42.714 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.712+0000 7ffb477fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:42.714 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.712+0000 7ffb477fe640 1 -- 10.20.193.195:0/3802324024 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ffb58003f10 con 0x7ffb68164710 2026-02-24T19:16:42.714 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.712+0000 7ffb477fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:42.714 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.712+0000 7ffb477fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:16:42.714 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.712+0000 7ffb477fe640 10 monclient: dump: 2026-02-24T19:16:42.714 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:42.714 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:42.714 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:42.714 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:42.714 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:42.714 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:42.714 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:42.714 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:42.714 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:42.714 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:42.714 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.712+0000 7ffb657fa640 4 set_mon_vals no callback set 2026-02-24T19:16:42.714 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.712+0000 7ffb477fe640 1 -- 10.20.193.195:0/3802324024 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7ffb58004500 con 0x7ffb68164710 2026-02-24T19:16:42.714 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.712+0000 7ffb477fe640 1 -- 10.20.193.195:0/3802324024 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 720+0+0 (unknown 3078237851 0 0) 0x7ffb58006fa0 con 0x7ffb68164710 2026-02-24T19:16:42.714 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.712+0000 7ffb477fe640 10 client.4122.objecter ms_dispatch2 0x7ffb68000b90 osd_map(2..2 src has 1..2) 2026-02-24T19:16:42.714 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.712+0000 7ffb477fe640 3 client.4122.objecter handle_osd_map got epochs [2,2] > 0 2026-02-24T19:16:42.714 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.712+0000 7ffb477fe640 3 client.4122.objecter handle_osd_map decoding full epoch 2 2026-02-24T19:16:42.714 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.713+0000 7ffb477fe640 20 client.4122.objecter dump_active .. 0 homeless 2026-02-24T19:16:42.742 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.741+0000 7ffb477fe640 1 -- 10.20.193.195:0/3802324024 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7ffb58004820 con 0x7ffb68164710 2026-02-24T19:16:42.742 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.741+0000 7ffb477fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:42.742 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.741+0000 7ffb477fe640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:16:42.775 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.774+0000 7ffb6d7e3640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "9a3fd69b-7f2a-443b-9ae1-673acfad8b00", "id": 0}] 2026-02-24T19:16:42.775 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.774+0000 7ffb6d7e3640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "9a3fd69b-7f2a-443b-9ae1-673acfad8b00", "id": 0}] 2026-02-24T19:16:42.775 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.774+0000 7ffb6d7e3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:16:42.775 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.774+0000 7ffb6d7e3640 1 -- 10.20.193.195:0/3802324024 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "osd new", "uuid": "9a3fd69b-7f2a-443b-9ae1-673acfad8b00", "id": 0} v 0) -- 0x7ffb680553a0 con 0x7ffb68164710 2026-02-24T19:16:42.820 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.819+0000 7ffb477fe640 1 -- 10.20.193.195:0/3802324024 <== mon.0 v1:10.20.193.14:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9a3fd69b-7f2a-443b-9ae1-673acfad8b00", "id": 0}]=0 v3) ==== 112+0+2 (unknown 1656002493 0 732707515) 0x7ffb680553a0 con 0x7ffb68164710 2026-02-24T19:16:42.820 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.819+0000 7ffb477fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "9a3fd69b-7f2a-443b-9ae1-673acfad8b00", "id": 0}] 2026-02-24T19:16:42.820 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.819+0000 7ffb477fe640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:16:42.820 INFO:teuthology.orchestra.run.trial195.stdout:0 2026-02-24T19:16:42.821 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.819+0000 7ffb6d7e3640 10 librados: watch_flush enter 2026-02-24T19:16:42.821 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.819+0000 7ffb6d7e3640 10 librados: watch_flush exit 2026-02-24T19:16:42.821 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.819+0000 7ffb6d7e3640 20 client.4122.objecter shutdown clearing up homeless session... 2026-02-24T19:16:42.821 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.819+0000 7ffb6d7e3640 10 client.4122.objecter successfully canceled tick 2026-02-24T19:16:42.821 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.819+0000 7ffb6d7e3640 10 monclient: shutdown 2026-02-24T19:16:42.821 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.819+0000 7ffb6d7e3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:42.821 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.819+0000 7ffb6d7e3640 1 -- 10.20.193.195:0/3802324024 >> v1:10.20.193.14:6789/0 conn(0x7ffb68164710 legacy=0x7ffb6811c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:42.821 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.819+0000 7ffb6d7e3640 1 -- 10.20.193.195:0/3802324024 shutdown_connections 2026-02-24T19:16:42.821 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.820+0000 7ffb6d7e3640 1 -- 10.20.193.195:0/3802324024 >> 10.20.193.195:0/3802324024 conn(0x7ffb68057440 msgr2=0x7ffb681208b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:42.821 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.820+0000 7ffb6d7e3640 1 -- 10.20.193.195:0/3802324024 shutdown_connections 2026-02-24T19:16:42.821 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.820+0000 7ffb6d7e3640 1 -- 10.20.193.195:0/3802324024 wait complete. 2026-02-24T19:16:42.821 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.820+0000 7ffb6d7e3640 1 librados: shutdown 2026-02-24T19:16:42.829 DEBUG:teuthology.orchestra.run.trial195:> sudo ceph --cluster ceph osd new 7dca8ec5-5aa3-420d-bf78-1331d974dafd 1 2026-02-24T19:16:42.896 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.895+0000 7fabd417f640 10 monclient: get_monmap_and_config 2026-02-24T19:16:42.896 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.895+0000 7fabd417f640 10 monclient: build_initial_monmap 2026-02-24T19:16:42.896 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.895+0000 7fabd417f640 10 monclient: monmap: 2026-02-24T19:16:42.896 INFO:teuthology.orchestra.run.trial195.stderr:epoch 0 2026-02-24T19:16:42.896 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:42.896 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:16:42.895850+0000 2026-02-24T19:16:42.896 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:16:42.895850+0000 2026-02-24T19:16:42.896 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:42.896 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:42.896 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:42.896 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:42.896 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:42.896 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:42.897 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.895+0000 7fabd417f640 1 Processor -- start 2026-02-24T19:16:42.897 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.895+0000 7fabd417f640 1 -- start start 2026-02-24T19:16:42.897 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.895+0000 7fabd417f640 10 monclient: init 2026-02-24T19:16:42.897 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.895+0000 7fabd417f640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:42.897 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.895+0000 7fabd417f640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:16:42.897 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.895+0000 7fabd417f640 10 monclient(hunting): picked mon.noname-c con 0x7fabcc11c500 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:42.897 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.895+0000 7fabd417f640 10 monclient(hunting): picked mon.noname-b con 0x7fabcc11e420 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:42.897 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.895+0000 7fabd417f640 10 monclient(hunting): picked mon.noname-a con 0x7fabcc11ffc0 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:42.897 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.895+0000 7fabd417f640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabcc120d10 con 0x7fabcc11ffc0 2026-02-24T19:16:42.897 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.895+0000 7fabd417f640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabcc120f00 con 0x7fabcc11e420 2026-02-24T19:16:42.898 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.895+0000 7fabd417f640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabcc1210f0 con 0x7fabcc11c500 2026-02-24T19:16:42.898 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.895+0000 7fabd417f640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:42.898 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.895+0000 7fabd417f640 10 monclient(hunting): authenticate will time out at 3571.530825s 2026-02-24T19:16:42.898 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.896+0000 7fabd26f5640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7fabcc11ffc0 0x7fabcc120420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.195:34062/0 (socket says 10.20.193.195:34062) 2026-02-24T19:16:42.898 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.896+0000 7fabd26f5640 1 -- 10.20.193.195:0/1710615761 learned_addr learned my addr 10.20.193.195:0/1710615761 (peer_addr_for_me v1:10.20.193.195:0/0) 2026-02-24T19:16:42.898 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.897+0000 7fabd0ef2640 1 -- 10.20.193.195:0/1710615761 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 383776560 0 0) 0x7fabcc120d10 con 0x7fabcc11ffc0 2026-02-24T19:16:42.898 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.897+0000 7fabd0ef2640 10 monclient(hunting): _negotiate 2026-02-24T19:16:42.899 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.897+0000 7fabd0ef2640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:42.899 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.897+0000 7fabd0ef2640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:42.899 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.897+0000 7fabd0ef2640 10 monclient(hunting): my global_id is 4125 2026-02-24T19:16:42.899 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.897+0000 7fabd0ef2640 1 -- 10.20.193.195:0/1710615761 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabb4003610 con 0x7fabcc11ffc0 2026-02-24T19:16:42.899 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.897+0000 7fabd0ef2640 1 -- 10.20.193.195:0/1710615761 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1892249652 0 0) 0x7fabcc1210f0 con 0x7fabcc11c500 2026-02-24T19:16:42.899 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.897+0000 7fabd0ef2640 10 monclient(hunting): _negotiate 2026-02-24T19:16:42.899 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.897+0000 7fabd0ef2640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:42.899 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.897+0000 7fabd0ef2640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:42.899 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.897+0000 7fabd0ef2640 10 monclient(hunting): my global_id is 4124 2026-02-24T19:16:42.899 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.897+0000 7fabd0ef2640 1 -- 10.20.193.195:0/1710615761 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabcc120d10 con 0x7fabcc11c500 2026-02-24T19:16:42.899 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.898+0000 7fabd0ef2640 1 -- 10.20.193.195:0/1710615761 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 72698019 0 0) 0x7fabcc120f00 con 0x7fabcc11e420 2026-02-24T19:16:42.899 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.898+0000 7fabd0ef2640 10 monclient(hunting): _negotiate 2026-02-24T19:16:42.899 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.898+0000 7fabd0ef2640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:42.899 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.898+0000 7fabd0ef2640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:42.899 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.898+0000 7fabd0ef2640 10 monclient(hunting): my global_id is 4126 2026-02-24T19:16:42.899 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.898+0000 7fabd0ef2640 1 -- 10.20.193.195:0/1710615761 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabcc1210f0 con 0x7fabcc11e420 2026-02-24T19:16:42.900 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.899+0000 7fabd0ef2640 1 -- 10.20.193.195:0/1710615761 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 83405781 0 0) 0x7fabb4003610 con 0x7fabcc11ffc0 2026-02-24T19:16:42.900 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.899+0000 7fabd0ef2640 1 -- 10.20.193.195:0/1710615761 >> v1:10.20.193.170:6789/0 conn(0x7fabcc11c500 legacy=0x7fabcc11c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:42.900 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.899+0000 7fabd0ef2640 1 -- 10.20.193.195:0/1710615761 >> v1:10.20.193.44:6789/0 conn(0x7fabcc11e420 legacy=0x7fabcc11e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:42.901 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.899+0000 7fabd0ef2640 10 monclient: _finish_hunting 0 2026-02-24T19:16:42.901 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.899+0000 7fabd0ef2640 1 monclient: found mon.noname-a 2026-02-24T19:16:42.901 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.899+0000 7fabd0ef2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:42.901 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.899+0000 7fabd0ef2640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:16:42.901 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.899+0000 7fabd0ef2640 1 -- 10.20.193.195:0/1710615761 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabcc121380 con 0x7fabcc11ffc0 2026-02-24T19:16:42.901 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.899+0000 7fabd0ef2640 10 monclient: _finish_auth 0 2026-02-24T19:16:42.901 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.899+0000 7fabd0ef2640 10 monclient: _check_auth_tickets 2026-02-24T19:16:42.901 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.899+0000 7fabd0ef2640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:42.901 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.899+0000 7fabd0ef2640 1 -- 10.20.193.195:0/1710615761 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fabc8003170 con 0x7fabcc11ffc0 2026-02-24T19:16:42.901 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.899+0000 7fabd0ef2640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:42.901 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.899+0000 7fabd0ef2640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:16:42.901 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.899+0000 7fabd0ef2640 10 monclient: dump: 2026-02-24T19:16:42.901 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:42.901 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:42.901 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:42.901 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:42.901 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:42.901 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:42.901 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:42.901 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:42.901 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:42.901 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:42.901 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.899+0000 7fabd417f640 5 monclient: authenticate success, global_id 4125 2026-02-24T19:16:42.901 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.899+0000 7fabd417f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:16:42.903 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.900+0000 7fabd0ef2640 1 -- 10.20.193.195:0/1710615761 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fabc80033b0 con 0x7fabcc11ffc0 2026-02-24T19:16:42.903 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.900+0000 7fabd0ef2640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:42.903 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.900+0000 7fabd0ef2640 1 -- 10.20.193.195:0/1710615761 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fabc80037f0 con 0x7fabcc11ffc0 2026-02-24T19:16:42.903 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.900+0000 7fabd0ef2640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:42.903 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.900+0000 7fabd0ef2640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:16:42.903 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.900+0000 7fabd0ef2640 10 monclient: dump: 2026-02-24T19:16:42.903 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:42.903 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:42.903 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:42.903 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:42.903 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:42.903 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:42.903 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:42.903 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:42.904 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:42.904 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:42.904 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.900+0000 7fabd417f640 10 monclient: get_monmap_and_config success 2026-02-24T19:16:42.904 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.900+0000 7fabd417f640 4 set_mon_vals no callback set 2026-02-24T19:16:42.904 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.900+0000 7fabd417f640 10 monclient: shutdown 2026-02-24T19:16:42.904 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.900+0000 7fabd417f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:42.904 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.900+0000 7fabd417f640 1 -- 10.20.193.195:0/1710615761 >> v1:10.20.193.14:6789/0 conn(0x7fabcc11ffc0 legacy=0x7fabcc120420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:42.904 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.900+0000 7fabd417f640 1 -- 10.20.193.195:0/1710615761 shutdown_connections 2026-02-24T19:16:42.904 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.900+0000 7fabd417f640 1 -- 10.20.193.195:0/1710615761 >> 10.20.193.195:0/1710615761 conn(0x7fabcc0588d0 msgr2=0x7fabcc058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:42.904 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.900+0000 7fabd417f640 1 -- 10.20.193.195:0/1710615761 shutdown_connections 2026-02-24T19:16:42.904 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.900+0000 7fabd417f640 1 -- 10.20.193.195:0/1710615761 wait complete. 2026-02-24T19:16:42.904 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.901+0000 7fabd417f640 10 monclient: build_initial_monmap 2026-02-24T19:16:42.904 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.901+0000 7fabd417f640 10 monclient: monmap: 2026-02-24T19:16:42.904 INFO:teuthology.orchestra.run.trial195.stderr:epoch 0 2026-02-24T19:16:42.904 INFO:teuthology.orchestra.run.trial195.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:16:42.904 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 0.000000 2026-02-24T19:16:42.904 INFO:teuthology.orchestra.run.trial195.stderr:created 0.000000 2026-02-24T19:16:42.904 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:42.904 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 1 2026-02-24T19:16:42.904 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:42.904 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:42.904 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:42.904 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:42.904 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.901+0000 7fabd417f640 1 librados: starting msgr at 2026-02-24T19:16:42.904 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.901+0000 7fabd417f640 1 librados: starting objecter 2026-02-24T19:16:42.904 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.901+0000 7fabd417f640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:16:42.905 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.901+0000 7fabd417f640 1 Processor -- start 2026-02-24T19:16:42.905 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.901+0000 7fabd417f640 1 -- start start 2026-02-24T19:16:42.905 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.901+0000 7fabd417f640 1 librados: setting wanted keys 2026-02-24T19:16:42.905 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.901+0000 7fabd417f640 1 librados: calling monclient init 2026-02-24T19:16:42.905 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.901+0000 7fabd417f640 10 monclient: init 2026-02-24T19:16:42.905 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.901+0000 7fabd417f640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:42.905 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.901+0000 7fabd417f640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:16:42.905 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.901+0000 7fabd417f640 10 monclient(hunting): picked mon.noname-a con 0x7fabcc11c500 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:42.905 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.901+0000 7fabd417f640 10 monclient(hunting): picked mon.noname-c con 0x7fabcc11e420 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:42.905 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.901+0000 7fabd417f640 10 monclient(hunting): picked mon.noname-b con 0x7fabcc11ffc0 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:42.905 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.901+0000 7fabd417f640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabcc179870 con 0x7fabcc11c500 2026-02-24T19:16:42.905 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.901+0000 7fabd417f640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabcc17aa50 con 0x7fabcc11ffc0 2026-02-24T19:16:42.905 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.901+0000 7fabd417f640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabcc17bc30 con 0x7fabcc11e420 2026-02-24T19:16:42.905 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.901+0000 7fabd417f640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:42.905 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.901+0000 7fabd417f640 10 monclient(hunting): authenticate will time out at 3571.536449s 2026-02-24T19:16:42.905 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.901+0000 7fabd1ef4640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7fabcc11c500 0x7fabcc130080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.195:34078/0 (socket says 10.20.193.195:34078) 2026-02-24T19:16:42.905 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.901+0000 7fabd16f3640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7fabcc11e420 0x7fabcc176a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.195:32790/0 (socket says 10.20.193.195:32790) 2026-02-24T19:16:42.905 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.901+0000 7fabd1ef4640 1 -- 10.20.193.195:0/2046701608 learned_addr learned my addr 10.20.193.195:0/2046701608 (peer_addr_for_me v1:10.20.193.195:0/0) 2026-02-24T19:16:42.905 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.901+0000 7fabba7fc640 10 client.?.objecter ms_handle_connect 0x7fabcc11e420 2026-02-24T19:16:42.905 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.901+0000 7fabba7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:42.905 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.902+0000 7fabba7fc640 10 client.?.objecter ms_handle_connect 0x7fabcc11c500 2026-02-24T19:16:42.905 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.902+0000 7fabba7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:42.905 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.902+0000 7fabba7fc640 10 client.?.objecter ms_handle_connect 0x7fabcc11ffc0 2026-02-24T19:16:42.905 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.902+0000 7fabba7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:42.906 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.902+0000 7fabba7fc640 1 -- 10.20.193.195:0/2046701608 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2981095682 0 0) 0x7fabcc179870 con 0x7fabcc11c500 2026-02-24T19:16:42.906 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.902+0000 7fabba7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:16:42.906 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.902+0000 7fabba7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:42.906 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.902+0000 7fabba7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:42.907 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.902+0000 7fabba7fc640 10 monclient(hunting): my global_id is 4128 2026-02-24T19:16:42.907 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.902+0000 7fabba7fc640 1 -- 10.20.193.195:0/2046701608 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab9c003610 con 0x7fabcc11c500 2026-02-24T19:16:42.907 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.902+0000 7fabba7fc640 1 -- 10.20.193.195:0/2046701608 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2533829397 0 0) 0x7fabcc17bc30 con 0x7fabcc11e420 2026-02-24T19:16:42.907 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.902+0000 7fabba7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:16:42.907 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.902+0000 7fabba7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:42.907 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.902+0000 7fabba7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:42.907 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.902+0000 7fabba7fc640 10 monclient(hunting): my global_id is 4127 2026-02-24T19:16:42.907 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.902+0000 7fabba7fc640 1 -- 10.20.193.195:0/2046701608 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabcc179870 con 0x7fabcc11e420 2026-02-24T19:16:42.907 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.903+0000 7fabba7fc640 1 -- 10.20.193.195:0/2046701608 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 841527750 0 0) 0x7fabcc17aa50 con 0x7fabcc11ffc0 2026-02-24T19:16:42.907 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.903+0000 7fabba7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:16:42.907 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.903+0000 7fabba7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:42.907 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.903+0000 7fabba7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:42.907 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.903+0000 7fabba7fc640 10 monclient(hunting): my global_id is 4129 2026-02-24T19:16:42.907 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.903+0000 7fabba7fc640 1 -- 10.20.193.195:0/2046701608 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabcc17bc30 con 0x7fabcc11ffc0 2026-02-24T19:16:42.907 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.905+0000 7fabba7fc640 1 -- 10.20.193.195:0/2046701608 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2984746967 0 0) 0x7fab9c003610 con 0x7fabcc11c500 2026-02-24T19:16:42.907 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.905+0000 7fabba7fc640 1 -- 10.20.193.195:0/2046701608 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fabcc17aa50 con 0x7fabcc11c500 2026-02-24T19:16:42.907 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.905+0000 7fabba7fc640 1 -- 10.20.193.195:0/2046701608 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fabbc003190 con 0x7fabcc11c500 2026-02-24T19:16:42.907 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.905+0000 7fabba7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:42.907 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.905+0000 7fabba7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:16:42.907 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.905+0000 7fabba7fc640 10 monclient(hunting): dump: 2026-02-24T19:16:42.907 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:42.907 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:42.907 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:42.907 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:42.907 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:42.907 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:42.907 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:42.908 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:42.908 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:42.908 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:42.908 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.905+0000 7fabba7fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:16:42.908 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.905+0000 7fabba7fc640 1 -- 10.20.193.195:0/2046701608 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1100733226 0 0) 0x7fabcc17bc30 con 0x7fabcc11ffc0 2026-02-24T19:16:42.908 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.905+0000 7fabba7fc640 1 -- 10.20.193.195:0/2046701608 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fab9c003610 con 0x7fabcc11ffc0 2026-02-24T19:16:42.908 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.905+0000 7fabba7fc640 1 -- 10.20.193.195:0/2046701608 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fabc8003560 con 0x7fabcc11ffc0 2026-02-24T19:16:42.908 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.905+0000 7fabba7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:42.908 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.905+0000 7fabba7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:16:42.908 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.905+0000 7fabba7fc640 10 monclient(hunting): dump: 2026-02-24T19:16:42.908 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:42.908 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:42.908 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:42.908 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:42.908 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:42.908 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:42.908 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:42.908 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:42.908 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:42.908 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:42.909 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.906+0000 7fabba7fc640 1 -- 10.20.193.195:0/2046701608 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1265629334 0 0) 0x7fabcc17aa50 con 0x7fabcc11c500 2026-02-24T19:16:42.909 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.906+0000 7fabba7fc640 1 -- 10.20.193.195:0/2046701608 >> v1:10.20.193.170:6789/0 conn(0x7fabcc11e420 legacy=0x7fabcc176a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:42.909 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.906+0000 7fabba7fc640 1 -- 10.20.193.195:0/2046701608 >> v1:10.20.193.44:6789/0 conn(0x7fabcc11ffc0 legacy=0x7fabcc178150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:42.909 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.906+0000 7fabba7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:16:42.909 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.906+0000 7fabba7fc640 1 monclient: found mon.a 2026-02-24T19:16:42.909 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.906+0000 7fabba7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:42.909 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.906+0000 7fabba7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:16:42.909 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.906+0000 7fabba7fc640 1 -- 10.20.193.195:0/2046701608 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabcc17ce10 con 0x7fabcc11c500 2026-02-24T19:16:42.909 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.906+0000 7fabba7fc640 10 monclient: _finish_auth 0 2026-02-24T19:16:42.910 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.906+0000 7fabba7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:16:42.910 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.906+0000 7fabba7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:42.910 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.906+0000 7fabd417f640 5 monclient: authenticate success, global_id 4128 2026-02-24T19:16:42.910 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.906+0000 7fabd417f640 10 monclient: _renew_subs 2026-02-24T19:16:42.910 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.906+0000 7fabd417f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:16:42.910 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.906+0000 7fabd417f640 1 -- 10.20.193.195:0/2046701608 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fabcc179a40 con 0x7fabcc11c500 2026-02-24T19:16:42.910 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.906+0000 7fabd417f640 10 client.4128.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:16:42.910 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.906+0000 7fabd417f640 10 monclient: _renew_subs 2026-02-24T19:16:42.910 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.906+0000 7fabd417f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:16:42.910 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.906+0000 7fabd417f640 1 -- 10.20.193.195:0/2046701608 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fabcc17a080 con 0x7fabcc11c500 2026-02-24T19:16:42.910 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.906+0000 7fabd417f640 1 librados: init done 2026-02-24T19:16:42.910 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.907+0000 7fabd417f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:42.910 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.907+0000 7fabd417f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:42.910 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.907+0000 7fabd417f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:16:42.910 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.907+0000 7fabd417f640 1 -- 10.20.193.195:0/2046701608 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabcc18b560 con 0x7fabcc11c500 2026-02-24T19:16:42.910 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.908+0000 7fabba7fc640 1 -- 10.20.193.195:0/2046701608 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fabbc003500 con 0x7fabcc11c500 2026-02-24T19:16:42.910 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.908+0000 7fabba7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:42.910 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.908+0000 7fabba7fc640 1 -- 10.20.193.195:0/2046701608 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fabbc003b50 con 0x7fabcc11c500 2026-02-24T19:16:42.910 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.908+0000 7fabba7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:42.910 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.908+0000 7fabba7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:16:42.910 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.908+0000 7fabba7fc640 10 monclient: dump: 2026-02-24T19:16:42.910 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:42.910 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:42.910 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:42.910 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:42.910 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:42.910 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:42.911 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:42.911 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:42.911 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:42.911 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:42.911 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.908+0000 7fabbbfff640 4 set_mon_vals no callback set 2026-02-24T19:16:42.911 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.908+0000 7fabba7fc640 1 -- 10.20.193.195:0/2046701608 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7fabbc004140 con 0x7fabcc11c500 2026-02-24T19:16:42.911 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.908+0000 7fabba7fc640 1 -- 10.20.193.195:0/2046701608 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 835+0+0 (unknown 3759579486 0 0) 0x7fabbc006c50 con 0x7fabcc11c500 2026-02-24T19:16:42.911 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.908+0000 7fabba7fc640 10 client.4128.objecter ms_dispatch2 0x7fabcc000b90 osd_map(3..3 src has 1..3) 2026-02-24T19:16:42.911 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.908+0000 7fabba7fc640 3 client.4128.objecter handle_osd_map got epochs [3,3] > 0 2026-02-24T19:16:42.911 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.908+0000 7fabba7fc640 3 client.4128.objecter handle_osd_map decoding full epoch 3 2026-02-24T19:16:42.911 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.908+0000 7fabba7fc640 20 client.4128.objecter dump_active .. 0 homeless 2026-02-24T19:16:42.940 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.939+0000 7fabba7fc640 1 -- 10.20.193.195:0/2046701608 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7fabbc004460 con 0x7fabcc11c500 2026-02-24T19:16:42.940 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.939+0000 7fabba7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:42.940 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.939+0000 7fabba7fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:16:42.977 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.976+0000 7fabd417f640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "7dca8ec5-5aa3-420d-bf78-1331d974dafd", "id": 1}] 2026-02-24T19:16:42.977 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.976+0000 7fabd417f640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "7dca8ec5-5aa3-420d-bf78-1331d974dafd", "id": 1}] 2026-02-24T19:16:42.977 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.976+0000 7fabd417f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:16:42.977 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.976+0000 7fabd417f640 1 -- 10.20.193.195:0/2046701608 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "osd new", "uuid": "7dca8ec5-5aa3-420d-bf78-1331d974dafd", "id": 1} v 0) -- 0x7fabcc17a370 con 0x7fabcc11c500 2026-02-24T19:16:42.998 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.997+0000 7fabba7fc640 1 -- 10.20.193.195:0/2046701608 <== mon.0 v1:10.20.193.14:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7dca8ec5-5aa3-420d-bf78-1331d974dafd", "id": 1}]=0 v4) ==== 112+0+2 (unknown 2814156095 0 940483276) 0x7fabbc0058b0 con 0x7fabcc11c500 2026-02-24T19:16:42.998 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.997+0000 7fabba7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "7dca8ec5-5aa3-420d-bf78-1331d974dafd", "id": 1}] 2026-02-24T19:16:42.998 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.997+0000 7fabba7fc640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:16:42.998 INFO:teuthology.orchestra.run.trial195.stdout:1 2026-02-24T19:16:42.999 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.997+0000 7fabd417f640 10 librados: watch_flush enter 2026-02-24T19:16:42.999 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.997+0000 7fabd417f640 10 librados: watch_flush exit 2026-02-24T19:16:42.999 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.997+0000 7fabd417f640 20 client.4128.objecter shutdown clearing up homeless session... 2026-02-24T19:16:42.999 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.997+0000 7fabd417f640 10 client.4128.objecter successfully canceled tick 2026-02-24T19:16:42.999 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.998+0000 7fabd417f640 10 monclient: shutdown 2026-02-24T19:16:42.999 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.998+0000 7fabd417f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:42.999 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.998+0000 7fabd417f640 1 -- 10.20.193.195:0/2046701608 >> v1:10.20.193.14:6789/0 conn(0x7fabcc11c500 legacy=0x7fabcc130080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:42.999 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.998+0000 7fabd417f640 1 -- 10.20.193.195:0/2046701608 shutdown_connections 2026-02-24T19:16:42.999 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.998+0000 7fabd417f640 1 -- 10.20.193.195:0/2046701608 >> 10.20.193.195:0/2046701608 conn(0x7fabcc0588d0 msgr2=0x7fabcc059490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:42.999 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.998+0000 7fabd417f640 1 -- 10.20.193.195:0/2046701608 shutdown_connections 2026-02-24T19:16:42.999 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.998+0000 7fabd417f640 1 -- 10.20.193.195:0/2046701608 wait complete. 2026-02-24T19:16:42.999 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:42.998+0000 7fabd417f640 1 librados: shutdown 2026-02-24T19:16:43.007 DEBUG:teuthology.orchestra.run.trial195:> sudo ceph --cluster ceph osd new 5a7b7c02-22f9-4eb1-a1b0-afb106604416 2 2026-02-24T19:16:43.071 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.070+0000 7fd4060e1640 10 monclient: get_monmap_and_config 2026-02-24T19:16:43.072 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.070+0000 7fd4060e1640 10 monclient: build_initial_monmap 2026-02-24T19:16:43.072 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.070+0000 7fd4060e1640 10 monclient: monmap: 2026-02-24T19:16:43.072 INFO:teuthology.orchestra.run.trial195.stderr:epoch 0 2026-02-24T19:16:43.072 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:43.072 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:16:43.071373+0000 2026-02-24T19:16:43.072 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:16:43.071373+0000 2026-02-24T19:16:43.072 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:43.072 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:43.072 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:43.072 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:43.072 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:43.072 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:43.073 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.071+0000 7fd4060e1640 1 Processor -- start 2026-02-24T19:16:43.073 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.071+0000 7fd4060e1640 1 -- start start 2026-02-24T19:16:43.073 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.071+0000 7fd4060e1640 10 monclient: init 2026-02-24T19:16:43.073 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.071+0000 7fd4060e1640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:43.073 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.071+0000 7fd4060e1640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:16:43.073 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.071+0000 7fd4060e1640 10 monclient(hunting): picked mon.noname-b con 0x7fd40005d9b0 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:43.073 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.071+0000 7fd4060e1640 10 monclient(hunting): picked mon.noname-a con 0x7fd40005dd80 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:43.073 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.071+0000 7fd4060e1640 10 monclient(hunting): picked mon.noname-c con 0x7fd4001649b0 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:43.073 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.071+0000 7fd4060e1640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd40005e200 con 0x7fd40005dd80 2026-02-24T19:16:43.073 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.071+0000 7fd4060e1640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4001874c0 con 0x7fd40005d9b0 2026-02-24T19:16:43.073 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.071+0000 7fd4060e1640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4001886a0 con 0x7fd4001649b0 2026-02-24T19:16:43.073 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.071+0000 7fd4060e1640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:43.073 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.071+0000 7fd4060e1640 10 monclient(hunting): authenticate will time out at 3571.706513s 2026-02-24T19:16:43.073 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.071+0000 7fd3ff7fe640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7fd40005d9b0 0x7fd40011b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.195:43818/0 (socket says 10.20.193.195:43818) 2026-02-24T19:16:43.073 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.071+0000 7fd3ff7fe640 1 -- 10.20.193.195:0/3174245711 learned_addr learned my addr 10.20.193.195:0/3174245711 (peer_addr_for_me v1:10.20.193.195:0/0) 2026-02-24T19:16:43.074 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.073+0000 7fd3fe7fc640 1 -- 10.20.193.195:0/3174245711 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 424452217 0 0) 0x7fd4001874c0 con 0x7fd40005d9b0 2026-02-24T19:16:43.074 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.073+0000 7fd3fe7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:16:43.074 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.073+0000 7fd3fe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:43.074 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.073+0000 7fd3fe7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:43.074 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.073+0000 7fd3fe7fc640 10 monclient(hunting): my global_id is 4132 2026-02-24T19:16:43.074 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.073+0000 7fd3fe7fc640 1 -- 10.20.193.195:0/3174245711 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3e4003610 con 0x7fd40005d9b0 2026-02-24T19:16:43.074 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.073+0000 7fd3fe7fc640 1 -- 10.20.193.195:0/3174245711 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 491637496 0 0) 0x7fd4001886a0 con 0x7fd4001649b0 2026-02-24T19:16:43.074 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.073+0000 7fd3fe7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:16:43.075 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.073+0000 7fd3fe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:43.075 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.073+0000 7fd3fe7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:43.075 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.073+0000 7fd3fe7fc640 10 monclient(hunting): my global_id is 4130 2026-02-24T19:16:43.075 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.073+0000 7fd3fe7fc640 1 -- 10.20.193.195:0/3174245711 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4001874c0 con 0x7fd4001649b0 2026-02-24T19:16:43.075 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.073+0000 7fd3fe7fc640 1 -- 10.20.193.195:0/3174245711 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 943193020 0 0) 0x7fd40005e200 con 0x7fd40005dd80 2026-02-24T19:16:43.075 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.073+0000 7fd3fe7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:16:43.075 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.073+0000 7fd3fe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:43.075 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.073+0000 7fd3fe7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:43.075 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.073+0000 7fd3fe7fc640 10 monclient(hunting): my global_id is 4131 2026-02-24T19:16:43.075 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.073+0000 7fd3fe7fc640 1 -- 10.20.193.195:0/3174245711 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4001886a0 con 0x7fd40005dd80 2026-02-24T19:16:43.076 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.074+0000 7fd3fe7fc640 1 -- 10.20.193.195:0/3174245711 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1630843780 0 0) 0x7fd3e4003610 con 0x7fd40005d9b0 2026-02-24T19:16:43.076 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.074+0000 7fd3fe7fc640 1 -- 10.20.193.195:0/3174245711 >> v1:10.20.193.170:6789/0 conn(0x7fd4001649b0 legacy=0x7fd400184d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:43.076 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.075+0000 7fd3fe7fc640 1 -- 10.20.193.195:0/3174245711 >> v1:10.20.193.14:6789/0 conn(0x7fd40005dd80 legacy=0x7fd40011b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:43.076 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.075+0000 7fd3fe7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:16:43.076 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.075+0000 7fd3fe7fc640 1 monclient: found mon.noname-b 2026-02-24T19:16:43.076 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.075+0000 7fd3fe7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:43.076 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.075+0000 7fd3fe7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.44:6789/0 2026-02-24T19:16:43.076 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.075+0000 7fd3fe7fc640 1 -- 10.20.193.195:0/3174245711 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd400189920 con 0x7fd40005d9b0 2026-02-24T19:16:43.076 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.075+0000 7fd3fe7fc640 10 monclient: _finish_auth 0 2026-02-24T19:16:43.076 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.075+0000 7fd3fe7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:16:43.076 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.075+0000 7fd3fe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:43.076 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.075+0000 7fd3fe7fc640 1 -- 10.20.193.195:0/3174245711 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fd3ec002df0 con 0x7fd40005d9b0 2026-02-24T19:16:43.076 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.075+0000 7fd3fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:43.076 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.075+0000 7fd3fe7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:16:43.076 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.075+0000 7fd3fe7fc640 10 monclient: dump: 2026-02-24T19:16:43.076 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:43.076 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:43.076 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.077 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.077 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:43.077 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:43.077 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:43.077 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:43.077 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:43.077 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:43.077 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.075+0000 7fd4060e1640 5 monclient: authenticate success, global_id 4132 2026-02-24T19:16:43.077 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.075+0000 7fd4060e1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:16:43.078 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.076+0000 7fd3fe7fc640 1 -- 10.20.193.195:0/3174245711 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd3ec003030 con 0x7fd40005d9b0 2026-02-24T19:16:43.078 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.076+0000 7fd3fe7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:43.078 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.076+0000 7fd3fe7fc640 1 -- 10.20.193.195:0/3174245711 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fd3ec003470 con 0x7fd40005d9b0 2026-02-24T19:16:43.078 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.076+0000 7fd3fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:43.078 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.076+0000 7fd3fe7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:16:43.078 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.076+0000 7fd3fe7fc640 10 monclient: dump: 2026-02-24T19:16:43.078 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:43.078 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:43.078 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.078 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.079 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:43.079 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:43.079 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:43.079 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:43.079 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:43.079 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:43.079 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.076+0000 7fd4060e1640 10 monclient: get_monmap_and_config success 2026-02-24T19:16:43.079 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.076+0000 7fd4060e1640 4 set_mon_vals no callback set 2026-02-24T19:16:43.079 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.076+0000 7fd4060e1640 10 monclient: shutdown 2026-02-24T19:16:43.079 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.076+0000 7fd4060e1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:43.079 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.076+0000 7fd4060e1640 1 -- 10.20.193.195:0/3174245711 >> v1:10.20.193.44:6789/0 conn(0x7fd40005d9b0 legacy=0x7fd40011b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:43.079 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.076+0000 7fd4060e1640 1 -- 10.20.193.195:0/3174245711 shutdown_connections 2026-02-24T19:16:43.079 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.076+0000 7fd4060e1640 1 -- 10.20.193.195:0/3174245711 >> 10.20.193.195:0/3174245711 conn(0x7fd4000588d0 msgr2=0x7fd400058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:43.079 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.076+0000 7fd4060e1640 1 -- 10.20.193.195:0/3174245711 shutdown_connections 2026-02-24T19:16:43.079 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.076+0000 7fd4060e1640 1 -- 10.20.193.195:0/3174245711 wait complete. 2026-02-24T19:16:43.079 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.076+0000 7fd4060e1640 10 monclient: build_initial_monmap 2026-02-24T19:16:43.079 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.076+0000 7fd4060e1640 10 monclient: monmap: 2026-02-24T19:16:43.079 INFO:teuthology.orchestra.run.trial195.stderr:epoch 0 2026-02-24T19:16:43.079 INFO:teuthology.orchestra.run.trial195.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:16:43.079 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 0.000000 2026-02-24T19:16:43.079 INFO:teuthology.orchestra.run.trial195.stderr:created 0.000000 2026-02-24T19:16:43.079 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:43.079 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 1 2026-02-24T19:16:43.079 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:43.079 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:43.079 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:43.080 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:43.080 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.076+0000 7fd4060e1640 1 librados: starting msgr at 2026-02-24T19:16:43.080 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.076+0000 7fd4060e1640 1 librados: starting objecter 2026-02-24T19:16:43.080 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.076+0000 7fd4060e1640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:16:43.080 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.076+0000 7fd4060e1640 1 Processor -- start 2026-02-24T19:16:43.080 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.077+0000 7fd4060e1640 1 -- start start 2026-02-24T19:16:43.080 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.077+0000 7fd4060e1640 1 librados: setting wanted keys 2026-02-24T19:16:43.080 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.077+0000 7fd4060e1640 1 librados: calling monclient init 2026-02-24T19:16:43.080 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.077+0000 7fd4060e1640 10 monclient: init 2026-02-24T19:16:43.080 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.077+0000 7fd4060e1640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:43.080 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.077+0000 7fd4060e1640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:16:43.080 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.077+0000 7fd4060e1640 10 monclient(hunting): picked mon.noname-a con 0x7fd40005d9b0 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:43.080 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.077+0000 7fd4060e1640 10 monclient(hunting): picked mon.noname-b con 0x7fd40005dd80 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:43.080 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.077+0000 7fd4060e1640 10 monclient(hunting): picked mon.noname-c con 0x7fd4001649b0 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:43.080 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.077+0000 7fd4060e1640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd400102380 con 0x7fd40005d9b0 2026-02-24T19:16:43.080 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.077+0000 7fd4060e1640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd400109260 con 0x7fd40005dd80 2026-02-24T19:16:43.080 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.077+0000 7fd4060e1640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd40010a440 con 0x7fd4001649b0 2026-02-24T19:16:43.080 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.077+0000 7fd4060e1640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:43.080 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.077+0000 7fd4060e1640 10 monclient(hunting): authenticate will time out at 3571.712181s 2026-02-24T19:16:43.080 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.077+0000 7fd3ff7fe640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7fd40005d9b0 0x7fd400101870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.195:34094/0 (socket says 10.20.193.195:34094) 2026-02-24T19:16:43.080 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.077+0000 7fd3ff7fe640 1 -- 10.20.193.195:0/4122183684 learned_addr learned my addr 10.20.193.195:0/4122183684 (peer_addr_for_me v1:10.20.193.195:0/0) 2026-02-24T19:16:43.081 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.077+0000 7fd3dbfff640 10 client.?.objecter ms_handle_connect 0x7fd4001649b0 2026-02-24T19:16:43.081 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.077+0000 7fd3dbfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:43.081 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.077+0000 7fd3dbfff640 10 client.?.objecter ms_handle_connect 0x7fd40005d9b0 2026-02-24T19:16:43.081 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.077+0000 7fd3dbfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:43.081 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.077+0000 7fd3dbfff640 10 client.?.objecter ms_handle_connect 0x7fd40005dd80 2026-02-24T19:16:43.081 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.077+0000 7fd3dbfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:43.081 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.078+0000 7fd3dbfff640 1 -- 10.20.193.195:0/4122183684 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2629773276 0 0) 0x7fd400102380 con 0x7fd40005d9b0 2026-02-24T19:16:43.081 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.078+0000 7fd3dbfff640 10 monclient(hunting): _negotiate 2026-02-24T19:16:43.081 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.078+0000 7fd3dbfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:43.081 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.078+0000 7fd3dbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:43.081 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.078+0000 7fd3dbfff640 10 monclient(hunting): my global_id is 4134 2026-02-24T19:16:43.081 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.078+0000 7fd3dbfff640 1 -- 10.20.193.195:0/4122183684 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3d0003610 con 0x7fd40005d9b0 2026-02-24T19:16:43.082 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.078+0000 7fd3dbfff640 1 -- 10.20.193.195:0/4122183684 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3169178310 0 0) 0x7fd40010a440 con 0x7fd4001649b0 2026-02-24T19:16:43.082 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.078+0000 7fd3dbfff640 10 monclient(hunting): _negotiate 2026-02-24T19:16:43.082 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.078+0000 7fd3dbfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:43.082 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.078+0000 7fd3dbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:43.082 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.078+0000 7fd3dbfff640 10 monclient(hunting): my global_id is 4133 2026-02-24T19:16:43.082 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.078+0000 7fd3dbfff640 1 -- 10.20.193.195:0/4122183684 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd400102380 con 0x7fd4001649b0 2026-02-24T19:16:43.082 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.078+0000 7fd3dbfff640 1 -- 10.20.193.195:0/4122183684 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1310980419 0 0) 0x7fd400109260 con 0x7fd40005dd80 2026-02-24T19:16:43.082 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.078+0000 7fd3dbfff640 10 monclient(hunting): _negotiate 2026-02-24T19:16:43.082 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.078+0000 7fd3dbfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:43.082 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.078+0000 7fd3dbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:43.082 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.078+0000 7fd3dbfff640 10 monclient(hunting): my global_id is 4135 2026-02-24T19:16:43.082 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.078+0000 7fd3dbfff640 1 -- 10.20.193.195:0/4122183684 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd40010a440 con 0x7fd40005dd80 2026-02-24T19:16:43.082 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.081+0000 7fd3dbfff640 1 -- 10.20.193.195:0/4122183684 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2851890536 0 0) 0x7fd400102380 con 0x7fd4001649b0 2026-02-24T19:16:43.082 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.081+0000 7fd3dbfff640 1 -- 10.20.193.195:0/4122183684 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd400109260 con 0x7fd4001649b0 2026-02-24T19:16:43.083 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.081+0000 7fd3dbfff640 1 -- 10.20.193.195:0/4122183684 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fd3f4003400 con 0x7fd4001649b0 2026-02-24T19:16:43.083 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.081+0000 7fd3dbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:43.083 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.081+0000 7fd3dbfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:16:43.083 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.081+0000 7fd3dbfff640 10 monclient(hunting): dump: 2026-02-24T19:16:43.083 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:43.083 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:43.083 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.083 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.083 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:43.083 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:43.083 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:43.083 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:43.083 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:43.083 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:43.083 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.081+0000 7fd3dbfff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:16:43.083 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.081+0000 7fd3dbfff640 1 -- 10.20.193.195:0/4122183684 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1901612125 0 0) 0x7fd40010a440 con 0x7fd40005dd80 2026-02-24T19:16:43.083 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.081+0000 7fd3dbfff640 1 -- 10.20.193.195:0/4122183684 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd400102380 con 0x7fd40005dd80 2026-02-24T19:16:43.083 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.081+0000 7fd3dbfff640 1 -- 10.20.193.195:0/4122183684 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fd3f0003060 con 0x7fd40005dd80 2026-02-24T19:16:43.083 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.081+0000 7fd3dbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:43.083 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.081+0000 7fd3dbfff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:16:43.083 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.081+0000 7fd3dbfff640 10 monclient(hunting): dump: 2026-02-24T19:16:43.083 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:43.083 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:43.083 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.083 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.083 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:43.084 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:43.084 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:43.084 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:43.084 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:43.084 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:43.085 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.082+0000 7fd3dbfff640 1 -- 10.20.193.195:0/4122183684 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3956160720 0 0) 0x7fd3d0003610 con 0x7fd40005d9b0 2026-02-24T19:16:43.085 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.082+0000 7fd3dbfff640 1 -- 10.20.193.195:0/4122183684 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd40010a440 con 0x7fd40005d9b0 2026-02-24T19:16:43.085 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.082+0000 7fd3dbfff640 1 -- 10.20.193.195:0/4122183684 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fd3ec003380 con 0x7fd40005d9b0 2026-02-24T19:16:43.085 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.082+0000 7fd3dbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:43.085 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.082+0000 7fd3dbfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:16:43.085 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.082+0000 7fd3dbfff640 10 monclient(hunting): dump: 2026-02-24T19:16:43.085 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:43.085 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:43.085 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.085 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.085 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:43.085 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:43.085 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:43.085 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:43.085 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:43.085 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:43.085 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.083+0000 7fd3dbfff640 1 -- 10.20.193.195:0/4122183684 <== mon.1 v1:10.20.193.44:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2735568539 0 0) 0x7fd400102380 con 0x7fd40005dd80 2026-02-24T19:16:43.085 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.083+0000 7fd3dbfff640 1 -- 10.20.193.195:0/4122183684 >> v1:10.20.193.170:6789/0 conn(0x7fd4001649b0 legacy=0x7fd4001630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:43.085 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.083+0000 7fd3dbfff640 1 -- 10.20.193.195:0/4122183684 >> v1:10.20.193.14:6789/0 conn(0x7fd40005d9b0 legacy=0x7fd400101870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:43.085 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.083+0000 7fd3dbfff640 10 monclient: _finish_hunting 0 2026-02-24T19:16:43.085 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.083+0000 7fd3dbfff640 1 monclient: found mon.b 2026-02-24T19:16:43.085 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.083+0000 7fd3dbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:43.085 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.083+0000 7fd3dbfff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:16:43.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.083+0000 7fd3dbfff640 1 -- 10.20.193.195:0/4122183684 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd40010b620 con 0x7fd40005dd80 2026-02-24T19:16:43.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.083+0000 7fd3dbfff640 10 monclient: _finish_auth 0 2026-02-24T19:16:43.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.083+0000 7fd3dbfff640 10 monclient: _check_auth_tickets 2026-02-24T19:16:43.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.083+0000 7fd3dbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:43.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.083+0000 7fd4060e1640 5 monclient: authenticate success, global_id 4135 2026-02-24T19:16:43.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.083+0000 7fd4060e1640 10 monclient: _renew_subs 2026-02-24T19:16:43.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.083+0000 7fd4060e1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:16:43.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.083+0000 7fd4060e1640 1 -- 10.20.193.195:0/4122183684 --> v1:10.20.193.44:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd400108250 con 0x7fd40005dd80 2026-02-24T19:16:43.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.083+0000 7fd4060e1640 10 client.4135.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:16:43.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.083+0000 7fd4060e1640 10 monclient: _renew_subs 2026-02-24T19:16:43.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.083+0000 7fd4060e1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:16:43.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.083+0000 7fd4060e1640 1 -- 10.20.193.195:0/4122183684 --> v1:10.20.193.44:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd400108890 con 0x7fd40005dd80 2026-02-24T19:16:43.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.083+0000 7fd4060e1640 1 librados: init done 2026-02-24T19:16:43.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.083+0000 7fd4060e1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:43.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.083+0000 7fd4060e1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:43.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.083+0000 7fd4060e1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:16:43.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.083+0000 7fd4060e1640 1 -- 10.20.193.195:0/4122183684 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4001869b0 con 0x7fd40005dd80 2026-02-24T19:16:43.094 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.093+0000 7fd3dbfff640 1 -- 10.20.193.195:0/4122183684 <== mon.1 v1:10.20.193.44:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd3f0003700 con 0x7fd40005dd80 2026-02-24T19:16:43.095 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.093+0000 7fd3dbfff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:43.095 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.093+0000 7fd3dbfff640 1 -- 10.20.193.195:0/4122183684 <== mon.1 v1:10.20.193.44:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fd3f0003a50 con 0x7fd40005dd80 2026-02-24T19:16:43.095 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.093+0000 7fd3dbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:43.095 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.093+0000 7fd3fdffb640 4 set_mon_vals no callback set 2026-02-24T19:16:43.095 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.093+0000 7fd3dbfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:16:43.095 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.093+0000 7fd3dbfff640 10 monclient: dump: 2026-02-24T19:16:43.095 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:43.095 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:43.095 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.095 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.095 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:43.095 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:43.095 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:43.095 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:43.095 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:43.095 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:43.095 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.094+0000 7fd3dbfff640 1 -- 10.20.193.195:0/4122183684 <== mon.1 v1:10.20.193.44:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7fd3f0004000 con 0x7fd40005dd80 2026-02-24T19:16:43.095 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.094+0000 7fd3dbfff640 1 -- 10.20.193.195:0/4122183684 <== mon.1 v1:10.20.193.44:6789/0 8 ==== osd_map(4..4 src has 1..4) ==== 950+0+0 (unknown 551873203 0 0) 0x7fd3f0005780 con 0x7fd40005dd80 2026-02-24T19:16:43.096 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.094+0000 7fd3dbfff640 10 client.4135.objecter ms_dispatch2 0x7fd400000b90 osd_map(4..4 src has 1..4) 2026-02-24T19:16:43.096 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.094+0000 7fd3dbfff640 3 client.4135.objecter handle_osd_map got epochs [4,4] > 0 2026-02-24T19:16:43.096 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.094+0000 7fd3dbfff640 3 client.4135.objecter handle_osd_map decoding full epoch 4 2026-02-24T19:16:43.096 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.094+0000 7fd3dbfff640 20 client.4135.objecter dump_active .. 0 homeless 2026-02-24T19:16:43.165 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.164+0000 7fd3dbfff640 1 -- 10.20.193.195:0/4122183684 <== mon.1 v1:10.20.193.44:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7fd3f0005470 con 0x7fd40005dd80 2026-02-24T19:16:43.165 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.164+0000 7fd3dbfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:43.165 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.164+0000 7fd3dbfff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:16:43.198 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.197+0000 7fd4060e1640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "5a7b7c02-22f9-4eb1-a1b0-afb106604416", "id": 2}] 2026-02-24T19:16:43.198 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.197+0000 7fd4060e1640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "5a7b7c02-22f9-4eb1-a1b0-afb106604416", "id": 2}] 2026-02-24T19:16:43.198 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.197+0000 7fd4060e1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:16:43.198 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.197+0000 7fd4060e1640 1 -- 10.20.193.195:0/4122183684 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "osd new", "uuid": "5a7b7c02-22f9-4eb1-a1b0-afb106604416", "id": 2} v 0) -- 0x7fd400108b80 con 0x7fd40005dd80 2026-02-24T19:16:43.253 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.252+0000 7fd3dbfff640 1 -- 10.20.193.195:0/4122183684 <== mon.1 v1:10.20.193.44:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5a7b7c02-22f9-4eb1-a1b0-afb106604416", "id": 2}]=0 v5) ==== 112+0+2 (unknown 1166259844 0 216599125) 0x7fd3f00059d0 con 0x7fd40005dd80 2026-02-24T19:16:43.253 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.252+0000 7fd3dbfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "5a7b7c02-22f9-4eb1-a1b0-afb106604416", "id": 2}] 2026-02-24T19:16:43.253 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.252+0000 7fd3dbfff640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:16:43.253 INFO:teuthology.orchestra.run.trial195.stdout:2 2026-02-24T19:16:43.254 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.252+0000 7fd4060e1640 10 librados: watch_flush enter 2026-02-24T19:16:43.254 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.252+0000 7fd4060e1640 10 librados: watch_flush exit 2026-02-24T19:16:43.254 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.252+0000 7fd4060e1640 20 client.4135.objecter shutdown clearing up homeless session... 2026-02-24T19:16:43.254 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.252+0000 7fd4060e1640 10 client.4135.objecter successfully canceled tick 2026-02-24T19:16:43.254 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.252+0000 7fd4060e1640 10 monclient: shutdown 2026-02-24T19:16:43.254 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.252+0000 7fd4060e1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:43.254 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.252+0000 7fd4060e1640 1 -- 10.20.193.195:0/4122183684 >> v1:10.20.193.44:6789/0 conn(0x7fd40005dd80 legacy=0x7fd400161980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:43.254 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.252+0000 7fd4060e1640 1 -- 10.20.193.195:0/4122183684 shutdown_connections 2026-02-24T19:16:43.254 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.253+0000 7fd4060e1640 1 -- 10.20.193.195:0/4122183684 >> 10.20.193.195:0/4122183684 conn(0x7fd4000588d0 msgr2=0x7fd40005aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:43.254 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.253+0000 7fd4060e1640 1 -- 10.20.193.195:0/4122183684 shutdown_connections 2026-02-24T19:16:43.254 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.253+0000 7fd4060e1640 1 -- 10.20.193.195:0/4122183684 wait complete. 2026-02-24T19:16:43.254 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.253+0000 7fd4060e1640 1 librados: shutdown 2026-02-24T19:16:43.261 DEBUG:teuthology.orchestra.run.trial195:> sudo ceph --cluster ceph osd new 695eeb19-d0a7-4b16-8d9a-ec59206d7ecc 3 2026-02-24T19:16:43.326 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.325+0000 7f2215783640 10 monclient: get_monmap_and_config 2026-02-24T19:16:43.326 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.325+0000 7f2215783640 10 monclient: build_initial_monmap 2026-02-24T19:16:43.326 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.325+0000 7f2215783640 10 monclient: monmap: 2026-02-24T19:16:43.326 INFO:teuthology.orchestra.run.trial195.stderr:epoch 0 2026-02-24T19:16:43.326 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:43.326 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:16:43.326024+0000 2026-02-24T19:16:43.326 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:16:43.326024+0000 2026-02-24T19:16:43.326 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:43.326 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:43.326 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:43.326 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:43.327 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:43.327 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:43.327 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.325+0000 7f2215783640 1 Processor -- start 2026-02-24T19:16:43.327 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.325+0000 7f2215783640 1 -- start start 2026-02-24T19:16:43.327 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.325+0000 7f2215783640 10 monclient: init 2026-02-24T19:16:43.327 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.325+0000 7f2215783640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:43.327 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.325+0000 7f2215783640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:16:43.327 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.325+0000 7f2215783640 10 monclient(hunting): picked mon.noname-a con 0x7f221011c500 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:43.327 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.325+0000 7f2215783640 10 monclient(hunting): picked mon.noname-c con 0x7f221011e420 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:43.327 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.325+0000 7f2215783640 10 monclient(hunting): picked mon.noname-b con 0x7f221011ffc0 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:43.328 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.325+0000 7f2215783640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2210120d10 con 0x7f221011c500 2026-02-24T19:16:43.328 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.325+0000 7f2215783640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2210120f00 con 0x7f221011ffc0 2026-02-24T19:16:43.328 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.325+0000 7f2215783640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22101210f0 con 0x7f221011e420 2026-02-24T19:16:43.328 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.325+0000 7f2215783640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:43.328 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.325+0000 7f2215783640 10 monclient(hunting): authenticate will time out at 3571.960961s 2026-02-24T19:16:43.328 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.326+0000 7f220f7fe640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7f221011ffc0 0x7f2210120420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.195:43844/0 (socket says 10.20.193.195:43844) 2026-02-24T19:16:43.328 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.326+0000 7f220f7fe640 1 -- 10.20.193.195:0/1869195894 learned_addr learned my addr 10.20.193.195:0/1869195894 (peer_addr_for_me v1:10.20.193.195:0/0) 2026-02-24T19:16:43.329 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.327+0000 7f220dffb640 1 -- 10.20.193.195:0/1869195894 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3427418338 0 0) 0x7f2210120f00 con 0x7f221011ffc0 2026-02-24T19:16:43.329 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.327+0000 7f220dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:16:43.329 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.327+0000 7f220dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:43.329 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.327+0000 7f220dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:43.329 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.327+0000 7f220dffb640 10 monclient(hunting): my global_id is 4138 2026-02-24T19:16:43.329 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.327+0000 7f220dffb640 1 -- 10.20.193.195:0/1869195894 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21fc003610 con 0x7f221011ffc0 2026-02-24T19:16:43.329 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.327+0000 7f220dffb640 1 -- 10.20.193.195:0/1869195894 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 365716983 0 0) 0x7f22101210f0 con 0x7f221011e420 2026-02-24T19:16:43.329 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.327+0000 7f220dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:16:43.329 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.327+0000 7f220dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:43.329 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.327+0000 7f220dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:43.329 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.327+0000 7f220dffb640 10 monclient(hunting): my global_id is 4136 2026-02-24T19:16:43.329 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.327+0000 7f220dffb640 1 -- 10.20.193.195:0/1869195894 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2210120f00 con 0x7f221011e420 2026-02-24T19:16:43.329 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.327+0000 7f220dffb640 1 -- 10.20.193.195:0/1869195894 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 31700574 0 0) 0x7f2210120d10 con 0x7f221011c500 2026-02-24T19:16:43.329 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.327+0000 7f220dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:16:43.329 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.327+0000 7f220dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:43.329 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.327+0000 7f220dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:43.329 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.327+0000 7f220dffb640 10 monclient(hunting): my global_id is 4137 2026-02-24T19:16:43.329 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.327+0000 7f220dffb640 1 -- 10.20.193.195:0/1869195894 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22101210f0 con 0x7f221011c500 2026-02-24T19:16:43.330 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.329+0000 7f220dffb640 1 -- 10.20.193.195:0/1869195894 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1124656030 0 0) 0x7f2210120f00 con 0x7f221011e420 2026-02-24T19:16:43.330 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.329+0000 7f220dffb640 1 -- 10.20.193.195:0/1869195894 >> v1:10.20.193.44:6789/0 conn(0x7f221011ffc0 legacy=0x7f2210120420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:43.330 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.329+0000 7f220dffb640 1 -- 10.20.193.195:0/1869195894 >> v1:10.20.193.14:6789/0 conn(0x7f221011c500 legacy=0x7f221011c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:43.330 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.329+0000 7f220dffb640 10 monclient: _finish_hunting 0 2026-02-24T19:16:43.330 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.329+0000 7f220dffb640 1 monclient: found mon.noname-c 2026-02-24T19:16:43.330 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.329+0000 7f220dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:43.330 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.329+0000 7f220dffb640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.170:6789/0 2026-02-24T19:16:43.330 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.329+0000 7f220dffb640 1 -- 10.20.193.195:0/1869195894 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2210121380 con 0x7f221011e420 2026-02-24T19:16:43.330 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.329+0000 7f220dffb640 10 monclient: _finish_auth 0 2026-02-24T19:16:43.330 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.329+0000 7f220dffb640 10 monclient: _check_auth_tickets 2026-02-24T19:16:43.331 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.329+0000 7f220dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:43.331 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.329+0000 7f220dffb640 1 -- 10.20.193.195:0/1869195894 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f21f8002df0 con 0x7f221011e420 2026-02-24T19:16:43.331 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.329+0000 7f220dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:43.331 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.329+0000 7f220dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:16:43.331 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.329+0000 7f220dffb640 10 monclient: dump: 2026-02-24T19:16:43.331 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:43.331 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:43.331 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.331 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.331 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:43.331 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:43.331 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:43.331 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:43.331 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:43.331 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:43.331 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.329+0000 7f2215783640 5 monclient: authenticate success, global_id 4136 2026-02-24T19:16:43.331 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.329+0000 7f2215783640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:16:43.345 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.344+0000 7f220dffb640 1 -- 10.20.193.195:0/1869195894 <== mon.2 v1:10.20.193.170:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f21f8003030 con 0x7f221011e420 2026-02-24T19:16:43.345 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.344+0000 7f220dffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:43.345 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.344+0000 7f220dffb640 1 -- 10.20.193.195:0/1869195894 <== mon.2 v1:10.20.193.170:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f21f8003470 con 0x7f221011e420 2026-02-24T19:16:43.345 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.344+0000 7f2215783640 10 monclient: get_monmap_and_config success 2026-02-24T19:16:43.345 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.344+0000 7f2215783640 4 set_mon_vals no callback set 2026-02-24T19:16:43.345 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.344+0000 7f220dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:43.345 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.344+0000 7f220dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:16:43.345 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.344+0000 7f220dffb640 10 monclient: dump: 2026-02-24T19:16:43.345 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:43.345 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:43.345 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.345 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.345 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:43.345 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:43.345 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:43.345 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:43.345 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:43.345 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:43.346 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.344+0000 7f2215783640 10 monclient: shutdown 2026-02-24T19:16:43.347 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.344+0000 7f2215783640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:43.347 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.344+0000 7f2215783640 1 -- 10.20.193.195:0/1869195894 >> v1:10.20.193.170:6789/0 conn(0x7f221011e420 legacy=0x7f221011e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:43.347 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.344+0000 7f2215783640 1 -- 10.20.193.195:0/1869195894 shutdown_connections 2026-02-24T19:16:43.347 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.344+0000 7f2215783640 1 -- 10.20.193.195:0/1869195894 >> 10.20.193.195:0/1869195894 conn(0x7f22100588d0 msgr2=0x7f2210058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:43.347 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.344+0000 7f2215783640 1 -- 10.20.193.195:0/1869195894 shutdown_connections 2026-02-24T19:16:43.347 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.344+0000 7f2215783640 1 -- 10.20.193.195:0/1869195894 wait complete. 2026-02-24T19:16:43.347 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.344+0000 7f2215783640 10 monclient: build_initial_monmap 2026-02-24T19:16:43.347 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.344+0000 7f2215783640 10 monclient: monmap: 2026-02-24T19:16:43.347 INFO:teuthology.orchestra.run.trial195.stderr:epoch 0 2026-02-24T19:16:43.347 INFO:teuthology.orchestra.run.trial195.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:16:43.347 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 0.000000 2026-02-24T19:16:43.347 INFO:teuthology.orchestra.run.trial195.stderr:created 0.000000 2026-02-24T19:16:43.347 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:43.347 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 1 2026-02-24T19:16:43.347 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:43.347 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:43.347 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:43.347 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:43.347 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.344+0000 7f2215783640 1 librados: starting msgr at 2026-02-24T19:16:43.347 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.344+0000 7f2215783640 1 librados: starting objecter 2026-02-24T19:16:43.347 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.344+0000 7f2215783640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:16:43.347 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.344+0000 7f2215783640 1 Processor -- start 2026-02-24T19:16:43.347 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.344+0000 7f2215783640 1 -- start start 2026-02-24T19:16:43.347 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.344+0000 7f2215783640 1 librados: setting wanted keys 2026-02-24T19:16:43.347 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.344+0000 7f2215783640 1 librados: calling monclient init 2026-02-24T19:16:43.347 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.344+0000 7f2215783640 10 monclient: init 2026-02-24T19:16:43.348 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.344+0000 7f2215783640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:43.348 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.345+0000 7f2215783640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:16:43.348 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.345+0000 7f2215783640 10 monclient(hunting): picked mon.noname-b con 0x7f221011c500 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:43.348 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.345+0000 7f2215783640 10 monclient(hunting): picked mon.noname-a con 0x7f221011e420 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:43.348 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.345+0000 7f2215783640 10 monclient(hunting): picked mon.noname-c con 0x7f221011ffc0 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:43.348 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.345+0000 7f2215783640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22101796a0 con 0x7f221011e420 2026-02-24T19:16:43.348 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.345+0000 7f2215783640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f221017a880 con 0x7f221011c500 2026-02-24T19:16:43.348 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.345+0000 7f2215783640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f221017ba60 con 0x7f221011ffc0 2026-02-24T19:16:43.348 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.345+0000 7f2215783640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:43.348 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.345+0000 7f2215783640 10 monclient(hunting): authenticate will time out at 3571.980046s 2026-02-24T19:16:43.348 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.345+0000 7f220effd640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7f221011c500 0x7f221012fe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.195:43860/0 (socket says 10.20.193.195:43860) 2026-02-24T19:16:43.348 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.345+0000 7f220effd640 1 -- 10.20.193.195:0/3145391831 learned_addr learned my addr 10.20.193.195:0/3145391831 (peer_addr_for_me v1:10.20.193.195:0/0) 2026-02-24T19:16:43.348 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.345+0000 7f21ef7fe640 10 client.?.objecter ms_handle_connect 0x7f221011ffc0 2026-02-24T19:16:43.348 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.345+0000 7f21ef7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:43.348 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.345+0000 7f21ef7fe640 10 client.?.objecter ms_handle_connect 0x7f221011e420 2026-02-24T19:16:43.348 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.345+0000 7f21ef7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:43.348 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.345+0000 7f21ef7fe640 10 client.?.objecter ms_handle_connect 0x7f221011c500 2026-02-24T19:16:43.348 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.345+0000 7f21ef7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:43.349 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.346+0000 7f21ef7fe640 1 -- 10.20.193.195:0/3145391831 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3146350121 0 0) 0x7f221017ba60 con 0x7f221011ffc0 2026-02-24T19:16:43.349 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.346+0000 7f21ef7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:16:43.349 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.346+0000 7f21ef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:43.349 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.346+0000 7f21ef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:43.349 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.346+0000 7f21ef7fe640 10 monclient(hunting): my global_id is 4139 2026-02-24T19:16:43.349 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.346+0000 7f21ef7fe640 1 -- 10.20.193.195:0/3145391831 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21dc003610 con 0x7f221011ffc0 2026-02-24T19:16:43.349 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.346+0000 7f21ef7fe640 1 -- 10.20.193.195:0/3145391831 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3127134143 0 0) 0x7f221017a880 con 0x7f221011c500 2026-02-24T19:16:43.349 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.346+0000 7f21ef7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:16:43.349 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.346+0000 7f21ef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:43.349 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.346+0000 7f21ef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:43.349 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.346+0000 7f21ef7fe640 10 monclient(hunting): my global_id is 4141 2026-02-24T19:16:43.349 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.346+0000 7f21ef7fe640 1 -- 10.20.193.195:0/3145391831 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f221017ba60 con 0x7f221011c500 2026-02-24T19:16:43.349 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.346+0000 7f21ef7fe640 1 -- 10.20.193.195:0/3145391831 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2395604142 0 0) 0x7f22101796a0 con 0x7f221011e420 2026-02-24T19:16:43.349 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.346+0000 7f21ef7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:16:43.349 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.346+0000 7f21ef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:43.349 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.346+0000 7f21ef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:43.349 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.346+0000 7f21ef7fe640 10 monclient(hunting): my global_id is 4140 2026-02-24T19:16:43.349 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.346+0000 7f21ef7fe640 1 -- 10.20.193.195:0/3145391831 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f221017a880 con 0x7f221011e420 2026-02-24T19:16:43.350 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.348+0000 7f21ef7fe640 1 -- 10.20.193.195:0/3145391831 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2051123339 0 0) 0x7f21dc003610 con 0x7f221011ffc0 2026-02-24T19:16:43.350 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.348+0000 7f21ef7fe640 1 -- 10.20.193.195:0/3145391831 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f22101796a0 con 0x7f221011ffc0 2026-02-24T19:16:43.350 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.348+0000 7f21ef7fe640 1 -- 10.20.193.195:0/3145391831 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f2200003430 con 0x7f221011ffc0 2026-02-24T19:16:43.350 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.348+0000 7f21ef7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:43.350 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.348+0000 7f21ef7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:16:43.350 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.348+0000 7f21ef7fe640 10 monclient(hunting): dump: 2026-02-24T19:16:43.350 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:43.350 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:43.350 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.350 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.350 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:43.350 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:43.350 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:43.351 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:43.351 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:43.351 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:43.351 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.348+0000 7f21ef7fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:16:43.351 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.348+0000 7f21ef7fe640 1 -- 10.20.193.195:0/3145391831 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 258682975 0 0) 0x7f221017ba60 con 0x7f221011c500 2026-02-24T19:16:43.351 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.348+0000 7f21ef7fe640 1 -- 10.20.193.195:0/3145391831 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f21dc003610 con 0x7f221011c500 2026-02-24T19:16:43.351 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.349+0000 7f21ef7fe640 1 -- 10.20.193.195:0/3145391831 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f2204003270 con 0x7f221011c500 2026-02-24T19:16:43.351 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.349+0000 7f21ef7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:43.351 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.349+0000 7f21ef7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:16:43.351 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.349+0000 7f21ef7fe640 10 monclient(hunting): dump: 2026-02-24T19:16:43.351 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:43.351 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:43.351 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.351 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.351 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:43.351 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:43.351 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:43.351 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:43.351 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:43.351 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:43.351 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.349+0000 7f21ef7fe640 1 -- 10.20.193.195:0/3145391831 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 820849995 0 0) 0x7f221017a880 con 0x7f221011e420 2026-02-24T19:16:43.351 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.349+0000 7f21ef7fe640 1 -- 10.20.193.195:0/3145391831 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f221017ba60 con 0x7f221011e420 2026-02-24T19:16:43.351 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.349+0000 7f21ef7fe640 1 -- 10.20.193.195:0/3145391831 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f21f8003380 con 0x7f221011e420 2026-02-24T19:16:43.351 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.349+0000 7f21ef7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:43.351 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.349+0000 7f21ef7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:16:43.351 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.349+0000 7f21ef7fe640 10 monclient(hunting): dump: 2026-02-24T19:16:43.352 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:43.352 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:43.352 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.352 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.352 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:43.352 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:43.352 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:43.352 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:43.352 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:43.352 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:43.352 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.350+0000 7f21ef7fe640 1 -- 10.20.193.195:0/3145391831 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2513077115 0 0) 0x7f22101796a0 con 0x7f221011ffc0 2026-02-24T19:16:43.353 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.350+0000 7f21ef7fe640 1 -- 10.20.193.195:0/3145391831 >> v1:10.20.193.44:6789/0 conn(0x7f221011c500 legacy=0x7f221012fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:43.353 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.350+0000 7f21ef7fe640 1 -- 10.20.193.195:0/3145391831 >> v1:10.20.193.14:6789/0 conn(0x7f221011e420 legacy=0x7f2210176860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:43.353 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.350+0000 7f21ef7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:16:43.353 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.350+0000 7f21ef7fe640 1 monclient: found mon.c 2026-02-24T19:16:43.353 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.350+0000 7f21ef7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:43.353 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.350+0000 7f21ef7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:16:43.353 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.350+0000 7f21ef7fe640 1 -- 10.20.193.195:0/3145391831 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f221017cc40 con 0x7f221011ffc0 2026-02-24T19:16:43.353 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.350+0000 7f21ef7fe640 10 monclient: _finish_auth 0 2026-02-24T19:16:43.353 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.350+0000 7f21ef7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:16:43.353 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.350+0000 7f21ef7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:43.353 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.350+0000 7f2215783640 5 monclient: authenticate success, global_id 4139 2026-02-24T19:16:43.353 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.350+0000 7f2215783640 10 monclient: _renew_subs 2026-02-24T19:16:43.353 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.350+0000 7f2215783640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:16:43.353 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.350+0000 7f2215783640 1 -- 10.20.193.195:0/3145391831 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2210179870 con 0x7f221011ffc0 2026-02-24T19:16:43.353 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.350+0000 7f2215783640 10 client.4139.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:16:43.353 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.350+0000 7f2215783640 10 monclient: _renew_subs 2026-02-24T19:16:43.353 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.350+0000 7f2215783640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:16:43.353 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.350+0000 7f2215783640 1 -- 10.20.193.195:0/3145391831 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2210179eb0 con 0x7f221011ffc0 2026-02-24T19:16:43.353 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.350+0000 7f2215783640 1 librados: init done 2026-02-24T19:16:43.353 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.350+0000 7f2215783640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:43.353 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.350+0000 7f2215783640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:43.353 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.350+0000 7f2215783640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:16:43.353 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.350+0000 7f2215783640 1 -- 10.20.193.195:0/3145391831 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f221018b560 con 0x7f221011ffc0 2026-02-24T19:16:43.429 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.428+0000 7f21ef7fe640 1 -- 10.20.193.195:0/3145391831 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f22000038b0 con 0x7f221011ffc0 2026-02-24T19:16:43.429 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.428+0000 7f21ef7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:43.429 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.428+0000 7f21ef7fe640 1 -- 10.20.193.195:0/3145391831 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f2200004df0 con 0x7f221011ffc0 2026-02-24T19:16:43.429 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.428+0000 7f21ef7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:43.429 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.428+0000 7f21ef7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:16:43.429 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.428+0000 7f21ef7fe640 10 monclient: dump: 2026-02-24T19:16:43.429 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:43.429 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:43.429 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.429 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.429 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:43.429 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:43.429 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:43.429 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:43.429 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:43.429 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:43.429 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.428+0000 7f220d7fa640 4 set_mon_vals no callback set 2026-02-24T19:16:43.434 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.433+0000 7f21ef7fe640 1 -- 10.20.193.195:0/3145391831 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f22000053a0 con 0x7f221011ffc0 2026-02-24T19:16:43.434 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.433+0000 7f21ef7fe640 1 -- 10.20.193.195:0/3145391831 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(5..5 src has 1..5) ==== 1065+0+0 (unknown 2486328265 0 0) 0x7f2200006cd0 con 0x7f221011ffc0 2026-02-24T19:16:43.434 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.433+0000 7f21ef7fe640 10 client.4139.objecter ms_dispatch2 0x7f2210000b90 osd_map(5..5 src has 1..5) 2026-02-24T19:16:43.434 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.433+0000 7f21ef7fe640 3 client.4139.objecter handle_osd_map got epochs [5,5] > 0 2026-02-24T19:16:43.434 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.433+0000 7f21ef7fe640 3 client.4139.objecter handle_osd_map decoding full epoch 5 2026-02-24T19:16:43.434 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.433+0000 7f21ef7fe640 20 client.4139.objecter dump_active .. 0 homeless 2026-02-24T19:16:43.434 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.433+0000 7f21ef7fe640 1 -- 10.20.193.195:0/3145391831 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7f2200006840 con 0x7f221011ffc0 2026-02-24T19:16:43.434 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.433+0000 7f21ef7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:43.434 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.433+0000 7f21ef7fe640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:16:43.467 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.466+0000 7f2215783640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "695eeb19-d0a7-4b16-8d9a-ec59206d7ecc", "id": 3}] 2026-02-24T19:16:43.467 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.466+0000 7f2215783640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "695eeb19-d0a7-4b16-8d9a-ec59206d7ecc", "id": 3}] 2026-02-24T19:16:43.467 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.466+0000 7f2215783640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:16:43.467 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.466+0000 7f2215783640 1 -- 10.20.193.195:0/3145391831 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "osd new", "uuid": "695eeb19-d0a7-4b16-8d9a-ec59206d7ecc", "id": 3} v 0) -- 0x7f221017a1a0 con 0x7f221011ffc0 2026-02-24T19:16:43.541 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.540+0000 7f21ef7fe640 1 -- 10.20.193.195:0/3145391831 <== mon.2 v1:10.20.193.170:6789/0 10 ==== mgrmap(e 2) ==== 50897+0+0 (unknown 2763422093 0 0) 0x7f22000057b0 con 0x7f221011ffc0 2026-02-24T19:16:43.622 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.621+0000 7f21ef7fe640 1 -- 10.20.193.195:0/3145391831 <== mon.2 v1:10.20.193.170:6789/0 11 ==== mon_command_ack([{"prefix": "osd new", "uuid": "695eeb19-d0a7-4b16-8d9a-ec59206d7ecc", "id": 3}]=0 v6) ==== 112+0+2 (unknown 3701897838 0 525046306) 0x7f2200020e20 con 0x7f221011ffc0 2026-02-24T19:16:43.622 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.621+0000 7f21ef7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "695eeb19-d0a7-4b16-8d9a-ec59206d7ecc", "id": 3}] 2026-02-24T19:16:43.622 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.621+0000 7f21ef7fe640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:16:43.622 INFO:teuthology.orchestra.run.trial195.stdout:3 2026-02-24T19:16:43.622 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.621+0000 7f2215783640 10 librados: watch_flush enter 2026-02-24T19:16:43.622 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.621+0000 7f2215783640 10 librados: watch_flush exit 2026-02-24T19:16:43.622 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.621+0000 7f2215783640 20 client.4139.objecter shutdown clearing up homeless session... 2026-02-24T19:16:43.623 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.621+0000 7f2215783640 10 client.4139.objecter successfully canceled tick 2026-02-24T19:16:43.623 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.621+0000 7f2215783640 10 monclient: shutdown 2026-02-24T19:16:43.623 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.621+0000 7f2215783640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:43.623 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.621+0000 7f2215783640 1 -- 10.20.193.195:0/3145391831 >> v1:10.20.193.170:6789/0 conn(0x7f221011ffc0 legacy=0x7f2210177f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:43.623 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.621+0000 7f2215783640 1 -- 10.20.193.195:0/3145391831 shutdown_connections 2026-02-24T19:16:43.623 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.621+0000 7f2215783640 1 -- 10.20.193.195:0/3145391831 >> 10.20.193.195:0/3145391831 conn(0x7f22100588d0 msgr2=0x7f2210058e40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:43.623 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.621+0000 7f2215783640 1 -- 10.20.193.195:0/3145391831 shutdown_connections 2026-02-24T19:16:43.623 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.621+0000 7f2215783640 1 -- 10.20.193.195:0/3145391831 wait complete. 2026-02-24T19:16:43.623 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.621+0000 7f2215783640 1 librados: shutdown 2026-02-24T19:16:43.629 DEBUG:teuthology.orchestra.run.trial195:> sudo ceph --cluster ceph osd new 09ca59ec-7e76-44ba-bf1a-1b752732db60 4 2026-02-24T19:16:43.696 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.695+0000 7fc6909b3640 10 monclient: get_monmap_and_config 2026-02-24T19:16:43.696 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.695+0000 7fc6909b3640 10 monclient: build_initial_monmap 2026-02-24T19:16:43.696 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.695+0000 7fc6909b3640 10 monclient: monmap: 2026-02-24T19:16:43.696 INFO:teuthology.orchestra.run.trial195.stderr:epoch 0 2026-02-24T19:16:43.696 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:43.696 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:16:43.695652+0000 2026-02-24T19:16:43.696 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:16:43.695652+0000 2026-02-24T19:16:43.696 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:43.696 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:43.696 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:43.696 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:43.696 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:43.696 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:43.697 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.695+0000 7fc6909b3640 1 Processor -- start 2026-02-24T19:16:43.697 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.695+0000 7fc6909b3640 1 -- start start 2026-02-24T19:16:43.697 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.695+0000 7fc6909b3640 10 monclient: init 2026-02-24T19:16:43.697 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.695+0000 7fc6909b3640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:43.697 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.695+0000 7fc6909b3640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:16:43.697 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.695+0000 7fc6909b3640 10 monclient(hunting): picked mon.noname-b con 0x7fc68811e790 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:43.697 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.695+0000 7fc6909b3640 10 monclient(hunting): picked mon.noname-a con 0x7fc6881406c0 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:43.697 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.695+0000 7fc6909b3640 10 monclient(hunting): picked mon.noname-c con 0x7fc688162250 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:43.697 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.695+0000 7fc6909b3640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc688183fe0 con 0x7fc6881406c0 2026-02-24T19:16:43.697 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.695+0000 7fc6909b3640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6881851e0 con 0x7fc68811e790 2026-02-24T19:16:43.697 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.695+0000 7fc6909b3640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6881863e0 con 0x7fc688162250 2026-02-24T19:16:43.697 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.695+0000 7fc6909b3640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:43.697 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.695+0000 7fc6909b3640 10 monclient(hunting): authenticate will time out at 3572.330630s 2026-02-24T19:16:43.697 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.696+0000 7fc68ef29640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7fc688162250 0x7fc6881826e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.195:32830/0 (socket says 10.20.193.195:32830) 2026-02-24T19:16:43.697 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.696+0000 7fc68ef29640 1 -- 10.20.193.195:0/2097112093 learned_addr learned my addr 10.20.193.195:0/2097112093 (peer_addr_for_me v1:10.20.193.195:0/0) 2026-02-24T19:16:43.698 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.697+0000 7fc68d726640 1 -- 10.20.193.195:0/2097112093 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3184408121 0 0) 0x7fc6881863e0 con 0x7fc688162250 2026-02-24T19:16:43.698 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.697+0000 7fc68d726640 10 monclient(hunting): _negotiate 2026-02-24T19:16:43.698 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.697+0000 7fc68d726640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:43.698 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.697+0000 7fc68d726640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:43.698 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.697+0000 7fc68d726640 10 monclient(hunting): my global_id is 4154 2026-02-24T19:16:43.698 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.697+0000 7fc68d726640 1 -- 10.20.193.195:0/2097112093 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc678003610 con 0x7fc688162250 2026-02-24T19:16:43.698 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.697+0000 7fc68d726640 1 -- 10.20.193.195:0/2097112093 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3250519779 0 0) 0x7fc6881851e0 con 0x7fc68811e790 2026-02-24T19:16:43.698 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.697+0000 7fc68d726640 10 monclient(hunting): _negotiate 2026-02-24T19:16:43.699 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.697+0000 7fc68d726640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:43.699 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.697+0000 7fc68d726640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:43.699 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.697+0000 7fc68d726640 10 monclient(hunting): my global_id is 4144 2026-02-24T19:16:43.699 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.697+0000 7fc68d726640 1 -- 10.20.193.195:0/2097112093 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6881863e0 con 0x7fc68811e790 2026-02-24T19:16:43.700 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.698+0000 7fc68d726640 1 -- 10.20.193.195:0/2097112093 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3746415771 0 0) 0x7fc678003610 con 0x7fc688162250 2026-02-24T19:16:43.700 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.698+0000 7fc68d726640 1 -- 10.20.193.195:0/2097112093 >> v1:10.20.193.44:6789/0 conn(0x7fc68811e790 legacy=0x7fc68811eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:43.700 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.698+0000 7fc68d726640 1 -- 10.20.193.195:0/2097112093 >> v1:10.20.193.14:6789/0 conn(0x7fc6881406c0 legacy=0x7fc688160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:16:43.700 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.698+0000 7fc68d726640 10 monclient: _finish_hunting 0 2026-02-24T19:16:43.700 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.698+0000 7fc68d726640 1 monclient: found mon.noname-c 2026-02-24T19:16:43.700 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.698+0000 7fc68d726640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:43.700 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.698+0000 7fc68d726640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.170:6789/0 2026-02-24T19:16:43.700 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.698+0000 7fc68d726640 1 -- 10.20.193.195:0/2097112093 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc688187680 con 0x7fc688162250 2026-02-24T19:16:43.700 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.698+0000 7fc68d726640 10 monclient: _finish_auth 0 2026-02-24T19:16:43.700 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.698+0000 7fc68d726640 10 monclient: _check_auth_tickets 2026-02-24T19:16:43.700 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.698+0000 7fc68d726640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:43.700 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.698+0000 7fc68d726640 1 -- 10.20.193.195:0/2097112093 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc67c003170 con 0x7fc688162250 2026-02-24T19:16:43.700 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.698+0000 7fc68d726640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:43.700 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.698+0000 7fc68d726640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:16:43.700 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.698+0000 7fc68d726640 10 monclient: dump: 2026-02-24T19:16:43.700 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:43.700 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:43.700 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.700 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.700 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:43.700 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:43.700 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:43.701 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:43.701 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:43.701 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:43.701 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.698+0000 7fc6909b3640 5 monclient: authenticate success, global_id 4154 2026-02-24T19:16:43.701 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.698+0000 7fc6909b3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:16:43.702 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.699+0000 7fc68d726640 1 -- 10.20.193.195:0/2097112093 <== mon.2 v1:10.20.193.170:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc67c0033f0 con 0x7fc688162250 2026-02-24T19:16:43.702 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.699+0000 7fc68d726640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:43.702 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.699+0000 7fc68d726640 1 -- 10.20.193.195:0/2097112093 <== mon.2 v1:10.20.193.170:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc67c003830 con 0x7fc688162250 2026-02-24T19:16:43.702 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.699+0000 7fc68d726640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:43.702 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.699+0000 7fc68d726640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:16:43.702 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.699+0000 7fc68d726640 10 monclient: dump: 2026-02-24T19:16:43.702 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:43.702 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:43.702 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.702 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.702 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:43.703 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:43.703 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:43.703 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:43.703 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:43.703 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:43.703 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.699+0000 7fc6909b3640 10 monclient: get_monmap_and_config success 2026-02-24T19:16:43.703 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.699+0000 7fc6909b3640 4 set_mon_vals no callback set 2026-02-24T19:16:43.703 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.699+0000 7fc6909b3640 10 monclient: shutdown 2026-02-24T19:16:43.703 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.699+0000 7fc6909b3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:43.703 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.699+0000 7fc6909b3640 1 -- 10.20.193.195:0/2097112093 >> v1:10.20.193.170:6789/0 conn(0x7fc688162250 legacy=0x7fc6881826e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:43.703 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.699+0000 7fc6909b3640 1 -- 10.20.193.195:0/2097112093 shutdown_connections 2026-02-24T19:16:43.703 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.699+0000 7fc6909b3640 1 -- 10.20.193.195:0/2097112093 >> 10.20.193.195:0/2097112093 conn(0x7fc6880588d0 msgr2=0x7fc688058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:43.703 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.699+0000 7fc6909b3640 1 -- 10.20.193.195:0/2097112093 shutdown_connections 2026-02-24T19:16:43.703 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.699+0000 7fc6909b3640 1 -- 10.20.193.195:0/2097112093 wait complete. 2026-02-24T19:16:43.703 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.700+0000 7fc6909b3640 10 monclient: build_initial_monmap 2026-02-24T19:16:43.703 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.700+0000 7fc6909b3640 10 monclient: monmap: 2026-02-24T19:16:43.703 INFO:teuthology.orchestra.run.trial195.stderr:epoch 0 2026-02-24T19:16:43.703 INFO:teuthology.orchestra.run.trial195.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:16:43.703 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 0.000000 2026-02-24T19:16:43.703 INFO:teuthology.orchestra.run.trial195.stderr:created 0.000000 2026-02-24T19:16:43.703 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:43.703 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 1 2026-02-24T19:16:43.703 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:43.703 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:43.703 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:43.703 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:43.704 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.700+0000 7fc6909b3640 1 librados: starting msgr at 2026-02-24T19:16:43.704 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.700+0000 7fc6909b3640 1 librados: starting objecter 2026-02-24T19:16:43.704 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.700+0000 7fc6909b3640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:16:43.704 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.700+0000 7fc6909b3640 1 Processor -- start 2026-02-24T19:16:43.704 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.700+0000 7fc6909b3640 1 -- start start 2026-02-24T19:16:43.704 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.700+0000 7fc6909b3640 1 librados: setting wanted keys 2026-02-24T19:16:43.704 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.700+0000 7fc6909b3640 1 librados: calling monclient init 2026-02-24T19:16:43.704 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.700+0000 7fc6909b3640 10 monclient: init 2026-02-24T19:16:43.704 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.700+0000 7fc6909b3640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:43.704 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.700+0000 7fc6909b3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:16:43.704 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.700+0000 7fc6909b3640 10 monclient(hunting): picked mon.noname-c con 0x7fc68811e790 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:43.704 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.700+0000 7fc6909b3640 10 monclient(hunting): picked mon.noname-a con 0x7fc6881406c0 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:43.704 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.700+0000 7fc6909b3640 10 monclient(hunting): picked mon.noname-b con 0x7fc688162250 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:43.704 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.700+0000 7fc6909b3640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc68812e6e0 con 0x7fc6881406c0 2026-02-24T19:16:43.704 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.700+0000 7fc6909b3640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc68812f8e0 con 0x7fc688162250 2026-02-24T19:16:43.704 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.700+0000 7fc6909b3640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc688130ae0 con 0x7fc68811e790 2026-02-24T19:16:43.704 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.700+0000 7fc6909b3640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:43.704 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.700+0000 7fc6909b3640 10 monclient(hunting): authenticate will time out at 3572.335552s 2026-02-24T19:16:43.704 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.700+0000 7fc68ef29640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7fc688162250 0x7fc68812ce40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.195:43872/0 (socket says 10.20.193.195:43872) 2026-02-24T19:16:43.704 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.700+0000 7fc68ef29640 1 -- 10.20.193.195:0/904365997 learned_addr learned my addr 10.20.193.195:0/904365997 (peer_addr_for_me v1:10.20.193.195:0/0) 2026-02-24T19:16:43.704 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.701+0000 7fc672ffd640 10 client.?.objecter ms_handle_connect 0x7fc688162250 2026-02-24T19:16:43.704 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.701+0000 7fc672ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:43.704 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.701+0000 7fc672ffd640 10 client.?.objecter ms_handle_connect 0x7fc68811e790 2026-02-24T19:16:43.704 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.701+0000 7fc672ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:43.705 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.702+0000 7fc672ffd640 1 -- 10.20.193.195:0/904365997 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 322022533 0 0) 0x7fc68812f8e0 con 0x7fc688162250 2026-02-24T19:16:43.705 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.702+0000 7fc672ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:16:43.705 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.702+0000 7fc672ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:43.705 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.702+0000 7fc672ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:43.705 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.702+0000 7fc672ffd640 10 monclient(hunting): my global_id is 4147 2026-02-24T19:16:43.705 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.702+0000 7fc672ffd640 1 -- 10.20.193.195:0/904365997 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc658003610 con 0x7fc688162250 2026-02-24T19:16:43.705 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.702+0000 7fc672ffd640 1 -- 10.20.193.195:0/904365997 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 148410400 0 0) 0x7fc688130ae0 con 0x7fc68811e790 2026-02-24T19:16:43.705 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.702+0000 7fc672ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:16:43.705 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.702+0000 7fc672ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:43.705 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.702+0000 7fc672ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:43.705 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.702+0000 7fc672ffd640 10 monclient(hunting): my global_id is 4157 2026-02-24T19:16:43.705 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.702+0000 7fc672ffd640 1 -- 10.20.193.195:0/904365997 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc68812f8e0 con 0x7fc68811e790 2026-02-24T19:16:43.706 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.704+0000 7fc672ffd640 1 -- 10.20.193.195:0/904365997 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 277133504 0 0) 0x7fc658003610 con 0x7fc688162250 2026-02-24T19:16:43.706 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.704+0000 7fc672ffd640 1 -- 10.20.193.195:0/904365997 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc688130ae0 con 0x7fc688162250 2026-02-24T19:16:43.706 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.704+0000 7fc672ffd640 1 -- 10.20.193.195:0/904365997 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc67c003080 con 0x7fc688162250 2026-02-24T19:16:43.706 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.704+0000 7fc672ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:43.706 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.704+0000 7fc672ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:16:43.706 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.704+0000 7fc672ffd640 10 monclient(hunting): dump: 2026-02-24T19:16:43.706 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:43.706 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:43.706 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.706 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.706 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:43.706 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:43.706 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:43.706 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:43.706 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:43.706 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:43.706 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.704+0000 7fc672ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:16:43.707 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.704+0000 7fc672ffd640 1 -- 10.20.193.195:0/904365997 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 576980482 0 0) 0x7fc68812f8e0 con 0x7fc68811e790 2026-02-24T19:16:43.707 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.704+0000 7fc672ffd640 1 -- 10.20.193.195:0/904365997 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc658003610 con 0x7fc68811e790 2026-02-24T19:16:43.707 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.704+0000 7fc672ffd640 1 -- 10.20.193.195:0/904365997 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc6800030b0 con 0x7fc68811e790 2026-02-24T19:16:43.707 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.704+0000 7fc672ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:43.707 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.704+0000 7fc672ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:16:43.707 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.704+0000 7fc672ffd640 10 monclient(hunting): dump: 2026-02-24T19:16:43.707 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:43.707 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:43.707 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.707 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.707 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:43.707 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:43.707 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:43.707 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:43.707 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:43.707 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:43.708 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.706+0000 7fc672ffd640 1 -- 10.20.193.195:0/904365997 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2098047440 0 0) 0x7fc658003610 con 0x7fc68811e790 2026-02-24T19:16:43.708 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.706+0000 7fc672ffd640 1 -- 10.20.193.195:0/904365997 >> v1:10.20.193.44:6789/0 conn(0x7fc688162250 legacy=0x7fc68812ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:43.708 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.706+0000 7fc672ffd640 1 -- 10.20.193.195:0/904365997 >> v1:10.20.193.14:6789/0 conn(0x7fc6881406c0 legacy=0x7fc688160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:43.708 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.706+0000 7fc672ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:16:43.708 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.706+0000 7fc672ffd640 1 monclient: found mon.c 2026-02-24T19:16:43.708 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.706+0000 7fc672ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:43.708 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.706+0000 7fc672ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:16:43.708 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.706+0000 7fc672ffd640 1 -- 10.20.193.195:0/904365997 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc688131d80 con 0x7fc68811e790 2026-02-24T19:16:43.708 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.706+0000 7fc672ffd640 10 monclient: _finish_auth 0 2026-02-24T19:16:43.708 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.706+0000 7fc672ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:16:43.708 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.706+0000 7fc672ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:43.708 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.706+0000 7fc6909b3640 5 monclient: authenticate success, global_id 4157 2026-02-24T19:16:43.708 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.706+0000 7fc6909b3640 10 monclient: _renew_subs 2026-02-24T19:16:43.708 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.706+0000 7fc6909b3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:16:43.708 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.706+0000 7fc6909b3640 1 -- 10.20.193.195:0/904365997 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc688130d10 con 0x7fc68811e790 2026-02-24T19:16:43.708 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.706+0000 7fc6909b3640 10 client.4157.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:16:43.708 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.706+0000 7fc6909b3640 10 monclient: _renew_subs 2026-02-24T19:16:43.709 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.706+0000 7fc6909b3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:16:43.709 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.706+0000 7fc6909b3640 1 -- 10.20.193.195:0/904365997 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc6881312d0 con 0x7fc68811e790 2026-02-24T19:16:43.709 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.706+0000 7fc6909b3640 1 librados: init done 2026-02-24T19:16:43.709 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.706+0000 7fc6909b3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:43.709 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.706+0000 7fc6909b3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:43.709 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.707+0000 7fc6909b3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:16:43.709 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.707+0000 7fc6909b3640 1 -- 10.20.193.195:0/904365997 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc688185770 con 0x7fc68811e790 2026-02-24T19:16:43.713 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.712+0000 7fc672ffd640 1 -- 10.20.193.195:0/904365997 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc680003700 con 0x7fc68811e790 2026-02-24T19:16:43.713 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.712+0000 7fc672ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:43.713 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.712+0000 7fc672ffd640 1 -- 10.20.193.195:0/904365997 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc680003ad0 con 0x7fc68811e790 2026-02-24T19:16:43.713 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.712+0000 7fc672ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:43.713 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.712+0000 7fc672ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:16:43.713 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.712+0000 7fc68cf25640 4 set_mon_vals no callback set 2026-02-24T19:16:43.713 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.712+0000 7fc672ffd640 10 monclient: dump: 2026-02-24T19:16:43.713 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:43.714 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:43.714 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.714 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.714 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:43.714 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:43.714 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:43.714 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:43.714 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:43.714 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:43.714 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.713+0000 7fc672ffd640 1 -- 10.20.193.195:0/904365997 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 2) ==== 50897+0+0 (unknown 2763422093 0 0) 0x7fc680003cb0 con 0x7fc68811e790 2026-02-24T19:16:43.714 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.713+0000 7fc672ffd640 1 -- 10.20.193.195:0/904365997 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(6..6 src has 1..6) ==== 1180+0+0 (unknown 2359459646 0 0) 0x7fc6800155a0 con 0x7fc68811e790 2026-02-24T19:16:43.714 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.713+0000 7fc672ffd640 10 client.4157.objecter ms_dispatch2 0x7fc688000b90 osd_map(6..6 src has 1..6) 2026-02-24T19:16:43.714 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.713+0000 7fc672ffd640 3 client.4157.objecter handle_osd_map got epochs [6,6] > 0 2026-02-24T19:16:43.714 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.713+0000 7fc672ffd640 3 client.4157.objecter handle_osd_map decoding full epoch 6 2026-02-24T19:16:43.714 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.713+0000 7fc672ffd640 20 client.4157.objecter dump_active .. 0 homeless 2026-02-24T19:16:43.742 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.742+0000 7fc672ffd640 1 -- 10.20.193.195:0/904365997 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7fc680016380 con 0x7fc68811e790 2026-02-24T19:16:43.742 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.742+0000 7fc672ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:43.742 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.742+0000 7fc672ffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:16:43.775 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.773+0000 7fc6909b3640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "09ca59ec-7e76-44ba-bf1a-1b752732db60", "id": 4}] 2026-02-24T19:16:43.775 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.773+0000 7fc6909b3640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "09ca59ec-7e76-44ba-bf1a-1b752732db60", "id": 4}] 2026-02-24T19:16:43.775 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.773+0000 7fc6909b3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:16:43.775 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.773+0000 7fc6909b3640 1 -- 10.20.193.195:0/904365997 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "osd new", "uuid": "09ca59ec-7e76-44ba-bf1a-1b752732db60", "id": 4} v 0) -- 0x7fc6881315c0 con 0x7fc68811e790 2026-02-24T19:16:43.835 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.834+0000 7fc672ffd640 1 -- 10.20.193.195:0/904365997 <== mon.2 v1:10.20.193.170:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "09ca59ec-7e76-44ba-bf1a-1b752732db60", "id": 4}]=0 v7) ==== 112+0+2 (unknown 2002363732 0 1697012583) 0x7fc680015c80 con 0x7fc68811e790 2026-02-24T19:16:43.835 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.834+0000 7fc672ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "09ca59ec-7e76-44ba-bf1a-1b752732db60", "id": 4}] 2026-02-24T19:16:43.835 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.834+0000 7fc672ffd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:16:43.835 INFO:teuthology.orchestra.run.trial195.stdout:4 2026-02-24T19:16:43.836 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.834+0000 7fc6909b3640 10 librados: watch_flush enter 2026-02-24T19:16:43.836 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.834+0000 7fc6909b3640 10 librados: watch_flush exit 2026-02-24T19:16:43.836 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.834+0000 7fc6909b3640 20 client.4157.objecter shutdown clearing up homeless session... 2026-02-24T19:16:43.836 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.834+0000 7fc6909b3640 10 client.4157.objecter successfully canceled tick 2026-02-24T19:16:43.836 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.834+0000 7fc6909b3640 10 monclient: shutdown 2026-02-24T19:16:43.836 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.834+0000 7fc6909b3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:43.836 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.834+0000 7fc6909b3640 1 -- 10.20.193.195:0/904365997 >> v1:10.20.193.170:6789/0 conn(0x7fc68811e790 legacy=0x7fc6881826c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:43.836 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.834+0000 7fc6909b3640 1 -- 10.20.193.195:0/904365997 shutdown_connections 2026-02-24T19:16:43.836 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.834+0000 7fc6909b3640 1 -- 10.20.193.195:0/904365997 >> 10.20.193.195:0/904365997 conn(0x7fc6880588d0 msgr2=0x7fc688183f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:43.836 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.834+0000 7fc6909b3640 1 -- 10.20.193.195:0/904365997 shutdown_connections 2026-02-24T19:16:43.836 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.834+0000 7fc6909b3640 1 -- 10.20.193.195:0/904365997 wait complete. 2026-02-24T19:16:43.836 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.834+0000 7fc6909b3640 1 librados: shutdown 2026-02-24T19:16:43.845 DEBUG:teuthology.orchestra.run.trial195:> sudo ceph --cluster ceph osd new 64319106-a5b4-4775-b122-8c50216df3a6 5 2026-02-24T19:16:43.908 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.906+0000 7fac8924d640 10 monclient: get_monmap_and_config 2026-02-24T19:16:43.909 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.906+0000 7fac8924d640 10 monclient: build_initial_monmap 2026-02-24T19:16:43.909 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.906+0000 7fac8924d640 10 monclient: monmap: 2026-02-24T19:16:43.909 INFO:teuthology.orchestra.run.trial195.stderr:epoch 0 2026-02-24T19:16:43.909 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:43.909 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:16:43.908415+0000 2026-02-24T19:16:43.909 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:16:43.908415+0000 2026-02-24T19:16:43.909 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:43.909 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:43.909 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:43.909 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:43.909 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:43.909 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:43.910 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.907+0000 7fac8924d640 1 Processor -- start 2026-02-24T19:16:43.910 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.907+0000 7fac8924d640 1 -- start start 2026-02-24T19:16:43.910 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.907+0000 7fac8924d640 10 monclient: init 2026-02-24T19:16:43.910 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.907+0000 7fac8924d640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:43.910 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.907+0000 7fac8924d640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:16:43.910 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.907+0000 7fac8924d640 10 monclient(hunting): picked mon.noname-c con 0x7fac8411e790 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:43.910 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.907+0000 7fac8924d640 10 monclient(hunting): picked mon.noname-b con 0x7fac841406c0 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:43.910 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.907+0000 7fac8924d640 10 monclient(hunting): picked mon.noname-a con 0x7fac84162250 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:43.910 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.907+0000 7fac8924d640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac84183fe0 con 0x7fac84162250 2026-02-24T19:16:43.910 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.907+0000 7fac8924d640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac841851e0 con 0x7fac841406c0 2026-02-24T19:16:43.910 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.907+0000 7fac8924d640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac841863e0 con 0x7fac8411e790 2026-02-24T19:16:43.910 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.907+0000 7fac8924d640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:43.910 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.907+0000 7fac8924d640 10 monclient(hunting): authenticate will time out at 3572.543439s 2026-02-24T19:16:43.910 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.907+0000 7fac82575640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7fac841406c0 0x7fac84160aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.195:43874/0 (socket says 10.20.193.195:43874) 2026-02-24T19:16:43.910 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.907+0000 7fac82d76640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7fac8411e790 0x7fac8411eb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.195:32850/0 (socket says 10.20.193.195:32850) 2026-02-24T19:16:43.910 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.907+0000 7fac82575640 1 -- 10.20.193.195:0/2274151276 learned_addr learned my addr 10.20.193.195:0/2274151276 (peer_addr_for_me v1:10.20.193.195:0/0) 2026-02-24T19:16:43.911 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.909+0000 7fac81d74640 1 -- 10.20.193.195:0/2274151276 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2430415881 0 0) 0x7fac841851e0 con 0x7fac841406c0 2026-02-24T19:16:43.911 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.909+0000 7fac81d74640 10 monclient(hunting): _negotiate 2026-02-24T19:16:43.911 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.909+0000 7fac81d74640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:43.911 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.909+0000 7fac81d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:43.911 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.909+0000 7fac81d74640 10 monclient(hunting): my global_id is 4150 2026-02-24T19:16:43.911 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.909+0000 7fac81d74640 1 -- 10.20.193.195:0/2274151276 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac70003610 con 0x7fac841406c0 2026-02-24T19:16:43.913 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.910+0000 7fac81d74640 1 -- 10.20.193.195:0/2274151276 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1824142215 0 0) 0x7fac70003610 con 0x7fac841406c0 2026-02-24T19:16:43.913 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.910+0000 7fac81d74640 1 -- 10.20.193.195:0/2274151276 >> v1:10.20.193.170:6789/0 conn(0x7fac8411e790 legacy=0x7fac8411eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:43.913 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.910+0000 7fac81d74640 1 -- 10.20.193.195:0/2274151276 >> v1:10.20.193.14:6789/0 conn(0x7fac84162250 legacy=0x7fac841826e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:16:43.913 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.910+0000 7fac81d74640 10 monclient: _finish_hunting 0 2026-02-24T19:16:43.913 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.910+0000 7fac81d74640 1 monclient: found mon.noname-b 2026-02-24T19:16:43.913 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.910+0000 7fac81d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:43.913 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.910+0000 7fac81d74640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.44:6789/0 2026-02-24T19:16:43.913 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.910+0000 7fac81d74640 1 -- 10.20.193.195:0/2274151276 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac84187680 con 0x7fac841406c0 2026-02-24T19:16:43.913 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.910+0000 7fac81d74640 10 monclient: _finish_auth 0 2026-02-24T19:16:43.913 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.910+0000 7fac81d74640 10 monclient: _check_auth_tickets 2026-02-24T19:16:43.913 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.910+0000 7fac81d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:43.913 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.910+0000 7fac81d74640 1 -- 10.20.193.195:0/2274151276 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fac6c002df0 con 0x7fac841406c0 2026-02-24T19:16:43.913 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.910+0000 7fac81d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:43.913 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.910+0000 7fac81d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:16:43.913 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.910+0000 7fac81d74640 10 monclient: dump: 2026-02-24T19:16:43.913 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:43.913 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:43.913 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.913 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.913 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:43.913 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:43.913 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:43.913 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:43.913 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:43.913 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:43.914 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.910+0000 7fac8924d640 5 monclient: authenticate success, global_id 4150 2026-02-24T19:16:43.914 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.910+0000 7fac8924d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:16:43.915 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.911+0000 7fac81d74640 1 -- 10.20.193.195:0/2274151276 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fac6c003070 con 0x7fac841406c0 2026-02-24T19:16:43.915 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.911+0000 7fac81d74640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:43.915 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.911+0000 7fac81d74640 1 -- 10.20.193.195:0/2274151276 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fac6c0034b0 con 0x7fac841406c0 2026-02-24T19:16:43.915 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.911+0000 7fac8924d640 10 monclient: get_monmap_and_config success 2026-02-24T19:16:43.915 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.911+0000 7fac81d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:43.915 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.911+0000 7fac8924d640 4 set_mon_vals no callback set 2026-02-24T19:16:43.915 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.911+0000 7fac81d74640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:16:43.915 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.911+0000 7fac81d74640 10 monclient: dump: 2026-02-24T19:16:43.915 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:43.915 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:43.915 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.915 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.916 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:43.916 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:43.916 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:43.916 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:43.916 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:43.916 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:43.916 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.911+0000 7fac8924d640 10 monclient: shutdown 2026-02-24T19:16:43.916 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.911+0000 7fac8924d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:43.916 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.911+0000 7fac8924d640 1 -- 10.20.193.195:0/2274151276 >> v1:10.20.193.44:6789/0 conn(0x7fac841406c0 legacy=0x7fac84160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:43.916 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.911+0000 7fac8924d640 1 -- 10.20.193.195:0/2274151276 shutdown_connections 2026-02-24T19:16:43.916 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.911+0000 7fac8924d640 1 -- 10.20.193.195:0/2274151276 >> 10.20.193.195:0/2274151276 conn(0x7fac840588d0 msgr2=0x7fac84058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:43.916 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.912+0000 7fac8924d640 1 -- 10.20.193.195:0/2274151276 shutdown_connections 2026-02-24T19:16:43.916 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.912+0000 7fac8924d640 1 -- 10.20.193.195:0/2274151276 wait complete. 2026-02-24T19:16:43.916 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.912+0000 7fac8924d640 10 monclient: build_initial_monmap 2026-02-24T19:16:43.916 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.912+0000 7fac8924d640 10 monclient: monmap: 2026-02-24T19:16:43.916 INFO:teuthology.orchestra.run.trial195.stderr:epoch 0 2026-02-24T19:16:43.916 INFO:teuthology.orchestra.run.trial195.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:16:43.916 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 0.000000 2026-02-24T19:16:43.916 INFO:teuthology.orchestra.run.trial195.stderr:created 0.000000 2026-02-24T19:16:43.916 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:43.916 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 1 2026-02-24T19:16:43.916 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:43.916 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:43.916 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:43.916 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:43.916 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.912+0000 7fac8924d640 1 librados: starting msgr at 2026-02-24T19:16:43.916 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.912+0000 7fac8924d640 1 librados: starting objecter 2026-02-24T19:16:43.917 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.912+0000 7fac8924d640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:16:43.917 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.912+0000 7fac8924d640 1 Processor -- start 2026-02-24T19:16:43.917 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.912+0000 7fac8924d640 1 -- start start 2026-02-24T19:16:43.917 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.912+0000 7fac8924d640 1 librados: setting wanted keys 2026-02-24T19:16:43.917 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.912+0000 7fac8924d640 1 librados: calling monclient init 2026-02-24T19:16:43.917 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.912+0000 7fac8924d640 10 monclient: init 2026-02-24T19:16:43.917 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.912+0000 7fac8924d640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:43.917 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.912+0000 7fac8924d640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:16:43.917 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.912+0000 7fac8924d640 10 monclient(hunting): picked mon.noname-b con 0x7fac8411e790 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:43.917 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.912+0000 7fac8924d640 10 monclient(hunting): picked mon.noname-a con 0x7fac841406c0 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:43.917 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.912+0000 7fac8924d640 10 monclient(hunting): picked mon.noname-c con 0x7fac84162250 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:43.917 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.912+0000 7fac8924d640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac84105840 con 0x7fac841406c0 2026-02-24T19:16:43.917 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.912+0000 7fac8924d640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac8410d630 con 0x7fac8411e790 2026-02-24T19:16:43.917 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.912+0000 7fac8924d640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac8410e850 con 0x7fac84162250 2026-02-24T19:16:43.917 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.912+0000 7fac8924d640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:43.917 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.912+0000 7fac8924d640 10 monclient(hunting): authenticate will time out at 3572.548641s 2026-02-24T19:16:43.917 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.912+0000 7fac83577640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7fac84162250 0x7fac84161ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.195:32860/0 (socket says 10.20.193.195:32860) 2026-02-24T19:16:43.917 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.912+0000 7fac83577640 1 -- 10.20.193.195:0/142104832 learned_addr learned my addr 10.20.193.195:0/142104832 (peer_addr_for_me v1:10.20.193.195:0/0) 2026-02-24T19:16:43.917 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.913+0000 7fac637fe640 10 client.?.objecter ms_handle_connect 0x7fac84162250 2026-02-24T19:16:43.917 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.913+0000 7fac637fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:43.917 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.913+0000 7fac637fe640 10 client.?.objecter ms_handle_connect 0x7fac8411e790 2026-02-24T19:16:43.917 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.913+0000 7fac637fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:43.918 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.914+0000 7fac637fe640 1 -- 10.20.193.195:0/142104832 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3152544000 0 0) 0x7fac8410d630 con 0x7fac8411e790 2026-02-24T19:16:43.918 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.914+0000 7fac637fe640 10 monclient(hunting): _negotiate 2026-02-24T19:16:43.918 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.914+0000 7fac637fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:43.918 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.914+0000 7fac637fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:43.918 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.914+0000 7fac637fe640 10 monclient(hunting): my global_id is 4153 2026-02-24T19:16:43.918 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.914+0000 7fac637fe640 1 -- 10.20.193.195:0/142104832 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac50003610 con 0x7fac8411e790 2026-02-24T19:16:43.919 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.917+0000 7fac637fe640 1 -- 10.20.193.195:0/142104832 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2160764093 0 0) 0x7fac50003610 con 0x7fac8411e790 2026-02-24T19:16:43.919 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.917+0000 7fac637fe640 1 -- 10.20.193.195:0/142104832 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fac8410d630 con 0x7fac8411e790 2026-02-24T19:16:43.919 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.917+0000 7fac637fe640 1 -- 10.20.193.195:0/142104832 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fac78003090 con 0x7fac8411e790 2026-02-24T19:16:43.920 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.917+0000 7fac637fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:43.920 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.917+0000 7fac637fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:16:43.920 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.917+0000 7fac637fe640 10 monclient(hunting): dump: 2026-02-24T19:16:43.920 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:43.920 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:43.920 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.920 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.920 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:43.920 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:43.920 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:43.920 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:43.920 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:43.920 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:43.920 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.917+0000 7fac637fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:16:43.926 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.924+0000 7fac637fe640 10 client.?.objecter ms_handle_connect 0x7fac841406c0 2026-02-24T19:16:43.926 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.924+0000 7fac637fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:43.928 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.926+0000 7fac637fe640 1 -- 10.20.193.195:0/142104832 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 356950966 0 0) 0x7fac84187680 con 0x7fac841406c0 2026-02-24T19:16:43.928 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.926+0000 7fac637fe640 10 monclient(hunting): _negotiate 2026-02-24T19:16:43.928 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.926+0000 7fac637fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:43.928 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.926+0000 7fac637fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:43.928 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.926+0000 7fac637fe640 10 monclient(hunting): my global_id is 4161 2026-02-24T19:16:43.928 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.926+0000 7fac637fe640 1 -- 10.20.193.195:0/142104832 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac50003610 con 0x7fac841406c0 2026-02-24T19:16:43.960 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.958+0000 7fac637fe640 1 -- 10.20.193.195:0/142104832 <== mon.1 v1:10.20.193.44:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2800203094 0 0) 0x7fac8410d630 con 0x7fac8411e790 2026-02-24T19:16:43.960 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.958+0000 7fac637fe640 1 -- 10.20.193.195:0/142104832 >> v1:10.20.193.170:6789/0 conn(0x7fac84162250 legacy=0x7fac84161ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:43.960 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.958+0000 7fac637fe640 1 -- 10.20.193.195:0/142104832 >> v1:10.20.193.14:6789/0 conn(0x7fac841406c0 legacy=0x7fac84104e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:43.960 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.958+0000 7fac637fe640 10 monclient: _finish_hunting 0 2026-02-24T19:16:43.960 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.958+0000 7fac637fe640 1 monclient: found mon.b 2026-02-24T19:16:43.960 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.958+0000 7fac637fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:43.960 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.958+0000 7fac637fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:16:43.960 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.958+0000 7fac637fe640 1 -- 10.20.193.195:0/142104832 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac8410faf0 con 0x7fac8411e790 2026-02-24T19:16:43.960 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.958+0000 7fac637fe640 10 monclient: _finish_auth 0 2026-02-24T19:16:43.960 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.958+0000 7fac637fe640 10 monclient: _check_auth_tickets 2026-02-24T19:16:43.960 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.958+0000 7fac637fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:43.960 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.958+0000 7fac8924d640 5 monclient: authenticate success, global_id 4153 2026-02-24T19:16:43.960 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.958+0000 7fac8924d640 10 monclient: _renew_subs 2026-02-24T19:16:43.960 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.958+0000 7fac8924d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:16:43.960 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.958+0000 7fac8924d640 1 -- 10.20.193.195:0/142104832 --> v1:10.20.193.44:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fac8410d860 con 0x7fac8411e790 2026-02-24T19:16:43.960 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.958+0000 7fac8924d640 10 client.4153.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:16:43.960 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.958+0000 7fac8924d640 10 monclient: _renew_subs 2026-02-24T19:16:43.960 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.958+0000 7fac8924d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:16:43.960 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.958+0000 7fac8924d640 1 -- 10.20.193.195:0/142104832 --> v1:10.20.193.44:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fac8410de50 con 0x7fac8411e790 2026-02-24T19:16:43.960 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.958+0000 7fac8924d640 1 librados: init done 2026-02-24T19:16:43.961 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.958+0000 7fac8924d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:43.961 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.958+0000 7fac8924d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:43.961 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.958+0000 7fac8924d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:16:43.961 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.958+0000 7fac8924d640 1 -- 10.20.193.195:0/142104832 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac84186ae0 con 0x7fac8411e790 2026-02-24T19:16:43.964 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.962+0000 7fac637fe640 1 -- 10.20.193.195:0/142104832 <== mon.1 v1:10.20.193.44:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fac78003440 con 0x7fac8411e790 2026-02-24T19:16:43.964 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.962+0000 7fac637fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:43.964 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.962+0000 7fac637fe640 1 -- 10.20.193.195:0/142104832 <== mon.1 v1:10.20.193.44:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fac78004d20 con 0x7fac8411e790 2026-02-24T19:16:43.964 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.962+0000 7fac637fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:43.964 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.962+0000 7fac637fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:16:43.964 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.962+0000 7fac81573640 4 set_mon_vals no callback set 2026-02-24T19:16:43.964 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.962+0000 7fac637fe640 10 monclient: dump: 2026-02-24T19:16:43.964 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:43.964 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:43.964 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.965 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:43.965 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:43.965 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:43.965 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:43.965 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:43.965 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:43.965 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:43.965 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.963+0000 7fac637fe640 1 -- 10.20.193.195:0/142104832 <== mon.1 v1:10.20.193.44:6789/0 7 ==== mgrmap(e 2) ==== 50897+0+0 (unknown 2763422093 0 0) 0x7fac78004f00 con 0x7fac8411e790 2026-02-24T19:16:43.965 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.963+0000 7fac637fe640 1 -- 10.20.193.195:0/142104832 <== mon.1 v1:10.20.193.44:6789/0 8 ==== osd_map(7..7 src has 1..7) ==== 1295+0+0 (unknown 3780437488 0 0) 0x7fac7804cfb0 con 0x7fac8411e790 2026-02-24T19:16:43.965 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.963+0000 7fac637fe640 10 client.4153.objecter ms_dispatch2 0x7fac84000b90 osd_map(7..7 src has 1..7) 2026-02-24T19:16:43.965 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.963+0000 7fac637fe640 3 client.4153.objecter handle_osd_map got epochs [7,7] > 0 2026-02-24T19:16:43.965 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.963+0000 7fac637fe640 3 client.4153.objecter handle_osd_map decoding full epoch 7 2026-02-24T19:16:43.965 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.963+0000 7fac637fe640 20 client.4153.objecter dump_active .. 0 homeless 2026-02-24T19:16:43.995 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.994+0000 7fac637fe640 1 -- 10.20.193.195:0/142104832 <== mon.1 v1:10.20.193.44:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7fac78017670 con 0x7fac8411e790 2026-02-24T19:16:43.995 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.994+0000 7fac637fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:43.995 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:43.994+0000 7fac637fe640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:16:44.028 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.026+0000 7fac8924d640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "64319106-a5b4-4775-b122-8c50216df3a6", "id": 5}] 2026-02-24T19:16:44.028 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.026+0000 7fac8924d640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "64319106-a5b4-4775-b122-8c50216df3a6", "id": 5}] 2026-02-24T19:16:44.028 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.026+0000 7fac8924d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:16:44.028 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.026+0000 7fac8924d640 1 -- 10.20.193.195:0/142104832 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "osd new", "uuid": "64319106-a5b4-4775-b122-8c50216df3a6", "id": 5} v 0) -- 0x7fac8410e1e0 con 0x7fac8411e790 2026-02-24T19:16:44.111 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.109+0000 7fac637fe640 1 -- 10.20.193.195:0/142104832 <== mon.1 v1:10.20.193.44:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "64319106-a5b4-4775-b122-8c50216df3a6", "id": 5}]=0 v8) ==== 112+0+2 (unknown 1766949208 0 1988412176) 0x7fac78016f70 con 0x7fac8411e790 2026-02-24T19:16:44.111 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.109+0000 7fac637fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "64319106-a5b4-4775-b122-8c50216df3a6", "id": 5}] 2026-02-24T19:16:44.111 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.109+0000 7fac637fe640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:16:44.111 INFO:teuthology.orchestra.run.trial195.stdout:5 2026-02-24T19:16:44.112 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.110+0000 7fac8924d640 10 librados: watch_flush enter 2026-02-24T19:16:44.112 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.110+0000 7fac8924d640 10 librados: watch_flush exit 2026-02-24T19:16:44.112 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.110+0000 7fac8924d640 20 client.4153.objecter shutdown clearing up homeless session... 2026-02-24T19:16:44.112 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.110+0000 7fac8924d640 10 client.4153.objecter successfully canceled tick 2026-02-24T19:16:44.112 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.110+0000 7fac8924d640 10 monclient: shutdown 2026-02-24T19:16:44.112 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.110+0000 7fac8924d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:44.112 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.110+0000 7fac8924d640 1 -- 10.20.193.195:0/142104832 >> v1:10.20.193.44:6789/0 conn(0x7fac8411e790 legacy=0x7fac841826c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:44.112 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.110+0000 7fac8924d640 1 -- 10.20.193.195:0/142104832 shutdown_connections 2026-02-24T19:16:44.112 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.110+0000 7fac8924d640 1 -- 10.20.193.195:0/142104832 >> 10.20.193.195:0/142104832 conn(0x7fac840588d0 msgr2=0x7fac8411f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:44.112 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.110+0000 7fac8924d640 1 -- 10.20.193.195:0/142104832 shutdown_connections 2026-02-24T19:16:44.112 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.110+0000 7fac8924d640 1 -- 10.20.193.195:0/142104832 wait complete. 2026-02-24T19:16:44.112 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.110+0000 7fac8924d640 1 librados: shutdown 2026-02-24T19:16:44.121 DEBUG:teuthology.orchestra.run.trial195:> sudo ceph --cluster ceph osd new 19f0033c-abbd-406a-8eae-94e7e81da9ac 6 2026-02-24T19:16:44.184 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.182+0000 7fc1c9eb1640 10 monclient: get_monmap_and_config 2026-02-24T19:16:44.184 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.182+0000 7fc1c9eb1640 10 monclient: build_initial_monmap 2026-02-24T19:16:44.184 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.182+0000 7fc1c9eb1640 10 monclient: monmap: 2026-02-24T19:16:44.184 INFO:teuthology.orchestra.run.trial195.stderr:epoch 0 2026-02-24T19:16:44.184 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:44.184 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:16:44.183767+0000 2026-02-24T19:16:44.184 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:16:44.183767+0000 2026-02-24T19:16:44.184 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:44.184 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:44.184 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:44.184 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:44.184 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:44.184 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:44.185 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.182+0000 7fc1c9eb1640 1 Processor -- start 2026-02-24T19:16:44.185 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.182+0000 7fc1c9eb1640 1 -- start start 2026-02-24T19:16:44.185 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.182+0000 7fc1c9eb1640 10 monclient: init 2026-02-24T19:16:44.185 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.182+0000 7fc1c9eb1640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:44.185 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.182+0000 7fc1c9eb1640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:16:44.185 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.182+0000 7fc1c9eb1640 10 monclient(hunting): picked mon.noname-b con 0x7fc1c405d9b0 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:44.185 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.182+0000 7fc1c9eb1640 10 monclient(hunting): picked mon.noname-a con 0x7fc1c405dd80 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:44.185 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.182+0000 7fc1c9eb1640 10 monclient(hunting): picked mon.noname-c con 0x7fc1c41649b0 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:44.185 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.182+0000 7fc1c9eb1640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1c405e200 con 0x7fc1c405dd80 2026-02-24T19:16:44.185 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.182+0000 7fc1c9eb1640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1c41874c0 con 0x7fc1c405d9b0 2026-02-24T19:16:44.185 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.182+0000 7fc1c9eb1640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1c41886a0 con 0x7fc1c41649b0 2026-02-24T19:16:44.186 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.182+0000 7fc1c9eb1640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:44.186 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.182+0000 7fc1c9eb1640 10 monclient(hunting): authenticate will time out at 3572.818757s 2026-02-24T19:16:44.186 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.183+0000 7fc1c2ffd640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7fc1c405dd80 0x7fc1c411b8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.195:35090/0 (socket says 10.20.193.195:35090) 2026-02-24T19:16:44.186 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.183+0000 7fc1c2ffd640 1 -- 10.20.193.195:0/37935811 learned_addr learned my addr 10.20.193.195:0/37935811 (peer_addr_for_me v1:10.20.193.195:0/0) 2026-02-24T19:16:44.187 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.184+0000 7fc1c27fc640 1 -- 10.20.193.195:0/37935811 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 718007147 0 0) 0x7fc1c405e200 con 0x7fc1c405dd80 2026-02-24T19:16:44.188 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.184+0000 7fc1c27fc640 10 monclient(hunting): _negotiate 2026-02-24T19:16:44.188 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.184+0000 7fc1c27fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:44.188 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.184+0000 7fc1c27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:44.188 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.184+0000 7fc1c27fc640 10 monclient(hunting): my global_id is 4164 2026-02-24T19:16:44.188 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.184+0000 7fc1c27fc640 1 -- 10.20.193.195:0/37935811 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1a8003610 con 0x7fc1c405dd80 2026-02-24T19:16:44.188 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.184+0000 7fc1c27fc640 1 -- 10.20.193.195:0/37935811 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 679418764 0 0) 0x7fc1c41886a0 con 0x7fc1c41649b0 2026-02-24T19:16:44.188 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.184+0000 7fc1c27fc640 10 monclient(hunting): _negotiate 2026-02-24T19:16:44.188 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.184+0000 7fc1c27fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:44.188 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.184+0000 7fc1c27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:44.188 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.184+0000 7fc1c27fc640 10 monclient(hunting): my global_id is 4160 2026-02-24T19:16:44.188 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.184+0000 7fc1c27fc640 1 -- 10.20.193.195:0/37935811 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1c405e200 con 0x7fc1c41649b0 2026-02-24T19:16:44.189 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.184+0000 7fc1c27fc640 1 -- 10.20.193.195:0/37935811 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1404338303 0 0) 0x7fc1c41874c0 con 0x7fc1c405d9b0 2026-02-24T19:16:44.189 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.184+0000 7fc1c27fc640 10 monclient(hunting): _negotiate 2026-02-24T19:16:44.189 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.184+0000 7fc1c27fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:44.189 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.184+0000 7fc1c27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:44.189 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.184+0000 7fc1c27fc640 10 monclient(hunting): my global_id is 4156 2026-02-24T19:16:44.189 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.184+0000 7fc1c27fc640 1 -- 10.20.193.195:0/37935811 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1c41886a0 con 0x7fc1c405d9b0 2026-02-24T19:16:44.193 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.186+0000 7fc1c27fc640 1 -- 10.20.193.195:0/37935811 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 116035160 0 0) 0x7fc1a8003610 con 0x7fc1c405dd80 2026-02-24T19:16:44.193 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.186+0000 7fc1c27fc640 1 -- 10.20.193.195:0/37935811 >> v1:10.20.193.170:6789/0 conn(0x7fc1c41649b0 legacy=0x7fc1c4184d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:44.193 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.186+0000 7fc1c27fc640 1 -- 10.20.193.195:0/37935811 >> v1:10.20.193.44:6789/0 conn(0x7fc1c405d9b0 legacy=0x7fc1c411b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:44.193 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.186+0000 7fc1c27fc640 10 monclient: _finish_hunting 0 2026-02-24T19:16:44.193 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.186+0000 7fc1c27fc640 1 monclient: found mon.noname-a 2026-02-24T19:16:44.193 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.186+0000 7fc1c27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:44.193 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.186+0000 7fc1c27fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:16:44.193 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.186+0000 7fc1c27fc640 1 -- 10.20.193.195:0/37935811 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1c4189920 con 0x7fc1c405dd80 2026-02-24T19:16:44.193 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.186+0000 7fc1c27fc640 10 monclient: _finish_auth 0 2026-02-24T19:16:44.194 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.186+0000 7fc1c27fc640 10 monclient: _check_auth_tickets 2026-02-24T19:16:44.194 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.186+0000 7fc1c27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:44.194 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.186+0000 7fc1c27fc640 1 -- 10.20.193.195:0/37935811 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc1b4002df0 con 0x7fc1c405dd80 2026-02-24T19:16:44.194 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.186+0000 7fc1c27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:44.194 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.186+0000 7fc1c27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:16:44.194 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.186+0000 7fc1c27fc640 10 monclient: dump: 2026-02-24T19:16:44.194 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:44.194 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:44.194 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:44.194 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:44.194 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:44.194 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:44.194 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:44.194 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:44.194 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:44.194 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:44.194 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.186+0000 7fc1c9eb1640 5 monclient: authenticate success, global_id 4164 2026-02-24T19:16:44.194 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.186+0000 7fc1c9eb1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:16:44.194 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.187+0000 7fc1c27fc640 1 -- 10.20.193.195:0/37935811 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc1b4003030 con 0x7fc1c405dd80 2026-02-24T19:16:44.194 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.187+0000 7fc1c27fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:44.194 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.187+0000 7fc1c27fc640 1 -- 10.20.193.195:0/37935811 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc1b4003470 con 0x7fc1c405dd80 2026-02-24T19:16:44.194 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.187+0000 7fc1c27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:44.194 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.187+0000 7fc1c27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:16:44.194 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.187+0000 7fc1c27fc640 10 monclient: dump: 2026-02-24T19:16:44.194 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:44.195 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:44.195 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:44.195 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:44.195 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:44.195 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:44.195 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:44.195 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:44.195 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:44.195 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:44.195 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.187+0000 7fc1c9eb1640 10 monclient: get_monmap_and_config success 2026-02-24T19:16:44.195 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.187+0000 7fc1c9eb1640 4 set_mon_vals no callback set 2026-02-24T19:16:44.195 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.187+0000 7fc1c9eb1640 10 monclient: shutdown 2026-02-24T19:16:44.195 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.187+0000 7fc1c9eb1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:44.195 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.187+0000 7fc1c9eb1640 1 -- 10.20.193.195:0/37935811 >> v1:10.20.193.14:6789/0 conn(0x7fc1c405dd80 legacy=0x7fc1c411b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:44.195 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.187+0000 7fc1c9eb1640 1 -- 10.20.193.195:0/37935811 shutdown_connections 2026-02-24T19:16:44.195 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.187+0000 7fc1c9eb1640 1 -- 10.20.193.195:0/37935811 >> 10.20.193.195:0/37935811 conn(0x7fc1c40588d0 msgr2=0x7fc1c4058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:44.195 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.187+0000 7fc1c9eb1640 1 -- 10.20.193.195:0/37935811 shutdown_connections 2026-02-24T19:16:44.195 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.187+0000 7fc1c9eb1640 1 -- 10.20.193.195:0/37935811 wait complete. 2026-02-24T19:16:44.195 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.187+0000 7fc1c9eb1640 10 monclient: build_initial_monmap 2026-02-24T19:16:44.195 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.187+0000 7fc1c9eb1640 10 monclient: monmap: 2026-02-24T19:16:44.195 INFO:teuthology.orchestra.run.trial195.stderr:epoch 0 2026-02-24T19:16:44.195 INFO:teuthology.orchestra.run.trial195.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:16:44.195 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 0.000000 2026-02-24T19:16:44.195 INFO:teuthology.orchestra.run.trial195.stderr:created 0.000000 2026-02-24T19:16:44.195 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:44.196 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 1 2026-02-24T19:16:44.196 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:44.196 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:44.196 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:44.196 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:44.196 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.187+0000 7fc1c9eb1640 1 librados: starting msgr at 2026-02-24T19:16:44.196 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.187+0000 7fc1c9eb1640 1 librados: starting objecter 2026-02-24T19:16:44.196 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.187+0000 7fc1c9eb1640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:16:44.196 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.187+0000 7fc1c9eb1640 1 Processor -- start 2026-02-24T19:16:44.196 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.187+0000 7fc1c9eb1640 1 -- start start 2026-02-24T19:16:44.196 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.187+0000 7fc1c9eb1640 1 librados: setting wanted keys 2026-02-24T19:16:44.196 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.187+0000 7fc1c9eb1640 1 librados: calling monclient init 2026-02-24T19:16:44.196 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.187+0000 7fc1c9eb1640 10 monclient: init 2026-02-24T19:16:44.196 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.188+0000 7fc1c9eb1640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:44.196 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.188+0000 7fc1c9eb1640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:16:44.196 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.188+0000 7fc1c9eb1640 10 monclient(hunting): picked mon.noname-a con 0x7fc1c405d9b0 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:44.196 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.188+0000 7fc1c9eb1640 10 monclient(hunting): picked mon.noname-b con 0x7fc1c405dd80 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:44.196 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.188+0000 7fc1c9eb1640 10 monclient(hunting): picked mon.noname-c con 0x7fc1c41649b0 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:44.196 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.188+0000 7fc1c9eb1640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1c416c7d0 con 0x7fc1c405d9b0 2026-02-24T19:16:44.196 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.188+0000 7fc1c9eb1640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1c41736b0 con 0x7fc1c405dd80 2026-02-24T19:16:44.196 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.188+0000 7fc1c9eb1640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1c4174890 con 0x7fc1c41649b0 2026-02-24T19:16:44.196 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.188+0000 7fc1c9eb1640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:44.196 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.188+0000 7fc1c9eb1640 10 monclient(hunting): authenticate will time out at 3572.824144s 2026-02-24T19:16:44.196 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.188+0000 7fc1c2ffd640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7fc1c405dd80 0x7fc1c4161980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.195:36376/0 (socket says 10.20.193.195:36376) 2026-02-24T19:16:44.196 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.188+0000 7fc1c2ffd640 1 -- 10.20.193.195:0/2490550511 learned_addr learned my addr 10.20.193.195:0/2490550511 (peer_addr_for_me v1:10.20.193.195:0/0) 2026-02-24T19:16:44.196 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.188+0000 7fc19ffff640 10 client.?.objecter ms_handle_connect 0x7fc1c405dd80 2026-02-24T19:16:44.196 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.188+0000 7fc19ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:44.197 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.188+0000 7fc19ffff640 10 client.?.objecter ms_handle_connect 0x7fc1c405d9b0 2026-02-24T19:16:44.197 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.188+0000 7fc19ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:44.197 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.188+0000 7fc19ffff640 10 client.?.objecter ms_handle_connect 0x7fc1c41649b0 2026-02-24T19:16:44.197 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.188+0000 7fc19ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:44.197 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.189+0000 7fc19ffff640 1 -- 10.20.193.195:0/2490550511 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2163302451 0 0) 0x7fc1c41736b0 con 0x7fc1c405dd80 2026-02-24T19:16:44.197 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.189+0000 7fc19ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:16:44.197 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.189+0000 7fc19ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:44.197 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.189+0000 7fc19ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:44.197 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.189+0000 7fc19ffff640 10 monclient(hunting): my global_id is 4159 2026-02-24T19:16:44.197 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.189+0000 7fc19ffff640 1 -- 10.20.193.195:0/2490550511 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc194003610 con 0x7fc1c405dd80 2026-02-24T19:16:44.197 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.189+0000 7fc19ffff640 1 -- 10.20.193.195:0/2490550511 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3164768303 0 0) 0x7fc1c4174890 con 0x7fc1c41649b0 2026-02-24T19:16:44.197 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.189+0000 7fc19ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:16:44.197 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.189+0000 7fc19ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:44.197 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.189+0000 7fc19ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:44.197 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.189+0000 7fc19ffff640 10 monclient(hunting): my global_id is 4163 2026-02-24T19:16:44.197 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.189+0000 7fc19ffff640 1 -- 10.20.193.195:0/2490550511 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1c41736b0 con 0x7fc1c41649b0 2026-02-24T19:16:44.197 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.189+0000 7fc19ffff640 1 -- 10.20.193.195:0/2490550511 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 893641360 0 0) 0x7fc1c416c7d0 con 0x7fc1c405d9b0 2026-02-24T19:16:44.197 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.189+0000 7fc19ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:16:44.197 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.189+0000 7fc19ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:44.197 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.189+0000 7fc19ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:44.197 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.189+0000 7fc19ffff640 10 monclient(hunting): my global_id is 4167 2026-02-24T19:16:44.197 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.189+0000 7fc19ffff640 1 -- 10.20.193.195:0/2490550511 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1c4174890 con 0x7fc1c405d9b0 2026-02-24T19:16:44.199 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.191+0000 7fc19ffff640 1 -- 10.20.193.195:0/2490550511 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2961386270 0 0) 0x7fc194003610 con 0x7fc1c405dd80 2026-02-24T19:16:44.199 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.191+0000 7fc19ffff640 1 -- 10.20.193.195:0/2490550511 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc1c416c7d0 con 0x7fc1c405dd80 2026-02-24T19:16:44.199 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.191+0000 7fc19ffff640 1 -- 10.20.193.195:0/2490550511 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc1b4003380 con 0x7fc1c405dd80 2026-02-24T19:16:44.199 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.191+0000 7fc19ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:44.199 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.191+0000 7fc19ffff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:16:44.199 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.191+0000 7fc19ffff640 10 monclient(hunting): dump: 2026-02-24T19:16:44.199 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:44.199 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:44.199 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:44.199 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:44.199 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:44.199 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:44.199 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:44.199 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:44.199 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:44.199 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:44.199 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.191+0000 7fc19ffff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:16:44.199 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.191+0000 7fc19ffff640 1 -- 10.20.193.195:0/2490550511 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4024310035 0 0) 0x7fc1c41736b0 con 0x7fc1c41649b0 2026-02-24T19:16:44.200 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.191+0000 7fc19ffff640 1 -- 10.20.193.195:0/2490550511 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc194003610 con 0x7fc1c41649b0 2026-02-24T19:16:44.200 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.191+0000 7fc19ffff640 1 -- 10.20.193.195:0/2490550511 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc1b80033b0 con 0x7fc1c41649b0 2026-02-24T19:16:44.200 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.191+0000 7fc19ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:44.200 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.191+0000 7fc19ffff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:16:44.200 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.191+0000 7fc19ffff640 10 monclient(hunting): dump: 2026-02-24T19:16:44.200 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:44.200 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:44.200 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:44.200 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:44.200 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:44.200 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:44.200 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:44.200 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:44.200 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:44.200 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:44.200 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.192+0000 7fc19ffff640 1 -- 10.20.193.195:0/2490550511 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3860171801 0 0) 0x7fc1c4174890 con 0x7fc1c405d9b0 2026-02-24T19:16:44.200 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.192+0000 7fc19ffff640 1 -- 10.20.193.195:0/2490550511 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc1c41736b0 con 0x7fc1c405d9b0 2026-02-24T19:16:44.200 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.192+0000 7fc19ffff640 1 -- 10.20.193.195:0/2490550511 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc1b0003060 con 0x7fc1c405d9b0 2026-02-24T19:16:44.200 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.192+0000 7fc19ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:44.200 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.192+0000 7fc19ffff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:16:44.200 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.192+0000 7fc19ffff640 10 monclient(hunting): dump: 2026-02-24T19:16:44.200 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:44.200 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:44.200 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:44.200 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:44.200 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:44.200 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:44.201 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:44.201 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:44.201 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:44.201 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:44.201 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.193+0000 7fc19ffff640 1 -- 10.20.193.195:0/2490550511 <== mon.1 v1:10.20.193.44:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 543513369 0 0) 0x7fc1c416c7d0 con 0x7fc1c405dd80 2026-02-24T19:16:44.201 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.193+0000 7fc19ffff640 1 -- 10.20.193.195:0/2490550511 >> v1:10.20.193.170:6789/0 conn(0x7fc1c41649b0 legacy=0x7fc1c41630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:44.201 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.193+0000 7fc19ffff640 1 -- 10.20.193.195:0/2490550511 >> v1:10.20.193.14:6789/0 conn(0x7fc1c405d9b0 legacy=0x7fc1c416bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:44.201 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.193+0000 7fc19ffff640 10 monclient: _finish_hunting 0 2026-02-24T19:16:44.201 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.193+0000 7fc19ffff640 1 monclient: found mon.b 2026-02-24T19:16:44.201 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.193+0000 7fc19ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:44.201 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.193+0000 7fc19ffff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:16:44.201 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.193+0000 7fc19ffff640 1 -- 10.20.193.195:0/2490550511 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1c4175a70 con 0x7fc1c405dd80 2026-02-24T19:16:44.201 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.193+0000 7fc19ffff640 10 monclient: _finish_auth 0 2026-02-24T19:16:44.201 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.193+0000 7fc19ffff640 10 monclient: _check_auth_tickets 2026-02-24T19:16:44.201 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.193+0000 7fc19ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:44.201 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.193+0000 7fc1c9eb1640 5 monclient: authenticate success, global_id 4159 2026-02-24T19:16:44.201 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.193+0000 7fc1c9eb1640 10 monclient: _renew_subs 2026-02-24T19:16:44.201 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.193+0000 7fc1c9eb1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:16:44.201 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.193+0000 7fc1c9eb1640 1 -- 10.20.193.195:0/2490550511 --> v1:10.20.193.44:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc1c41726a0 con 0x7fc1c405dd80 2026-02-24T19:16:44.201 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.193+0000 7fc1c9eb1640 10 client.4159.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:16:44.201 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.193+0000 7fc1c9eb1640 10 monclient: _renew_subs 2026-02-24T19:16:44.201 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.193+0000 7fc1c9eb1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:16:44.201 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.193+0000 7fc1c9eb1640 1 -- 10.20.193.195:0/2490550511 --> v1:10.20.193.44:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc1c4172c90 con 0x7fc1c405dd80 2026-02-24T19:16:44.201 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.193+0000 7fc1c9eb1640 1 librados: init done 2026-02-24T19:16:44.201 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.194+0000 7fc1c9eb1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:44.201 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.194+0000 7fc1c9eb1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:44.201 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.194+0000 7fc1c9eb1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:16:44.202 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.194+0000 7fc1c9eb1640 1 -- 10.20.193.195:0/2490550511 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1c41869b0 con 0x7fc1c405dd80 2026-02-24T19:16:44.202 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.197+0000 7fc19ffff640 1 -- 10.20.193.195:0/2490550511 <== mon.1 v1:10.20.193.44:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc1b4002fb0 con 0x7fc1c405dd80 2026-02-24T19:16:44.202 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.197+0000 7fc19ffff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:44.202 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.197+0000 7fc19ffff640 1 -- 10.20.193.195:0/2490550511 <== mon.1 v1:10.20.193.44:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc1b4004e80 con 0x7fc1c405dd80 2026-02-24T19:16:44.202 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.197+0000 7fc19ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:44.202 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.197+0000 7fc19ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:16:44.202 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.197+0000 7fc19ffff640 10 monclient: dump: 2026-02-24T19:16:44.202 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:44.202 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:44.202 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:44.202 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:44.202 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:44.202 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:44.202 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:44.203 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:44.203 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:44.203 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:44.203 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.197+0000 7fc1c1ffb640 4 set_mon_vals no callback set 2026-02-24T19:16:44.203 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.198+0000 7fc19ffff640 1 -- 10.20.193.195:0/2490550511 <== mon.1 v1:10.20.193.44:6789/0 7 ==== mgrmap(e 2) ==== 50897+0+0 (unknown 2763422093 0 0) 0x7fc1b4011700 con 0x7fc1c405dd80 2026-02-24T19:16:44.203 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.198+0000 7fc19ffff640 1 -- 10.20.193.195:0/2490550511 <== mon.1 v1:10.20.193.44:6789/0 8 ==== osd_map(8..8 src has 1..8) ==== 1410+0+0 (unknown 856100444 0 0) 0x7fc1b4020df0 con 0x7fc1c405dd80 2026-02-24T19:16:44.203 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.198+0000 7fc19ffff640 10 client.4159.objecter ms_dispatch2 0x7fc1c4000b90 osd_map(8..8 src has 1..8) 2026-02-24T19:16:44.203 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.198+0000 7fc19ffff640 3 client.4159.objecter handle_osd_map got epochs [8,8] > 0 2026-02-24T19:16:44.203 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.198+0000 7fc19ffff640 3 client.4159.objecter handle_osd_map decoding full epoch 8 2026-02-24T19:16:44.203 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.198+0000 7fc19ffff640 20 client.4159.objecter dump_active .. 0 homeless 2026-02-24T19:16:44.228 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.226+0000 7fc19ffff640 1 -- 10.20.193.195:0/2490550511 <== mon.1 v1:10.20.193.44:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7fc1b4017580 con 0x7fc1c405dd80 2026-02-24T19:16:44.228 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.226+0000 7fc19ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:44.228 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.226+0000 7fc19ffff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:16:44.261 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.259+0000 7fc1c9eb1640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "19f0033c-abbd-406a-8eae-94e7e81da9ac", "id": 6}] 2026-02-24T19:16:44.261 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.259+0000 7fc1c9eb1640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "19f0033c-abbd-406a-8eae-94e7e81da9ac", "id": 6}] 2026-02-24T19:16:44.261 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.259+0000 7fc1c9eb1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:16:44.261 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.259+0000 7fc1c9eb1640 1 -- 10.20.193.195:0/2490550511 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "osd new", "uuid": "19f0033c-abbd-406a-8eae-94e7e81da9ac", "id": 6} v 0) -- 0x7fc1c4172f80 con 0x7fc1c405dd80 2026-02-24T19:16:44.297 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.295+0000 7fc19ffff640 1 -- 10.20.193.195:0/2490550511 <== mon.1 v1:10.20.193.44:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "19f0033c-abbd-406a-8eae-94e7e81da9ac", "id": 6}]=0 v9) ==== 112+0+2 (unknown 1784842317 0 1113811849) 0x7fc1b4016e80 con 0x7fc1c405dd80 2026-02-24T19:16:44.297 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.295+0000 7fc19ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "19f0033c-abbd-406a-8eae-94e7e81da9ac", "id": 6}] 2026-02-24T19:16:44.297 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.295+0000 7fc19ffff640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:16:44.297 INFO:teuthology.orchestra.run.trial195.stdout:6 2026-02-24T19:16:44.298 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.295+0000 7fc1c9eb1640 10 librados: watch_flush enter 2026-02-24T19:16:44.298 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.295+0000 7fc1c9eb1640 10 librados: watch_flush exit 2026-02-24T19:16:44.298 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.295+0000 7fc1c9eb1640 20 client.4159.objecter shutdown clearing up homeless session... 2026-02-24T19:16:44.298 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.295+0000 7fc1c9eb1640 10 client.4159.objecter successfully canceled tick 2026-02-24T19:16:44.298 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.295+0000 7fc1c9eb1640 10 monclient: shutdown 2026-02-24T19:16:44.298 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.295+0000 7fc1c9eb1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:44.298 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.295+0000 7fc1c9eb1640 1 -- 10.20.193.195:0/2490550511 >> v1:10.20.193.44:6789/0 conn(0x7fc1c405dd80 legacy=0x7fc1c4161980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:44.298 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.295+0000 7fc1c9eb1640 1 -- 10.20.193.195:0/2490550511 shutdown_connections 2026-02-24T19:16:44.298 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.295+0000 7fc1c9eb1640 1 -- 10.20.193.195:0/2490550511 >> 10.20.193.195:0/2490550511 conn(0x7fc1c40588d0 msgr2=0x7fc1c405be80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:44.298 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.295+0000 7fc1c9eb1640 1 -- 10.20.193.195:0/2490550511 shutdown_connections 2026-02-24T19:16:44.298 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.295+0000 7fc1c9eb1640 1 -- 10.20.193.195:0/2490550511 wait complete. 2026-02-24T19:16:44.298 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.295+0000 7fc1c9eb1640 1 librados: shutdown 2026-02-24T19:16:44.304 DEBUG:teuthology.orchestra.run.trial195:> sudo ceph --cluster ceph osd new 7cdd3b9b-4146-45b9-aaf6-df379c7a1e0e 7 2026-02-24T19:16:44.369 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.367+0000 7f51681cf640 10 monclient: get_monmap_and_config 2026-02-24T19:16:44.369 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.367+0000 7f51681cf640 10 monclient: build_initial_monmap 2026-02-24T19:16:44.369 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.367+0000 7f51681cf640 10 monclient: monmap: 2026-02-24T19:16:44.369 INFO:teuthology.orchestra.run.trial195.stderr:epoch 0 2026-02-24T19:16:44.369 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:44.369 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:16:44.369161+0000 2026-02-24T19:16:44.369 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:16:44.369161+0000 2026-02-24T19:16:44.370 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:44.370 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:44.370 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:44.370 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:44.370 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:44.370 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:44.370 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.367+0000 7f51681cf640 1 Processor -- start 2026-02-24T19:16:44.370 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.367+0000 7f51681cf640 1 -- start start 2026-02-24T19:16:44.370 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.367+0000 7f51681cf640 10 monclient: init 2026-02-24T19:16:44.371 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.368+0000 7f51681cf640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:44.371 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.368+0000 7f51681cf640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:16:44.371 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.368+0000 7f51681cf640 10 monclient(hunting): picked mon.noname-c con 0x7f516005d9b0 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:44.371 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.368+0000 7f51681cf640 10 monclient(hunting): picked mon.noname-b con 0x7f516005dd80 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:44.371 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.368+0000 7f51681cf640 10 monclient(hunting): picked mon.noname-a con 0x7f51601649b0 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:44.371 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.368+0000 7f51681cf640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f516005e200 con 0x7f51601649b0 2026-02-24T19:16:44.371 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.368+0000 7f51681cf640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51601874c0 con 0x7f516005dd80 2026-02-24T19:16:44.371 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.368+0000 7f51681cf640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51601886a0 con 0x7f516005d9b0 2026-02-24T19:16:44.371 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.368+0000 7f51681cf640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:44.371 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.368+0000 7f51681cf640 10 monclient(hunting): authenticate will time out at 3573.004251s 2026-02-24T19:16:44.371 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.368+0000 7f5165f44640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7f516005d9b0 0x7f516011b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.195:49156/0 (socket says 10.20.193.195:49156) 2026-02-24T19:16:44.371 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.368+0000 7f5165f44640 1 -- 10.20.193.195:0/2799387357 learned_addr learned my addr 10.20.193.195:0/2799387357 (peer_addr_for_me v1:10.20.193.195:0/0) 2026-02-24T19:16:44.371 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.369+0000 7f5164f42640 1 -- 10.20.193.195:0/2799387357 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3713062953 0 0) 0x7f51601886a0 con 0x7f516005d9b0 2026-02-24T19:16:44.372 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.369+0000 7f5164f42640 10 monclient(hunting): _negotiate 2026-02-24T19:16:44.372 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.369+0000 7f5164f42640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:44.372 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.369+0000 7f5164f42640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:44.372 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.369+0000 7f5164f42640 10 monclient(hunting): my global_id is 4166 2026-02-24T19:16:44.372 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.369+0000 7f5164f42640 1 -- 10.20.193.195:0/2799387357 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5148003610 con 0x7f516005d9b0 2026-02-24T19:16:44.372 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.370+0000 7f5164f42640 1 -- 10.20.193.195:0/2799387357 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2410595532 0 0) 0x7f516005e200 con 0x7f51601649b0 2026-02-24T19:16:44.372 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.370+0000 7f5164f42640 10 monclient(hunting): _negotiate 2026-02-24T19:16:44.372 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.370+0000 7f5164f42640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:44.372 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.370+0000 7f5164f42640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:44.372 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.370+0000 7f5164f42640 10 monclient(hunting): my global_id is 4170 2026-02-24T19:16:44.372 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.370+0000 7f5164f42640 1 -- 10.20.193.195:0/2799387357 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51601886a0 con 0x7f51601649b0 2026-02-24T19:16:44.373 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.371+0000 7f5164f42640 1 -- 10.20.193.195:0/2799387357 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 289282728 0 0) 0x7f5148003610 con 0x7f516005d9b0 2026-02-24T19:16:44.373 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.371+0000 7f5164f42640 1 -- 10.20.193.195:0/2799387357 >> v1:10.20.193.44:6789/0 conn(0x7f516005dd80 legacy=0x7f516011b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:16:44.373 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.371+0000 7f5164f42640 1 -- 10.20.193.195:0/2799387357 >> v1:10.20.193.14:6789/0 conn(0x7f51601649b0 legacy=0x7f5160184d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:44.373 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.371+0000 7f5164f42640 10 monclient: _finish_hunting 0 2026-02-24T19:16:44.374 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.371+0000 7f5164f42640 1 monclient: found mon.noname-c 2026-02-24T19:16:44.374 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.371+0000 7f5164f42640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:44.374 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.371+0000 7f5164f42640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.170:6789/0 2026-02-24T19:16:44.374 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.371+0000 7f5164f42640 1 -- 10.20.193.195:0/2799387357 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5160189920 con 0x7f516005d9b0 2026-02-24T19:16:44.374 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.371+0000 7f5164f42640 10 monclient: _finish_auth 0 2026-02-24T19:16:44.374 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.371+0000 7f5164f42640 10 monclient: _check_auth_tickets 2026-02-24T19:16:44.374 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.371+0000 7f5164f42640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:44.374 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.371+0000 7f5164f42640 1 -- 10.20.193.195:0/2799387357 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5150002df0 con 0x7f516005d9b0 2026-02-24T19:16:44.374 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.371+0000 7f5164f42640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:44.374 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.371+0000 7f5164f42640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:16:44.374 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.371+0000 7f5164f42640 10 monclient: dump: 2026-02-24T19:16:44.374 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:44.374 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:44.374 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:44.374 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:44.374 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:44.374 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:44.374 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:44.374 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:44.374 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:44.374 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:44.374 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.371+0000 7f51681cf640 5 monclient: authenticate success, global_id 4166 2026-02-24T19:16:44.374 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.371+0000 7f51681cf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:16:44.376 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.372+0000 7f5164f42640 1 -- 10.20.193.195:0/2799387357 <== mon.2 v1:10.20.193.170:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5150003070 con 0x7f516005d9b0 2026-02-24T19:16:44.376 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.372+0000 7f5164f42640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:44.376 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.372+0000 7f5164f42640 1 -- 10.20.193.195:0/2799387357 <== mon.2 v1:10.20.193.170:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f51500034b0 con 0x7f516005d9b0 2026-02-24T19:16:44.376 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.372+0000 7f5164f42640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:44.376 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.372+0000 7f5164f42640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:16:44.376 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.372+0000 7f5164f42640 10 monclient: dump: 2026-02-24T19:16:44.376 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:44.376 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:44.376 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:44.376 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:44.376 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:44.376 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:44.376 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:44.376 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:44.376 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:44.377 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:44.377 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.372+0000 7f51681cf640 10 monclient: get_monmap_and_config success 2026-02-24T19:16:44.377 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.372+0000 7f51681cf640 4 set_mon_vals no callback set 2026-02-24T19:16:44.377 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.372+0000 7f51681cf640 10 monclient: shutdown 2026-02-24T19:16:44.377 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.372+0000 7f51681cf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:44.377 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.372+0000 7f51681cf640 1 -- 10.20.193.195:0/2799387357 >> v1:10.20.193.170:6789/0 conn(0x7f516005d9b0 legacy=0x7f516011b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:44.377 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.372+0000 7f51681cf640 1 -- 10.20.193.195:0/2799387357 shutdown_connections 2026-02-24T19:16:44.377 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.372+0000 7f51681cf640 1 -- 10.20.193.195:0/2799387357 >> 10.20.193.195:0/2799387357 conn(0x7f51600588d0 msgr2=0x7f5160058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:44.377 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.372+0000 7f51681cf640 1 -- 10.20.193.195:0/2799387357 shutdown_connections 2026-02-24T19:16:44.377 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.372+0000 7f51681cf640 1 -- 10.20.193.195:0/2799387357 wait complete. 2026-02-24T19:16:44.377 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.372+0000 7f51681cf640 10 monclient: build_initial_monmap 2026-02-24T19:16:44.377 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.372+0000 7f51681cf640 10 monclient: monmap: 2026-02-24T19:16:44.377 INFO:teuthology.orchestra.run.trial195.stderr:epoch 0 2026-02-24T19:16:44.377 INFO:teuthology.orchestra.run.trial195.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:16:44.377 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 0.000000 2026-02-24T19:16:44.377 INFO:teuthology.orchestra.run.trial195.stderr:created 0.000000 2026-02-24T19:16:44.377 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:44.377 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 1 2026-02-24T19:16:44.377 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:44.377 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:44.377 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:44.377 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:44.377 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.372+0000 7f51681cf640 1 librados: starting msgr at 2026-02-24T19:16:44.377 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.372+0000 7f51681cf640 1 librados: starting objecter 2026-02-24T19:16:44.377 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.373+0000 7f51681cf640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:16:44.377 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.373+0000 7f51681cf640 1 Processor -- start 2026-02-24T19:16:44.377 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.373+0000 7f51681cf640 1 -- start start 2026-02-24T19:16:44.377 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.373+0000 7f51681cf640 1 librados: setting wanted keys 2026-02-24T19:16:44.378 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.373+0000 7f51681cf640 1 librados: calling monclient init 2026-02-24T19:16:44.378 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.373+0000 7f51681cf640 10 monclient: init 2026-02-24T19:16:44.378 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.373+0000 7f51681cf640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:44.378 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.373+0000 7f51681cf640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:16:44.378 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.373+0000 7f51681cf640 10 monclient(hunting): picked mon.noname-c con 0x7f516005d9b0 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:44.378 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.373+0000 7f51681cf640 10 monclient(hunting): picked mon.noname-a con 0x7f516005dd80 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:44.378 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.373+0000 7f51681cf640 10 monclient(hunting): picked mon.noname-b con 0x7f51601649b0 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:44.378 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.373+0000 7f51681cf640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f516016c680 con 0x7f516005dd80 2026-02-24T19:16:44.378 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.373+0000 7f51681cf640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5160173560 con 0x7f51601649b0 2026-02-24T19:16:44.378 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.373+0000 7f51681cf640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5160174740 con 0x7f516005d9b0 2026-02-24T19:16:44.378 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.373+0000 7f51681cf640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:44.378 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.373+0000 7f51681cf640 10 monclient(hunting): authenticate will time out at 3573.009269s 2026-02-24T19:16:44.378 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.373+0000 7f5165f44640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7f516005d9b0 0x7f516016bb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.195:49158/0 (socket says 10.20.193.195:49158) 2026-02-24T19:16:44.378 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.373+0000 7f5165f44640 1 -- 10.20.193.195:0/3811792729 learned_addr learned my addr 10.20.193.195:0/3811792729 (peer_addr_for_me v1:10.20.193.195:0/0) 2026-02-24T19:16:44.378 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.373+0000 7f514e7fc640 10 client.?.objecter ms_handle_connect 0x7f516005dd80 2026-02-24T19:16:44.378 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.373+0000 7f514e7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:44.378 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.373+0000 7f514e7fc640 10 client.?.objecter ms_handle_connect 0x7f51601649b0 2026-02-24T19:16:44.378 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.373+0000 7f514e7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:44.378 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.374+0000 7f514e7fc640 10 client.?.objecter ms_handle_connect 0x7f516005d9b0 2026-02-24T19:16:44.378 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.374+0000 7f514e7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:44.379 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.374+0000 7f514e7fc640 1 -- 10.20.193.195:0/3811792729 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 785373254 0 0) 0x7f5160173560 con 0x7f51601649b0 2026-02-24T19:16:44.379 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.374+0000 7f514e7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:16:44.379 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.374+0000 7f514e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:44.380 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.374+0000 7f514e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:44.380 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.374+0000 7f514e7fc640 10 monclient(hunting): my global_id is 4162 2026-02-24T19:16:44.380 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.374+0000 7f514e7fc640 1 -- 10.20.193.195:0/3811792729 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5130003610 con 0x7f51601649b0 2026-02-24T19:16:44.380 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.374+0000 7f514e7fc640 1 -- 10.20.193.195:0/3811792729 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1565118567 0 0) 0x7f5160174740 con 0x7f516005d9b0 2026-02-24T19:16:44.380 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.374+0000 7f514e7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:16:44.380 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.374+0000 7f514e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:44.380 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.374+0000 7f514e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:44.380 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.374+0000 7f514e7fc640 10 monclient(hunting): my global_id is 4169 2026-02-24T19:16:44.380 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.374+0000 7f514e7fc640 1 -- 10.20.193.195:0/3811792729 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5160173560 con 0x7f516005d9b0 2026-02-24T19:16:44.380 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.374+0000 7f514e7fc640 1 -- 10.20.193.195:0/3811792729 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3139895541 0 0) 0x7f516016c680 con 0x7f516005dd80 2026-02-24T19:16:44.380 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.374+0000 7f514e7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:16:44.380 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.374+0000 7f514e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:44.380 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.374+0000 7f514e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:44.380 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.374+0000 7f514e7fc640 10 monclient(hunting): my global_id is 4173 2026-02-24T19:16:44.380 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.374+0000 7f514e7fc640 1 -- 10.20.193.195:0/3811792729 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5160174740 con 0x7f516005dd80 2026-02-24T19:16:44.380 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.377+0000 7f514e7fc640 1 -- 10.20.193.195:0/3811792729 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 971972181 0 0) 0x7f5130003610 con 0x7f51601649b0 2026-02-24T19:16:44.380 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.377+0000 7f514e7fc640 1 -- 10.20.193.195:0/3811792729 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f516016c680 con 0x7f51601649b0 2026-02-24T19:16:44.380 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.377+0000 7f514e7fc640 1 -- 10.20.193.195:0/3811792729 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f515c003400 con 0x7f51601649b0 2026-02-24T19:16:44.380 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.377+0000 7f514e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:44.380 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.377+0000 7f514e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:16:44.380 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.377+0000 7f514e7fc640 10 monclient(hunting): dump: 2026-02-24T19:16:44.380 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:44.380 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:44.380 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:44.380 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:44.380 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:44.380 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:44.381 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:44.381 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:44.381 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:44.381 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:44.381 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.377+0000 7f514e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:16:44.381 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.377+0000 7f514e7fc640 1 -- 10.20.193.195:0/3811792729 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3123971217 0 0) 0x7f5160173560 con 0x7f516005d9b0 2026-02-24T19:16:44.381 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.377+0000 7f514e7fc640 1 -- 10.20.193.195:0/3811792729 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5130003610 con 0x7f516005d9b0 2026-02-24T19:16:44.381 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.377+0000 7f514e7fc640 1 -- 10.20.193.195:0/3811792729 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5150002d00 con 0x7f516005d9b0 2026-02-24T19:16:44.381 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.377+0000 7f514e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:44.381 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.377+0000 7f514e7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:16:44.381 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.377+0000 7f514e7fc640 10 monclient(hunting): dump: 2026-02-24T19:16:44.381 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:44.381 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:44.381 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:44.381 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:44.381 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:44.381 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:44.381 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:44.381 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:44.381 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:44.381 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:44.381 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.377+0000 7f514e7fc640 1 -- 10.20.193.195:0/3811792729 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1324225265 0 0) 0x7f5160174740 con 0x7f516005dd80 2026-02-24T19:16:44.381 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.377+0000 7f514e7fc640 1 -- 10.20.193.195:0/3811792729 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5160173560 con 0x7f516005dd80 2026-02-24T19:16:44.381 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.377+0000 7f514e7fc640 1 -- 10.20.193.195:0/3811792729 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5154002f70 con 0x7f516005dd80 2026-02-24T19:16:44.381 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.377+0000 7f514e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:44.381 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.377+0000 7f514e7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:16:44.381 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.377+0000 7f514e7fc640 10 monclient(hunting): dump: 2026-02-24T19:16:44.382 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:44.382 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:44.382 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:44.382 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:44.382 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:44.382 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:44.382 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:44.382 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:44.382 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:44.382 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:44.383 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.378+0000 7f514e7fc640 1 -- 10.20.193.195:0/3811792729 <== mon.1 v1:10.20.193.44:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2795359582 0 0) 0x7f516016c680 con 0x7f51601649b0 2026-02-24T19:16:44.383 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.378+0000 7f514e7fc640 1 -- 10.20.193.195:0/3811792729 >> v1:10.20.193.170:6789/0 conn(0x7f516005d9b0 legacy=0x7f516016bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:44.383 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.378+0000 7f514e7fc640 1 -- 10.20.193.195:0/3811792729 >> v1:10.20.193.14:6789/0 conn(0x7f516005dd80 legacy=0x7f5160161980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:44.383 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.378+0000 7f514e7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:16:44.383 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.378+0000 7f514e7fc640 1 monclient: found mon.b 2026-02-24T19:16:44.383 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.378+0000 7f514e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:44.383 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.378+0000 7f514e7fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:16:44.383 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.378+0000 7f514e7fc640 1 -- 10.20.193.195:0/3811792729 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5160175920 con 0x7f51601649b0 2026-02-24T19:16:44.383 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.378+0000 7f514e7fc640 10 monclient: _finish_auth 0 2026-02-24T19:16:44.383 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.378+0000 7f514e7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:16:44.383 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.378+0000 7f514e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:44.383 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.378+0000 7f51681cf640 5 monclient: authenticate success, global_id 4162 2026-02-24T19:16:44.383 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.378+0000 7f51681cf640 10 monclient: _renew_subs 2026-02-24T19:16:44.383 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.378+0000 7f51681cf640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:16:44.383 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.378+0000 7f51681cf640 1 -- 10.20.193.195:0/3811792729 --> v1:10.20.193.44:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5160173730 con 0x7f51601649b0 2026-02-24T19:16:44.383 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.378+0000 7f51681cf640 10 client.4162.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:16:44.383 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.378+0000 7f51681cf640 10 monclient: _renew_subs 2026-02-24T19:16:44.383 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.378+0000 7f51681cf640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:16:44.383 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.378+0000 7f51681cf640 1 -- 10.20.193.195:0/3811792729 --> v1:10.20.193.44:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5160173cf0 con 0x7f51601649b0 2026-02-24T19:16:44.384 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.378+0000 7f51681cf640 1 librados: init done 2026-02-24T19:16:44.384 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.379+0000 7f51681cf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:44.384 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.379+0000 7f51681cf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:44.384 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.379+0000 7f51681cf640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:16:44.384 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.379+0000 7f51681cf640 1 -- 10.20.193.195:0/3811792729 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51601869e0 con 0x7f51601649b0 2026-02-24T19:16:44.384 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.381+0000 7f514e7fc640 1 -- 10.20.193.195:0/3811792729 <== mon.1 v1:10.20.193.44:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f515c003a80 con 0x7f51601649b0 2026-02-24T19:16:44.384 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.381+0000 7f514e7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:44.384 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.381+0000 7f514ffff640 4 set_mon_vals no callback set 2026-02-24T19:16:44.385 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.383+0000 7f514e7fc640 1 -- 10.20.193.195:0/3811792729 <== mon.1 v1:10.20.193.44:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f515c003dd0 con 0x7f51601649b0 2026-02-24T19:16:44.385 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.383+0000 7f514e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:44.385 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.383+0000 7f514e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:16:44.385 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.383+0000 7f514e7fc640 10 monclient: dump: 2026-02-24T19:16:44.385 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:44.385 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:44.385 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:44.385 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:44.385 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:44.385 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:44.386 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:44.386 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:44.386 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:44.386 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:44.386 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.383+0000 7f514e7fc640 1 -- 10.20.193.195:0/3811792729 <== mon.1 v1:10.20.193.44:6789/0 7 ==== mgrmap(e 2) ==== 50897+0+0 (unknown 2763422093 0 0) 0x7f515c010650 con 0x7f51601649b0 2026-02-24T19:16:44.387 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.385+0000 7f514e7fc640 1 -- 10.20.193.195:0/3811792729 <== mon.1 v1:10.20.193.44:6789/0 8 ==== osd_map(9..9 src has 1..9) ==== 1525+0+0 (unknown 2023910159 0 0) 0x7f515c011f70 con 0x7f51601649b0 2026-02-24T19:16:44.387 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.385+0000 7f514e7fc640 10 client.4162.objecter ms_dispatch2 0x7f5160000b90 osd_map(9..9 src has 1..9) 2026-02-24T19:16:44.387 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.385+0000 7f514e7fc640 3 client.4162.objecter handle_osd_map got epochs [9,9] > 0 2026-02-24T19:16:44.387 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.385+0000 7f514e7fc640 3 client.4162.objecter handle_osd_map decoding full epoch 9 2026-02-24T19:16:44.387 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.385+0000 7f514e7fc640 20 client.4162.objecter dump_active .. 0 homeless 2026-02-24T19:16:44.417 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.415+0000 7f514e7fc640 1 -- 10.20.193.195:0/3811792729 <== mon.1 v1:10.20.193.44:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7f515c016620 con 0x7f51601649b0 2026-02-24T19:16:44.417 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.415+0000 7f514e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:44.417 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.415+0000 7f514e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:16:44.450 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.448+0000 7f51681cf640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "7cdd3b9b-4146-45b9-aaf6-df379c7a1e0e", "id": 7}] 2026-02-24T19:16:44.451 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.448+0000 7f51681cf640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "7cdd3b9b-4146-45b9-aaf6-df379c7a1e0e", "id": 7}] 2026-02-24T19:16:44.451 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.448+0000 7f51681cf640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:16:44.451 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.448+0000 7f51681cf640 1 -- 10.20.193.195:0/3811792729 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "osd new", "uuid": "7cdd3b9b-4146-45b9-aaf6-df379c7a1e0e", "id": 7} v 0) -- 0x7f5160173fe0 con 0x7f51601649b0 2026-02-24T19:16:44.610 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.608+0000 7f514e7fc640 1 -- 10.20.193.195:0/3811792729 <== mon.1 v1:10.20.193.44:6789/0 10 ==== mgrmap(e 3) ==== 101401+0+0 (unknown 710223534 0 0) 0x7f515c015840 con 0x7f51601649b0 2026-02-24T19:16:44.611 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.609+0000 7f5165f44640 10 monclient: get_auth_request con 0x7f51300780b0 auth_method 0 2026-02-24T19:16:44.611 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.609+0000 7f514e7fc640 10 client.4162.objecter ms_handle_connect 0x7f51300780b0 2026-02-24T19:16:44.642 INFO:tasks.ceph.mgr.y.trial014.stderr:2026-02-24T19:16:44.642+0000 7f88ba96f640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-24T19:16:44.673 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.671+0000 7f514e7fc640 1 -- 10.20.193.195:0/3811792729 <== mon.1 v1:10.20.193.44:6789/0 11 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7cdd3b9b-4146-45b9-aaf6-df379c7a1e0e", "id": 7}]=0 v10) ==== 112+0+2 (unknown 3997367702 0 1371665406) 0x7f515c0168b0 con 0x7f51601649b0 2026-02-24T19:16:44.673 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.671+0000 7f514e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "7cdd3b9b-4146-45b9-aaf6-df379c7a1e0e", "id": 7}] 2026-02-24T19:16:44.673 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.671+0000 7f514e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:16:44.673 INFO:teuthology.orchestra.run.trial195.stdout:7 2026-02-24T19:16:44.674 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.672+0000 7f51681cf640 10 librados: watch_flush enter 2026-02-24T19:16:44.674 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.672+0000 7f51681cf640 10 librados: watch_flush exit 2026-02-24T19:16:44.674 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.672+0000 7f51681cf640 20 client.4162.objecter shutdown clearing up homeless session... 2026-02-24T19:16:44.674 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.672+0000 7f51681cf640 10 client.4162.objecter successfully canceled tick 2026-02-24T19:16:44.674 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.672+0000 7f51681cf640 1 -- 10.20.193.195:0/3811792729 >> v1:10.20.193.14:6800/4014096310 conn(0x7f51300780b0 legacy=0x7f5130098490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:44.674 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.672+0000 7f51681cf640 10 monclient: shutdown 2026-02-24T19:16:44.674 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.672+0000 7f51681cf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:44.674 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.672+0000 7f51681cf640 1 -- 10.20.193.195:0/3811792729 >> v1:10.20.193.44:6789/0 conn(0x7f51601649b0 legacy=0x7f51601630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:44.674 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.672+0000 7f51681cf640 1 -- 10.20.193.195:0/3811792729 shutdown_connections 2026-02-24T19:16:44.674 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.672+0000 7f51681cf640 1 -- 10.20.193.195:0/3811792729 >> 10.20.193.195:0/3811792729 conn(0x7f51600588d0 msgr2=0x7f516005bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:44.675 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.672+0000 7f51681cf640 1 -- 10.20.193.195:0/3811792729 shutdown_connections 2026-02-24T19:16:44.675 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.672+0000 7f51681cf640 1 -- 10.20.193.195:0/3811792729 wait complete. 2026-02-24T19:16:44.675 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.672+0000 7f51681cf640 1 librados: shutdown 2026-02-24T19:16:44.682 DEBUG:teuthology.orchestra.run.trial195:> sudo ceph --cluster ceph osd new a4833012-c50c-4a6e-b754-cf18fc6117fd 8 2026-02-24T19:16:44.697 INFO:tasks.ceph.mgr.y.trial014.stderr:2026-02-24T19:16:44.696+0000 7f88ba96f640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-24T19:16:44.747 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.745+0000 7f48447b3640 10 monclient: get_monmap_and_config 2026-02-24T19:16:44.747 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.745+0000 7f48447b3640 10 monclient: build_initial_monmap 2026-02-24T19:16:44.747 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.745+0000 7f48447b3640 10 monclient: monmap: 2026-02-24T19:16:44.747 INFO:teuthology.orchestra.run.trial195.stderr:epoch 0 2026-02-24T19:16:44.747 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:44.748 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:16:44.747271+0000 2026-02-24T19:16:44.748 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:16:44.747271+0000 2026-02-24T19:16:44.748 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:44.748 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:44.748 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:44.748 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:44.748 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:44.748 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:44.748 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.746+0000 7f48447b3640 1 Processor -- start 2026-02-24T19:16:44.749 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.746+0000 7f48447b3640 1 -- start start 2026-02-24T19:16:44.749 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.746+0000 7f48447b3640 10 monclient: init 2026-02-24T19:16:44.749 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.746+0000 7f48447b3640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:44.749 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.746+0000 7f48447b3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:16:44.749 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.746+0000 7f48447b3640 10 monclient(hunting): picked mon.noname-c con 0x7f483c11e790 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:44.749 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.746+0000 7f48447b3640 10 monclient(hunting): picked mon.noname-a con 0x7f483c1406c0 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:44.749 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.746+0000 7f48447b3640 10 monclient(hunting): picked mon.noname-b con 0x7f483c162250 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:44.749 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.746+0000 7f48447b3640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f483c183fe0 con 0x7f483c1406c0 2026-02-24T19:16:44.749 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.746+0000 7f48447b3640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f483c1851e0 con 0x7f483c162250 2026-02-24T19:16:44.749 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.746+0000 7f48447b3640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f483c1863e0 con 0x7f483c11e790 2026-02-24T19:16:44.749 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.746+0000 7f48447b3640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:44.749 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.746+0000 7f48447b3640 10 monclient(hunting): authenticate will time out at 3573.382254s 2026-02-24T19:16:44.749 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.746+0000 7f4842528640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7f483c11e790 0x7f483c11eb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.195:49166/0 (socket says 10.20.193.195:49166) 2026-02-24T19:16:44.749 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.746+0000 7f4842528640 1 -- 10.20.193.195:0/2948169980 learned_addr learned my addr 10.20.193.195:0/2948169980 (peer_addr_for_me v1:10.20.193.195:0/0) 2026-02-24T19:16:44.750 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.747+0000 7f4841526640 1 -- 10.20.193.195:0/2948169980 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3113697406 0 0) 0x7f483c1863e0 con 0x7f483c11e790 2026-02-24T19:16:44.750 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.747+0000 7f4841526640 10 monclient(hunting): _negotiate 2026-02-24T19:16:44.750 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.747+0000 7f4841526640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:44.750 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.747+0000 7f4841526640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:44.750 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.747+0000 7f4841526640 10 monclient(hunting): my global_id is 4172 2026-02-24T19:16:44.750 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.747+0000 7f4841526640 1 -- 10.20.193.195:0/2948169980 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4824003610 con 0x7f483c11e790 2026-02-24T19:16:44.750 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.748+0000 7f4841526640 1 -- 10.20.193.195:0/2948169980 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 250009857 0 0) 0x7f483c1851e0 con 0x7f483c162250 2026-02-24T19:16:44.750 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.748+0000 7f4841526640 10 monclient(hunting): _negotiate 2026-02-24T19:16:44.750 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.748+0000 7f4841526640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:44.750 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.748+0000 7f4841526640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:44.750 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.748+0000 7f4841526640 10 monclient(hunting): my global_id is 4165 2026-02-24T19:16:44.750 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.748+0000 7f4841526640 1 -- 10.20.193.195:0/2948169980 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f483c1863e0 con 0x7f483c162250 2026-02-24T19:16:44.750 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.748+0000 7f4841526640 1 -- 10.20.193.195:0/2948169980 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3123274411 0 0) 0x7f483c183fe0 con 0x7f483c1406c0 2026-02-24T19:16:44.750 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.748+0000 7f4841526640 10 monclient(hunting): _negotiate 2026-02-24T19:16:44.750 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.748+0000 7f4841526640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:44.750 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.748+0000 7f4841526640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:44.750 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.748+0000 7f4841526640 10 monclient(hunting): my global_id is 4176 2026-02-24T19:16:44.750 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.748+0000 7f4841526640 1 -- 10.20.193.195:0/2948169980 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f483c1851e0 con 0x7f483c1406c0 2026-02-24T19:16:44.751 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.749+0000 7f4841526640 1 -- 10.20.193.195:0/2948169980 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2010304018 0 0) 0x7f4824003610 con 0x7f483c11e790 2026-02-24T19:16:44.751 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.749+0000 7f4841526640 1 -- 10.20.193.195:0/2948169980 >> v1:10.20.193.44:6789/0 conn(0x7f483c162250 legacy=0x7f483c1826e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:44.751 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.749+0000 7f4841526640 1 -- 10.20.193.195:0/2948169980 >> v1:10.20.193.14:6789/0 conn(0x7f483c1406c0 legacy=0x7f483c160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:44.751 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.749+0000 7f4841526640 10 monclient: _finish_hunting 0 2026-02-24T19:16:44.751 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.749+0000 7f4841526640 1 monclient: found mon.noname-c 2026-02-24T19:16:44.751 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.749+0000 7f4841526640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:44.752 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.749+0000 7f4841526640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.170:6789/0 2026-02-24T19:16:44.752 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.749+0000 7f4841526640 1 -- 10.20.193.195:0/2948169980 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f483c187680 con 0x7f483c11e790 2026-02-24T19:16:44.752 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.749+0000 7f4841526640 10 monclient: _finish_auth 0 2026-02-24T19:16:44.752 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.749+0000 7f4841526640 10 monclient: _check_auth_tickets 2026-02-24T19:16:44.752 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.749+0000 7f4841526640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:44.752 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.749+0000 7f4841526640 1 -- 10.20.193.195:0/2948169980 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f482c002df0 con 0x7f483c11e790 2026-02-24T19:16:44.752 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.749+0000 7f4841526640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:44.752 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.749+0000 7f4841526640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:16:44.752 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.749+0000 7f4841526640 10 monclient: dump: 2026-02-24T19:16:44.752 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:44.752 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:44.752 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:44.752 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:44.752 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:44.752 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:44.752 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:44.752 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:44.752 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:44.752 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:44.752 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.749+0000 7f48447b3640 5 monclient: authenticate success, global_id 4172 2026-02-24T19:16:44.752 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.749+0000 7f48447b3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:16:44.754 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.750+0000 7f4841526640 1 -- 10.20.193.195:0/2948169980 <== mon.2 v1:10.20.193.170:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f482c003030 con 0x7f483c11e790 2026-02-24T19:16:44.754 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.750+0000 7f4841526640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:44.754 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.750+0000 7f4841526640 1 -- 10.20.193.195:0/2948169980 <== mon.2 v1:10.20.193.170:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f482c003470 con 0x7f483c11e790 2026-02-24T19:16:44.754 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.750+0000 7f4841526640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:44.754 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.750+0000 7f4841526640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:16:44.754 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.750+0000 7f4841526640 10 monclient: dump: 2026-02-24T19:16:44.754 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:44.754 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:44.754 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:44.754 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:44.754 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:44.754 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:44.754 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:44.754 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:44.754 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:44.754 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:44.754 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.750+0000 7f48447b3640 10 monclient: get_monmap_and_config success 2026-02-24T19:16:44.754 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.750+0000 7f48447b3640 4 set_mon_vals no callback set 2026-02-24T19:16:44.754 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.750+0000 7f48447b3640 10 monclient: shutdown 2026-02-24T19:16:44.754 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.750+0000 7f48447b3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:44.754 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.750+0000 7f48447b3640 1 -- 10.20.193.195:0/2948169980 >> v1:10.20.193.170:6789/0 conn(0x7f483c11e790 legacy=0x7f483c11eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:44.754 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.750+0000 7f48447b3640 1 -- 10.20.193.195:0/2948169980 shutdown_connections 2026-02-24T19:16:44.754 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.750+0000 7f48447b3640 1 -- 10.20.193.195:0/2948169980 >> 10.20.193.195:0/2948169980 conn(0x7f483c0588d0 msgr2=0x7f483c058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:44.755 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.750+0000 7f48447b3640 1 -- 10.20.193.195:0/2948169980 shutdown_connections 2026-02-24T19:16:44.755 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.750+0000 7f48447b3640 1 -- 10.20.193.195:0/2948169980 wait complete. 2026-02-24T19:16:44.755 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.750+0000 7f48447b3640 10 monclient: build_initial_monmap 2026-02-24T19:16:44.755 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.750+0000 7f48447b3640 10 monclient: monmap: 2026-02-24T19:16:44.755 INFO:teuthology.orchestra.run.trial195.stderr:epoch 0 2026-02-24T19:16:44.755 INFO:teuthology.orchestra.run.trial195.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:16:44.755 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 0.000000 2026-02-24T19:16:44.755 INFO:teuthology.orchestra.run.trial195.stderr:created 0.000000 2026-02-24T19:16:44.755 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:44.755 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 1 2026-02-24T19:16:44.755 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:44.755 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:44.755 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:44.755 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:44.755 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.750+0000 7f48447b3640 1 librados: starting msgr at 2026-02-24T19:16:44.755 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.750+0000 7f48447b3640 1 librados: starting objecter 2026-02-24T19:16:44.755 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.750+0000 7f48447b3640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:16:44.755 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.750+0000 7f48447b3640 1 Processor -- start 2026-02-24T19:16:44.755 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.751+0000 7f48447b3640 1 -- start start 2026-02-24T19:16:44.755 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.751+0000 7f48447b3640 1 librados: setting wanted keys 2026-02-24T19:16:44.755 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.751+0000 7f48447b3640 1 librados: calling monclient init 2026-02-24T19:16:44.755 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.751+0000 7f48447b3640 10 monclient: init 2026-02-24T19:16:44.755 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.751+0000 7f48447b3640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:44.755 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.751+0000 7f48447b3640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:16:44.755 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.751+0000 7f48447b3640 10 monclient(hunting): picked mon.noname-a con 0x7f483c11e790 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:44.755 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.751+0000 7f48447b3640 10 monclient(hunting): picked mon.noname-b con 0x7f483c1406c0 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:44.755 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.751+0000 7f48447b3640 10 monclient(hunting): picked mon.noname-c con 0x7f483c162250 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:44.755 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.751+0000 7f48447b3640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f483c12e7e0 con 0x7f483c11e790 2026-02-24T19:16:44.756 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.751+0000 7f48447b3640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f483c12f9c0 con 0x7f483c1406c0 2026-02-24T19:16:44.756 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.751+0000 7f48447b3640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f483c130bc0 con 0x7f483c162250 2026-02-24T19:16:44.756 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.751+0000 7f48447b3640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:44.756 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.751+0000 7f48447b3640 10 monclient(hunting): authenticate will time out at 3573.387173s 2026-02-24T19:16:44.756 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.751+0000 7f4842d29640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7f483c162250 0x7f483c12cf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.195:49180/0 (socket says 10.20.193.195:49180) 2026-02-24T19:16:44.756 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.751+0000 7f4842d29640 1 -- 10.20.193.195:0/766240847 learned_addr learned my addr 10.20.193.195:0/766240847 (peer_addr_for_me v1:10.20.193.195:0/0) 2026-02-24T19:16:44.756 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.751+0000 7f4822ffd640 10 client.?.objecter ms_handle_connect 0x7f483c162250 2026-02-24T19:16:44.756 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.751+0000 7f4822ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:44.756 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.751+0000 7f4822ffd640 10 client.?.objecter ms_handle_connect 0x7f483c11e790 2026-02-24T19:16:44.756 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.751+0000 7f4822ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:44.757 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.752+0000 7f4822ffd640 10 client.?.objecter ms_handle_connect 0x7f483c1406c0 2026-02-24T19:16:44.757 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.752+0000 7f4822ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:44.757 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.752+0000 7f4822ffd640 1 -- 10.20.193.195:0/766240847 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1035653165 0 0) 0x7f483c130bc0 con 0x7f483c162250 2026-02-24T19:16:44.757 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.752+0000 7f4822ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:16:44.757 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.752+0000 7f4822ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:44.757 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.752+0000 7f4822ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:44.757 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.752+0000 7f4822ffd640 10 monclient(hunting): my global_id is 4175 2026-02-24T19:16:44.757 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.752+0000 7f4822ffd640 1 -- 10.20.193.195:0/766240847 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f480c003610 con 0x7f483c162250 2026-02-24T19:16:44.757 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.752+0000 7f4822ffd640 1 -- 10.20.193.195:0/766240847 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1632505081 0 0) 0x7f483c12e7e0 con 0x7f483c11e790 2026-02-24T19:16:44.757 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.752+0000 7f4822ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:16:44.757 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.752+0000 7f4822ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:44.757 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.752+0000 7f4822ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:44.757 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.752+0000 7f4822ffd640 10 monclient(hunting): my global_id is 4179 2026-02-24T19:16:44.757 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.752+0000 7f4822ffd640 1 -- 10.20.193.195:0/766240847 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f483c130bc0 con 0x7f483c11e790 2026-02-24T19:16:44.757 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.753+0000 7f4822ffd640 1 -- 10.20.193.195:0/766240847 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 820204709 0 0) 0x7f483c12f9c0 con 0x7f483c1406c0 2026-02-24T19:16:44.758 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.753+0000 7f4822ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:16:44.758 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.753+0000 7f4822ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:44.758 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.753+0000 7f4822ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:44.758 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.753+0000 7f4822ffd640 10 monclient(hunting): my global_id is 4168 2026-02-24T19:16:44.758 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.753+0000 7f4822ffd640 1 -- 10.20.193.195:0/766240847 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f483c12e7e0 con 0x7f483c1406c0 2026-02-24T19:16:44.758 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.755+0000 7f4822ffd640 1 -- 10.20.193.195:0/766240847 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 621818880 0 0) 0x7f480c003610 con 0x7f483c162250 2026-02-24T19:16:44.758 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.755+0000 7f4822ffd640 1 -- 10.20.193.195:0/766240847 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f483c12f9c0 con 0x7f483c162250 2026-02-24T19:16:44.758 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.755+0000 7f4822ffd640 1 -- 10.20.193.195:0/766240847 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4838003490 con 0x7f483c162250 2026-02-24T19:16:44.758 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.755+0000 7f4822ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:44.758 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.755+0000 7f4822ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:16:44.758 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.755+0000 7f4822ffd640 10 monclient(hunting): dump: 2026-02-24T19:16:44.758 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:44.758 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:44.758 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:44.758 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:44.758 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:44.758 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:44.758 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:44.758 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:44.758 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:44.758 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:44.758 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.755+0000 7f4822ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:16:44.758 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.755+0000 7f4822ffd640 1 -- 10.20.193.195:0/766240847 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 68666827 0 0) 0x7f483c130bc0 con 0x7f483c11e790 2026-02-24T19:16:44.758 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.755+0000 7f4822ffd640 1 -- 10.20.193.195:0/766240847 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f480c003610 con 0x7f483c11e790 2026-02-24T19:16:44.758 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.755+0000 7f4822ffd640 1 -- 10.20.193.195:0/766240847 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f482c0031e0 con 0x7f483c11e790 2026-02-24T19:16:44.758 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.755+0000 7f4822ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:44.758 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.755+0000 7f4822ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:16:44.759 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.755+0000 7f4822ffd640 10 monclient(hunting): dump: 2026-02-24T19:16:44.759 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:44.759 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:44.759 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:44.759 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:44.759 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:44.759 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:44.759 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:44.759 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:44.759 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:44.759 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:44.760 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.756+0000 7f4822ffd640 1 -- 10.20.193.195:0/766240847 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1080510810 0 0) 0x7f483c12e7e0 con 0x7f483c1406c0 2026-02-24T19:16:44.760 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.756+0000 7f4822ffd640 1 -- 10.20.193.195:0/766240847 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f483c130bc0 con 0x7f483c1406c0 2026-02-24T19:16:44.760 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.756+0000 7f4822ffd640 1 -- 10.20.193.195:0/766240847 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4830003060 con 0x7f483c1406c0 2026-02-24T19:16:44.760 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.756+0000 7f4822ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:44.760 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.756+0000 7f4822ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:16:44.760 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.756+0000 7f4822ffd640 10 monclient(hunting): dump: 2026-02-24T19:16:44.760 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:44.760 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:44.760 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:44.760 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:44.760 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:44.760 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:44.760 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:44.760 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:44.760 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:44.760 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:44.760 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.756+0000 7f4822ffd640 1 -- 10.20.193.195:0/766240847 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2070429831 0 0) 0x7f480c003610 con 0x7f483c11e790 2026-02-24T19:16:44.761 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.756+0000 7f4822ffd640 1 -- 10.20.193.195:0/766240847 >> v1:10.20.193.170:6789/0 conn(0x7f483c162250 legacy=0x7f483c12cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:44.761 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.756+0000 7f4822ffd640 1 -- 10.20.193.195:0/766240847 >> v1:10.20.193.44:6789/0 conn(0x7f483c1406c0 legacy=0x7f483c160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:44.761 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.756+0000 7f4822ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:16:44.761 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.756+0000 7f4822ffd640 1 monclient: found mon.a 2026-02-24T19:16:44.761 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.756+0000 7f4822ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:44.761 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.756+0000 7f4822ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:16:44.761 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.756+0000 7f4822ffd640 1 -- 10.20.193.195:0/766240847 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f483c131e60 con 0x7f483c11e790 2026-02-24T19:16:44.761 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.756+0000 7f4822ffd640 10 monclient: _finish_auth 0 2026-02-24T19:16:44.761 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.756+0000 7f4822ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:16:44.761 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.756+0000 7f4822ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:44.761 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.756+0000 7f48447b3640 5 monclient: authenticate success, global_id 4179 2026-02-24T19:16:44.761 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.756+0000 7f48447b3640 10 monclient: _renew_subs 2026-02-24T19:16:44.761 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.756+0000 7f48447b3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:16:44.761 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.756+0000 7f48447b3640 1 -- 10.20.193.195:0/766240847 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f483c12ea10 con 0x7f483c11e790 2026-02-24T19:16:44.761 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.756+0000 7f48447b3640 10 client.4179.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:16:44.761 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.756+0000 7f48447b3640 10 monclient: _renew_subs 2026-02-24T19:16:44.761 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.756+0000 7f48447b3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:16:44.761 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.756+0000 7f48447b3640 1 -- 10.20.193.195:0/766240847 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f483c12f000 con 0x7f483c11e790 2026-02-24T19:16:44.761 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.756+0000 7f48447b3640 1 librados: init done 2026-02-24T19:16:44.761 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.757+0000 7f48447b3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:44.761 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.757+0000 7f48447b3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:44.761 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.757+0000 7f48447b3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:16:44.761 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.757+0000 7f48447b3640 1 -- 10.20.193.195:0/766240847 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f483c185740 con 0x7f483c11e790 2026-02-24T19:16:44.765 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.763+0000 7f4822ffd640 1 -- 10.20.193.195:0/766240847 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f482c002f40 con 0x7f483c11e790 2026-02-24T19:16:44.765 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.763+0000 7f4822ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:44.765 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.763+0000 7f4822ffd640 1 -- 10.20.193.195:0/766240847 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f482c004bd0 con 0x7f483c11e790 2026-02-24T19:16:44.766 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.763+0000 7f4822ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:44.766 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.763+0000 7f4822ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:16:44.766 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.763+0000 7f4840d25640 4 set_mon_vals no callback set 2026-02-24T19:16:44.766 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.763+0000 7f4822ffd640 10 monclient: dump: 2026-02-24T19:16:44.766 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:44.766 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:44.766 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:44.766 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:44.766 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:44.766 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:44.766 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:44.766 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:44.766 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:44.766 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:44.766 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.764+0000 7f4822ffd640 1 -- 10.20.193.195:0/766240847 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 3) ==== 101401+0+0 (unknown 710223534 0 0) 0x7f482c01d9a0 con 0x7f483c11e790 2026-02-24T19:16:44.767 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.765+0000 7f4841d27640 10 monclient: get_auth_request con 0x7f480c077cf0 auth_method 0 2026-02-24T19:16:44.767 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.765+0000 7f4822ffd640 1 -- 10.20.193.195:0/766240847 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(10..10 src has 1..10) ==== 1640+0+0 (unknown 3046669758 0 0) 0x7f482c059240 con 0x7f483c11e790 2026-02-24T19:16:44.767 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.765+0000 7f4822ffd640 10 client.4179.objecter ms_dispatch2 0x7f483c000b90 osd_map(10..10 src has 1..10) 2026-02-24T19:16:44.767 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.765+0000 7f4822ffd640 3 client.4179.objecter handle_osd_map got epochs [10,10] > 0 2026-02-24T19:16:44.767 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.765+0000 7f4822ffd640 3 client.4179.objecter handle_osd_map decoding full epoch 10 2026-02-24T19:16:44.767 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.765+0000 7f4822ffd640 20 client.4179.objecter dump_active .. 0 homeless 2026-02-24T19:16:44.767 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.765+0000 7f4822ffd640 10 client.4179.objecter ms_handle_connect 0x7f480c077cf0 2026-02-24T19:16:44.855 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.853+0000 7f4822ffd640 1 -- 10.20.193.195:0/766240847 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f482c05d9b0 con 0x7f483c11e790 2026-02-24T19:16:44.855 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.853+0000 7f4822ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:44.855 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.853+0000 7f4822ffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:16:44.964 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.962+0000 7f48447b3640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "a4833012-c50c-4a6e-b754-cf18fc6117fd", "id": 8}] 2026-02-24T19:16:44.964 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.962+0000 7f48447b3640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "a4833012-c50c-4a6e-b754-cf18fc6117fd", "id": 8}] 2026-02-24T19:16:44.964 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.962+0000 7f48447b3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:16:44.965 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.962+0000 7f48447b3640 1 -- 10.20.193.195:0/766240847 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "osd new", "uuid": "a4833012-c50c-4a6e-b754-cf18fc6117fd", "id": 8} v 0) -- 0x7f483c12f2f0 con 0x7f483c11e790 2026-02-24T19:16:44.982 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.980+0000 7f4822ffd640 1 -- 10.20.193.195:0/766240847 <== mon.0 v1:10.20.193.14:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a4833012-c50c-4a6e-b754-cf18fc6117fd", "id": 8}]=0 v11) ==== 112+0+2 (unknown 3583524723 0 3065575683) 0x7f482c05d2b0 con 0x7f483c11e790 2026-02-24T19:16:44.982 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.980+0000 7f4822ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "a4833012-c50c-4a6e-b754-cf18fc6117fd", "id": 8}] 2026-02-24T19:16:44.982 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.980+0000 7f4822ffd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:16:44.982 INFO:teuthology.orchestra.run.trial195.stdout:8 2026-02-24T19:16:44.983 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.981+0000 7f48447b3640 10 librados: watch_flush enter 2026-02-24T19:16:44.983 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.981+0000 7f48447b3640 10 librados: watch_flush exit 2026-02-24T19:16:44.983 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.981+0000 7f48447b3640 20 client.4179.objecter shutdown clearing up homeless session... 2026-02-24T19:16:44.983 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.981+0000 7f48447b3640 10 client.4179.objecter successfully canceled tick 2026-02-24T19:16:44.983 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.981+0000 7f48447b3640 1 -- 10.20.193.195:0/766240847 >> v1:10.20.193.14:6800/4014096310 conn(0x7f480c077cf0 legacy=0x7f480c0981a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:44.983 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.981+0000 7f48447b3640 10 monclient: shutdown 2026-02-24T19:16:44.984 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.981+0000 7f48447b3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:44.984 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.981+0000 7f48447b3640 1 -- 10.20.193.195:0/766240847 >> v1:10.20.193.14:6789/0 conn(0x7f483c11e790 legacy=0x7f483c1826e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:44.984 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.981+0000 7f48447b3640 1 -- 10.20.193.195:0/766240847 shutdown_connections 2026-02-24T19:16:44.984 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.981+0000 7f48447b3640 1 -- 10.20.193.195:0/766240847 >> 10.20.193.195:0/766240847 conn(0x7f483c0588d0 msgr2=0x7f483c058ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:44.984 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.981+0000 7f48447b3640 1 -- 10.20.193.195:0/766240847 shutdown_connections 2026-02-24T19:16:44.984 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.981+0000 7f48447b3640 1 -- 10.20.193.195:0/766240847 wait complete. 2026-02-24T19:16:44.984 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:44.981+0000 7f48447b3640 1 librados: shutdown 2026-02-24T19:16:44.991 DEBUG:teuthology.orchestra.run.trial195:> sudo ceph --cluster ceph osd new 322914a2-9ba3-44b8-98ec-958b00c92f0c 9 2026-02-24T19:16:45.058 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.056+0000 7fe534bfa640 10 monclient: get_monmap_and_config 2026-02-24T19:16:45.058 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.056+0000 7fe534bfa640 10 monclient: build_initial_monmap 2026-02-24T19:16:45.058 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.056+0000 7fe534bfa640 10 monclient: monmap: 2026-02-24T19:16:45.058 INFO:teuthology.orchestra.run.trial195.stderr:epoch 0 2026-02-24T19:16:45.059 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:45.059 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:16:45.057656+0000 2026-02-24T19:16:45.059 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:16:45.057656+0000 2026-02-24T19:16:45.059 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:45.059 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:45.059 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:45.059 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:45.059 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:45.059 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:45.061 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.056+0000 7fe534bfa640 1 Processor -- start 2026-02-24T19:16:45.061 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.056+0000 7fe534bfa640 1 -- start start 2026-02-24T19:16:45.061 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.056+0000 7fe534bfa640 10 monclient: init 2026-02-24T19:16:45.061 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.056+0000 7fe534bfa640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:45.061 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.056+0000 7fe534bfa640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:16:45.061 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.056+0000 7fe534bfa640 10 monclient(hunting): picked mon.noname-b con 0x7fe530121d90 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:45.061 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.056+0000 7fe534bfa640 10 monclient(hunting): picked mon.noname-c con 0x7fe530142a00 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:45.061 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.056+0000 7fe534bfa640 10 monclient(hunting): picked mon.noname-a con 0x7fe530164710 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:45.061 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.056+0000 7fe534bfa640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5301864c0 con 0x7fe530164710 2026-02-24T19:16:45.061 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.056+0000 7fe534bfa640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5301876c0 con 0x7fe530121d90 2026-02-24T19:16:45.062 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.056+0000 7fe534bfa640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5301888c0 con 0x7fe530142a00 2026-02-24T19:16:45.062 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.056+0000 7fe534bfa640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:45.062 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.056+0000 7fe534bfa640 10 monclient(hunting): authenticate will time out at 3573.692837s 2026-02-24T19:16:45.067 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.064+0000 7fe52dd74640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7fe530142a00 0x7fe530162e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.195:49184/0 (socket says 10.20.193.195:49184) 2026-02-24T19:16:45.067 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.064+0000 7fe52dd74640 1 -- 10.20.193.195:0/701393791 learned_addr learned my addr 10.20.193.195:0/701393791 (peer_addr_for_me v1:10.20.193.195:0/0) 2026-02-24T19:16:45.076 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.073+0000 7fe52d573640 1 -- 10.20.193.195:0/701393791 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2290430335 0 0) 0x7fe5301888c0 con 0x7fe530142a00 2026-02-24T19:16:45.076 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.073+0000 7fe52d573640 10 monclient(hunting): _negotiate 2026-02-24T19:16:45.076 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.073+0000 7fe52d573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:45.076 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.073+0000 7fe52d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:45.076 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.073+0000 7fe52d573640 10 monclient(hunting): my global_id is 4178 2026-02-24T19:16:45.076 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.073+0000 7fe52d573640 1 -- 10.20.193.195:0/701393791 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe51c003610 con 0x7fe530142a00 2026-02-24T19:16:45.080 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.075+0000 7fe52d573640 1 -- 10.20.193.195:0/701393791 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1884389857 0 0) 0x7fe51c003610 con 0x7fe530142a00 2026-02-24T19:16:45.080 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.075+0000 7fe52d573640 1 -- 10.20.193.195:0/701393791 >> v1:10.20.193.44:6789/0 conn(0x7fe530121d90 legacy=0x7fe530122160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:45.080 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.075+0000 7fe52d573640 1 -- 10.20.193.195:0/701393791 >> v1:10.20.193.14:6789/0 conn(0x7fe530164710 legacy=0x7fe530184bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:16:45.080 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.075+0000 7fe52d573640 10 monclient: _finish_hunting 0 2026-02-24T19:16:45.080 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.075+0000 7fe52d573640 1 monclient: found mon.noname-c 2026-02-24T19:16:45.080 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.075+0000 7fe52d573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:45.080 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.075+0000 7fe52d573640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.170:6789/0 2026-02-24T19:16:45.080 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.075+0000 7fe52d573640 1 -- 10.20.193.195:0/701393791 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe530189b60 con 0x7fe530142a00 2026-02-24T19:16:45.080 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.075+0000 7fe52d573640 10 monclient: _finish_auth 0 2026-02-24T19:16:45.080 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.075+0000 7fe52d573640 10 monclient: _check_auth_tickets 2026-02-24T19:16:45.080 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.075+0000 7fe52d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:45.080 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.075+0000 7fe52d573640 1 -- 10.20.193.195:0/701393791 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fe518002df0 con 0x7fe530142a00 2026-02-24T19:16:45.081 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.075+0000 7fe52d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:45.081 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.075+0000 7fe52d573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:16:45.081 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.075+0000 7fe52d573640 10 monclient: dump: 2026-02-24T19:16:45.081 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:45.081 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:45.081 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:45.081 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:45.081 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:45.081 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:45.081 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:45.081 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:45.081 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:45.081 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:45.081 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.075+0000 7fe534bfa640 5 monclient: authenticate success, global_id 4178 2026-02-24T19:16:45.081 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.075+0000 7fe534bfa640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:16:45.081 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.075+0000 7fe52d573640 1 -- 10.20.193.195:0/701393791 <== mon.2 v1:10.20.193.170:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe518003070 con 0x7fe530142a00 2026-02-24T19:16:45.081 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.075+0000 7fe52d573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:45.081 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.075+0000 7fe52d573640 1 -- 10.20.193.195:0/701393791 <== mon.2 v1:10.20.193.170:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fe5180034b0 con 0x7fe530142a00 2026-02-24T19:16:45.081 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.075+0000 7fe52d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:45.081 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.075+0000 7fe52d573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:16:45.081 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.075+0000 7fe52d573640 10 monclient: dump: 2026-02-24T19:16:45.081 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:45.081 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:45.081 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:45.081 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:45.081 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:45.082 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:45.082 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:45.082 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:45.082 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:45.082 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:45.082 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.075+0000 7fe534bfa640 10 monclient: get_monmap_and_config success 2026-02-24T19:16:45.082 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.075+0000 7fe534bfa640 4 set_mon_vals no callback set 2026-02-24T19:16:45.082 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.076+0000 7fe534bfa640 10 monclient: shutdown 2026-02-24T19:16:45.082 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.076+0000 7fe534bfa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:45.082 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.076+0000 7fe534bfa640 1 -- 10.20.193.195:0/701393791 >> v1:10.20.193.170:6789/0 conn(0x7fe530142a00 legacy=0x7fe530162e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:45.082 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.076+0000 7fe534bfa640 1 -- 10.20.193.195:0/701393791 shutdown_connections 2026-02-24T19:16:45.082 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.076+0000 7fe534bfa640 1 -- 10.20.193.195:0/701393791 >> 10.20.193.195:0/701393791 conn(0x7fe530057490 msgr2=0x7fe530057890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:45.082 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.076+0000 7fe534bfa640 1 -- 10.20.193.195:0/701393791 shutdown_connections 2026-02-24T19:16:45.082 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.076+0000 7fe534bfa640 1 -- 10.20.193.195:0/701393791 wait complete. 2026-02-24T19:16:45.082 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.076+0000 7fe534bfa640 10 monclient: build_initial_monmap 2026-02-24T19:16:45.082 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.076+0000 7fe534bfa640 10 monclient: monmap: 2026-02-24T19:16:45.082 INFO:teuthology.orchestra.run.trial195.stderr:epoch 0 2026-02-24T19:16:45.082 INFO:teuthology.orchestra.run.trial195.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:16:45.082 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 0.000000 2026-02-24T19:16:45.082 INFO:teuthology.orchestra.run.trial195.stderr:created 0.000000 2026-02-24T19:16:45.082 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:45.082 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 1 2026-02-24T19:16:45.082 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:45.082 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:45.082 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:45.082 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:45.082 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.076+0000 7fe534bfa640 1 librados: starting msgr at 2026-02-24T19:16:45.083 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.076+0000 7fe534bfa640 1 librados: starting objecter 2026-02-24T19:16:45.083 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.076+0000 7fe534bfa640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:16:45.083 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.076+0000 7fe534bfa640 1 Processor -- start 2026-02-24T19:16:45.083 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.077+0000 7fe534bfa640 1 -- start start 2026-02-24T19:16:45.083 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.077+0000 7fe534bfa640 1 librados: setting wanted keys 2026-02-24T19:16:45.083 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.077+0000 7fe534bfa640 1 librados: calling monclient init 2026-02-24T19:16:45.083 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.077+0000 7fe534bfa640 10 monclient: init 2026-02-24T19:16:45.083 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.077+0000 7fe534bfa640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:45.083 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.077+0000 7fe534bfa640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:16:45.083 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.077+0000 7fe534bfa640 10 monclient(hunting): picked mon.noname-a con 0x7fe530121d90 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:45.083 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.077+0000 7fe534bfa640 10 monclient(hunting): picked mon.noname-c con 0x7fe530142a00 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:45.083 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.077+0000 7fe534bfa640 10 monclient(hunting): picked mon.noname-b con 0x7fe530164710 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:45.083 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.077+0000 7fe534bfa640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe53011c8e0 con 0x7fe530121d90 2026-02-24T19:16:45.083 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.077+0000 7fe534bfa640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe53011cab0 con 0x7fe530164710 2026-02-24T19:16:45.083 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.077+0000 7fe534bfa640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe53011cc80 con 0x7fe530142a00 2026-02-24T19:16:45.083 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.077+0000 7fe534bfa640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:45.083 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.077+0000 7fe534bfa640 10 monclient(hunting): authenticate will time out at 3573.713161s 2026-02-24T19:16:45.083 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.077+0000 7fe52dd74640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7fe530142a00 0x7fe530148600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.195:49190/0 (socket says 10.20.193.195:49190) 2026-02-24T19:16:45.083 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.077+0000 7fe52dd74640 1 -- 10.20.193.195:0/1981998895 learned_addr learned my addr 10.20.193.195:0/1981998895 (peer_addr_for_me v1:10.20.193.195:0/0) 2026-02-24T19:16:45.083 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.077+0000 7fe516ffd640 10 client.?.objecter ms_handle_connect 0x7fe530164710 2026-02-24T19:16:45.083 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.077+0000 7fe516ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:45.083 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.077+0000 7fe516ffd640 10 client.?.objecter ms_handle_connect 0x7fe530142a00 2026-02-24T19:16:45.083 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.077+0000 7fe516ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:45.085 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.078+0000 7fe516ffd640 1 -- 10.20.193.195:0/1981998895 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3416417012 0 0) 0x7fe53011cc80 con 0x7fe530142a00 2026-02-24T19:16:45.085 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.078+0000 7fe516ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:16:45.085 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.078+0000 7fe516ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:45.085 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.078+0000 7fe516ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:45.085 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.078+0000 7fe516ffd640 10 monclient(hunting): my global_id is 4181 2026-02-24T19:16:45.085 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.078+0000 7fe516ffd640 1 -- 10.20.193.195:0/1981998895 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4fc003610 con 0x7fe530142a00 2026-02-24T19:16:45.085 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.081+0000 7fe516ffd640 1 -- 10.20.193.195:0/1981998895 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3035865376 0 0) 0x7fe4fc003610 con 0x7fe530142a00 2026-02-24T19:16:45.085 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.081+0000 7fe516ffd640 1 -- 10.20.193.195:0/1981998895 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe53011cc80 con 0x7fe530142a00 2026-02-24T19:16:45.085 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.081+0000 7fe516ffd640 1 -- 10.20.193.195:0/1981998895 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fe518002d00 con 0x7fe530142a00 2026-02-24T19:16:45.085 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.081+0000 7fe516ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:45.085 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.081+0000 7fe516ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:16:45.085 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.081+0000 7fe516ffd640 10 monclient(hunting): dump: 2026-02-24T19:16:45.085 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:45.085 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:45.085 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:45.085 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:45.085 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:45.085 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:45.085 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:45.086 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:45.086 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:45.086 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:45.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.081+0000 7fe516ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:16:45.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.082+0000 7fe516ffd640 1 -- 10.20.193.195:0/1981998895 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 704130922 0 0) 0x7fe53011cab0 con 0x7fe530164710 2026-02-24T19:16:45.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.082+0000 7fe516ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:16:45.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.082+0000 7fe516ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:45.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.082+0000 7fe516ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:45.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.082+0000 7fe516ffd640 10 monclient(hunting): my global_id is 4171 2026-02-24T19:16:45.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.082+0000 7fe516ffd640 1 -- 10.20.193.195:0/1981998895 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4fc003610 con 0x7fe530164710 2026-02-24T19:16:45.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.082+0000 7fe516ffd640 10 client.?.objecter ms_handle_connect 0x7fe530121d90 2026-02-24T19:16:45.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.082+0000 7fe516ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:45.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.082+0000 7fe516ffd640 1 -- 10.20.193.195:0/1981998895 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1046547872 0 0) 0x7fe53011cc80 con 0x7fe530142a00 2026-02-24T19:16:45.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.082+0000 7fe516ffd640 1 -- 10.20.193.195:0/1981998895 >> v1:10.20.193.44:6789/0 conn(0x7fe530164710 legacy=0x7fe53011c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:45.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.082+0000 7fe516ffd640 1 -- 10.20.193.195:0/1981998895 >> v1:10.20.193.14:6789/0 conn(0x7fe530121d90 legacy=0x7fe530184ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:45.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.082+0000 7fe516ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:16:45.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.082+0000 7fe516ffd640 1 monclient: found mon.c 2026-02-24T19:16:45.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.082+0000 7fe516ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:45.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.082+0000 7fe516ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:16:45.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.082+0000 7fe516ffd640 1 -- 10.20.193.195:0/1981998895 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe53011ce50 con 0x7fe530142a00 2026-02-24T19:16:45.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.082+0000 7fe516ffd640 10 monclient: _finish_auth 0 2026-02-24T19:16:45.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.082+0000 7fe516ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:16:45.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.082+0000 7fe516ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:45.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.082+0000 7fe534bfa640 5 monclient: authenticate success, global_id 4181 2026-02-24T19:16:45.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.082+0000 7fe534bfa640 10 monclient: _renew_subs 2026-02-24T19:16:45.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.082+0000 7fe534bfa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:16:45.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.082+0000 7fe534bfa640 1 -- 10.20.193.195:0/1981998895 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe53014fde0 con 0x7fe530142a00 2026-02-24T19:16:45.087 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.082+0000 7fe534bfa640 10 client.4181.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:16:45.087 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.082+0000 7fe534bfa640 10 monclient: _renew_subs 2026-02-24T19:16:45.087 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.082+0000 7fe534bfa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:16:45.087 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.082+0000 7fe534bfa640 1 -- 10.20.193.195:0/1981998895 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe5301503d0 con 0x7fe530142a00 2026-02-24T19:16:45.087 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.082+0000 7fe534bfa640 1 librados: init done 2026-02-24T19:16:45.087 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.083+0000 7fe534bfa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:45.087 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.083+0000 7fe534bfa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:45.087 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.083+0000 7fe534bfa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:16:45.087 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.083+0000 7fe534bfa640 1 -- 10.20.193.195:0/1981998895 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe530187c10 con 0x7fe530142a00 2026-02-24T19:16:45.174 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.173+0000 7fe516ffd640 1 -- 10.20.193.195:0/1981998895 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe518002f70 con 0x7fe530142a00 2026-02-24T19:16:45.174 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.173+0000 7fe516ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:45.174 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.173+0000 7fe516ffd640 1 -- 10.20.193.195:0/1981998895 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fe518004e80 con 0x7fe530142a00 2026-02-24T19:16:45.175 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.173+0000 7fe516ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:45.175 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.173+0000 7fe516ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:16:45.175 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.173+0000 7fe52cd72640 4 set_mon_vals no callback set 2026-02-24T19:16:45.175 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.173+0000 7fe516ffd640 10 monclient: dump: 2026-02-24T19:16:45.175 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:45.175 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:45.175 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:45.175 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:45.175 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:45.175 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:45.175 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:45.175 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:45.175 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:45.175 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:45.175 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.173+0000 7fe516ffd640 1 -- 10.20.193.195:0/1981998895 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 3) ==== 101401+0+0 (unknown 710223534 0 0) 0x7fe51801dc50 con 0x7fe530142a00 2026-02-24T19:16:45.176 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.174+0000 7fe52e575640 10 monclient: get_auth_request con 0x7fe4fc077b50 auth_method 0 2026-02-24T19:16:45.176 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.174+0000 7fe516ffd640 10 client.4181.objecter ms_handle_connect 0x7fe4fc077b50 2026-02-24T19:16:45.177 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.175+0000 7fe516ffd640 1 -- 10.20.193.195:0/1981998895 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(11..11 src has 1..11) ==== 1755+0+0 (unknown 159488875 0 0) 0x7fe5180594e0 con 0x7fe530142a00 2026-02-24T19:16:45.177 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.175+0000 7fe516ffd640 10 client.4181.objecter ms_dispatch2 0x7fe530000b90 osd_map(11..11 src has 1..11) 2026-02-24T19:16:45.177 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.175+0000 7fe516ffd640 3 client.4181.objecter handle_osd_map got epochs [11,11] > 0 2026-02-24T19:16:45.177 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.175+0000 7fe516ffd640 3 client.4181.objecter handle_osd_map decoding full epoch 11 2026-02-24T19:16:45.177 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.175+0000 7fe516ffd640 20 client.4181.objecter dump_active .. 0 homeless 2026-02-24T19:16:45.178 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.176+0000 7fe516ffd640 1 -- 10.20.193.195:0/1981998895 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fe51805dc50 con 0x7fe530142a00 2026-02-24T19:16:45.178 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.176+0000 7fe516ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:45.178 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.176+0000 7fe516ffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:16:45.289 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.287+0000 7fe534bfa640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "322914a2-9ba3-44b8-98ec-958b00c92f0c", "id": 9}] 2026-02-24T19:16:45.289 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.287+0000 7fe534bfa640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "322914a2-9ba3-44b8-98ec-958b00c92f0c", "id": 9}] 2026-02-24T19:16:45.289 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.287+0000 7fe534bfa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:16:45.289 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.287+0000 7fe534bfa640 1 -- 10.20.193.195:0/1981998895 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "osd new", "uuid": "322914a2-9ba3-44b8-98ec-958b00c92f0c", "id": 9} v 0) -- 0x7fe530187e60 con 0x7fe530142a00 2026-02-24T19:16:45.332 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.330+0000 7fe516ffd640 1 -- 10.20.193.195:0/1981998895 <== mon.2 v1:10.20.193.170:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "322914a2-9ba3-44b8-98ec-958b00c92f0c", "id": 9}]=0 v12) ==== 112+0+2 (unknown 2287506094 0 2769969524) 0x7fe51805d550 con 0x7fe530142a00 2026-02-24T19:16:45.332 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.330+0000 7fe516ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "322914a2-9ba3-44b8-98ec-958b00c92f0c", "id": 9}] 2026-02-24T19:16:45.332 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.330+0000 7fe516ffd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:16:45.332 INFO:teuthology.orchestra.run.trial195.stdout:9 2026-02-24T19:16:45.333 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.331+0000 7fe534bfa640 10 librados: watch_flush enter 2026-02-24T19:16:45.333 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.331+0000 7fe534bfa640 10 librados: watch_flush exit 2026-02-24T19:16:45.333 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.331+0000 7fe534bfa640 20 client.4181.objecter shutdown clearing up homeless session... 2026-02-24T19:16:45.333 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.331+0000 7fe534bfa640 10 client.4181.objecter successfully canceled tick 2026-02-24T19:16:45.334 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.331+0000 7fe534bfa640 1 -- 10.20.193.195:0/1981998895 >> v1:10.20.193.14:6800/4014096310 conn(0x7fe4fc077b50 legacy=0x7fe4fc098000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:45.334 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.331+0000 7fe534bfa640 10 monclient: shutdown 2026-02-24T19:16:45.334 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.331+0000 7fe534bfa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:45.334 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.331+0000 7fe534bfa640 1 -- 10.20.193.195:0/1981998895 >> v1:10.20.193.170:6789/0 conn(0x7fe530142a00 legacy=0x7fe530148600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:45.334 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.331+0000 7fe534bfa640 1 -- 10.20.193.195:0/1981998895 shutdown_connections 2026-02-24T19:16:45.334 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.331+0000 7fe534bfa640 1 -- 10.20.193.195:0/1981998895 >> 10.20.193.195:0/1981998895 conn(0x7fe530057490 msgr2=0x7fe530188370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:45.334 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.331+0000 7fe534bfa640 1 -- 10.20.193.195:0/1981998895 shutdown_connections 2026-02-24T19:16:45.334 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.331+0000 7fe534bfa640 1 -- 10.20.193.195:0/1981998895 wait complete. 2026-02-24T19:16:45.334 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.331+0000 7fe534bfa640 1 librados: shutdown 2026-02-24T19:16:45.341 DEBUG:teuthology.orchestra.run.trial195:> sudo ceph --cluster ceph osd new dbfdf855-de28-491b-9112-8009ab155fb6 10 2026-02-24T19:16:45.404 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.402+0000 7f261ae9d640 10 monclient: get_monmap_and_config 2026-02-24T19:16:45.404 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.402+0000 7f261ae9d640 10 monclient: build_initial_monmap 2026-02-24T19:16:45.404 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.402+0000 7f261ae9d640 10 monclient: monmap: 2026-02-24T19:16:45.404 INFO:teuthology.orchestra.run.trial195.stderr:epoch 0 2026-02-24T19:16:45.404 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:45.404 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:16:45.403742+0000 2026-02-24T19:16:45.404 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:16:45.403742+0000 2026-02-24T19:16:45.404 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:45.404 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:45.404 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:45.404 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:45.404 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:45.404 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:45.405 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.402+0000 7f261ae9d640 1 Processor -- start 2026-02-24T19:16:45.405 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.402+0000 7f261ae9d640 1 -- start start 2026-02-24T19:16:45.405 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.402+0000 7f261ae9d640 10 monclient: init 2026-02-24T19:16:45.405 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.402+0000 7f261ae9d640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:45.405 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.402+0000 7f261ae9d640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:16:45.405 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.402+0000 7f261ae9d640 10 monclient(hunting): picked mon.noname-c con 0x7f261405d9c0 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:45.405 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.402+0000 7f261ae9d640 10 monclient(hunting): picked mon.noname-a con 0x7f261405de80 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:45.405 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.402+0000 7f261ae9d640 10 monclient(hunting): picked mon.noname-b con 0x7f2614164740 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:45.405 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.402+0000 7f261ae9d640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2614186360 con 0x7f261405de80 2026-02-24T19:16:45.405 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.402+0000 7f261ae9d640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2614187540 con 0x7f2614164740 2026-02-24T19:16:45.405 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.402+0000 7f261ae9d640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2614188740 con 0x7f261405d9c0 2026-02-24T19:16:45.405 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.402+0000 7f261ae9d640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:45.405 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.402+0000 7f261ae9d640 10 monclient(hunting): authenticate will time out at 3574.038888s 2026-02-24T19:16:45.405 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.403+0000 7f260bfff640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f261405de80 0x7f261405b6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.195:35164/0 (socket says 10.20.193.195:35164) 2026-02-24T19:16:45.406 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.403+0000 7f260bfff640 1 -- 10.20.193.195:0/3259940948 learned_addr learned my addr 10.20.193.195:0/3259940948 (peer_addr_for_me v1:10.20.193.195:0/0) 2026-02-24T19:16:45.406 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.404+0000 7f260b7fe640 1 -- 10.20.193.195:0/3259940948 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 856920259 0 0) 0x7f2614186360 con 0x7f261405de80 2026-02-24T19:16:45.406 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.404+0000 7f260b7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:16:45.406 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.404+0000 7f260b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:45.406 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.404+0000 7f260b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:45.406 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.404+0000 7f260b7fe640 10 monclient(hunting): my global_id is 4185 2026-02-24T19:16:45.406 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.404+0000 7f260b7fe640 1 -- 10.20.193.195:0/3259940948 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2600003610 con 0x7f261405de80 2026-02-24T19:16:45.407 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.404+0000 7f260b7fe640 1 -- 10.20.193.195:0/3259940948 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1324583673 0 0) 0x7f2614187540 con 0x7f2614164740 2026-02-24T19:16:45.407 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.404+0000 7f260b7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:16:45.407 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.404+0000 7f260b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:45.407 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.404+0000 7f260b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:45.407 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.404+0000 7f260b7fe640 10 monclient(hunting): my global_id is 4174 2026-02-24T19:16:45.407 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.404+0000 7f260b7fe640 1 -- 10.20.193.195:0/3259940948 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2614186360 con 0x7f2614164740 2026-02-24T19:16:45.407 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.404+0000 7f260b7fe640 1 -- 10.20.193.195:0/3259940948 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1149246263 0 0) 0x7f2614188740 con 0x7f261405d9c0 2026-02-24T19:16:45.407 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.404+0000 7f260b7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:16:45.407 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.404+0000 7f260b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:45.407 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.404+0000 7f260b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:45.407 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.404+0000 7f260b7fe640 10 monclient(hunting): my global_id is 4184 2026-02-24T19:16:45.407 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.404+0000 7f260b7fe640 1 -- 10.20.193.195:0/3259940948 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2614187540 con 0x7f261405d9c0 2026-02-24T19:16:45.408 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.406+0000 7f260b7fe640 1 -- 10.20.193.195:0/3259940948 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 226101296 0 0) 0x7f2600003610 con 0x7f261405de80 2026-02-24T19:16:45.408 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.406+0000 7f260b7fe640 1 -- 10.20.193.195:0/3259940948 >> v1:10.20.193.170:6789/0 conn(0x7f261405d9c0 legacy=0x7f261405afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:45.408 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.406+0000 7f260b7fe640 1 -- 10.20.193.195:0/3259940948 >> v1:10.20.193.44:6789/0 conn(0x7f2614164740 legacy=0x7f2614184b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:45.408 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.406+0000 7f260b7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:16:45.408 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.406+0000 7f260b7fe640 1 monclient: found mon.noname-a 2026-02-24T19:16:45.408 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.406+0000 7f260b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:45.408 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.406+0000 7f260b7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:16:45.408 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.406+0000 7f260b7fe640 1 -- 10.20.193.195:0/3259940948 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26141899e0 con 0x7f261405de80 2026-02-24T19:16:45.408 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.406+0000 7f260b7fe640 10 monclient: _finish_auth 0 2026-02-24T19:16:45.408 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.406+0000 7f260b7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:16:45.408 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.406+0000 7f260b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:45.408 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.406+0000 7f260b7fe640 1 -- 10.20.193.195:0/3259940948 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f25fc002df0 con 0x7f261405de80 2026-02-24T19:16:45.408 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.406+0000 7f260b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:45.408 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.406+0000 7f260b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:16:45.408 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.406+0000 7f260b7fe640 10 monclient: dump: 2026-02-24T19:16:45.409 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:45.409 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:45.409 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:45.409 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:45.409 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:45.409 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:45.409 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:45.409 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:45.409 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:45.409 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:45.409 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.406+0000 7f261ae9d640 5 monclient: authenticate success, global_id 4185 2026-02-24T19:16:45.409 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.406+0000 7f261ae9d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:16:45.413 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.411+0000 7f260b7fe640 1 -- 10.20.193.195:0/3259940948 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f25fc003030 con 0x7f261405de80 2026-02-24T19:16:45.413 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.411+0000 7f260b7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:45.413 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.411+0000 7f260b7fe640 1 -- 10.20.193.195:0/3259940948 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f25fc003470 con 0x7f261405de80 2026-02-24T19:16:45.413 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.411+0000 7f260b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:45.413 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.411+0000 7f260b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:16:45.413 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.411+0000 7f260b7fe640 10 monclient: dump: 2026-02-24T19:16:45.413 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:45.414 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:45.414 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:45.414 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:45.414 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:45.414 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:45.414 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:45.414 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:45.414 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:45.414 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:45.414 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.411+0000 7f261ae9d640 10 monclient: get_monmap_and_config success 2026-02-24T19:16:45.414 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.411+0000 7f261ae9d640 4 set_mon_vals no callback set 2026-02-24T19:16:45.415 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.412+0000 7f261ae9d640 10 monclient: shutdown 2026-02-24T19:16:45.415 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.412+0000 7f261ae9d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:45.415 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.412+0000 7f261ae9d640 1 -- 10.20.193.195:0/3259940948 >> v1:10.20.193.14:6789/0 conn(0x7f261405de80 legacy=0x7f261405b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:45.415 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.412+0000 7f261ae9d640 1 -- 10.20.193.195:0/3259940948 shutdown_connections 2026-02-24T19:16:45.415 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.412+0000 7f261ae9d640 1 -- 10.20.193.195:0/3259940948 >> 10.20.193.195:0/3259940948 conn(0x7f2614058d00 msgr2=0x7f2614059100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:45.415 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.412+0000 7f261ae9d640 1 -- 10.20.193.195:0/3259940948 shutdown_connections 2026-02-24T19:16:45.415 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.412+0000 7f261ae9d640 1 -- 10.20.193.195:0/3259940948 wait complete. 2026-02-24T19:16:45.415 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.412+0000 7f261ae9d640 10 monclient: build_initial_monmap 2026-02-24T19:16:45.415 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.412+0000 7f261ae9d640 10 monclient: monmap: 2026-02-24T19:16:45.415 INFO:teuthology.orchestra.run.trial195.stderr:epoch 0 2026-02-24T19:16:45.416 INFO:teuthology.orchestra.run.trial195.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:16:45.416 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 0.000000 2026-02-24T19:16:45.416 INFO:teuthology.orchestra.run.trial195.stderr:created 0.000000 2026-02-24T19:16:45.416 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:45.416 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 1 2026-02-24T19:16:45.416 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:45.416 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:45.416 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:45.416 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:45.416 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.412+0000 7f261ae9d640 1 librados: starting msgr at 2026-02-24T19:16:45.416 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.412+0000 7f261ae9d640 1 librados: starting objecter 2026-02-24T19:16:45.416 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.412+0000 7f261ae9d640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:16:45.416 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.412+0000 7f261ae9d640 1 Processor -- start 2026-02-24T19:16:45.416 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.412+0000 7f261ae9d640 1 -- start start 2026-02-24T19:16:45.416 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.412+0000 7f261ae9d640 1 librados: setting wanted keys 2026-02-24T19:16:45.416 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.412+0000 7f261ae9d640 1 librados: calling monclient init 2026-02-24T19:16:45.416 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.412+0000 7f261ae9d640 10 monclient: init 2026-02-24T19:16:45.416 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.412+0000 7f261ae9d640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:45.416 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.412+0000 7f261ae9d640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:16:45.416 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.412+0000 7f261ae9d640 10 monclient(hunting): picked mon.noname-c con 0x7f261405d9c0 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:45.416 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.412+0000 7f261ae9d640 10 monclient(hunting): picked mon.noname-a con 0x7f261405de80 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:45.416 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.412+0000 7f261ae9d640 10 monclient(hunting): picked mon.noname-b con 0x7f2614164740 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:45.416 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.412+0000 7f261ae9d640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2614162530 con 0x7f261405de80 2026-02-24T19:16:45.416 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.412+0000 7f261ae9d640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2614163710 con 0x7f2614164740 2026-02-24T19:16:45.416 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.412+0000 7f261ae9d640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26141638e0 con 0x7f261405d9c0 2026-02-24T19:16:45.416 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.412+0000 7f261ae9d640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:45.417 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.412+0000 7f261ae9d640 10 monclient(hunting): authenticate will time out at 3574.048888s 2026-02-24T19:16:45.417 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.413+0000 7f2618c12640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7f261405d9c0 0x7f2614102910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.195:49216/0 (socket says 10.20.193.195:49216) 2026-02-24T19:16:45.417 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.413+0000 7f2618c12640 1 -- 10.20.193.195:0/34879917 learned_addr learned my addr 10.20.193.195:0/34879917 (peer_addr_for_me v1:10.20.193.195:0/0) 2026-02-24T19:16:45.417 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.413+0000 7f26097fa640 10 client.?.objecter ms_handle_connect 0x7f261405d9c0 2026-02-24T19:16:45.417 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.413+0000 7f26097fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:45.417 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.413+0000 7f26097fa640 10 client.?.objecter ms_handle_connect 0x7f2614164740 2026-02-24T19:16:45.417 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.413+0000 7f26097fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:45.417 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.414+0000 7f26097fa640 1 -- 10.20.193.195:0/34879917 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2365422283 0 0) 0x7f26141638e0 con 0x7f261405d9c0 2026-02-24T19:16:45.417 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.414+0000 7f26097fa640 10 monclient(hunting): _negotiate 2026-02-24T19:16:45.417 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.414+0000 7f26097fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:45.418 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.414+0000 7f26097fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:45.418 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.414+0000 7f26097fa640 10 monclient(hunting): my global_id is 4187 2026-02-24T19:16:45.418 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.414+0000 7f26097fa640 1 -- 10.20.193.195:0/34879917 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25e4003610 con 0x7f261405d9c0 2026-02-24T19:16:45.418 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.414+0000 7f26097fa640 10 client.?.objecter ms_handle_connect 0x7f261405de80 2026-02-24T19:16:45.418 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.414+0000 7f26097fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:45.418 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.414+0000 7f26097fa640 1 -- 10.20.193.195:0/34879917 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 517993569 0 0) 0x7f2614163710 con 0x7f2614164740 2026-02-24T19:16:45.418 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.414+0000 7f26097fa640 10 monclient(hunting): _negotiate 2026-02-24T19:16:45.418 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.414+0000 7f26097fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:45.418 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.414+0000 7f26097fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:45.418 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.414+0000 7f26097fa640 10 monclient(hunting): my global_id is 4177 2026-02-24T19:16:45.418 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.414+0000 7f26097fa640 1 -- 10.20.193.195:0/34879917 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26141638e0 con 0x7f2614164740 2026-02-24T19:16:45.418 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.415+0000 7f26097fa640 1 -- 10.20.193.195:0/34879917 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3096438960 0 0) 0x7f2614162530 con 0x7f261405de80 2026-02-24T19:16:45.418 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.415+0000 7f26097fa640 10 monclient(hunting): _negotiate 2026-02-24T19:16:45.418 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.415+0000 7f26097fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:45.418 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.415+0000 7f26097fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:45.418 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.415+0000 7f26097fa640 10 monclient(hunting): my global_id is 4188 2026-02-24T19:16:45.418 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.415+0000 7f26097fa640 1 -- 10.20.193.195:0/34879917 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2614163710 con 0x7f261405de80 2026-02-24T19:16:45.419 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.416+0000 7f26097fa640 1 -- 10.20.193.195:0/34879917 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2715532797 0 0) 0x7f25e4003610 con 0x7f261405d9c0 2026-02-24T19:16:45.419 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.416+0000 7f26097fa640 1 -- 10.20.193.195:0/34879917 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2614162530 con 0x7f261405d9c0 2026-02-24T19:16:45.419 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.416+0000 7f26097fa640 1 -- 10.20.193.195:0/34879917 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f2604003170 con 0x7f261405d9c0 2026-02-24T19:16:45.419 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.416+0000 7f26097fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:45.419 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.416+0000 7f26097fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:16:45.419 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.416+0000 7f26097fa640 10 monclient(hunting): dump: 2026-02-24T19:16:45.419 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:45.419 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:45.419 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:45.419 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:45.419 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:45.419 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:45.419 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:45.419 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:45.419 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:45.419 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:45.419 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.416+0000 7f26097fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:16:45.420 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.417+0000 7f26097fa640 1 -- 10.20.193.195:0/34879917 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1670000276 0 0) 0x7f26141638e0 con 0x7f2614164740 2026-02-24T19:16:45.420 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.417+0000 7f26097fa640 1 -- 10.20.193.195:0/34879917 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e4003610 con 0x7f2614164740 2026-02-24T19:16:45.420 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.417+0000 7f26097fa640 1 -- 10.20.193.195:0/34879917 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f2610003430 con 0x7f2614164740 2026-02-24T19:16:45.420 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.417+0000 7f26097fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:45.420 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.417+0000 7f26097fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:16:45.420 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.417+0000 7f26097fa640 10 monclient(hunting): dump: 2026-02-24T19:16:45.420 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:45.420 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:45.420 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:45.420 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:45.420 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:45.420 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:45.420 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:45.420 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:45.420 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:45.420 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:45.420 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.418+0000 7f26097fa640 1 -- 10.20.193.195:0/34879917 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1428290254 0 0) 0x7f2614163710 con 0x7f261405de80 2026-02-24T19:16:45.420 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.418+0000 7f26097fa640 1 -- 10.20.193.195:0/34879917 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f26141638e0 con 0x7f261405de80 2026-02-24T19:16:45.420 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.418+0000 7f26097fa640 1 -- 10.20.193.195:0/34879917 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f25fc0031e0 con 0x7f261405de80 2026-02-24T19:16:45.420 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.418+0000 7f26097fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:45.420 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.418+0000 7f26097fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:16:45.421 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.418+0000 7f26097fa640 10 monclient(hunting): dump: 2026-02-24T19:16:45.421 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:45.421 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:45.421 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:45.421 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:45.421 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:45.421 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:45.421 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:45.421 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:45.421 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:45.421 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:45.422 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.418+0000 7f26097fa640 1 -- 10.20.193.195:0/34879917 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 414550557 0 0) 0x7f2614162530 con 0x7f261405d9c0 2026-02-24T19:16:45.422 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.418+0000 7f26097fa640 1 -- 10.20.193.195:0/34879917 >> v1:10.20.193.44:6789/0 conn(0x7f2614164740 legacy=0x7f2614160e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:45.422 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.418+0000 7f26097fa640 1 -- 10.20.193.195:0/34879917 >> v1:10.20.193.14:6789/0 conn(0x7f261405de80 legacy=0x7f261415f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:45.422 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.418+0000 7f26097fa640 10 monclient: _finish_hunting 0 2026-02-24T19:16:45.422 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.418+0000 7f26097fa640 1 monclient: found mon.c 2026-02-24T19:16:45.422 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.418+0000 7f26097fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:45.422 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.418+0000 7f26097fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:16:45.422 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.418+0000 7f26097fa640 1 -- 10.20.193.195:0/34879917 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2614163ab0 con 0x7f261405d9c0 2026-02-24T19:16:45.422 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.418+0000 7f26097fa640 10 monclient: _finish_auth 0 2026-02-24T19:16:45.422 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.418+0000 7f26097fa640 10 monclient: _check_auth_tickets 2026-02-24T19:16:45.422 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.418+0000 7f26097fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:45.422 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.418+0000 7f261ae9d640 5 monclient: authenticate success, global_id 4187 2026-02-24T19:16:45.422 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.418+0000 7f261ae9d640 10 monclient: _renew_subs 2026-02-24T19:16:45.422 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.418+0000 7f261ae9d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:16:45.422 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.418+0000 7f261ae9d640 1 -- 10.20.193.195:0/34879917 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2614163d40 con 0x7f261405d9c0 2026-02-24T19:16:45.422 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.418+0000 7f261ae9d640 10 client.4187.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:16:45.422 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.418+0000 7f261ae9d640 10 monclient: _renew_subs 2026-02-24T19:16:45.422 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.418+0000 7f261ae9d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:16:45.422 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.418+0000 7f261ae9d640 1 -- 10.20.193.195:0/34879917 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f26141642e0 con 0x7f261405d9c0 2026-02-24T19:16:45.422 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.418+0000 7f261ae9d640 1 librados: init done 2026-02-24T19:16:45.422 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.418+0000 7f261ae9d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:45.423 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.418+0000 7f261ae9d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:45.423 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.418+0000 7f261ae9d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:16:45.423 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.418+0000 7f261ae9d640 1 -- 10.20.193.195:0/34879917 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2614187c20 con 0x7f261405d9c0 2026-02-24T19:16:45.427 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.425+0000 7f26097fa640 1 -- 10.20.193.195:0/34879917 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f26040034e0 con 0x7f261405d9c0 2026-02-24T19:16:45.427 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.425+0000 7f26097fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:45.427 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.425+0000 7f26097fa640 1 -- 10.20.193.195:0/34879917 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f2604003b50 con 0x7f261405d9c0 2026-02-24T19:16:45.427 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.425+0000 7f26097fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:45.427 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.425+0000 7f26097fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:16:45.427 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.425+0000 7f26097fa640 10 monclient: dump: 2026-02-24T19:16:45.427 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:45.427 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:45.427 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:45.427 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:45.428 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:45.428 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:45.428 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:45.428 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:45.428 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:45.428 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:45.428 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.425+0000 7f260affd640 4 set_mon_vals no callback set 2026-02-24T19:16:45.428 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.426+0000 7f26097fa640 1 -- 10.20.193.195:0/34879917 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 3) ==== 101401+0+0 (unknown 710223534 0 0) 0x7f2604003d30 con 0x7f261405d9c0 2026-02-24T19:16:45.429 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.427+0000 7f260bfff640 10 monclient: get_auth_request con 0x7f25e4077d20 auth_method 0 2026-02-24T19:16:45.429 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.427+0000 7f26097fa640 10 client.4187.objecter ms_handle_connect 0x7f25e4077d20 2026-02-24T19:16:45.430 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.428+0000 7f26097fa640 1 -- 10.20.193.195:0/34879917 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(12..12 src has 1..12) ==== 1870+0+0 (unknown 1759752517 0 0) 0x7f2604059490 con 0x7f261405d9c0 2026-02-24T19:16:45.431 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.428+0000 7f26097fa640 10 client.4187.objecter ms_dispatch2 0x7f2614000b90 osd_map(12..12 src has 1..12) 2026-02-24T19:16:45.431 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.428+0000 7f26097fa640 3 client.4187.objecter handle_osd_map got epochs [12,12] > 0 2026-02-24T19:16:45.431 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.428+0000 7f26097fa640 3 client.4187.objecter handle_osd_map decoding full epoch 12 2026-02-24T19:16:45.431 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.428+0000 7f26097fa640 20 client.4187.objecter dump_active .. 0 homeless 2026-02-24T19:16:45.515 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.513+0000 7f26097fa640 1 -- 10.20.193.195:0/34879917 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f260405dc00 con 0x7f261405d9c0 2026-02-24T19:16:45.515 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.513+0000 7f26097fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:45.515 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.513+0000 7f26097fa640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:16:45.628 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.626+0000 7f261ae9d640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "dbfdf855-de28-491b-9112-8009ab155fb6", "id": 10}] 2026-02-24T19:16:45.628 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.626+0000 7f261ae9d640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "dbfdf855-de28-491b-9112-8009ab155fb6", "id": 10}] 2026-02-24T19:16:45.628 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.626+0000 7f261ae9d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:16:45.628 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.626+0000 7f261ae9d640 1 -- 10.20.193.195:0/34879917 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "osd new", "uuid": "dbfdf855-de28-491b-9112-8009ab155fb6", "id": 10} v 0) -- 0x7f26140fc8f0 con 0x7f261405d9c0 2026-02-24T19:16:45.672 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.671+0000 7f26097fa640 1 -- 10.20.193.195:0/34879917 <== mon.2 v1:10.20.193.170:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dbfdf855-de28-491b-9112-8009ab155fb6", "id": 10}]=0 v13) ==== 113+0+3 (unknown 3438428388 0 520826459) 0x7f2604003b50 con 0x7f261405d9c0 2026-02-24T19:16:45.672 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.671+0000 7f26097fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "dbfdf855-de28-491b-9112-8009ab155fb6", "id": 10}] 2026-02-24T19:16:45.672 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.671+0000 7f26097fa640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:16:45.673 INFO:teuthology.orchestra.run.trial195.stdout:10 2026-02-24T19:16:45.674 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.672+0000 7f261ae9d640 10 librados: watch_flush enter 2026-02-24T19:16:45.675 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.672+0000 7f261ae9d640 10 librados: watch_flush exit 2026-02-24T19:16:45.675 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.672+0000 7f261ae9d640 20 client.4187.objecter shutdown clearing up homeless session... 2026-02-24T19:16:45.675 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.672+0000 7f261ae9d640 10 client.4187.objecter successfully canceled tick 2026-02-24T19:16:45.675 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.672+0000 7f261ae9d640 1 -- 10.20.193.195:0/34879917 >> v1:10.20.193.14:6800/4014096310 conn(0x7f25e4077d20 legacy=0x7f25e40981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:45.675 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.672+0000 7f261ae9d640 10 monclient: shutdown 2026-02-24T19:16:45.675 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.672+0000 7f261ae9d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:45.675 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.672+0000 7f261ae9d640 1 -- 10.20.193.195:0/34879917 >> v1:10.20.193.170:6789/0 conn(0x7f261405d9c0 legacy=0x7f2614102910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:45.675 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.672+0000 7f261ae9d640 1 -- 10.20.193.195:0/34879917 shutdown_connections 2026-02-24T19:16:45.675 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.672+0000 7f261ae9d640 1 -- 10.20.193.195:0/34879917 >> 10.20.193.195:0/34879917 conn(0x7f2614058d00 msgr2=0x7f26140595d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:45.675 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.672+0000 7f261ae9d640 1 -- 10.20.193.195:0/34879917 shutdown_connections 2026-02-24T19:16:45.675 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.672+0000 7f261ae9d640 1 -- 10.20.193.195:0/34879917 wait complete. 2026-02-24T19:16:45.675 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.672+0000 7f261ae9d640 1 librados: shutdown 2026-02-24T19:16:45.684 DEBUG:teuthology.orchestra.run.trial195:> sudo ceph --cluster ceph osd new 253e9d0b-391d-4647-bd89-6ab4b57909aa 11 2026-02-24T19:16:45.749 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.747+0000 7f7fe7d08640 10 monclient: get_monmap_and_config 2026-02-24T19:16:45.749 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.747+0000 7f7fe7d08640 10 monclient: build_initial_monmap 2026-02-24T19:16:45.749 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.747+0000 7f7fe7d08640 10 monclient: monmap: 2026-02-24T19:16:45.749 INFO:teuthology.orchestra.run.trial195.stderr:epoch 0 2026-02-24T19:16:45.749 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:45.749 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:16:45.748895+0000 2026-02-24T19:16:45.749 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:16:45.748895+0000 2026-02-24T19:16:45.749 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:45.749 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:45.749 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:45.749 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:45.749 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:45.749 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:45.750 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.747+0000 7f7fe7d08640 1 Processor -- start 2026-02-24T19:16:45.750 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.747+0000 7f7fe7d08640 1 -- start start 2026-02-24T19:16:45.750 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.747+0000 7f7fe7d08640 10 monclient: init 2026-02-24T19:16:45.750 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.747+0000 7f7fe7d08640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:45.750 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.747+0000 7f7fe7d08640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:16:45.750 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.747+0000 7f7fe7d08640 10 monclient(hunting): picked mon.noname-c con 0x7f7fe011c500 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:45.750 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.747+0000 7f7fe7d08640 10 monclient(hunting): picked mon.noname-b con 0x7f7fe011e420 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:45.750 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.747+0000 7f7fe7d08640 10 monclient(hunting): picked mon.noname-a con 0x7f7fe011ffc0 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:45.750 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.747+0000 7f7fe7d08640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fe0120d10 con 0x7f7fe011ffc0 2026-02-24T19:16:45.750 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.747+0000 7f7fe7d08640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fe0120f00 con 0x7f7fe011e420 2026-02-24T19:16:45.750 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.747+0000 7f7fe7d08640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fe01210f0 con 0x7f7fe011c500 2026-02-24T19:16:45.751 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.747+0000 7f7fe7d08640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:45.751 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.747+0000 7f7fe7d08640 10 monclient(hunting): authenticate will time out at 3574.383852s 2026-02-24T19:16:45.751 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.748+0000 7f7fe5a7d640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7f7fe011c500 0x7f7fe011c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.195:49222/0 (socket says 10.20.193.195:49222) 2026-02-24T19:16:45.751 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.748+0000 7f7fe627e640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f7fe011ffc0 0x7f7fe0120420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.195:35176/0 (socket says 10.20.193.195:35176) 2026-02-24T19:16:45.751 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.748+0000 7f7fe5a7d640 1 -- 10.20.193.195:0/1063891881 learned_addr learned my addr 10.20.193.195:0/1063891881 (peer_addr_for_me v1:10.20.193.195:0/0) 2026-02-24T19:16:45.751 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.749+0000 7f7fe4a7b640 1 -- 10.20.193.195:0/1063891881 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3826846371 0 0) 0x7f7fe0120d10 con 0x7f7fe011ffc0 2026-02-24T19:16:45.752 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.749+0000 7f7fe4a7b640 10 monclient(hunting): _negotiate 2026-02-24T19:16:45.752 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.749+0000 7f7fe4a7b640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:45.752 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.749+0000 7f7fe4a7b640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:45.752 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.749+0000 7f7fe4a7b640 10 monclient(hunting): my global_id is 4191 2026-02-24T19:16:45.752 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.749+0000 7f7fe4a7b640 1 -- 10.20.193.195:0/1063891881 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fc8003610 con 0x7f7fe011ffc0 2026-02-24T19:16:45.752 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.749+0000 7f7fe4a7b640 1 -- 10.20.193.195:0/1063891881 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2477851323 0 0) 0x7f7fe01210f0 con 0x7f7fe011c500 2026-02-24T19:16:45.752 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.749+0000 7f7fe4a7b640 10 monclient(hunting): _negotiate 2026-02-24T19:16:45.752 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.749+0000 7f7fe4a7b640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:45.752 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.749+0000 7f7fe4a7b640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:45.752 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.749+0000 7f7fe4a7b640 10 monclient(hunting): my global_id is 4190 2026-02-24T19:16:45.752 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.749+0000 7f7fe4a7b640 1 -- 10.20.193.195:0/1063891881 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fe0120d10 con 0x7f7fe011c500 2026-02-24T19:16:45.752 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.749+0000 7f7fe4a7b640 1 -- 10.20.193.195:0/1063891881 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2386800217 0 0) 0x7f7fe0120f00 con 0x7f7fe011e420 2026-02-24T19:16:45.752 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.749+0000 7f7fe4a7b640 10 monclient(hunting): _negotiate 2026-02-24T19:16:45.752 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.749+0000 7f7fe4a7b640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:45.752 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.749+0000 7f7fe4a7b640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:45.752 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.749+0000 7f7fe4a7b640 10 monclient(hunting): my global_id is 4180 2026-02-24T19:16:45.752 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.749+0000 7f7fe4a7b640 1 -- 10.20.193.195:0/1063891881 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fe01210f0 con 0x7f7fe011e420 2026-02-24T19:16:45.753 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.751+0000 7f7fe4a7b640 1 -- 10.20.193.195:0/1063891881 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 611339939 0 0) 0x7f7fc8003610 con 0x7f7fe011ffc0 2026-02-24T19:16:45.753 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.751+0000 7f7fe4a7b640 1 -- 10.20.193.195:0/1063891881 >> v1:10.20.193.170:6789/0 conn(0x7f7fe011c500 legacy=0x7f7fe011c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:45.753 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.751+0000 7f7fe4a7b640 1 -- 10.20.193.195:0/1063891881 >> v1:10.20.193.44:6789/0 conn(0x7f7fe011e420 legacy=0x7f7fe011e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:45.753 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.751+0000 7f7fe4a7b640 10 monclient: _finish_hunting 0 2026-02-24T19:16:45.753 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.751+0000 7f7fe4a7b640 1 monclient: found mon.noname-a 2026-02-24T19:16:45.753 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.751+0000 7f7fe4a7b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:45.753 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.751+0000 7f7fe4a7b640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:16:45.753 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.751+0000 7f7fe4a7b640 1 -- 10.20.193.195:0/1063891881 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe0121380 con 0x7f7fe011ffc0 2026-02-24T19:16:45.753 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.751+0000 7f7fe4a7b640 10 monclient: _finish_auth 0 2026-02-24T19:16:45.753 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.751+0000 7f7fe4a7b640 10 monclient: _check_auth_tickets 2026-02-24T19:16:45.753 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.751+0000 7f7fe4a7b640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:45.753 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.751+0000 7f7fe4a7b640 1 -- 10.20.193.195:0/1063891881 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7fdc003170 con 0x7f7fe011ffc0 2026-02-24T19:16:45.754 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.751+0000 7f7fe4a7b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:45.754 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.751+0000 7f7fe4a7b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:16:45.754 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.751+0000 7f7fe4a7b640 10 monclient: dump: 2026-02-24T19:16:45.754 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:45.754 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:45.754 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:45.754 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:45.754 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:45.754 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:45.754 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:45.754 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:45.754 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:45.754 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:45.754 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.751+0000 7f7fe7d08640 5 monclient: authenticate success, global_id 4191 2026-02-24T19:16:45.754 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.751+0000 7f7fe7d08640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:16:45.755 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.752+0000 7f7fe4a7b640 1 -- 10.20.193.195:0/1063891881 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7fdc0033b0 con 0x7f7fe011ffc0 2026-02-24T19:16:45.755 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.752+0000 7f7fe4a7b640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:45.755 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.752+0000 7f7fe4a7b640 1 -- 10.20.193.195:0/1063891881 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7fdc0037f0 con 0x7f7fe011ffc0 2026-02-24T19:16:45.755 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.752+0000 7f7fe4a7b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:45.756 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.752+0000 7f7fe4a7b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:16:45.756 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.752+0000 7f7fe4a7b640 10 monclient: dump: 2026-02-24T19:16:45.756 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:45.756 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:45.756 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:45.756 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:45.756 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:45.756 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:45.756 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:45.756 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:45.756 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:45.756 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:45.756 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.752+0000 7f7fe7d08640 10 monclient: get_monmap_and_config success 2026-02-24T19:16:45.756 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.752+0000 7f7fe7d08640 4 set_mon_vals no callback set 2026-02-24T19:16:45.756 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.752+0000 7f7fe7d08640 10 monclient: shutdown 2026-02-24T19:16:45.756 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.752+0000 7f7fe7d08640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:45.756 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.752+0000 7f7fe7d08640 1 -- 10.20.193.195:0/1063891881 >> v1:10.20.193.14:6789/0 conn(0x7f7fe011ffc0 legacy=0x7f7fe0120420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:45.756 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.752+0000 7f7fe7d08640 1 -- 10.20.193.195:0/1063891881 shutdown_connections 2026-02-24T19:16:45.756 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.752+0000 7f7fe7d08640 1 -- 10.20.193.195:0/1063891881 >> 10.20.193.195:0/1063891881 conn(0x7f7fe00588d0 msgr2=0x7f7fe0058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:45.756 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.752+0000 7f7fe7d08640 1 -- 10.20.193.195:0/1063891881 shutdown_connections 2026-02-24T19:16:45.756 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.752+0000 7f7fe7d08640 1 -- 10.20.193.195:0/1063891881 wait complete. 2026-02-24T19:16:45.756 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.752+0000 7f7fe7d08640 10 monclient: build_initial_monmap 2026-02-24T19:16:45.756 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.752+0000 7f7fe7d08640 10 monclient: monmap: 2026-02-24T19:16:45.756 INFO:teuthology.orchestra.run.trial195.stderr:epoch 0 2026-02-24T19:16:45.756 INFO:teuthology.orchestra.run.trial195.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:16:45.756 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 0.000000 2026-02-24T19:16:45.756 INFO:teuthology.orchestra.run.trial195.stderr:created 0.000000 2026-02-24T19:16:45.757 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:45.757 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 1 2026-02-24T19:16:45.757 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:45.757 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:45.757 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:45.757 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:45.757 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.752+0000 7f7fe7d08640 1 librados: starting msgr at 2026-02-24T19:16:45.757 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.752+0000 7f7fe7d08640 1 librados: starting objecter 2026-02-24T19:16:45.757 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.752+0000 7f7fe7d08640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:16:45.757 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.752+0000 7f7fe7d08640 1 Processor -- start 2026-02-24T19:16:45.757 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.752+0000 7f7fe7d08640 1 -- start start 2026-02-24T19:16:45.757 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.752+0000 7f7fe7d08640 1 librados: setting wanted keys 2026-02-24T19:16:45.757 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.752+0000 7f7fe7d08640 1 librados: calling monclient init 2026-02-24T19:16:45.757 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.752+0000 7f7fe7d08640 10 monclient: init 2026-02-24T19:16:45.757 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.752+0000 7f7fe7d08640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:45.757 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.752+0000 7f7fe7d08640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:16:45.757 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.753+0000 7f7fe7d08640 10 monclient(hunting): picked mon.noname-a con 0x7f7fe011c500 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:45.757 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.753+0000 7f7fe7d08640 10 monclient(hunting): picked mon.noname-b con 0x7f7fe011e420 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:45.757 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.753+0000 7f7fe7d08640 10 monclient(hunting): picked mon.noname-c con 0x7f7fe011ffc0 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:45.757 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.753+0000 7f7fe7d08640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fe01029b0 con 0x7f7fe011c500 2026-02-24T19:16:45.757 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.753+0000 7f7fe7d08640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fe010b8e0 con 0x7f7fe011e420 2026-02-24T19:16:45.757 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.753+0000 7f7fe7d08640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fe010cac0 con 0x7f7fe011ffc0 2026-02-24T19:16:45.757 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.753+0000 7f7fe7d08640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:45.757 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.753+0000 7f7fe7d08640 10 monclient(hunting): authenticate will time out at 3574.389036s 2026-02-24T19:16:45.757 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.753+0000 7f7fe5a7d640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f7fe011c500 0x7f7fe0101f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.195:35184/0 (socket says 10.20.193.195:35184) 2026-02-24T19:16:45.757 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.753+0000 7f7fe5a7d640 1 -- 10.20.193.195:0/2126122672 learned_addr learned my addr 10.20.193.195:0/2126122672 (peer_addr_for_me v1:10.20.193.195:0/0) 2026-02-24T19:16:45.757 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.753+0000 7f7fce7fc640 10 client.?.objecter ms_handle_connect 0x7f7fe011c500 2026-02-24T19:16:45.758 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.753+0000 7f7fce7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:45.758 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.753+0000 7f7fce7fc640 10 client.?.objecter ms_handle_connect 0x7f7fe011ffc0 2026-02-24T19:16:45.758 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.753+0000 7f7fce7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:45.758 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.753+0000 7f7fce7fc640 10 client.?.objecter ms_handle_connect 0x7f7fe011e420 2026-02-24T19:16:45.758 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.753+0000 7f7fce7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:45.758 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.754+0000 7f7fce7fc640 1 -- 10.20.193.195:0/2126122672 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1927117962 0 0) 0x7f7fe01029b0 con 0x7f7fe011c500 2026-02-24T19:16:45.758 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.754+0000 7f7fce7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:16:45.758 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.754+0000 7f7fce7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:45.758 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.754+0000 7f7fce7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:45.758 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.754+0000 7f7fce7fc640 10 monclient(hunting): my global_id is 4194 2026-02-24T19:16:45.758 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.754+0000 7f7fce7fc640 1 -- 10.20.193.195:0/2126122672 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fb0003610 con 0x7f7fe011c500 2026-02-24T19:16:45.759 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.754+0000 7f7fce7fc640 1 -- 10.20.193.195:0/2126122672 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3484579485 0 0) 0x7f7fe010cac0 con 0x7f7fe011ffc0 2026-02-24T19:16:45.759 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.754+0000 7f7fce7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:16:45.759 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.754+0000 7f7fce7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:45.759 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.754+0000 7f7fce7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:45.759 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.754+0000 7f7fce7fc640 10 monclient(hunting): my global_id is 4193 2026-02-24T19:16:45.759 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.754+0000 7f7fce7fc640 1 -- 10.20.193.195:0/2126122672 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fe01029b0 con 0x7f7fe011ffc0 2026-02-24T19:16:45.759 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.755+0000 7f7fce7fc640 1 -- 10.20.193.195:0/2126122672 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1954806735 0 0) 0x7f7fe010b8e0 con 0x7f7fe011e420 2026-02-24T19:16:45.759 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.755+0000 7f7fce7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:16:45.759 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.755+0000 7f7fce7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:45.759 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.755+0000 7f7fce7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:45.759 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.755+0000 7f7fce7fc640 10 monclient(hunting): my global_id is 4183 2026-02-24T19:16:45.759 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.755+0000 7f7fce7fc640 1 -- 10.20.193.195:0/2126122672 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fe010cac0 con 0x7f7fe011e420 2026-02-24T19:16:45.760 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.757+0000 7f7fce7fc640 1 -- 10.20.193.195:0/2126122672 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 910142326 0 0) 0x7f7fb0003610 con 0x7f7fe011c500 2026-02-24T19:16:45.760 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.757+0000 7f7fce7fc640 1 -- 10.20.193.195:0/2126122672 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7fe010b8e0 con 0x7f7fe011c500 2026-02-24T19:16:45.760 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.757+0000 7f7fce7fc640 1 -- 10.20.193.195:0/2126122672 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7fd0003170 con 0x7f7fe011c500 2026-02-24T19:16:45.760 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.757+0000 7f7fce7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:45.760 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.757+0000 7f7fce7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:16:45.760 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.757+0000 7f7fce7fc640 10 monclient(hunting): dump: 2026-02-24T19:16:45.760 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:45.760 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:45.760 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:45.760 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:45.760 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:45.760 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:45.760 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:45.760 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:45.760 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:45.760 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:45.760 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.757+0000 7f7fce7fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:16:45.760 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.757+0000 7f7fce7fc640 1 -- 10.20.193.195:0/2126122672 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2733471704 0 0) 0x7f7fe01029b0 con 0x7f7fe011ffc0 2026-02-24T19:16:45.760 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.757+0000 7f7fce7fc640 1 -- 10.20.193.195:0/2126122672 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7fb0003610 con 0x7f7fe011ffc0 2026-02-24T19:16:45.760 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.757+0000 7f7fce7fc640 1 -- 10.20.193.195:0/2126122672 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7fdc003560 con 0x7f7fe011ffc0 2026-02-24T19:16:45.760 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.757+0000 7f7fce7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:45.761 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.757+0000 7f7fce7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:16:45.761 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.757+0000 7f7fce7fc640 10 monclient(hunting): dump: 2026-02-24T19:16:45.761 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:45.761 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:45.761 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:45.761 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:45.761 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:45.761 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:45.761 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:45.761 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:45.761 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:45.761 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:45.761 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.757+0000 7f7fce7fc640 1 -- 10.20.193.195:0/2126122672 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3084136916 0 0) 0x7f7fe010cac0 con 0x7f7fe011e420 2026-02-24T19:16:45.761 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.757+0000 7f7fce7fc640 1 -- 10.20.193.195:0/2126122672 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7fe01029b0 con 0x7f7fe011e420 2026-02-24T19:16:45.761 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.757+0000 7f7fce7fc640 1 -- 10.20.193.195:0/2126122672 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7fd4003060 con 0x7f7fe011e420 2026-02-24T19:16:45.761 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.757+0000 7f7fce7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:45.761 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.757+0000 7f7fce7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:16:45.761 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.757+0000 7f7fce7fc640 10 monclient(hunting): dump: 2026-02-24T19:16:45.761 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:45.761 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:45.761 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:45.761 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:45.761 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:45.761 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:45.761 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:45.761 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:45.761 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:45.762 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:45.762 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.758+0000 7f7fce7fc640 1 -- 10.20.193.195:0/2126122672 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4035437094 0 0) 0x7f7fb0003610 con 0x7f7fe011ffc0 2026-02-24T19:16:45.762 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.758+0000 7f7fce7fc640 1 -- 10.20.193.195:0/2126122672 >> v1:10.20.193.44:6789/0 conn(0x7f7fe011e420 legacy=0x7f7fe018a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:45.762 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.758+0000 7f7fce7fc640 1 -- 10.20.193.195:0/2126122672 >> v1:10.20.193.14:6789/0 conn(0x7f7fe011c500 legacy=0x7f7fe0101f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:45.762 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.758+0000 7f7fce7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:16:45.762 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.758+0000 7f7fce7fc640 1 monclient: found mon.c 2026-02-24T19:16:45.762 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.758+0000 7f7fce7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:45.763 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.758+0000 7f7fce7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:16:45.763 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.758+0000 7f7fce7fc640 1 -- 10.20.193.195:0/2126122672 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe010dca0 con 0x7f7fe011ffc0 2026-02-24T19:16:45.763 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.758+0000 7f7fce7fc640 10 monclient: _finish_auth 0 2026-02-24T19:16:45.763 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.758+0000 7f7fce7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:16:45.763 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.758+0000 7f7fce7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:45.763 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.758+0000 7f7fe7d08640 5 monclient: authenticate success, global_id 4193 2026-02-24T19:16:45.763 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.758+0000 7f7fe7d08640 10 monclient: _renew_subs 2026-02-24T19:16:45.763 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.758+0000 7f7fe7d08640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:16:45.763 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.758+0000 7f7fe7d08640 1 -- 10.20.193.195:0/2126122672 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7fe010cc90 con 0x7f7fe011ffc0 2026-02-24T19:16:45.763 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.758+0000 7f7fe7d08640 10 client.4193.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:16:45.763 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.758+0000 7f7fe7d08640 10 monclient: _renew_subs 2026-02-24T19:16:45.763 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.758+0000 7f7fe7d08640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:16:45.763 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.758+0000 7f7fe7d08640 1 -- 10.20.193.195:0/2126122672 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7fe010d250 con 0x7f7fe011ffc0 2026-02-24T19:16:45.763 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.758+0000 7f7fe7d08640 1 librados: init done 2026-02-24T19:16:45.763 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.759+0000 7f7fe7d08640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:45.763 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.759+0000 7f7fe7d08640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:45.763 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.759+0000 7f7fe7d08640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:16:45.763 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.759+0000 7f7fe7d08640 1 -- 10.20.193.195:0/2126122672 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fe018b560 con 0x7f7fe011ffc0 2026-02-24T19:16:45.768 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.766+0000 7f7fce7fc640 1 -- 10.20.193.195:0/2126122672 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7fdc0032f0 con 0x7f7fe011ffc0 2026-02-24T19:16:45.768 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.766+0000 7f7fce7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:45.768 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.766+0000 7f7fce7fc640 1 -- 10.20.193.195:0/2126122672 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7fdc004fa0 con 0x7f7fe011ffc0 2026-02-24T19:16:45.768 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.766+0000 7f7fce7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:45.768 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.766+0000 7f7fce7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:16:45.768 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.766+0000 7f7fcffff640 4 set_mon_vals no callback set 2026-02-24T19:16:45.768 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.766+0000 7f7fce7fc640 10 monclient: dump: 2026-02-24T19:16:45.768 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:45.768 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:45.768 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:45.768 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:45.769 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:45.769 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:45.769 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:45.769 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:45.769 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:45.769 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:45.769 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.767+0000 7f7fce7fc640 1 -- 10.20.193.195:0/2126122672 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 3) ==== 101401+0+0 (unknown 710223534 0 0) 0x7f7fdc01dd70 con 0x7f7fe011ffc0 2026-02-24T19:16:45.769 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.767+0000 7f7fe5a7d640 10 monclient: get_auth_request con 0x7f7fb0077ca0 auth_method 0 2026-02-24T19:16:45.770 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.768+0000 7f7fce7fc640 10 client.4193.objecter ms_handle_connect 0x7f7fb0077ca0 2026-02-24T19:16:45.853 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.852+0000 7f7fce7fc640 1 -- 10.20.193.195:0/2126122672 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(13..13 src has 1..13) ==== 1985+0+0 (unknown 3383798522 0 0) 0x7f7fdc0596a0 con 0x7f7fe011ffc0 2026-02-24T19:16:45.854 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.852+0000 7f7fce7fc640 10 client.4193.objecter ms_dispatch2 0x7f7fe0000b90 osd_map(13..13 src has 1..13) 2026-02-24T19:16:45.854 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.852+0000 7f7fce7fc640 3 client.4193.objecter handle_osd_map got epochs [13,13] > 0 2026-02-24T19:16:45.854 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.852+0000 7f7fce7fc640 3 client.4193.objecter handle_osd_map decoding full epoch 13 2026-02-24T19:16:45.854 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.852+0000 7f7fce7fc640 20 client.4193.objecter dump_active .. 0 homeless 2026-02-24T19:16:45.854 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.852+0000 7f7fce7fc640 1 -- 10.20.193.195:0/2126122672 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f7fdc05de10 con 0x7f7fe011ffc0 2026-02-24T19:16:45.854 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.852+0000 7f7fce7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:45.854 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.852+0000 7f7fce7fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:16:45.965 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.963+0000 7f7fe7d08640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "253e9d0b-391d-4647-bd89-6ab4b57909aa", "id": 11}] 2026-02-24T19:16:45.965 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.963+0000 7f7fe7d08640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "253e9d0b-391d-4647-bd89-6ab4b57909aa", "id": 11}] 2026-02-24T19:16:45.966 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.963+0000 7f7fe7d08640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:16:45.966 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:45.963+0000 7f7fe7d08640 1 -- 10.20.193.195:0/2126122672 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "osd new", "uuid": "253e9d0b-391d-4647-bd89-6ab4b57909aa", "id": 11} v 0) -- 0x7f7fe010d540 con 0x7f7fe011ffc0 2026-02-24T19:16:46.010 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.009+0000 7f7fce7fc640 1 -- 10.20.193.195:0/2126122672 <== mon.2 v1:10.20.193.170:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "253e9d0b-391d-4647-bd89-6ab4b57909aa", "id": 11}]=0 v14) ==== 113+0+3 (unknown 1155673145 0 212448812) 0x7f7fdc05d710 con 0x7f7fe011ffc0 2026-02-24T19:16:46.010 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.009+0000 7f7fce7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "253e9d0b-391d-4647-bd89-6ab4b57909aa", "id": 11}] 2026-02-24T19:16:46.010 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.009+0000 7f7fce7fc640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:16:46.011 INFO:teuthology.orchestra.run.trial195.stdout:11 2026-02-24T19:16:46.012 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.010+0000 7f7fe7d08640 10 librados: watch_flush enter 2026-02-24T19:16:46.012 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.010+0000 7f7fe7d08640 10 librados: watch_flush exit 2026-02-24T19:16:46.012 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.010+0000 7f7fe7d08640 20 client.4193.objecter shutdown clearing up homeless session... 2026-02-24T19:16:46.012 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.010+0000 7f7fe7d08640 10 client.4193.objecter successfully canceled tick 2026-02-24T19:16:46.012 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.010+0000 7f7fe7d08640 1 -- 10.20.193.195:0/2126122672 >> v1:10.20.193.14:6800/4014096310 conn(0x7f7fb0077ca0 legacy=0x7f7fb0098150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:46.012 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.010+0000 7f7fe7d08640 10 monclient: shutdown 2026-02-24T19:16:46.012 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.010+0000 7f7fe7d08640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:46.012 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.010+0000 7f7fe7d08640 1 -- 10.20.193.195:0/2126122672 >> v1:10.20.193.170:6789/0 conn(0x7f7fe011ffc0 legacy=0x7f7fe018aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:46.012 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.010+0000 7f7fe7d08640 1 -- 10.20.193.195:0/2126122672 shutdown_connections 2026-02-24T19:16:46.013 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.010+0000 7f7fe7d08640 1 -- 10.20.193.195:0/2126122672 >> 10.20.193.195:0/2126122672 conn(0x7f7fe00588d0 msgr2=0x7f7fe00591a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:46.013 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.010+0000 7f7fe7d08640 1 -- 10.20.193.195:0/2126122672 shutdown_connections 2026-02-24T19:16:46.013 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.010+0000 7f7fe7d08640 1 -- 10.20.193.195:0/2126122672 wait complete. 2026-02-24T19:16:46.013 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.010+0000 7f7fe7d08640 1 librados: shutdown 2026-02-24T19:16:46.020 DEBUG:teuthology.orchestra.run.trial195:> sudo ceph --cluster ceph osd new 7b7d5fca-4759-46e5-a681-45509749b265 12 2026-02-24T19:16:46.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.084+0000 7fbaf1e7b640 10 monclient: get_monmap_and_config 2026-02-24T19:16:46.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.084+0000 7fbaf1e7b640 10 monclient: build_initial_monmap 2026-02-24T19:16:46.086 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.084+0000 7fbaf1e7b640 10 monclient: monmap: 2026-02-24T19:16:46.086 INFO:teuthology.orchestra.run.trial195.stderr:epoch 0 2026-02-24T19:16:46.086 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:46.086 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:16:46.085938+0000 2026-02-24T19:16:46.086 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:16:46.085938+0000 2026-02-24T19:16:46.086 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:46.086 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:46.086 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:46.086 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:46.086 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:46.087 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:46.087 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.084+0000 7fbaf1e7b640 1 Processor -- start 2026-02-24T19:16:46.087 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.084+0000 7fbaf1e7b640 1 -- start start 2026-02-24T19:16:46.087 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.084+0000 7fbaf1e7b640 10 monclient: init 2026-02-24T19:16:46.087 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.084+0000 7fbaf1e7b640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:46.087 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.084+0000 7fbaf1e7b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:16:46.087 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.084+0000 7fbaf1e7b640 10 monclient(hunting): picked mon.noname-a con 0x7fbaec05da60 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:46.087 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.084+0000 7fbaf1e7b640 10 monclient(hunting): picked mon.noname-b con 0x7fbaec05df20 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:46.088 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.084+0000 7fbaf1e7b640 10 monclient(hunting): picked mon.noname-c con 0x7fbaec161240 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:46.088 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.084+0000 7fbaf1e7b640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaec182ea0 con 0x7fbaec05da60 2026-02-24T19:16:46.088 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.084+0000 7fbaf1e7b640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaec1840a0 con 0x7fbaec05df20 2026-02-24T19:16:46.088 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.084+0000 7fbaf1e7b640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaec1852a0 con 0x7fbaec161240 2026-02-24T19:16:46.088 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.084+0000 7fbaf1e7b640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:46.088 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.084+0000 7fbaf1e7b640 10 monclient(hunting): authenticate will time out at 3574.720929s 2026-02-24T19:16:46.088 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.085+0000 7fbaebfff640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7fbaec161240 0x7fbaec181620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.195:49230/0 (socket says 10.20.193.195:49230) 2026-02-24T19:16:46.088 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.085+0000 7fbaebfff640 1 -- 10.20.193.195:0/1320928412 learned_addr learned my addr 10.20.193.195:0/1320928412 (peer_addr_for_me v1:10.20.193.195:0/0) 2026-02-24T19:16:46.097 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.095+0000 7fbaea7fc640 1 -- 10.20.193.195:0/1320928412 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2380084327 0 0) 0x7fbaec1840a0 con 0x7fbaec05df20 2026-02-24T19:16:46.097 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.095+0000 7fbaea7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:16:46.097 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.095+0000 7fbaea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:46.097 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.095+0000 7fbaea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:46.097 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.095+0000 7fbaea7fc640 10 monclient(hunting): my global_id is 4186 2026-02-24T19:16:46.097 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.095+0000 7fbaea7fc640 1 -- 10.20.193.195:0/1320928412 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbad00058a0 con 0x7fbaec05df20 2026-02-24T19:16:46.097 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.095+0000 7fbaea7fc640 1 -- 10.20.193.195:0/1320928412 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2627157565 0 0) 0x7fbaec1852a0 con 0x7fbaec161240 2026-02-24T19:16:46.097 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.095+0000 7fbaea7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:16:46.097 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.095+0000 7fbaea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:46.097 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.095+0000 7fbaea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:46.098 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.095+0000 7fbaea7fc640 10 monclient(hunting): my global_id is 4196 2026-02-24T19:16:46.098 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.095+0000 7fbaea7fc640 1 -- 10.20.193.195:0/1320928412 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbaec1840a0 con 0x7fbaec161240 2026-02-24T19:16:46.099 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.096+0000 7fbaea7fc640 1 -- 10.20.193.195:0/1320928412 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1690962463 0 0) 0x7fbad00058a0 con 0x7fbaec05df20 2026-02-24T19:16:46.099 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.096+0000 7fbaea7fc640 1 -- 10.20.193.195:0/1320928412 >> v1:10.20.193.170:6789/0 conn(0x7fbaec161240 legacy=0x7fbaec181620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:46.099 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.096+0000 7fbaea7fc640 1 -- 10.20.193.195:0/1320928412 >> v1:10.20.193.14:6789/0 conn(0x7fbaec05da60 legacy=0x7fbaec05bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:16:46.099 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.096+0000 7fbaea7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:16:46.099 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.096+0000 7fbaea7fc640 1 monclient: found mon.noname-b 2026-02-24T19:16:46.099 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.096+0000 7fbaea7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:46.099 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.096+0000 7fbaea7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.44:6789/0 2026-02-24T19:16:46.099 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.096+0000 7fbaea7fc640 1 -- 10.20.193.195:0/1320928412 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaec186540 con 0x7fbaec05df20 2026-02-24T19:16:46.099 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.096+0000 7fbaea7fc640 10 monclient: _finish_auth 0 2026-02-24T19:16:46.099 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.096+0000 7fbaea7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:16:46.099 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.096+0000 7fbaea7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:46.099 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.096+0000 7fbaea7fc640 1 -- 10.20.193.195:0/1320928412 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fbadc002df0 con 0x7fbaec05df20 2026-02-24T19:16:46.099 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.096+0000 7fbaea7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:46.099 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.096+0000 7fbaea7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:16:46.099 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.096+0000 7fbaea7fc640 10 monclient: dump: 2026-02-24T19:16:46.099 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:46.100 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:46.100 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:46.100 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:46.100 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:46.100 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:46.100 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:46.100 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:46.100 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:46.100 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:46.100 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.097+0000 7fbaf1e7b640 5 monclient: authenticate success, global_id 4186 2026-02-24T19:16:46.100 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.097+0000 7fbaf1e7b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:16:46.101 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.097+0000 7fbaea7fc640 1 -- 10.20.193.195:0/1320928412 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbadc003070 con 0x7fbaec05df20 2026-02-24T19:16:46.101 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.097+0000 7fbaea7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:46.101 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.097+0000 7fbaea7fc640 1 -- 10.20.193.195:0/1320928412 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fbadc0034b0 con 0x7fbaec05df20 2026-02-24T19:16:46.101 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.097+0000 7fbaf1e7b640 10 monclient: get_monmap_and_config success 2026-02-24T19:16:46.101 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.097+0000 7fbaf1e7b640 4 set_mon_vals no callback set 2026-02-24T19:16:46.101 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.097+0000 7fbaea7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:46.101 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.097+0000 7fbaea7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:16:46.101 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.097+0000 7fbaea7fc640 10 monclient: dump: 2026-02-24T19:16:46.101 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:46.101 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:46.102 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:46.102 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:46.102 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:46.102 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:46.102 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:46.102 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:46.102 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:46.102 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:46.102 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.098+0000 7fbaf1e7b640 10 monclient: shutdown 2026-02-24T19:16:46.102 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.098+0000 7fbaf1e7b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:46.102 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.098+0000 7fbaf1e7b640 1 -- 10.20.193.195:0/1320928412 >> v1:10.20.193.44:6789/0 conn(0x7fbaec05df20 legacy=0x7fbaec05c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:46.102 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.098+0000 7fbaf1e7b640 1 -- 10.20.193.195:0/1320928412 shutdown_connections 2026-02-24T19:16:46.102 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.098+0000 7fbaf1e7b640 1 -- 10.20.193.195:0/1320928412 >> 10.20.193.195:0/1320928412 conn(0x7fbaec0588d0 msgr2=0x7fbaec058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:46.102 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.098+0000 7fbaf1e7b640 1 -- 10.20.193.195:0/1320928412 shutdown_connections 2026-02-24T19:16:46.102 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.098+0000 7fbaf1e7b640 1 -- 10.20.193.195:0/1320928412 wait complete. 2026-02-24T19:16:46.102 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.098+0000 7fbaf1e7b640 10 monclient: build_initial_monmap 2026-02-24T19:16:46.102 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.098+0000 7fbaf1e7b640 10 monclient: monmap: 2026-02-24T19:16:46.102 INFO:teuthology.orchestra.run.trial195.stderr:epoch 0 2026-02-24T19:16:46.102 INFO:teuthology.orchestra.run.trial195.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:16:46.102 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 0.000000 2026-02-24T19:16:46.102 INFO:teuthology.orchestra.run.trial195.stderr:created 0.000000 2026-02-24T19:16:46.102 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:46.102 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 1 2026-02-24T19:16:46.102 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:46.102 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:46.102 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:46.103 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:46.103 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.098+0000 7fbaf1e7b640 1 librados: starting msgr at 2026-02-24T19:16:46.103 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.098+0000 7fbaf1e7b640 1 librados: starting objecter 2026-02-24T19:16:46.103 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.098+0000 7fbaf1e7b640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:16:46.103 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.098+0000 7fbaf1e7b640 1 Processor -- start 2026-02-24T19:16:46.103 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.098+0000 7fbaf1e7b640 1 -- start start 2026-02-24T19:16:46.103 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.098+0000 7fbaf1e7b640 1 librados: setting wanted keys 2026-02-24T19:16:46.103 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.098+0000 7fbaf1e7b640 1 librados: calling monclient init 2026-02-24T19:16:46.103 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.098+0000 7fbaf1e7b640 10 monclient: init 2026-02-24T19:16:46.103 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.098+0000 7fbaf1e7b640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:46.103 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.098+0000 7fbaf1e7b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:16:46.103 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.098+0000 7fbaf1e7b640 10 monclient(hunting): picked mon.noname-c con 0x7fbaec05da60 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:46.103 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.098+0000 7fbaf1e7b640 10 monclient(hunting): picked mon.noname-b con 0x7fbaec05df20 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:46.103 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.098+0000 7fbaf1e7b640 10 monclient(hunting): picked mon.noname-a con 0x7fbaec161240 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:46.103 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.098+0000 7fbaf1e7b640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaec14bf20 con 0x7fbaec161240 2026-02-24T19:16:46.103 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.098+0000 7fbaf1e7b640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaec14d100 con 0x7fbaec05df20 2026-02-24T19:16:46.103 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.098+0000 7fbaf1e7b640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaec14e2e0 con 0x7fbaec05da60 2026-02-24T19:16:46.103 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.098+0000 7fbaf1e7b640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:46.103 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.098+0000 7fbaf1e7b640 10 monclient(hunting): authenticate will time out at 3574.734699s 2026-02-24T19:16:46.103 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.098+0000 7fbaeb7fe640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7fbaec05da60 0x7fbaec1026e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.195:49246/0 (socket says 10.20.193.195:49246) 2026-02-24T19:16:46.103 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.098+0000 7fbaeb7fe640 1 -- 10.20.193.195:0/3795374744 learned_addr learned my addr 10.20.193.195:0/3795374744 (peer_addr_for_me v1:10.20.193.195:0/0) 2026-02-24T19:16:46.103 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.099+0000 7fbac7fff640 10 client.?.objecter ms_handle_connect 0x7fbaec05da60 2026-02-24T19:16:46.103 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.099+0000 7fbac7fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:46.103 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.099+0000 7fbac7fff640 10 client.?.objecter ms_handle_connect 0x7fbaec05df20 2026-02-24T19:16:46.103 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.099+0000 7fbac7fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:46.104 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.100+0000 7fbac7fff640 1 -- 10.20.193.195:0/3795374744 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3299150645 0 0) 0x7fbaec14d100 con 0x7fbaec05df20 2026-02-24T19:16:46.104 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.100+0000 7fbac7fff640 10 monclient(hunting): _negotiate 2026-02-24T19:16:46.104 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.100+0000 7fbac7fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:46.104 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.100+0000 7fbac7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:46.104 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.100+0000 7fbac7fff640 10 monclient(hunting): my global_id is 4189 2026-02-24T19:16:46.104 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.100+0000 7fbac7fff640 1 -- 10.20.193.195:0/3795374744 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbabc003610 con 0x7fbaec05df20 2026-02-24T19:16:46.104 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.100+0000 7fbac7fff640 1 -- 10.20.193.195:0/3795374744 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 623273370 0 0) 0x7fbaec14e2e0 con 0x7fbaec05da60 2026-02-24T19:16:46.104 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.100+0000 7fbac7fff640 10 monclient(hunting): _negotiate 2026-02-24T19:16:46.104 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.100+0000 7fbac7fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:46.104 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.100+0000 7fbac7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:46.104 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.100+0000 7fbac7fff640 10 monclient(hunting): my global_id is 4199 2026-02-24T19:16:46.104 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.100+0000 7fbac7fff640 1 -- 10.20.193.195:0/3795374744 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbaec14d100 con 0x7fbaec05da60 2026-02-24T19:16:46.105 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.102+0000 7fbac7fff640 1 -- 10.20.193.195:0/3795374744 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 758010657 0 0) 0x7fbabc003610 con 0x7fbaec05df20 2026-02-24T19:16:46.105 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.102+0000 7fbac7fff640 1 -- 10.20.193.195:0/3795374744 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbaec14e2e0 con 0x7fbaec05df20 2026-02-24T19:16:46.105 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.102+0000 7fbac7fff640 1 -- 10.20.193.195:0/3795374744 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fbadc002d00 con 0x7fbaec05df20 2026-02-24T19:16:46.105 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.102+0000 7fbac7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:46.105 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.102+0000 7fbac7fff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:16:46.105 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.102+0000 7fbac7fff640 10 monclient(hunting): dump: 2026-02-24T19:16:46.105 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:46.105 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:46.105 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:46.105 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:46.105 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:46.105 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:46.106 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:46.106 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:46.106 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:46.106 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:46.106 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.102+0000 7fbac7fff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:16:46.106 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.102+0000 7fbac7fff640 1 -- 10.20.193.195:0/3795374744 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 728402731 0 0) 0x7fbaec14d100 con 0x7fbaec05da60 2026-02-24T19:16:46.106 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.102+0000 7fbac7fff640 1 -- 10.20.193.195:0/3795374744 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbabc003610 con 0x7fbaec05da60 2026-02-24T19:16:46.106 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.102+0000 7fbac7fff640 1 -- 10.20.193.195:0/3795374744 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fbad80040d0 con 0x7fbaec05da60 2026-02-24T19:16:46.106 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.102+0000 7fbac7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:46.106 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.102+0000 7fbac7fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:16:46.106 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.102+0000 7fbac7fff640 10 monclient(hunting): dump: 2026-02-24T19:16:46.106 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:46.106 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:46.106 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:46.106 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:46.106 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:46.106 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:46.106 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:46.106 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:46.106 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:46.106 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:46.107 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.104+0000 7fbac7fff640 1 -- 10.20.193.195:0/3795374744 <== mon.1 v1:10.20.193.44:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1704171970 0 0) 0x7fbaec14e2e0 con 0x7fbaec05df20 2026-02-24T19:16:46.107 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.104+0000 7fbac7fff640 1 -- 10.20.193.195:0/3795374744 >> v1:10.20.193.170:6789/0 conn(0x7fbaec05da60 legacy=0x7fbaec1026e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:46.107 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.104+0000 7fbac7fff640 1 -- 10.20.193.195:0/3795374744 >> v1:10.20.193.14:6789/0 conn(0x7fbaec161240 legacy=0x7fbaec14a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:46.107 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.104+0000 7fbac7fff640 10 monclient: _finish_hunting 0 2026-02-24T19:16:46.107 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.104+0000 7fbac7fff640 1 monclient: found mon.b 2026-02-24T19:16:46.107 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.104+0000 7fbac7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:46.107 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.104+0000 7fbac7fff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:16:46.107 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.104+0000 7fbac7fff640 1 -- 10.20.193.195:0/3795374744 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaec14f4c0 con 0x7fbaec05df20 2026-02-24T19:16:46.107 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.104+0000 7fbac7fff640 10 monclient: _finish_auth 0 2026-02-24T19:16:46.108 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.104+0000 7fbac7fff640 10 monclient: _check_auth_tickets 2026-02-24T19:16:46.108 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.104+0000 7fbac7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:46.108 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.104+0000 7fbaf1e7b640 5 monclient: authenticate success, global_id 4189 2026-02-24T19:16:46.108 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.104+0000 7fbaf1e7b640 10 monclient: _renew_subs 2026-02-24T19:16:46.108 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.104+0000 7fbaf1e7b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:16:46.108 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.104+0000 7fbaf1e7b640 1 -- 10.20.193.195:0/3795374744 --> v1:10.20.193.44:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbaec14d2d0 con 0x7fbaec05df20 2026-02-24T19:16:46.108 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.104+0000 7fbaf1e7b640 10 client.4189.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:16:46.108 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.104+0000 7fbaf1e7b640 10 monclient: _renew_subs 2026-02-24T19:16:46.108 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.104+0000 7fbaf1e7b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:16:46.108 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.104+0000 7fbaf1e7b640 1 -- 10.20.193.195:0/3795374744 --> v1:10.20.193.44:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fbaec14d890 con 0x7fbaec05df20 2026-02-24T19:16:46.108 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.104+0000 7fbaf1e7b640 1 librados: init done 2026-02-24T19:16:46.108 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.104+0000 7fbaf1e7b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:46.108 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.104+0000 7fbaf1e7b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:46.108 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.104+0000 7fbaf1e7b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:16:46.108 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.104+0000 7fbaf1e7b640 1 -- 10.20.193.195:0/3795374744 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaec1847a0 con 0x7fbaec05df20 2026-02-24T19:16:46.196 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.194+0000 7fbac7fff640 1 -- 10.20.193.195:0/3795374744 <== mon.1 v1:10.20.193.44:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbadc002ff0 con 0x7fbaec05df20 2026-02-24T19:16:46.196 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.194+0000 7fbac7fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:46.196 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.194+0000 7fbac7fff640 1 -- 10.20.193.195:0/3795374744 <== mon.1 v1:10.20.193.44:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fbadc003bf0 con 0x7fbaec05df20 2026-02-24T19:16:46.196 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.194+0000 7fbac7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:46.197 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.194+0000 7fbac7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:16:46.197 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.194+0000 7fbac7fff640 10 monclient: dump: 2026-02-24T19:16:46.197 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:46.197 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:46.197 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:46.197 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:46.197 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:46.197 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:46.197 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:46.197 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:46.197 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:46.198 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:46.198 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.194+0000 7fbae9ffb640 4 set_mon_vals no callback set 2026-02-24T19:16:46.198 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.194+0000 7fbac7fff640 1 -- 10.20.193.195:0/3795374744 <== mon.1 v1:10.20.193.44:6789/0 7 ==== mgrmap(e 3) ==== 101401+0+0 (unknown 710223534 0 0) 0x7fbadc01c9c0 con 0x7fbaec05df20 2026-02-24T19:16:46.198 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.195+0000 7fbaeb7fe640 10 monclient: get_auth_request con 0x7fbabc077a80 auth_method 0 2026-02-24T19:16:46.199 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.195+0000 7fbac7fff640 10 client.4189.objecter ms_handle_connect 0x7fbabc077a80 2026-02-24T19:16:46.200 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.198+0000 7fbac7fff640 1 -- 10.20.193.195:0/3795374744 <== mon.1 v1:10.20.193.44:6789/0 8 ==== osd_map(14..14 src has 1..14) ==== 2100+0+0 (unknown 2322386345 0 0) 0x7fbadc058300 con 0x7fbaec05df20 2026-02-24T19:16:46.200 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.198+0000 7fbac7fff640 10 client.4189.objecter ms_dispatch2 0x7fbaec000b90 osd_map(14..14 src has 1..14) 2026-02-24T19:16:46.200 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.198+0000 7fbac7fff640 3 client.4189.objecter handle_osd_map got epochs [14,14] > 0 2026-02-24T19:16:46.201 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.198+0000 7fbac7fff640 3 client.4189.objecter handle_osd_map decoding full epoch 14 2026-02-24T19:16:46.201 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.198+0000 7fbac7fff640 20 client.4189.objecter dump_active .. 0 homeless 2026-02-24T19:16:46.201 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.198+0000 7fbac7fff640 1 -- 10.20.193.195:0/3795374744 <== mon.1 v1:10.20.193.44:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fbadc05ca70 con 0x7fbaec05df20 2026-02-24T19:16:46.201 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.198+0000 7fbac7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:46.201 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.198+0000 7fbac7fff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:16:46.313 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.310+0000 7fbaf1e7b640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "7b7d5fca-4759-46e5-a681-45509749b265", "id": 12}] 2026-02-24T19:16:46.313 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.310+0000 7fbaf1e7b640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "7b7d5fca-4759-46e5-a681-45509749b265", "id": 12}] 2026-02-24T19:16:46.313 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.310+0000 7fbaf1e7b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:16:46.313 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.310+0000 7fbaf1e7b640 1 -- 10.20.193.195:0/3795374744 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "osd new", "uuid": "7b7d5fca-4759-46e5-a681-45509749b265", "id": 12} v 0) -- 0x7fbaec14db80 con 0x7fbaec05df20 2026-02-24T19:16:46.386 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.384+0000 7fbac7fff640 1 -- 10.20.193.195:0/3795374744 <== mon.1 v1:10.20.193.44:6789/0 10 ==== mgrmap(e 4) ==== 101507+0+0 (unknown 1883626494 0 0) 0x7fbadc05bc30 con 0x7fbaec05df20 2026-02-24T19:16:46.460 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.458+0000 7fbac7fff640 1 -- 10.20.193.195:0/3795374744 <== mon.1 v1:10.20.193.44:6789/0 11 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7b7d5fca-4759-46e5-a681-45509749b265", "id": 12}]=0 v15) ==== 113+0+3 (unknown 1639187749 0 944643765) 0x7fbadc0463e0 con 0x7fbaec05df20 2026-02-24T19:16:46.460 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.458+0000 7fbac7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "7b7d5fca-4759-46e5-a681-45509749b265", "id": 12}] 2026-02-24T19:16:46.460 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.458+0000 7fbac7fff640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:16:46.460 INFO:teuthology.orchestra.run.trial195.stdout:12 2026-02-24T19:16:46.463 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.460+0000 7fbaf1e7b640 10 librados: watch_flush enter 2026-02-24T19:16:46.463 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.460+0000 7fbaf1e7b640 10 librados: watch_flush exit 2026-02-24T19:16:46.463 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.460+0000 7fbaf1e7b640 20 client.4189.objecter shutdown clearing up homeless session... 2026-02-24T19:16:46.463 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.460+0000 7fbaf1e7b640 10 client.4189.objecter successfully canceled tick 2026-02-24T19:16:46.464 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.460+0000 7fbaf1e7b640 1 -- 10.20.193.195:0/3795374744 >> v1:10.20.193.14:6800/4014096310 conn(0x7fbabc077a80 legacy=0x7fbabc097f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:46.464 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.460+0000 7fbaf1e7b640 10 monclient: shutdown 2026-02-24T19:16:46.464 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.460+0000 7fbaf1e7b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:46.464 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.460+0000 7fbaf1e7b640 1 -- 10.20.193.195:0/3795374744 >> v1:10.20.193.44:6789/0 conn(0x7fbaec05df20 legacy=0x7fbaec1490e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:46.464 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.460+0000 7fbaf1e7b640 1 -- 10.20.193.195:0/3795374744 shutdown_connections 2026-02-24T19:16:46.464 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.460+0000 7fbaf1e7b640 1 -- 10.20.193.195:0/3795374744 >> 10.20.193.195:0/3795374744 conn(0x7fbaec0588d0 msgr2=0x7fbaec181620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:46.464 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.460+0000 7fbaf1e7b640 1 -- 10.20.193.195:0/3795374744 shutdown_connections 2026-02-24T19:16:46.464 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.460+0000 7fbaf1e7b640 1 -- 10.20.193.195:0/3795374744 wait complete. 2026-02-24T19:16:46.464 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.460+0000 7fbaf1e7b640 1 librados: shutdown 2026-02-24T19:16:46.473 DEBUG:teuthology.orchestra.run.trial195:> sudo ceph --cluster ceph osd new 8d1f12c8-5787-425d-a4a6-ac820bbf6e8b 13 2026-02-24T19:16:46.539 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.537+0000 7f590c6e8640 10 monclient: get_monmap_and_config 2026-02-24T19:16:46.539 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.537+0000 7f590c6e8640 10 monclient: build_initial_monmap 2026-02-24T19:16:46.540 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.537+0000 7f590c6e8640 10 monclient: monmap: 2026-02-24T19:16:46.540 INFO:teuthology.orchestra.run.trial195.stderr:epoch 0 2026-02-24T19:16:46.540 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:46.540 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:16:46.539006+0000 2026-02-24T19:16:46.540 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:16:46.539006+0000 2026-02-24T19:16:46.540 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:46.540 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:46.540 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:46.540 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:46.540 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:46.540 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:46.543 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.537+0000 7f590c6e8640 1 Processor -- start 2026-02-24T19:16:46.543 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.537+0000 7f590c6e8640 1 -- start start 2026-02-24T19:16:46.543 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.537+0000 7f590c6e8640 10 monclient: init 2026-02-24T19:16:46.543 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.537+0000 7f590c6e8640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:46.543 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.537+0000 7f590c6e8640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:16:46.543 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.537+0000 7f590c6e8640 10 monclient(hunting): picked mon.noname-b con 0x7f590411e790 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:46.543 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.537+0000 7f590c6e8640 10 monclient(hunting): picked mon.noname-a con 0x7f59041406c0 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:46.543 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.537+0000 7f590c6e8640 10 monclient(hunting): picked mon.noname-c con 0x7f5904162250 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:46.543 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.537+0000 7f590c6e8640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5904183fe0 con 0x7f59041406c0 2026-02-24T19:16:46.543 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.537+0000 7f590c6e8640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59041851e0 con 0x7f590411e790 2026-02-24T19:16:46.544 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.538+0000 7f590c6e8640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59041863e0 con 0x7f5904162250 2026-02-24T19:16:46.544 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.538+0000 7f590c6e8640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:46.544 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.538+0000 7f590c6e8640 10 monclient(hunting): authenticate will time out at 3575.174008s 2026-02-24T19:16:46.544 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.538+0000 7f590ac5e640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7f5904162250 0x7f59041826e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.195:49252/0 (socket says 10.20.193.195:49252) 2026-02-24T19:16:46.544 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.538+0000 7f590ac5e640 1 -- 10.20.193.195:0/122670112 learned_addr learned my addr 10.20.193.195:0/122670112 (peer_addr_for_me v1:10.20.193.195:0/0) 2026-02-24T19:16:46.544 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.539+0000 7f590945b640 1 -- 10.20.193.195:0/122670112 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3543144383 0 0) 0x7f59041863e0 con 0x7f5904162250 2026-02-24T19:16:46.544 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.539+0000 7f590945b640 10 monclient(hunting): _negotiate 2026-02-24T19:16:46.544 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.539+0000 7f590945b640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:46.544 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.539+0000 7f590945b640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:46.544 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.539+0000 7f590945b640 10 monclient(hunting): my global_id is 4202 2026-02-24T19:16:46.544 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.539+0000 7f590945b640 1 -- 10.20.193.195:0/122670112 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58ec003610 con 0x7f5904162250 2026-02-24T19:16:46.544 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.539+0000 7f590945b640 1 -- 10.20.193.195:0/122670112 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3301499619 0 0) 0x7f5904183fe0 con 0x7f59041406c0 2026-02-24T19:16:46.544 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.539+0000 7f590945b640 10 monclient(hunting): _negotiate 2026-02-24T19:16:46.545 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.539+0000 7f590945b640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:46.545 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.539+0000 7f590945b640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:46.545 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.539+0000 7f590945b640 10 monclient(hunting): my global_id is 4197 2026-02-24T19:16:46.545 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.539+0000 7f590945b640 1 -- 10.20.193.195:0/122670112 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59041863e0 con 0x7f59041406c0 2026-02-24T19:16:46.545 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.539+0000 7f590945b640 1 -- 10.20.193.195:0/122670112 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3878157878 0 0) 0x7f59041851e0 con 0x7f590411e790 2026-02-24T19:16:46.545 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.539+0000 7f590945b640 10 monclient(hunting): _negotiate 2026-02-24T19:16:46.545 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.539+0000 7f590945b640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:46.545 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.539+0000 7f590945b640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:46.545 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.539+0000 7f590945b640 10 monclient(hunting): my global_id is 4192 2026-02-24T19:16:46.545 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.539+0000 7f590945b640 1 -- 10.20.193.195:0/122670112 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5904183fe0 con 0x7f590411e790 2026-02-24T19:16:46.551 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.541+0000 7f590945b640 1 -- 10.20.193.195:0/122670112 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2642245726 0 0) 0x7f58ec003610 con 0x7f5904162250 2026-02-24T19:16:46.551 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.541+0000 7f590945b640 1 -- 10.20.193.195:0/122670112 >> v1:10.20.193.44:6789/0 conn(0x7f590411e790 legacy=0x7f590411eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:46.551 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.541+0000 7f590945b640 1 -- 10.20.193.195:0/122670112 >> v1:10.20.193.14:6789/0 conn(0x7f59041406c0 legacy=0x7f5904160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:46.551 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.541+0000 7f590945b640 10 monclient: _finish_hunting 0 2026-02-24T19:16:46.552 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.541+0000 7f590945b640 1 monclient: found mon.noname-c 2026-02-24T19:16:46.552 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.541+0000 7f590945b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:46.552 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.541+0000 7f590945b640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.170:6789/0 2026-02-24T19:16:46.552 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.541+0000 7f590945b640 1 -- 10.20.193.195:0/122670112 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5904187680 con 0x7f5904162250 2026-02-24T19:16:46.552 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.541+0000 7f590945b640 10 monclient: _finish_auth 0 2026-02-24T19:16:46.552 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.541+0000 7f590945b640 10 monclient: _check_auth_tickets 2026-02-24T19:16:46.552 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.541+0000 7f590945b640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:46.552 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.541+0000 7f590945b640 1 -- 10.20.193.195:0/122670112 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5900003170 con 0x7f5904162250 2026-02-24T19:16:46.552 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.541+0000 7f590945b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:46.552 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.541+0000 7f590945b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:16:46.552 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.541+0000 7f590945b640 10 monclient: dump: 2026-02-24T19:16:46.552 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:46.552 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:46.552 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:46.552 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:46.552 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:46.552 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:46.552 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:46.552 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:46.553 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:46.553 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:46.553 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.541+0000 7f590c6e8640 5 monclient: authenticate success, global_id 4202 2026-02-24T19:16:46.553 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.541+0000 7f590c6e8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:16:46.553 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.542+0000 7f590945b640 1 -- 10.20.193.195:0/122670112 <== mon.2 v1:10.20.193.170:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f59000033b0 con 0x7f5904162250 2026-02-24T19:16:46.553 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.542+0000 7f590945b640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:46.553 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.542+0000 7f590945b640 1 -- 10.20.193.195:0/122670112 <== mon.2 v1:10.20.193.170:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f59000037f0 con 0x7f5904162250 2026-02-24T19:16:46.553 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.542+0000 7f590c6e8640 10 monclient: get_monmap_and_config success 2026-02-24T19:16:46.553 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.542+0000 7f590c6e8640 4 set_mon_vals no callback set 2026-02-24T19:16:46.553 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.542+0000 7f590945b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:46.553 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.542+0000 7f590945b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:16:46.553 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.542+0000 7f590945b640 10 monclient: dump: 2026-02-24T19:16:46.553 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:46.553 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:46.553 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:46.553 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:46.553 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:46.553 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:46.553 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:46.554 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:46.554 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:46.554 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:46.554 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.542+0000 7f590c6e8640 10 monclient: shutdown 2026-02-24T19:16:46.554 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.542+0000 7f590c6e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:46.554 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.542+0000 7f590c6e8640 1 -- 10.20.193.195:0/122670112 >> v1:10.20.193.170:6789/0 conn(0x7f5904162250 legacy=0x7f59041826e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:46.554 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.542+0000 7f590c6e8640 1 -- 10.20.193.195:0/122670112 shutdown_connections 2026-02-24T19:16:46.554 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.542+0000 7f590c6e8640 1 -- 10.20.193.195:0/122670112 >> 10.20.193.195:0/122670112 conn(0x7f59040588d0 msgr2=0x7f5904058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:46.554 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.542+0000 7f590c6e8640 1 -- 10.20.193.195:0/122670112 shutdown_connections 2026-02-24T19:16:46.554 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.542+0000 7f590c6e8640 1 -- 10.20.193.195:0/122670112 wait complete. 2026-02-24T19:16:46.554 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.542+0000 7f590c6e8640 10 monclient: build_initial_monmap 2026-02-24T19:16:46.554 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.542+0000 7f590c6e8640 10 monclient: monmap: 2026-02-24T19:16:46.554 INFO:teuthology.orchestra.run.trial195.stderr:epoch 0 2026-02-24T19:16:46.554 INFO:teuthology.orchestra.run.trial195.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:16:46.554 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 0.000000 2026-02-24T19:16:46.554 INFO:teuthology.orchestra.run.trial195.stderr:created 0.000000 2026-02-24T19:16:46.554 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:46.554 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 1 2026-02-24T19:16:46.554 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:46.554 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:46.555 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:46.555 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:46.555 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.542+0000 7f590c6e8640 1 librados: starting msgr at 2026-02-24T19:16:46.555 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.542+0000 7f590c6e8640 1 librados: starting objecter 2026-02-24T19:16:46.555 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.542+0000 7f590c6e8640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:16:46.555 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.542+0000 7f590c6e8640 1 Processor -- start 2026-02-24T19:16:46.555 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.542+0000 7f590c6e8640 1 -- start start 2026-02-24T19:16:46.555 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.543+0000 7f590c6e8640 1 librados: setting wanted keys 2026-02-24T19:16:46.555 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.543+0000 7f590c6e8640 1 librados: calling monclient init 2026-02-24T19:16:46.555 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.543+0000 7f590c6e8640 10 monclient: init 2026-02-24T19:16:46.555 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.543+0000 7f590c6e8640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:46.555 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.543+0000 7f590c6e8640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:16:46.555 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.543+0000 7f590c6e8640 10 monclient(hunting): picked mon.noname-a con 0x7f590411e790 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:46.555 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.543+0000 7f590c6e8640 10 monclient(hunting): picked mon.noname-b con 0x7f59041406c0 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:46.555 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.543+0000 7f590c6e8640 10 monclient(hunting): picked mon.noname-c con 0x7f5904162250 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:46.555 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.543+0000 7f590c6e8640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f590412e790 con 0x7f590411e790 2026-02-24T19:16:46.555 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.543+0000 7f590c6e8640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f590412f990 con 0x7f59041406c0 2026-02-24T19:16:46.555 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.543+0000 7f590c6e8640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5904130b90 con 0x7f5904162250 2026-02-24T19:16:46.555 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.543+0000 7f590c6e8640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:46.555 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.543+0000 7f590c6e8640 10 monclient(hunting): authenticate will time out at 3575.179166s 2026-02-24T19:16:46.556 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.543+0000 7f590ac5e640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7f5904162250 0x7f590412cef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.195:49268/0 (socket says 10.20.193.195:49268) 2026-02-24T19:16:46.556 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.543+0000 7f590ac5e640 1 -- 10.20.193.195:0/4129581638 learned_addr learned my addr 10.20.193.195:0/4129581638 (peer_addr_for_me v1:10.20.193.195:0/0) 2026-02-24T19:16:46.556 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.543+0000 7f58eaffd640 10 client.?.objecter ms_handle_connect 0x7f5904162250 2026-02-24T19:16:46.556 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.543+0000 7f58eaffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:46.556 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.543+0000 7f58eaffd640 10 client.?.objecter ms_handle_connect 0x7f590411e790 2026-02-24T19:16:46.556 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.543+0000 7f58eaffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:46.556 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.543+0000 7f58eaffd640 10 client.?.objecter ms_handle_connect 0x7f59041406c0 2026-02-24T19:16:46.556 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.543+0000 7f58eaffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:46.556 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.544+0000 7f58eaffd640 1 -- 10.20.193.195:0/4129581638 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3634362764 0 0) 0x7f5904130b90 con 0x7f5904162250 2026-02-24T19:16:46.556 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.544+0000 7f58eaffd640 10 monclient(hunting): _negotiate 2026-02-24T19:16:46.556 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.544+0000 7f58eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:46.556 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.544+0000 7f58eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:46.556 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.544+0000 7f58eaffd640 10 monclient(hunting): my global_id is 4205 2026-02-24T19:16:46.556 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.544+0000 7f58eaffd640 1 -- 10.20.193.195:0/4129581638 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58d4003610 con 0x7f5904162250 2026-02-24T19:16:46.556 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.544+0000 7f58eaffd640 1 -- 10.20.193.195:0/4129581638 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 53517526 0 0) 0x7f590412f990 con 0x7f59041406c0 2026-02-24T19:16:46.556 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.544+0000 7f58eaffd640 10 monclient(hunting): _negotiate 2026-02-24T19:16:46.556 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.544+0000 7f58eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:46.556 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.544+0000 7f58eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:46.556 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.544+0000 7f58eaffd640 10 monclient(hunting): my global_id is 4195 2026-02-24T19:16:46.556 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.544+0000 7f58eaffd640 1 -- 10.20.193.195:0/4129581638 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5904130b90 con 0x7f59041406c0 2026-02-24T19:16:46.557 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.545+0000 7f58eaffd640 1 -- 10.20.193.195:0/4129581638 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1543152163 0 0) 0x7f590412e790 con 0x7f590411e790 2026-02-24T19:16:46.557 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.545+0000 7f58eaffd640 10 monclient(hunting): _negotiate 2026-02-24T19:16:46.557 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.545+0000 7f58eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:46.557 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.545+0000 7f58eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:46.557 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.545+0000 7f58eaffd640 10 monclient(hunting): my global_id is 4200 2026-02-24T19:16:46.557 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.545+0000 7f58eaffd640 1 -- 10.20.193.195:0/4129581638 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f590412f990 con 0x7f590411e790 2026-02-24T19:16:46.557 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.547+0000 7f58eaffd640 1 -- 10.20.193.195:0/4129581638 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3233362062 0 0) 0x7f58d4003610 con 0x7f5904162250 2026-02-24T19:16:46.557 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.547+0000 7f58eaffd640 1 -- 10.20.193.195:0/4129581638 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f590412e790 con 0x7f5904162250 2026-02-24T19:16:46.557 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.547+0000 7f58eaffd640 1 -- 10.20.193.195:0/4129581638 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5900003560 con 0x7f5904162250 2026-02-24T19:16:46.557 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.547+0000 7f58eaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:46.557 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.547+0000 7f58eaffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:16:46.557 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.547+0000 7f58eaffd640 10 monclient(hunting): dump: 2026-02-24T19:16:46.557 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:46.557 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:46.557 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:46.557 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:46.557 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:46.557 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:46.557 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:46.557 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:46.557 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:46.558 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:46.558 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.547+0000 7f58eaffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:16:46.558 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.547+0000 7f58eaffd640 1 -- 10.20.193.195:0/4129581638 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3744654369 0 0) 0x7f5904130b90 con 0x7f59041406c0 2026-02-24T19:16:46.558 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.547+0000 7f58eaffd640 1 -- 10.20.193.195:0/4129581638 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f58d4003610 con 0x7f59041406c0 2026-02-24T19:16:46.558 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.547+0000 7f58eaffd640 1 -- 10.20.193.195:0/4129581638 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f58f80030b0 con 0x7f59041406c0 2026-02-24T19:16:46.558 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.547+0000 7f58eaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:46.558 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.547+0000 7f58eaffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:16:46.558 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.547+0000 7f58eaffd640 10 monclient(hunting): dump: 2026-02-24T19:16:46.558 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:46.558 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:46.558 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:46.558 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:46.558 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:46.558 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:46.558 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:46.558 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:46.558 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:46.558 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:46.558 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.547+0000 7f58eaffd640 1 -- 10.20.193.195:0/4129581638 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1964347029 0 0) 0x7f590412f990 con 0x7f590411e790 2026-02-24T19:16:46.559 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.547+0000 7f58eaffd640 1 -- 10.20.193.195:0/4129581638 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5904130b90 con 0x7f590411e790 2026-02-24T19:16:46.559 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.547+0000 7f58eaffd640 1 -- 10.20.193.195:0/4129581638 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f58f4003060 con 0x7f590411e790 2026-02-24T19:16:46.559 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.547+0000 7f58eaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:46.559 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.547+0000 7f58eaffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:16:46.559 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.547+0000 7f58eaffd640 10 monclient(hunting): dump: 2026-02-24T19:16:46.559 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:46.559 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:46.559 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:46.559 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:46.559 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:46.559 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:46.559 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:46.559 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:46.559 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:46.559 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:46.559 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.548+0000 7f58eaffd640 1 -- 10.20.193.195:0/4129581638 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3174715559 0 0) 0x7f590412e790 con 0x7f5904162250 2026-02-24T19:16:46.559 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.548+0000 7f58eaffd640 1 -- 10.20.193.195:0/4129581638 >> v1:10.20.193.44:6789/0 conn(0x7f59041406c0 legacy=0x7f5904160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:46.559 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.548+0000 7f58eaffd640 1 -- 10.20.193.195:0/4129581638 >> v1:10.20.193.14:6789/0 conn(0x7f590411e790 legacy=0x7f59041826c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:46.559 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.548+0000 7f58eaffd640 10 monclient: _finish_hunting 0 2026-02-24T19:16:46.559 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.548+0000 7f58eaffd640 1 monclient: found mon.c 2026-02-24T19:16:46.559 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.548+0000 7f58eaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:46.560 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.548+0000 7f58eaffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:16:46.560 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.548+0000 7f58eaffd640 1 -- 10.20.193.195:0/4129581638 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5904131e30 con 0x7f5904162250 2026-02-24T19:16:46.560 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.548+0000 7f58eaffd640 10 monclient: _finish_auth 0 2026-02-24T19:16:46.560 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.548+0000 7f58eaffd640 10 monclient: _check_auth_tickets 2026-02-24T19:16:46.560 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.548+0000 7f58eaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:46.560 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.548+0000 7f590c6e8640 5 monclient: authenticate success, global_id 4205 2026-02-24T19:16:46.560 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.548+0000 7f590c6e8640 10 monclient: _renew_subs 2026-02-24T19:16:46.560 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.548+0000 7f590c6e8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:16:46.560 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.548+0000 7f590c6e8640 1 -- 10.20.193.195:0/4129581638 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f590412e9c0 con 0x7f5904162250 2026-02-24T19:16:46.560 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.548+0000 7f590c6e8640 10 client.4205.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:16:46.560 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.548+0000 7f590c6e8640 10 monclient: _renew_subs 2026-02-24T19:16:46.560 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.548+0000 7f590c6e8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:16:46.560 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.548+0000 7f590c6e8640 1 -- 10.20.193.195:0/4129581638 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f590412f000 con 0x7f5904162250 2026-02-24T19:16:46.560 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.548+0000 7f590c6e8640 1 librados: init done 2026-02-24T19:16:46.560 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.549+0000 7f590c6e8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:46.560 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.549+0000 7f590c6e8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:46.560 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.549+0000 7f590c6e8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:16:46.560 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.549+0000 7f590c6e8640 1 -- 10.20.193.195:0/4129581638 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5904184540 con 0x7f5904162250 2026-02-24T19:16:46.561 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.553+0000 7f58eaffd640 1 -- 10.20.193.195:0/4129581638 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5900003870 con 0x7f5904162250 2026-02-24T19:16:46.561 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.553+0000 7f58eaffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:46.561 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.553+0000 7f58eaffd640 1 -- 10.20.193.195:0/4129581638 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5900005060 con 0x7f5904162250 2026-02-24T19:16:46.561 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.553+0000 7f58eaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:46.561 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.553+0000 7f58eaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:16:46.561 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.553+0000 7f58eaffd640 10 monclient: dump: 2026-02-24T19:16:46.562 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:46.562 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:46.562 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:46.562 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:46.562 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:46.562 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:46.562 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:46.562 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:46.562 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:46.562 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:46.562 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.553+0000 7f5908c5a640 4 set_mon_vals no callback set 2026-02-24T19:16:46.562 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.557+0000 7f58eaffd640 1 -- 10.20.193.195:0/4129581638 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 4) ==== 101507+0+0 (unknown 1883626494 0 0) 0x7f590001dcf0 con 0x7f5904162250 2026-02-24T19:16:46.562 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.557+0000 7f590a45d640 10 monclient: get_auth_request con 0x7f58d4077cf0 auth_method 0 2026-02-24T19:16:46.562 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.558+0000 7f58eaffd640 10 client.4205.objecter ms_handle_connect 0x7f58d4077cf0 2026-02-24T19:16:46.562 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.558+0000 7f58eaffd640 1 -- 10.20.193.195:0/4129581638 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(15..15 src has 1..15) ==== 2215+0+0 (unknown 3076513146 0 0) 0x7f59000596e0 con 0x7f5904162250 2026-02-24T19:16:46.562 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.558+0000 7f58eaffd640 10 client.4205.objecter ms_dispatch2 0x7f5904000b90 osd_map(15..15 src has 1..15) 2026-02-24T19:16:46.562 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.558+0000 7f58eaffd640 3 client.4205.objecter handle_osd_map got epochs [15,15] > 0 2026-02-24T19:16:46.562 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.558+0000 7f58eaffd640 3 client.4205.objecter handle_osd_map decoding full epoch 15 2026-02-24T19:16:46.562 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.558+0000 7f58eaffd640 20 client.4205.objecter dump_active .. 0 homeless 2026-02-24T19:16:46.643 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.642+0000 7f58eaffd640 1 -- 10.20.193.195:0/4129581638 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f590005de50 con 0x7f5904162250 2026-02-24T19:16:46.643 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.642+0000 7f58eaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:46.643 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.642+0000 7f58eaffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:16:46.752 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.750+0000 7f590c6e8640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "8d1f12c8-5787-425d-a4a6-ac820bbf6e8b", "id": 13}] 2026-02-24T19:16:46.753 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.750+0000 7f590c6e8640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "8d1f12c8-5787-425d-a4a6-ac820bbf6e8b", "id": 13}] 2026-02-24T19:16:46.753 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.750+0000 7f590c6e8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:16:46.753 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.750+0000 7f590c6e8640 1 -- 10.20.193.195:0/4129581638 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "osd new", "uuid": "8d1f12c8-5787-425d-a4a6-ac820bbf6e8b", "id": 13} v 0) -- 0x7f590412f340 con 0x7f5904162250 2026-02-24T19:16:46.797 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.795+0000 7f58eaffd640 1 -- 10.20.193.195:0/4129581638 <== mon.2 v1:10.20.193.170:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8d1f12c8-5787-425d-a4a6-ac820bbf6e8b", "id": 13}]=0 v16) ==== 113+0+3 (unknown 957838359 0 736921282) 0x7f5900067020 con 0x7f5904162250 2026-02-24T19:16:46.797 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.795+0000 7f58eaffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "8d1f12c8-5787-425d-a4a6-ac820bbf6e8b", "id": 13}] 2026-02-24T19:16:46.797 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.795+0000 7f58eaffd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:16:46.797 INFO:teuthology.orchestra.run.trial195.stdout:13 2026-02-24T19:16:46.799 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.796+0000 7f590c6e8640 10 librados: watch_flush enter 2026-02-24T19:16:46.799 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.796+0000 7f590c6e8640 10 librados: watch_flush exit 2026-02-24T19:16:46.799 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.796+0000 7f590c6e8640 20 client.4205.objecter shutdown clearing up homeless session... 2026-02-24T19:16:46.799 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.796+0000 7f590c6e8640 10 client.4205.objecter successfully canceled tick 2026-02-24T19:16:46.799 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.796+0000 7f590c6e8640 1 -- 10.20.193.195:0/4129581638 >> v1:10.20.193.14:6800/4014096310 conn(0x7f58d4077cf0 legacy=0x7f58d40981a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:46.799 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.796+0000 7f590c6e8640 10 monclient: shutdown 2026-02-24T19:16:46.799 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.796+0000 7f590c6e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:46.799 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.796+0000 7f590c6e8640 1 -- 10.20.193.195:0/4129581638 >> v1:10.20.193.170:6789/0 conn(0x7f5904162250 legacy=0x7f590412cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:46.799 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.796+0000 7f590c6e8640 1 -- 10.20.193.195:0/4129581638 shutdown_connections 2026-02-24T19:16:46.799 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.796+0000 7f590c6e8640 1 -- 10.20.193.195:0/4129581638 >> 10.20.193.195:0/4129581638 conn(0x7f59040588d0 msgr2=0x7f5904182eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:46.799 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.796+0000 7f590c6e8640 1 -- 10.20.193.195:0/4129581638 shutdown_connections 2026-02-24T19:16:46.799 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.796+0000 7f590c6e8640 1 -- 10.20.193.195:0/4129581638 wait complete. 2026-02-24T19:16:46.799 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.797+0000 7f590c6e8640 1 librados: shutdown 2026-02-24T19:16:46.809 DEBUG:teuthology.orchestra.run.trial195:> sudo ceph --cluster ceph osd new 866643a2-5f54-425c-b5ec-70607e191f02 14 2026-02-24T19:16:46.874 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.871+0000 7f5bd4bbe640 10 monclient: get_monmap_and_config 2026-02-24T19:16:46.874 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.871+0000 7f5bd4bbe640 10 monclient: build_initial_monmap 2026-02-24T19:16:46.874 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.871+0000 7f5bd4bbe640 10 monclient: monmap: 2026-02-24T19:16:46.874 INFO:teuthology.orchestra.run.trial195.stderr:epoch 0 2026-02-24T19:16:46.874 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:46.874 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:16:46.873540+0000 2026-02-24T19:16:46.874 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:16:46.873540+0000 2026-02-24T19:16:46.874 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:46.874 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:46.874 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:46.874 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:46.874 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:46.874 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:46.875 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.872+0000 7f5bd4bbe640 1 Processor -- start 2026-02-24T19:16:46.875 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.872+0000 7f5bd4bbe640 1 -- start start 2026-02-24T19:16:46.876 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.872+0000 7f5bd4bbe640 10 monclient: init 2026-02-24T19:16:46.876 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.872+0000 7f5bd4bbe640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:46.876 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.872+0000 7f5bd4bbe640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:16:46.876 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.872+0000 7f5bd4bbe640 10 monclient(hunting): picked mon.noname-c con 0x7f5bd005da60 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:46.876 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.872+0000 7f5bd4bbe640 10 monclient(hunting): picked mon.noname-b con 0x7f5bd005df20 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:46.876 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.872+0000 7f5bd4bbe640 10 monclient(hunting): picked mon.noname-a con 0x7f5bd0161240 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:46.876 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.872+0000 7f5bd4bbe640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bd0182ea0 con 0x7f5bd0161240 2026-02-24T19:16:46.876 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.872+0000 7f5bd4bbe640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bd01840a0 con 0x7f5bd005df20 2026-02-24T19:16:46.876 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.872+0000 7f5bd4bbe640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bd01852a0 con 0x7f5bd005da60 2026-02-24T19:16:46.876 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.872+0000 7f5bd4bbe640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:46.876 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.872+0000 7f5bd4bbe640 10 monclient(hunting): authenticate will time out at 3575.508665s 2026-02-24T19:16:46.876 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.873+0000 7f5bce575640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7f5bd005da60 0x7f5bd005c3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.195:49270/0 (socket says 10.20.193.195:49270) 2026-02-24T19:16:46.876 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.873+0000 7f5bce575640 1 -- 10.20.193.195:0/3043470253 learned_addr learned my addr 10.20.193.195:0/3043470253 (peer_addr_for_me v1:10.20.193.195:0/0) 2026-02-24T19:16:46.877 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.874+0000 7f5bcd573640 1 -- 10.20.193.195:0/3043470253 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2414383522 0 0) 0x7f5bd01852a0 con 0x7f5bd005da60 2026-02-24T19:16:46.877 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.874+0000 7f5bcd573640 10 monclient(hunting): _negotiate 2026-02-24T19:16:46.877 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.874+0000 7f5bcd573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:46.877 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.874+0000 7f5bcd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:46.877 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.874+0000 7f5bcd573640 10 monclient(hunting): my global_id is 4208 2026-02-24T19:16:46.877 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.874+0000 7f5bcd573640 1 -- 10.20.193.195:0/3043470253 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5bbc0058a0 con 0x7f5bd005da60 2026-02-24T19:16:46.877 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.874+0000 7f5bcd573640 1 -- 10.20.193.195:0/3043470253 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4253481899 0 0) 0x7f5bd01840a0 con 0x7f5bd005df20 2026-02-24T19:16:46.877 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.874+0000 7f5bcd573640 10 monclient(hunting): _negotiate 2026-02-24T19:16:46.877 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.874+0000 7f5bcd573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:46.877 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.874+0000 7f5bcd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:46.877 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.874+0000 7f5bcd573640 10 monclient(hunting): my global_id is 4198 2026-02-24T19:16:46.878 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.874+0000 7f5bcd573640 1 -- 10.20.193.195:0/3043470253 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5bd01852a0 con 0x7f5bd005df20 2026-02-24T19:16:46.878 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.875+0000 7f5bcd573640 1 -- 10.20.193.195:0/3043470253 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 398635629 0 0) 0x7f5bd0182ea0 con 0x7f5bd0161240 2026-02-24T19:16:46.878 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.875+0000 7f5bcd573640 10 monclient(hunting): _negotiate 2026-02-24T19:16:46.878 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.875+0000 7f5bcd573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:46.878 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.875+0000 7f5bcd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:46.878 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.875+0000 7f5bcd573640 10 monclient(hunting): my global_id is 4203 2026-02-24T19:16:46.878 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.875+0000 7f5bcd573640 1 -- 10.20.193.195:0/3043470253 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5bd01840a0 con 0x7f5bd0161240 2026-02-24T19:16:46.879 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.876+0000 7f5bcd573640 1 -- 10.20.193.195:0/3043470253 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3168275180 0 0) 0x7f5bbc0058a0 con 0x7f5bd005da60 2026-02-24T19:16:46.879 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.876+0000 7f5bcd573640 1 -- 10.20.193.195:0/3043470253 >> v1:10.20.193.44:6789/0 conn(0x7f5bd005df20 legacy=0x7f5bd005caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:46.879 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.876+0000 7f5bcd573640 1 -- 10.20.193.195:0/3043470253 >> v1:10.20.193.14:6789/0 conn(0x7f5bd0161240 legacy=0x7f5bd0181620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:46.879 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.876+0000 7f5bcd573640 10 monclient: _finish_hunting 0 2026-02-24T19:16:46.879 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.876+0000 7f5bcd573640 1 monclient: found mon.noname-c 2026-02-24T19:16:46.879 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.876+0000 7f5bcd573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:46.879 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.876+0000 7f5bcd573640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.170:6789/0 2026-02-24T19:16:46.879 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.876+0000 7f5bcd573640 1 -- 10.20.193.195:0/3043470253 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bd0186540 con 0x7f5bd005da60 2026-02-24T19:16:46.879 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.876+0000 7f5bcd573640 10 monclient: _finish_auth 0 2026-02-24T19:16:46.879 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.876+0000 7f5bcd573640 10 monclient: _check_auth_tickets 2026-02-24T19:16:46.879 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.876+0000 7f5bcd573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:46.879 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.876+0000 7f5bd4bbe640 5 monclient: authenticate success, global_id 4208 2026-02-24T19:16:46.879 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.876+0000 7f5bcd573640 1 -- 10.20.193.195:0/3043470253 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5bc4002df0 con 0x7f5bd005da60 2026-02-24T19:16:46.879 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.876+0000 7f5bd4bbe640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:16:46.879 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.876+0000 7f5bcd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:46.879 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.876+0000 7f5bcd573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:16:46.879 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.876+0000 7f5bcd573640 10 monclient: dump: 2026-02-24T19:16:46.880 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:46.880 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:46.880 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:46.880 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:46.880 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:46.880 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:46.880 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:46.880 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:46.880 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:46.880 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:46.880 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.876+0000 7f5bd4bbe640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:16:46.883 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.877+0000 7f5bcd573640 1 -- 10.20.193.195:0/3043470253 <== mon.2 v1:10.20.193.170:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5bc4003030 con 0x7f5bd005da60 2026-02-24T19:16:46.883 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.877+0000 7f5bcd573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:46.883 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.877+0000 7f5bcd573640 1 -- 10.20.193.195:0/3043470253 <== mon.2 v1:10.20.193.170:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5bc4003470 con 0x7f5bd005da60 2026-02-24T19:16:46.883 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.877+0000 7f5bcd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:46.883 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.877+0000 7f5bcd573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:16:46.883 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.877+0000 7f5bcd573640 10 monclient: dump: 2026-02-24T19:16:46.883 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:46.883 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:46.883 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:46.883 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:46.883 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:46.883 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:46.883 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:46.883 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:46.883 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:46.883 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:46.883 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.877+0000 7f5bd4bbe640 10 monclient: get_monmap_and_config success 2026-02-24T19:16:46.883 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.877+0000 7f5bd4bbe640 4 set_mon_vals no callback set 2026-02-24T19:16:46.884 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.877+0000 7f5bd4bbe640 10 monclient: shutdown 2026-02-24T19:16:46.884 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.877+0000 7f5bd4bbe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:46.884 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.877+0000 7f5bd4bbe640 1 -- 10.20.193.195:0/3043470253 >> v1:10.20.193.170:6789/0 conn(0x7f5bd005da60 legacy=0x7f5bd005c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:46.884 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.877+0000 7f5bd4bbe640 1 -- 10.20.193.195:0/3043470253 shutdown_connections 2026-02-24T19:16:46.884 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.877+0000 7f5bd4bbe640 1 -- 10.20.193.195:0/3043470253 >> 10.20.193.195:0/3043470253 conn(0x7f5bd00588d0 msgr2=0x7f5bd0058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:46.884 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.877+0000 7f5bd4bbe640 1 -- 10.20.193.195:0/3043470253 shutdown_connections 2026-02-24T19:16:46.884 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.877+0000 7f5bd4bbe640 1 -- 10.20.193.195:0/3043470253 wait complete. 2026-02-24T19:16:46.884 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.877+0000 7f5bd4bbe640 10 monclient: build_initial_monmap 2026-02-24T19:16:46.884 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.877+0000 7f5bd4bbe640 10 monclient: monmap: 2026-02-24T19:16:46.884 INFO:teuthology.orchestra.run.trial195.stderr:epoch 0 2026-02-24T19:16:46.884 INFO:teuthology.orchestra.run.trial195.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:16:46.884 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 0.000000 2026-02-24T19:16:46.884 INFO:teuthology.orchestra.run.trial195.stderr:created 0.000000 2026-02-24T19:16:46.884 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:46.884 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 1 2026-02-24T19:16:46.884 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:46.884 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:46.884 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:46.884 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:46.884 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.878+0000 7f5bd4bbe640 1 librados: starting msgr at 2026-02-24T19:16:46.885 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.878+0000 7f5bd4bbe640 1 librados: starting objecter 2026-02-24T19:16:46.885 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.878+0000 7f5bd4bbe640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:16:46.885 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.878+0000 7f5bd4bbe640 1 Processor -- start 2026-02-24T19:16:46.885 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.878+0000 7f5bd4bbe640 1 -- start start 2026-02-24T19:16:46.885 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.878+0000 7f5bd4bbe640 1 librados: setting wanted keys 2026-02-24T19:16:46.885 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.878+0000 7f5bd4bbe640 1 librados: calling monclient init 2026-02-24T19:16:46.885 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.878+0000 7f5bd4bbe640 10 monclient: init 2026-02-24T19:16:46.885 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.878+0000 7f5bd4bbe640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:46.885 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.878+0000 7f5bd4bbe640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:16:46.885 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.878+0000 7f5bd4bbe640 10 monclient(hunting): picked mon.noname-a con 0x7f5bd005da60 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:46.885 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.878+0000 7f5bd4bbe640 10 monclient(hunting): picked mon.noname-b con 0x7f5bd005df20 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:46.885 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.878+0000 7f5bd4bbe640 10 monclient(hunting): picked mon.noname-c con 0x7f5bd0161240 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:46.885 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.878+0000 7f5bd4bbe640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bd0150560 con 0x7f5bd005da60 2026-02-24T19:16:46.885 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.878+0000 7f5bd4bbe640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bd0151740 con 0x7f5bd005df20 2026-02-24T19:16:46.885 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.878+0000 7f5bd4bbe640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bd0152920 con 0x7f5bd0161240 2026-02-24T19:16:46.885 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.878+0000 7f5bd4bbe640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:46.885 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.878+0000 7f5bd4bbe640 10 monclient(hunting): authenticate will time out at 3575.514333s 2026-02-24T19:16:46.885 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.878+0000 7f5bce575640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f5bd005da60 0x7f5bd0106d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.195:35226/0 (socket says 10.20.193.195:35226) 2026-02-24T19:16:46.885 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.878+0000 7f5bce575640 1 -- 10.20.193.195:0/512441171 learned_addr learned my addr 10.20.193.195:0/512441171 (peer_addr_for_me v1:10.20.193.195:0/0) 2026-02-24T19:16:46.885 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.879+0000 7f5bb6ffd640 10 client.?.objecter ms_handle_connect 0x7f5bd005da60 2026-02-24T19:16:46.885 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.879+0000 7f5bb6ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:46.886 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.879+0000 7f5bb6ffd640 10 client.?.objecter ms_handle_connect 0x7f5bd005df20 2026-02-24T19:16:46.886 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.879+0000 7f5bb6ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:46.886 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.879+0000 7f5bb6ffd640 10 client.?.objecter ms_handle_connect 0x7f5bd0161240 2026-02-24T19:16:46.886 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.879+0000 7f5bb6ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:46.886 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.879+0000 7f5bb6ffd640 1 -- 10.20.193.195:0/512441171 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2849944225 0 0) 0x7f5bd0150560 con 0x7f5bd005da60 2026-02-24T19:16:46.886 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.879+0000 7f5bb6ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:16:46.886 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.879+0000 7f5bb6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:46.886 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.879+0000 7f5bb6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:46.886 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.879+0000 7f5bb6ffd640 10 monclient(hunting): my global_id is 4206 2026-02-24T19:16:46.886 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.879+0000 7f5bb6ffd640 1 -- 10.20.193.195:0/512441171 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b9c003610 con 0x7f5bd005da60 2026-02-24T19:16:46.886 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.880+0000 7f5bb6ffd640 1 -- 10.20.193.195:0/512441171 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3929466117 0 0) 0x7f5bd0151740 con 0x7f5bd005df20 2026-02-24T19:16:46.886 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.880+0000 7f5bb6ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:16:46.886 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.880+0000 7f5bb6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:46.886 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.880+0000 7f5bb6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:46.886 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.880+0000 7f5bb6ffd640 10 monclient(hunting): my global_id is 4201 2026-02-24T19:16:46.886 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.880+0000 7f5bb6ffd640 1 -- 10.20.193.195:0/512441171 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5bd0150560 con 0x7f5bd005df20 2026-02-24T19:16:46.886 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.880+0000 7f5bb6ffd640 1 -- 10.20.193.195:0/512441171 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1328857856 0 0) 0x7f5bd0152920 con 0x7f5bd0161240 2026-02-24T19:16:46.886 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.880+0000 7f5bb6ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:16:46.886 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.880+0000 7f5bb6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:46.886 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.880+0000 7f5bb6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:46.886 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.880+0000 7f5bb6ffd640 10 monclient(hunting): my global_id is 4211 2026-02-24T19:16:46.887 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.880+0000 7f5bb6ffd640 1 -- 10.20.193.195:0/512441171 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5bd0151740 con 0x7f5bd0161240 2026-02-24T19:16:46.888 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.882+0000 7f5bb6ffd640 1 -- 10.20.193.195:0/512441171 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1831669235 0 0) 0x7f5b9c003610 con 0x7f5bd005da60 2026-02-24T19:16:46.888 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.882+0000 7f5bb6ffd640 1 -- 10.20.193.195:0/512441171 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5bd0152920 con 0x7f5bd005da60 2026-02-24T19:16:46.889 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.882+0000 7f5bb6ffd640 1 -- 10.20.193.195:0/512441171 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5bc4003380 con 0x7f5bd005da60 2026-02-24T19:16:46.889 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.882+0000 7f5bb6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:46.889 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.882+0000 7f5bb6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:16:46.889 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.882+0000 7f5bb6ffd640 10 monclient(hunting): dump: 2026-02-24T19:16:46.889 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:46.889 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:46.889 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:46.889 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:46.889 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:46.889 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:46.889 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:46.889 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:46.889 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:46.889 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:46.889 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.882+0000 7f5bb6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:16:46.889 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.882+0000 7f5bb6ffd640 1 -- 10.20.193.195:0/512441171 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1921615685 0 0) 0x7f5bd0150560 con 0x7f5bd005df20 2026-02-24T19:16:46.889 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.882+0000 7f5bb6ffd640 1 -- 10.20.193.195:0/512441171 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5b9c003610 con 0x7f5bd005df20 2026-02-24T19:16:46.889 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.882+0000 7f5bb6ffd640 1 -- 10.20.193.195:0/512441171 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5bb80030b0 con 0x7f5bd005df20 2026-02-24T19:16:46.889 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.882+0000 7f5bb6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:46.890 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.882+0000 7f5bb6ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:16:46.890 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.882+0000 7f5bb6ffd640 10 monclient(hunting): dump: 2026-02-24T19:16:46.890 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:46.890 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:46.890 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:46.890 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:46.890 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:46.890 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:46.890 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:46.890 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:46.890 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:46.890 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:46.890 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.883+0000 7f5bb6ffd640 1 -- 10.20.193.195:0/512441171 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1113571979 0 0) 0x7f5bd0151740 con 0x7f5bd0161240 2026-02-24T19:16:46.890 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.883+0000 7f5bb6ffd640 1 -- 10.20.193.195:0/512441171 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5bd0150560 con 0x7f5bd0161240 2026-02-24T19:16:46.890 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.883+0000 7f5bb6ffd640 1 -- 10.20.193.195:0/512441171 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5bc0003410 con 0x7f5bd0161240 2026-02-24T19:16:46.890 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.883+0000 7f5bb6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:46.890 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.883+0000 7f5bb6ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:16:46.890 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.883+0000 7f5bb6ffd640 10 monclient(hunting): dump: 2026-02-24T19:16:46.890 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:46.890 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:46.891 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:46.891 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:46.891 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:46.891 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:46.891 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:46.891 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:46.891 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:46.891 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:46.891 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.884+0000 7f5bb6ffd640 1 -- 10.20.193.195:0/512441171 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1903350214 0 0) 0x7f5bd0152920 con 0x7f5bd005da60 2026-02-24T19:16:46.891 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.884+0000 7f5bb6ffd640 1 -- 10.20.193.195:0/512441171 >> v1:10.20.193.170:6789/0 conn(0x7f5bd0161240 legacy=0x7f5bd014ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:46.891 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.884+0000 7f5bb6ffd640 1 -- 10.20.193.195:0/512441171 >> v1:10.20.193.44:6789/0 conn(0x7f5bd005df20 legacy=0x7f5bd014d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:46.891 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.884+0000 7f5bb6ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:16:46.891 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.884+0000 7f5bb6ffd640 1 monclient: found mon.a 2026-02-24T19:16:46.891 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.884+0000 7f5bb6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:46.891 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.884+0000 7f5bb6ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:16:46.891 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.884+0000 7f5bb6ffd640 1 -- 10.20.193.195:0/512441171 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bd0153b00 con 0x7f5bd005da60 2026-02-24T19:16:46.891 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.884+0000 7f5bb6ffd640 10 monclient: _finish_auth 0 2026-02-24T19:16:46.891 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.884+0000 7f5bb6ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:16:46.891 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.884+0000 7f5bb6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:46.891 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.884+0000 7f5bd4bbe640 5 monclient: authenticate success, global_id 4206 2026-02-24T19:16:46.892 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.884+0000 7f5bd4bbe640 10 monclient: _renew_subs 2026-02-24T19:16:46.892 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.884+0000 7f5bd4bbe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:16:46.892 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.884+0000 7f5bd4bbe640 1 -- 10.20.193.195:0/512441171 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5bd0151910 con 0x7f5bd005da60 2026-02-24T19:16:46.892 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.884+0000 7f5bd4bbe640 10 client.4206.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:16:46.892 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.884+0000 7f5bd4bbe640 10 monclient: _renew_subs 2026-02-24T19:16:46.892 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.884+0000 7f5bd4bbe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:16:46.892 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.884+0000 7f5bd4bbe640 1 -- 10.20.193.195:0/512441171 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5bd0151f00 con 0x7f5bd005da60 2026-02-24T19:16:46.892 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.884+0000 7f5bd4bbe640 1 librados: init done 2026-02-24T19:16:46.892 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.884+0000 7f5bd4bbe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:46.892 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.884+0000 7f5bd4bbe640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:46.892 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.884+0000 7f5bd4bbe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:16:46.892 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.884+0000 7f5bd4bbe640 1 -- 10.20.193.195:0/512441171 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bd0184770 con 0x7f5bd005da60 2026-02-24T19:16:46.976 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.975+0000 7f5bb6ffd640 1 -- 10.20.193.195:0/512441171 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5bc4002f80 con 0x7f5bd005da60 2026-02-24T19:16:46.977 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.975+0000 7f5bb6ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:46.977 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.975+0000 7f5bb6ffd640 1 -- 10.20.193.195:0/512441171 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5bc4004ce0 con 0x7f5bd005da60 2026-02-24T19:16:46.977 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.975+0000 7f5bb6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:46.977 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.975+0000 7f5bb6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:16:46.977 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.975+0000 7f5bb6ffd640 10 monclient: dump: 2026-02-24T19:16:46.977 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:46.977 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:46.977 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:46.977 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:46.977 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:46.977 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:46.977 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:46.977 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:46.977 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:46.977 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:46.977 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.975+0000 7f5bccd72640 4 set_mon_vals no callback set 2026-02-24T19:16:46.978 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.975+0000 7f5bb6ffd640 1 -- 10.20.193.195:0/512441171 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 4) ==== 101507+0+0 (unknown 1883626494 0 0) 0x7f5bc401db10 con 0x7f5bd005da60 2026-02-24T19:16:46.978 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.976+0000 7f5bcdd74640 10 monclient: get_auth_request con 0x7f5b9c077d40 auth_method 0 2026-02-24T19:16:46.979 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.976+0000 7f5bb6ffd640 10 client.4206.objecter ms_handle_connect 0x7f5b9c077d40 2026-02-24T19:16:46.980 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.978+0000 7f5bb6ffd640 1 -- 10.20.193.195:0/512441171 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(16..16 src has 1..16) ==== 2330+0+0 (unknown 3870348323 0 0) 0x7f5bc4059380 con 0x7f5bd005da60 2026-02-24T19:16:46.980 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.978+0000 7f5bb6ffd640 10 client.4206.objecter ms_dispatch2 0x7f5bd0000b90 osd_map(16..16 src has 1..16) 2026-02-24T19:16:46.981 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.978+0000 7f5bb6ffd640 3 client.4206.objecter handle_osd_map got epochs [16,16] > 0 2026-02-24T19:16:46.981 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.978+0000 7f5bb6ffd640 3 client.4206.objecter handle_osd_map decoding full epoch 16 2026-02-24T19:16:46.981 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.978+0000 7f5bb6ffd640 20 client.4206.objecter dump_active .. 0 homeless 2026-02-24T19:16:46.981 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.978+0000 7f5bb6ffd640 1 -- 10.20.193.195:0/512441171 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f5bc405daf0 con 0x7f5bd005da60 2026-02-24T19:16:46.981 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.978+0000 7f5bb6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:46.981 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:46.978+0000 7f5bb6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:16:47.096 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.093+0000 7f5bd4bbe640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "866643a2-5f54-425c-b5ec-70607e191f02", "id": 14}] 2026-02-24T19:16:47.096 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.093+0000 7f5bd4bbe640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "866643a2-5f54-425c-b5ec-70607e191f02", "id": 14}] 2026-02-24T19:16:47.096 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.093+0000 7f5bd4bbe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:16:47.096 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.093+0000 7f5bd4bbe640 1 -- 10.20.193.195:0/512441171 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "osd new", "uuid": "866643a2-5f54-425c-b5ec-70607e191f02", "id": 14} v 0) -- 0x7f5bd0152240 con 0x7f5bd005da60 2026-02-24T19:16:47.145 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.144+0000 7f5bb6ffd640 1 -- 10.20.193.195:0/512441171 <== mon.0 v1:10.20.193.14:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "866643a2-5f54-425c-b5ec-70607e191f02", "id": 14}]=0 v17) ==== 113+0+3 (unknown 44191413 0 1367428999) 0x7f5bc405d3f0 con 0x7f5bd005da60 2026-02-24T19:16:47.145 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.144+0000 7f5bb6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "866643a2-5f54-425c-b5ec-70607e191f02", "id": 14}] 2026-02-24T19:16:47.146 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.144+0000 7f5bb6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:16:47.146 INFO:teuthology.orchestra.run.trial195.stdout:14 2026-02-24T19:16:47.147 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.144+0000 7f5bd4bbe640 10 librados: watch_flush enter 2026-02-24T19:16:47.148 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.144+0000 7f5bd4bbe640 10 librados: watch_flush exit 2026-02-24T19:16:47.148 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.144+0000 7f5bd4bbe640 20 client.4206.objecter shutdown clearing up homeless session... 2026-02-24T19:16:47.148 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.144+0000 7f5bd4bbe640 10 client.4206.objecter successfully canceled tick 2026-02-24T19:16:47.148 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.144+0000 7f5bd4bbe640 1 -- 10.20.193.195:0/512441171 >> v1:10.20.193.14:6800/4014096310 conn(0x7f5b9c077d40 legacy=0x7f5b9c0981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:47.148 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.144+0000 7f5bd4bbe640 10 monclient: shutdown 2026-02-24T19:16:47.148 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.144+0000 7f5bd4bbe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:47.148 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.144+0000 7f5bd4bbe640 1 -- 10.20.193.195:0/512441171 >> v1:10.20.193.14:6789/0 conn(0x7f5bd005da60 legacy=0x7f5bd0106d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:47.148 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.144+0000 7f5bd4bbe640 1 -- 10.20.193.195:0/512441171 shutdown_connections 2026-02-24T19:16:47.148 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.144+0000 7f5bd4bbe640 1 -- 10.20.193.195:0/512441171 >> 10.20.193.195:0/512441171 conn(0x7f5bd00588d0 msgr2=0x7f5bd0181620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:47.148 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.144+0000 7f5bd4bbe640 1 -- 10.20.193.195:0/512441171 shutdown_connections 2026-02-24T19:16:47.148 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.144+0000 7f5bd4bbe640 1 -- 10.20.193.195:0/512441171 wait complete. 2026-02-24T19:16:47.149 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.144+0000 7f5bd4bbe640 1 librados: shutdown 2026-02-24T19:16:47.155 DEBUG:teuthology.orchestra.run.trial195:> sudo ceph --cluster ceph osd new 4726a8b0-bcef-4e7f-aa36-e80228e2aec5 15 2026-02-24T19:16:47.220 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.218+0000 7f6f1ce08640 10 monclient: get_monmap_and_config 2026-02-24T19:16:47.220 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.218+0000 7f6f1ce08640 10 monclient: build_initial_monmap 2026-02-24T19:16:47.220 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.218+0000 7f6f1ce08640 10 monclient: monmap: 2026-02-24T19:16:47.220 INFO:teuthology.orchestra.run.trial195.stderr:epoch 0 2026-02-24T19:16:47.221 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:47.221 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:16:47.219631+0000 2026-02-24T19:16:47.221 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:16:47.219631+0000 2026-02-24T19:16:47.221 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:47.221 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:47.221 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:47.221 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:47.221 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:47.221 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:47.223 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.218+0000 7f6f1ce08640 1 Processor -- start 2026-02-24T19:16:47.224 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.218+0000 7f6f1ce08640 1 -- start start 2026-02-24T19:16:47.224 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.218+0000 7f6f1ce08640 10 monclient: init 2026-02-24T19:16:47.224 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.218+0000 7f6f1ce08640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:47.224 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.218+0000 7f6f1ce08640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:16:47.224 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.218+0000 7f6f1ce08640 10 monclient(hunting): picked mon.noname-c con 0x7f6f1811e790 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:47.224 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.218+0000 7f6f1ce08640 10 monclient(hunting): picked mon.noname-b con 0x7f6f181406c0 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:47.224 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.218+0000 7f6f1ce08640 10 monclient(hunting): picked mon.noname-a con 0x7f6f18162250 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:47.224 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.218+0000 7f6f1ce08640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f18183fe0 con 0x7f6f18162250 2026-02-24T19:16:47.224 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.218+0000 7f6f1ce08640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f181851e0 con 0x7f6f181406c0 2026-02-24T19:16:47.224 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.218+0000 7f6f1ce08640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f181863e0 con 0x7f6f1811e790 2026-02-24T19:16:47.225 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.218+0000 7f6f1ce08640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:47.225 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.218+0000 7f6f1ce08640 10 monclient(hunting): authenticate will time out at 3575.854783s 2026-02-24T19:16:47.225 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.219+0000 7f6f16575640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7f6f1811e790 0x7f6f1811eb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.195:49286/0 (socket says 10.20.193.195:49286) 2026-02-24T19:16:47.225 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.219+0000 7f6f16575640 1 -- 10.20.193.195:0/1318963508 learned_addr learned my addr 10.20.193.195:0/1318963508 (peer_addr_for_me v1:10.20.193.195:0/0) 2026-02-24T19:16:47.225 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.219+0000 7f6f16d76640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f6f18162250 0x7f6f181826e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.195:35240/0 (socket says 10.20.193.195:35240) 2026-02-24T19:16:47.225 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.220+0000 7f6f15573640 1 -- 10.20.193.195:0/1318963508 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3134785533 0 0) 0x7f6f181851e0 con 0x7f6f181406c0 2026-02-24T19:16:47.225 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.220+0000 7f6f15573640 10 monclient(hunting): _negotiate 2026-02-24T19:16:47.225 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.220+0000 7f6f15573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:47.225 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.220+0000 7f6f15573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:47.225 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.220+0000 7f6f15573640 10 monclient(hunting): my global_id is 4204 2026-02-24T19:16:47.226 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.220+0000 7f6f15573640 1 -- 10.20.193.195:0/1318963508 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f04003610 con 0x7f6f181406c0 2026-02-24T19:16:47.226 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.220+0000 7f6f15573640 1 -- 10.20.193.195:0/1318963508 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 185248763 0 0) 0x7f6f18183fe0 con 0x7f6f18162250 2026-02-24T19:16:47.226 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.220+0000 7f6f15573640 10 monclient(hunting): _negotiate 2026-02-24T19:16:47.226 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.220+0000 7f6f15573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:47.226 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.220+0000 7f6f15573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:47.226 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.220+0000 7f6f15573640 10 monclient(hunting): my global_id is 4209 2026-02-24T19:16:47.226 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.220+0000 7f6f15573640 1 -- 10.20.193.195:0/1318963508 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f181851e0 con 0x7f6f18162250 2026-02-24T19:16:47.226 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.220+0000 7f6f15573640 1 -- 10.20.193.195:0/1318963508 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 35265504 0 0) 0x7f6f181863e0 con 0x7f6f1811e790 2026-02-24T19:16:47.226 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.220+0000 7f6f15573640 10 monclient(hunting): _negotiate 2026-02-24T19:16:47.226 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.220+0000 7f6f15573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:47.226 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.220+0000 7f6f15573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:47.226 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.220+0000 7f6f15573640 10 monclient(hunting): my global_id is 4214 2026-02-24T19:16:47.227 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.220+0000 7f6f15573640 1 -- 10.20.193.195:0/1318963508 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f18183fe0 con 0x7f6f1811e790 2026-02-24T19:16:47.233 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.222+0000 7f6f15573640 1 -- 10.20.193.195:0/1318963508 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 652807624 0 0) 0x7f6f04003610 con 0x7f6f181406c0 2026-02-24T19:16:47.234 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.222+0000 7f6f15573640 1 -- 10.20.193.195:0/1318963508 >> v1:10.20.193.170:6789/0 conn(0x7f6f1811e790 legacy=0x7f6f1811eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:47.234 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.222+0000 7f6f15573640 1 -- 10.20.193.195:0/1318963508 >> v1:10.20.193.14:6789/0 conn(0x7f6f18162250 legacy=0x7f6f181826e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:47.234 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.222+0000 7f6f15573640 10 monclient: _finish_hunting 0 2026-02-24T19:16:47.234 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.222+0000 7f6f15573640 1 monclient: found mon.noname-b 2026-02-24T19:16:47.234 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.222+0000 7f6f15573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:47.234 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.222+0000 7f6f15573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.44:6789/0 2026-02-24T19:16:47.234 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.222+0000 7f6f15573640 1 -- 10.20.193.195:0/1318963508 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f18187680 con 0x7f6f181406c0 2026-02-24T19:16:47.234 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.222+0000 7f6f15573640 10 monclient: _finish_auth 0 2026-02-24T19:16:47.234 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.222+0000 7f6f15573640 10 monclient: _check_auth_tickets 2026-02-24T19:16:47.234 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.222+0000 7f6f15573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:47.235 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.222+0000 7f6f15573640 1 -- 10.20.193.195:0/1318963508 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f6f00002df0 con 0x7f6f181406c0 2026-02-24T19:16:47.235 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.222+0000 7f6f15573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:47.235 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.222+0000 7f6f15573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:16:47.235 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.222+0000 7f6f15573640 10 monclient: dump: 2026-02-24T19:16:47.235 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:47.235 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:47.235 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:47.235 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:47.235 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:47.235 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:47.235 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:47.235 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:47.236 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:47.236 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:47.236 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.222+0000 7f6f1ce08640 5 monclient: authenticate success, global_id 4204 2026-02-24T19:16:47.236 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.222+0000 7f6f1ce08640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:16:47.236 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.223+0000 7f6f15573640 1 -- 10.20.193.195:0/1318963508 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6f00003030 con 0x7f6f181406c0 2026-02-24T19:16:47.236 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.223+0000 7f6f15573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:47.236 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.223+0000 7f6f15573640 1 -- 10.20.193.195:0/1318963508 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f6f00003470 con 0x7f6f181406c0 2026-02-24T19:16:47.236 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.223+0000 7f6f15573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:47.236 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.223+0000 7f6f15573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:16:47.236 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.223+0000 7f6f15573640 10 monclient: dump: 2026-02-24T19:16:47.236 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:47.236 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:47.237 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:47.237 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:47.237 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:47.237 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:47.237 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:47.237 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:47.237 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:47.237 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:47.237 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.223+0000 7f6f1ce08640 10 monclient: get_monmap_and_config success 2026-02-24T19:16:47.237 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.223+0000 7f6f1ce08640 4 set_mon_vals no callback set 2026-02-24T19:16:47.237 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.223+0000 7f6f1ce08640 10 monclient: shutdown 2026-02-24T19:16:47.237 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.223+0000 7f6f1ce08640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:47.238 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.223+0000 7f6f1ce08640 1 -- 10.20.193.195:0/1318963508 >> v1:10.20.193.44:6789/0 conn(0x7f6f181406c0 legacy=0x7f6f18160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:47.238 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.223+0000 7f6f1ce08640 1 -- 10.20.193.195:0/1318963508 shutdown_connections 2026-02-24T19:16:47.238 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.223+0000 7f6f1ce08640 1 -- 10.20.193.195:0/1318963508 >> 10.20.193.195:0/1318963508 conn(0x7f6f180588d0 msgr2=0x7f6f18058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:47.238 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.223+0000 7f6f1ce08640 1 -- 10.20.193.195:0/1318963508 shutdown_connections 2026-02-24T19:16:47.238 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.223+0000 7f6f1ce08640 1 -- 10.20.193.195:0/1318963508 wait complete. 2026-02-24T19:16:47.238 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.223+0000 7f6f1ce08640 10 monclient: build_initial_monmap 2026-02-24T19:16:47.238 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.223+0000 7f6f1ce08640 10 monclient: monmap: 2026-02-24T19:16:47.238 INFO:teuthology.orchestra.run.trial195.stderr:epoch 0 2026-02-24T19:16:47.238 INFO:teuthology.orchestra.run.trial195.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:16:47.238 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 0.000000 2026-02-24T19:16:47.238 INFO:teuthology.orchestra.run.trial195.stderr:created 0.000000 2026-02-24T19:16:47.238 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:47.238 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 1 2026-02-24T19:16:47.239 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:47.239 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:47.239 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:47.239 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:47.239 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.223+0000 7f6f1ce08640 1 librados: starting msgr at 2026-02-24T19:16:47.239 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.223+0000 7f6f1ce08640 1 librados: starting objecter 2026-02-24T19:16:47.239 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.223+0000 7f6f1ce08640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:16:47.239 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.223+0000 7f6f1ce08640 1 Processor -- start 2026-02-24T19:16:47.239 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.223+0000 7f6f1ce08640 1 -- start start 2026-02-24T19:16:47.239 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.223+0000 7f6f1ce08640 1 librados: setting wanted keys 2026-02-24T19:16:47.239 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.223+0000 7f6f1ce08640 1 librados: calling monclient init 2026-02-24T19:16:47.239 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.223+0000 7f6f1ce08640 10 monclient: init 2026-02-24T19:16:47.240 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.223+0000 7f6f1ce08640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:47.240 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.223+0000 7f6f1ce08640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:16:47.240 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.223+0000 7f6f1ce08640 10 monclient(hunting): picked mon.noname-c con 0x7f6f1811e790 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:47.240 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.223+0000 7f6f1ce08640 10 monclient(hunting): picked mon.noname-b con 0x7f6f181406c0 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:47.240 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.223+0000 7f6f1ce08640 10 monclient(hunting): picked mon.noname-a con 0x7f6f18162250 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:47.240 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.224+0000 7f6f1ce08640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f18104880 con 0x7f6f18162250 2026-02-24T19:16:47.240 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.224+0000 7f6f1ce08640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f1810c6e0 con 0x7f6f181406c0 2026-02-24T19:16:47.240 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.224+0000 7f6f1ce08640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f1810d900 con 0x7f6f1811e790 2026-02-24T19:16:47.240 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.224+0000 7f6f1ce08640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:47.240 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.224+0000 7f6f1ce08640 10 monclient(hunting): authenticate will time out at 3575.860037s 2026-02-24T19:16:47.240 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.224+0000 7f6f16575640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7f6f1811e790 0x7f6f181826e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.195:49292/0 (socket says 10.20.193.195:49292) 2026-02-24T19:16:47.240 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.224+0000 7f6f16575640 1 -- 10.20.193.195:0/293333448 learned_addr learned my addr 10.20.193.195:0/293333448 (peer_addr_for_me v1:10.20.193.195:0/0) 2026-02-24T19:16:47.240 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.224+0000 7f6efeffd640 10 client.?.objecter ms_handle_connect 0x7f6f18162250 2026-02-24T19:16:47.241 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.224+0000 7f6efeffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:47.241 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.224+0000 7f6efeffd640 10 client.?.objecter ms_handle_connect 0x7f6f1811e790 2026-02-24T19:16:47.241 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.224+0000 7f6efeffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:47.241 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.224+0000 7f6efeffd640 10 client.?.objecter ms_handle_connect 0x7f6f181406c0 2026-02-24T19:16:47.241 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.224+0000 7f6efeffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:47.241 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.225+0000 7f6efeffd640 1 -- 10.20.193.195:0/293333448 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2159478557 0 0) 0x7f6f18104880 con 0x7f6f18162250 2026-02-24T19:16:47.241 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.225+0000 7f6efeffd640 10 monclient(hunting): _negotiate 2026-02-24T19:16:47.241 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.225+0000 7f6efeffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:47.241 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.225+0000 7f6efeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:47.241 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.225+0000 7f6efeffd640 10 monclient(hunting): my global_id is 4212 2026-02-24T19:16:47.241 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.225+0000 7f6efeffd640 1 -- 10.20.193.195:0/293333448 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ee4003610 con 0x7f6f18162250 2026-02-24T19:16:47.241 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.225+0000 7f6efeffd640 1 -- 10.20.193.195:0/293333448 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4248753216 0 0) 0x7f6f1810d900 con 0x7f6f1811e790 2026-02-24T19:16:47.242 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.225+0000 7f6efeffd640 10 monclient(hunting): _negotiate 2026-02-24T19:16:47.242 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.225+0000 7f6efeffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:47.242 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.225+0000 7f6efeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:47.242 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.225+0000 7f6efeffd640 10 monclient(hunting): my global_id is 4217 2026-02-24T19:16:47.242 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.225+0000 7f6efeffd640 1 -- 10.20.193.195:0/293333448 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f18104880 con 0x7f6f1811e790 2026-02-24T19:16:47.242 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.226+0000 7f6efeffd640 1 -- 10.20.193.195:0/293333448 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3604075358 0 0) 0x7f6f1810c6e0 con 0x7f6f181406c0 2026-02-24T19:16:47.242 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.226+0000 7f6efeffd640 10 monclient(hunting): _negotiate 2026-02-24T19:16:47.242 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.226+0000 7f6efeffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:47.242 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.226+0000 7f6efeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:47.242 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.226+0000 7f6efeffd640 10 monclient(hunting): my global_id is 4207 2026-02-24T19:16:47.242 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.226+0000 7f6efeffd640 1 -- 10.20.193.195:0/293333448 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f1810d900 con 0x7f6f181406c0 2026-02-24T19:16:47.242 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.228+0000 7f6efeffd640 1 -- 10.20.193.195:0/293333448 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3913157719 0 0) 0x7f6ee4003610 con 0x7f6f18162250 2026-02-24T19:16:47.243 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.228+0000 7f6efeffd640 1 -- 10.20.193.195:0/293333448 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f1810c6e0 con 0x7f6f18162250 2026-02-24T19:16:47.243 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.228+0000 7f6efeffd640 1 -- 10.20.193.195:0/293333448 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f6f08003430 con 0x7f6f18162250 2026-02-24T19:16:47.243 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.228+0000 7f6efeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:47.243 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.228+0000 7f6efeffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:16:47.243 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.228+0000 7f6efeffd640 10 monclient(hunting): dump: 2026-02-24T19:16:47.243 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:47.243 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:47.243 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:47.243 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:47.243 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:47.243 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:47.243 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:47.243 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:47.244 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:47.244 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:47.244 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.228+0000 7f6efeffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:16:47.244 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.228+0000 7f6efeffd640 1 -- 10.20.193.195:0/293333448 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1706131628 0 0) 0x7f6f18104880 con 0x7f6f1811e790 2026-02-24T19:16:47.244 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.228+0000 7f6efeffd640 1 -- 10.20.193.195:0/293333448 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6ee4003610 con 0x7f6f1811e790 2026-02-24T19:16:47.244 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.228+0000 7f6efeffd640 1 -- 10.20.193.195:0/293333448 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f6f0c003060 con 0x7f6f1811e790 2026-02-24T19:16:47.244 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.228+0000 7f6efeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:47.244 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.228+0000 7f6efeffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:16:47.244 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.228+0000 7f6efeffd640 10 monclient(hunting): dump: 2026-02-24T19:16:47.244 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:47.244 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:47.244 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:47.244 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:47.245 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:47.245 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:47.245 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:47.245 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:47.245 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:47.245 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:47.245 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.228+0000 7f6efeffd640 1 -- 10.20.193.195:0/293333448 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2670710284 0 0) 0x7f6f1810d900 con 0x7f6f181406c0 2026-02-24T19:16:47.245 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.228+0000 7f6efeffd640 1 -- 10.20.193.195:0/293333448 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f18104880 con 0x7f6f181406c0 2026-02-24T19:16:47.245 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.228+0000 7f6efeffd640 1 -- 10.20.193.195:0/293333448 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f6f00003380 con 0x7f6f181406c0 2026-02-24T19:16:47.245 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.228+0000 7f6efeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:47.245 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.228+0000 7f6efeffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:16:47.245 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.228+0000 7f6efeffd640 10 monclient(hunting): dump: 2026-02-24T19:16:47.246 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:47.246 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:47.246 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:47.246 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:47.246 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:47.246 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:47.246 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:47.246 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:47.246 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:47.246 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:47.246 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.230+0000 7f6efeffd640 1 -- 10.20.193.195:0/293333448 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1607025638 0 0) 0x7f6f1810c6e0 con 0x7f6f18162250 2026-02-24T19:16:47.246 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.230+0000 7f6efeffd640 1 -- 10.20.193.195:0/293333448 >> v1:10.20.193.170:6789/0 conn(0x7f6f1811e790 legacy=0x7f6f181826e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:47.246 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.230+0000 7f6efeffd640 1 -- 10.20.193.195:0/293333448 >> v1:10.20.193.44:6789/0 conn(0x7f6f181406c0 legacy=0x7f6f18103ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:47.247 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.230+0000 7f6efeffd640 10 monclient: _finish_hunting 0 2026-02-24T19:16:47.247 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.230+0000 7f6efeffd640 1 monclient: found mon.a 2026-02-24T19:16:47.247 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.230+0000 7f6efeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:47.247 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.230+0000 7f6efeffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:16:47.247 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.230+0000 7f6efeffd640 1 -- 10.20.193.195:0/293333448 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f1810eba0 con 0x7f6f18162250 2026-02-24T19:16:47.247 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.230+0000 7f6efeffd640 10 monclient: _finish_auth 0 2026-02-24T19:16:47.247 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.230+0000 7f6efeffd640 10 monclient: _check_auth_tickets 2026-02-24T19:16:47.247 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.230+0000 7f6efeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:47.247 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.230+0000 7f6f1ce08640 5 monclient: authenticate success, global_id 4212 2026-02-24T19:16:47.247 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.230+0000 7f6f1ce08640 10 monclient: _renew_subs 2026-02-24T19:16:47.247 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.230+0000 7f6f1ce08640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:16:47.247 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.230+0000 7f6f1ce08640 1 -- 10.20.193.195:0/293333448 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6f1810db30 con 0x7f6f18162250 2026-02-24T19:16:47.247 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.230+0000 7f6f1ce08640 10 client.4212.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:16:47.248 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.230+0000 7f6f1ce08640 10 monclient: _renew_subs 2026-02-24T19:16:47.248 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.230+0000 7f6f1ce08640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:16:47.248 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.230+0000 7f6f1ce08640 1 -- 10.20.193.195:0/293333448 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6f1810e080 con 0x7f6f18162250 2026-02-24T19:16:47.248 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.230+0000 7f6f1ce08640 1 librados: init done 2026-02-24T19:16:47.248 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.230+0000 7f6f1ce08640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:47.248 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.230+0000 7f6f1ce08640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:47.248 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.230+0000 7f6f1ce08640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:16:47.248 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.230+0000 7f6f1ce08640 1 -- 10.20.193.195:0/293333448 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f181846b0 con 0x7f6f18162250 2026-02-24T19:16:47.320 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.319+0000 7f6efeffd640 1 -- 10.20.193.195:0/293333448 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6f08004c50 con 0x7f6f18162250 2026-02-24T19:16:47.321 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.319+0000 7f6efeffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:47.321 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.319+0000 7f6efeffd640 1 -- 10.20.193.195:0/293333448 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f6f08004fa0 con 0x7f6f18162250 2026-02-24T19:16:47.321 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.319+0000 7f6efeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:47.321 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.319+0000 7f6efeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:16:47.321 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.319+0000 7f6efeffd640 10 monclient: dump: 2026-02-24T19:16:47.321 INFO:teuthology.orchestra.run.trial195.stderr:epoch 1 2026-02-24T19:16:47.321 INFO:teuthology.orchestra.run.trial195.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:47.321 INFO:teuthology.orchestra.run.trial195.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:47.321 INFO:teuthology.orchestra.run.trial195.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:47.321 INFO:teuthology.orchestra.run.trial195.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:47.321 INFO:teuthology.orchestra.run.trial195.stderr:election_strategy: 3 2026-02-24T19:16:47.321 INFO:teuthology.orchestra.run.trial195.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:47.321 INFO:teuthology.orchestra.run.trial195.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:47.321 INFO:teuthology.orchestra.run.trial195.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:47.321 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:16:47.321 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.319+0000 7f6f14d72640 4 set_mon_vals no callback set 2026-02-24T19:16:47.321 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.320+0000 7f6efeffd640 1 -- 10.20.193.195:0/293333448 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 4) ==== 101507+0+0 (unknown 1883626494 0 0) 0x7f6f0801ddd0 con 0x7f6f18162250 2026-02-24T19:16:47.322 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.320+0000 7f6f16575640 10 monclient: get_auth_request con 0x7f6ee4077d90 auth_method 0 2026-02-24T19:16:47.323 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.320+0000 7f6efeffd640 10 client.4212.objecter ms_handle_connect 0x7f6ee4077d90 2026-02-24T19:16:47.325 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.323+0000 7f6efeffd640 1 -- 10.20.193.195:0/293333448 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(17..17 src has 1..17) ==== 2445+0+0 (unknown 2278620011 0 0) 0x7f6f08059780 con 0x7f6f18162250 2026-02-24T19:16:47.325 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.323+0000 7f6efeffd640 10 client.4212.objecter ms_dispatch2 0x7f6f18000b90 osd_map(17..17 src has 1..17) 2026-02-24T19:16:47.326 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.323+0000 7f6efeffd640 3 client.4212.objecter handle_osd_map got epochs [17,17] > 0 2026-02-24T19:16:47.326 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.323+0000 7f6efeffd640 3 client.4212.objecter handle_osd_map decoding full epoch 17 2026-02-24T19:16:47.326 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.323+0000 7f6efeffd640 20 client.4212.objecter dump_active .. 0 homeless 2026-02-24T19:16:47.326 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.323+0000 7f6efeffd640 1 -- 10.20.193.195:0/293333448 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f6f0805def0 con 0x7f6f18162250 2026-02-24T19:16:47.326 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.323+0000 7f6efeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:47.326 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.323+0000 7f6efeffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:16:47.436 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.433+0000 7f6f1ce08640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "4726a8b0-bcef-4e7f-aa36-e80228e2aec5", "id": 15}] 2026-02-24T19:16:47.436 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.433+0000 7f6f1ce08640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "4726a8b0-bcef-4e7f-aa36-e80228e2aec5", "id": 15}] 2026-02-24T19:16:47.436 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.433+0000 7f6f1ce08640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:16:47.436 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.433+0000 7f6f1ce08640 1 -- 10.20.193.195:0/293333448 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "osd new", "uuid": "4726a8b0-bcef-4e7f-aa36-e80228e2aec5", "id": 15} v 0) -- 0x7f6f1810e3c0 con 0x7f6f18162250 2026-02-24T19:16:47.448 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.447+0000 7f6efeffd640 1 -- 10.20.193.195:0/293333448 <== mon.0 v1:10.20.193.14:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4726a8b0-bcef-4e7f-aa36-e80228e2aec5", "id": 15}]=0 v18) ==== 113+0+3 (unknown 3346836791 0 1109645296) 0x7f6f0805d7f0 con 0x7f6f18162250 2026-02-24T19:16:47.448 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.447+0000 7f6efeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "4726a8b0-bcef-4e7f-aa36-e80228e2aec5", "id": 15}] 2026-02-24T19:16:47.449 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.447+0000 7f6efeffd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:16:47.449 INFO:teuthology.orchestra.run.trial195.stdout:15 2026-02-24T19:16:47.450 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.447+0000 7f6f1ce08640 10 librados: watch_flush enter 2026-02-24T19:16:47.451 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.447+0000 7f6f1ce08640 10 librados: watch_flush exit 2026-02-24T19:16:47.451 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.447+0000 7f6f1ce08640 20 client.4212.objecter shutdown clearing up homeless session... 2026-02-24T19:16:47.451 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.447+0000 7f6f1ce08640 10 client.4212.objecter successfully canceled tick 2026-02-24T19:16:47.451 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.447+0000 7f6f1ce08640 1 -- 10.20.193.195:0/293333448 >> v1:10.20.193.14:6800/4014096310 conn(0x7f6ee4077d90 legacy=0x7f6ee4098240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:47.451 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.447+0000 7f6f1ce08640 10 monclient: shutdown 2026-02-24T19:16:47.451 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.447+0000 7f6f1ce08640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:47.451 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.447+0000 7f6f1ce08640 1 -- 10.20.193.195:0/293333448 >> v1:10.20.193.14:6789/0 conn(0x7f6f18162250 legacy=0x7f6f18161ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:47.451 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.447+0000 7f6f1ce08640 1 -- 10.20.193.195:0/293333448 shutdown_connections 2026-02-24T19:16:47.451 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.447+0000 7f6f1ce08640 1 -- 10.20.193.195:0/293333448 >> 10.20.193.195:0/293333448 conn(0x7f6f180588d0 msgr2=0x7f6f181863e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:47.451 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.447+0000 7f6f1ce08640 1 -- 10.20.193.195:0/293333448 shutdown_connections 2026-02-24T19:16:47.451 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.447+0000 7f6f1ce08640 1 -- 10.20.193.195:0/293333448 wait complete. 2026-02-24T19:16:47.452 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T19:16:47.447+0000 7f6f1ce08640 1 librados: shutdown 2026-02-24T19:16:47.458 DEBUG:tasks.ceph_manager:running osd.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:16:47.458 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-24T19:16:47.459 DEBUG:teuthology.orchestra.run.trial014:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0 2026-02-24T19:16:47.461 INFO:tasks.ceph.osd.0:Started 2026-02-24T19:16:47.461 DEBUG:tasks.ceph_manager:running osd.4 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.4.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:16:47.461 INFO:tasks.ceph.osd.4:Restarting daemon 2026-02-24T19:16:47.462 DEBUG:teuthology.orchestra.run.trial014:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 4 2026-02-24T19:16:47.464 INFO:tasks.ceph.osd.4:Started 2026-02-24T19:16:47.464 DEBUG:tasks.ceph_manager:running osd.8 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.8.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:16:47.464 INFO:tasks.ceph.osd.8:Restarting daemon 2026-02-24T19:16:47.465 DEBUG:teuthology.orchestra.run.trial014:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.8.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 8 2026-02-24T19:16:47.467 INFO:tasks.ceph.osd.8:Started 2026-02-24T19:16:47.467 DEBUG:tasks.ceph_manager:running osd.12 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.12.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:16:47.467 INFO:tasks.ceph.osd.12:Restarting daemon 2026-02-24T19:16:47.467 DEBUG:teuthology.orchestra.run.trial014:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.12.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 12 2026-02-24T19:16:47.469 INFO:tasks.ceph.osd.12:Started 2026-02-24T19:16:47.470 DEBUG:tasks.ceph_manager:running osd.1 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.1.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:16:47.470 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-24T19:16:47.470 DEBUG:teuthology.orchestra.run.trial044:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1 2026-02-24T19:16:47.472 INFO:tasks.ceph.osd.1:Started 2026-02-24T19:16:47.472 DEBUG:tasks.ceph_manager:running osd.5 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.5.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:16:47.473 INFO:tasks.ceph.osd.5:Restarting daemon 2026-02-24T19:16:47.473 DEBUG:teuthology.orchestra.run.trial044:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 5 2026-02-24T19:16:47.475 INFO:tasks.ceph.osd.5:Started 2026-02-24T19:16:47.475 DEBUG:tasks.ceph_manager:running osd.9 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.9.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:16:47.475 INFO:tasks.ceph.osd.9:Restarting daemon 2026-02-24T19:16:47.476 DEBUG:teuthology.orchestra.run.trial044:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.9.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 9 2026-02-24T19:16:47.478 INFO:tasks.ceph.osd.9:Started 2026-02-24T19:16:47.478 DEBUG:tasks.ceph_manager:running osd.13 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.13.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:16:47.478 INFO:tasks.ceph.osd.13:Restarting daemon 2026-02-24T19:16:47.478 DEBUG:teuthology.orchestra.run.trial044:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.13.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 13 2026-02-24T19:16:47.481 INFO:tasks.ceph.osd.13:Started 2026-02-24T19:16:47.481 DEBUG:tasks.ceph_manager:running osd.2 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.2.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:16:47.481 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-24T19:16:47.481 DEBUG:teuthology.orchestra.run.trial170:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2 2026-02-24T19:16:47.483 INFO:tasks.ceph.osd.2:Started 2026-02-24T19:16:47.484 DEBUG:tasks.ceph_manager:running osd.6 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.6.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:16:47.484 INFO:tasks.ceph.osd.6:Restarting daemon 2026-02-24T19:16:47.484 DEBUG:teuthology.orchestra.run.trial170:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 6 2026-02-24T19:16:47.486 INFO:tasks.ceph.osd.6:Started 2026-02-24T19:16:47.486 DEBUG:tasks.ceph_manager:running osd.10 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.10.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:16:47.487 INFO:tasks.ceph.osd.10:Restarting daemon 2026-02-24T19:16:47.487 DEBUG:teuthology.orchestra.run.trial170:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.10.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 10 2026-02-24T19:16:47.489 INFO:tasks.ceph.osd.10:Started 2026-02-24T19:16:47.489 DEBUG:tasks.ceph_manager:running osd.14 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.14.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:16:47.489 INFO:tasks.ceph.osd.14:Restarting daemon 2026-02-24T19:16:47.489 DEBUG:teuthology.orchestra.run.trial170:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.14.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 14 2026-02-24T19:16:47.492 INFO:tasks.ceph.osd.14:Started 2026-02-24T19:16:47.492 DEBUG:tasks.ceph_manager:running osd.3 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.3.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:16:47.492 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-24T19:16:47.492 DEBUG:teuthology.orchestra.run.trial195:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 3 2026-02-24T19:16:47.494 INFO:tasks.ceph.osd.3:Started 2026-02-24T19:16:47.495 DEBUG:tasks.ceph_manager:running osd.7 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.7.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:16:47.495 INFO:tasks.ceph.osd.7:Restarting daemon 2026-02-24T19:16:47.495 DEBUG:teuthology.orchestra.run.trial195:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 7 2026-02-24T19:16:47.497 INFO:tasks.ceph.osd.7:Started 2026-02-24T19:16:47.497 DEBUG:tasks.ceph_manager:running osd.11 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.11.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:16:47.498 INFO:tasks.ceph.osd.11:Restarting daemon 2026-02-24T19:16:47.498 DEBUG:teuthology.orchestra.run.trial195:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.11.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 11 2026-02-24T19:16:47.500 INFO:tasks.ceph.osd.11:Started 2026-02-24T19:16:47.500 DEBUG:tasks.ceph_manager:running osd.15 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.15.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:16:47.500 INFO:tasks.ceph.osd.15:Restarting daemon 2026-02-24T19:16:47.501 DEBUG:teuthology.orchestra.run.trial195:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.15.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 15 2026-02-24T19:16:47.503 INFO:tasks.ceph.osd.15:Started 2026-02-24T19:16:47.503 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-24T19:16:47.571 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.569+0000 7f533044d640 10 monclient: get_monmap_and_config 2026-02-24T19:16:47.571 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.569+0000 7f533044d640 10 monclient: build_initial_monmap 2026-02-24T19:16:47.571 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.569+0000 7f533044d640 10 monclient: monmap: 2026-02-24T19:16:47.571 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:16:47.571 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:47.571 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:16:47.570415+0000 2026-02-24T19:16:47.571 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:16:47.570415+0000 2026-02-24T19:16:47.571 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:47.572 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:16:47.572 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:47.572 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:47.572 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:47.572 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:16:47.573 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.570+0000 7f533044d640 1 Processor -- start 2026-02-24T19:16:47.573 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.570+0000 7f533044d640 1 -- start start 2026-02-24T19:16:47.574 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.570+0000 7f533044d640 10 monclient: init 2026-02-24T19:16:47.574 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.570+0000 7f533044d640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:47.574 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.570+0000 7f533044d640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:16:47.574 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.570+0000 7f533044d640 10 monclient(hunting): picked mon.noname-c con 0x7f5328058da0 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:47.574 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.570+0000 7f533044d640 10 monclient(hunting): picked mon.noname-b con 0x7f53280b0410 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:47.574 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.570+0000 7f533044d640 10 monclient(hunting): picked mon.noname-a con 0x7f53281626a0 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:47.574 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.570+0000 7f533044d640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53281655c0 con 0x7f53281626a0 2026-02-24T19:16:47.574 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.570+0000 7f533044d640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53280b12b0 con 0x7f53280b0410 2026-02-24T19:16:47.574 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.570+0000 7f533044d640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53280b1590 con 0x7f5328058da0 2026-02-24T19:16:47.574 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.570+0000 7f533044d640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:47.574 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.570+0000 7f533044d640 10 monclient(hunting): authenticate will time out at 3582.251907s 2026-02-24T19:16:47.574 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.571+0000 7f532e9c3640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f53281626a0 0x7f53281c6d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:51310/0 (socket says 10.20.193.14:51310) 2026-02-24T19:16:47.575 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.571+0000 7f532e1c2640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7f5328058da0 0x7f53281647a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:48492/0 (socket says 10.20.193.14:48492) 2026-02-24T19:16:47.575 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.571+0000 7f532e9c3640 1 -- 10.20.193.14:0/4243030674 learned_addr learned my addr 10.20.193.14:0/4243030674 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:16:47.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.573+0000 7f532d1c0640 1 -- 10.20.193.14:0/4243030674 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2373079435 0 0) 0x7f53280b1590 con 0x7f5328058da0 2026-02-24T19:16:47.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.573+0000 7f532d1c0640 10 monclient(hunting): _negotiate 2026-02-24T19:16:47.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.573+0000 7f532d1c0640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:47.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.573+0000 7f532d1c0640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:47.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.573+0000 7f532d1c0640 10 monclient(hunting): my global_id is 4220 2026-02-24T19:16:47.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.573+0000 7f532d1c0640 1 -- 10.20.193.14:0/4243030674 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5310003610 con 0x7f5328058da0 2026-02-24T19:16:47.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.573+0000 7f532d1c0640 1 -- 10.20.193.14:0/4243030674 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2475536627 0 0) 0x7f53281655c0 con 0x7f53281626a0 2026-02-24T19:16:47.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.573+0000 7f532d1c0640 10 monclient(hunting): _negotiate 2026-02-24T19:16:47.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.573+0000 7f532d1c0640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:47.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.573+0000 7f532d1c0640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:47.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.573+0000 7f532d1c0640 10 monclient(hunting): my global_id is 4215 2026-02-24T19:16:47.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.573+0000 7f532d1c0640 1 -- 10.20.193.14:0/4243030674 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53280b1590 con 0x7f53281626a0 2026-02-24T19:16:47.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.573+0000 7f532d1c0640 1 -- 10.20.193.14:0/4243030674 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 690156755 0 0) 0x7f53280b12b0 con 0x7f53280b0410 2026-02-24T19:16:47.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.573+0000 7f532d1c0640 10 monclient(hunting): _negotiate 2026-02-24T19:16:47.578 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.573+0000 7f532d1c0640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:47.578 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.573+0000 7f532d1c0640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:47.578 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.573+0000 7f532d1c0640 10 monclient(hunting): my global_id is 4210 2026-02-24T19:16:47.578 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.573+0000 7f532d1c0640 1 -- 10.20.193.14:0/4243030674 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53281655c0 con 0x7f53280b0410 2026-02-24T19:16:47.578 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.575+0000 7f532d1c0640 1 -- 10.20.193.14:0/4243030674 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4079242838 0 0) 0x7f53280b1590 con 0x7f53281626a0 2026-02-24T19:16:47.578 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.575+0000 7f532d1c0640 1 -- 10.20.193.14:0/4243030674 >> v1:10.20.193.170:6789/0 conn(0x7f5328058da0 legacy=0x7f53281647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:47.578 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.575+0000 7f532d1c0640 1 -- 10.20.193.14:0/4243030674 >> v1:10.20.193.44:6789/0 conn(0x7f53280b0410 legacy=0x7f5328164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:47.578 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.575+0000 7f532d1c0640 10 monclient: _finish_hunting 0 2026-02-24T19:16:47.578 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.575+0000 7f532d1c0640 1 monclient: found mon.noname-a 2026-02-24T19:16:47.578 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.575+0000 7f532d1c0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:47.578 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.575+0000 7f532d1c0640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:16:47.578 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.575+0000 7f532d1c0640 1 -- 10.20.193.14:0/4243030674 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53280b1870 con 0x7f53281626a0 2026-02-24T19:16:47.579 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.575+0000 7f532d1c0640 10 monclient: _finish_auth 0 2026-02-24T19:16:47.579 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.575+0000 7f532d1c0640 10 monclient: _check_auth_tickets 2026-02-24T19:16:47.579 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.575+0000 7f532d1c0640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:47.579 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.575+0000 7f532d1c0640 1 -- 10.20.193.14:0/4243030674 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5324003170 con 0x7f53281626a0 2026-02-24T19:16:47.579 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.575+0000 7f532d1c0640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:47.579 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.575+0000 7f532d1c0640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:16:47.579 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.575+0000 7f532d1c0640 10 monclient: dump: 2026-02-24T19:16:47.579 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:16:47.579 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:47.579 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:47.579 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:47.579 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:47.579 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:16:47.580 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:47.580 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:47.580 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:47.580 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:16:47.580 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.575+0000 7f533044d640 5 monclient: authenticate success, global_id 4215 2026-02-24T19:16:47.580 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.575+0000 7f533044d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:16:47.585 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.576+0000 7f532d1c0640 1 -- 10.20.193.14:0/4243030674 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5324003340 con 0x7f53281626a0 2026-02-24T19:16:47.585 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.576+0000 7f532d1c0640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:47.586 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.576+0000 7f532d1c0640 1 -- 10.20.193.14:0/4243030674 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5324003780 con 0x7f53281626a0 2026-02-24T19:16:47.586 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.576+0000 7f532d1c0640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:47.586 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.576+0000 7f532d1c0640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:16:47.586 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.576+0000 7f532d1c0640 10 monclient: dump: 2026-02-24T19:16:47.586 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:16:47.586 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:47.586 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:47.586 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:47.586 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:47.586 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:16:47.586 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:47.587 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:47.587 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:47.587 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:16:47.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.576+0000 7f533044d640 10 monclient: get_monmap_and_config success 2026-02-24T19:16:47.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.576+0000 7f533044d640 4 set_mon_vals no callback set 2026-02-24T19:16:47.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.576+0000 7f533044d640 10 monclient: shutdown 2026-02-24T19:16:47.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.576+0000 7f533044d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:47.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.576+0000 7f533044d640 1 -- 10.20.193.14:0/4243030674 >> v1:10.20.193.14:6789/0 conn(0x7f53281626a0 legacy=0x7f53281c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:47.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.576+0000 7f533044d640 1 -- 10.20.193.14:0/4243030674 shutdown_connections 2026-02-24T19:16:47.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.576+0000 7f533044d640 1 -- 10.20.193.14:0/4243030674 >> 10.20.193.14:0/4243030674 conn(0x7f53280b65f0 msgr2=0x7f53280b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:47.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.576+0000 7f533044d640 1 -- 10.20.193.14:0/4243030674 shutdown_connections 2026-02-24T19:16:47.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.576+0000 7f533044d640 1 -- 10.20.193.14:0/4243030674 wait complete. 2026-02-24T19:16:47.588 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.576+0000 7f533044d640 10 monclient: build_initial_monmap 2026-02-24T19:16:47.588 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.576+0000 7f533044d640 10 monclient: monmap: 2026-02-24T19:16:47.588 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:16:47.588 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:16:47.588 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:16:47.588 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:16:47.588 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:47.588 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:16:47.588 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:47.588 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:47.588 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:47.588 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:16:47.588 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.577+0000 7f533044d640 1 librados: starting msgr at 2026-02-24T19:16:47.589 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.577+0000 7f533044d640 1 librados: starting objecter 2026-02-24T19:16:47.589 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.577+0000 7f533044d640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:16:47.589 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.577+0000 7f533044d640 1 Processor -- start 2026-02-24T19:16:47.589 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.577+0000 7f533044d640 1 -- start start 2026-02-24T19:16:47.589 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.577+0000 7f533044d640 1 librados: setting wanted keys 2026-02-24T19:16:47.589 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.577+0000 7f533044d640 1 librados: calling monclient init 2026-02-24T19:16:47.589 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.577+0000 7f533044d640 10 monclient: init 2026-02-24T19:16:47.589 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.577+0000 7f533044d640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:47.589 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.577+0000 7f533044d640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:16:47.589 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.577+0000 7f533044d640 10 monclient(hunting): picked mon.noname-b con 0x7f5328058da0 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:47.589 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.577+0000 7f533044d640 10 monclient(hunting): picked mon.noname-c con 0x7f53280b0410 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:47.589 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.577+0000 7f533044d640 10 monclient(hunting): picked mon.noname-a con 0x7f53281626a0 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:47.589 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.577+0000 7f533044d640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53281fc9a0 con 0x7f53281626a0 2026-02-24T19:16:47.590 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.577+0000 7f533044d640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53281fcc80 con 0x7f5328058da0 2026-02-24T19:16:47.590 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.577+0000 7f533044d640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53281fcf60 con 0x7f53280b0410 2026-02-24T19:16:47.590 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.577+0000 7f533044d640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:47.590 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.577+0000 7f533044d640 10 monclient(hunting): authenticate will time out at 3582.258603s 2026-02-24T19:16:47.590 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.577+0000 7f532e1c2640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7f5328058da0 0x7f53281359d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:57410/0 (socket says 10.20.193.14:57410) 2026-02-24T19:16:47.590 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.577+0000 7f532e1c2640 1 -- 10.20.193.14:0/905151135 learned_addr learned my addr 10.20.193.14:0/905151135 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:16:47.590 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.578+0000 7f530effd640 10 client.?.objecter ms_handle_connect 0x7f5328058da0 2026-02-24T19:16:47.590 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.578+0000 7f530effd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:47.590 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.578+0000 7f530effd640 10 client.?.objecter ms_handle_connect 0x7f53281626a0 2026-02-24T19:16:47.590 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.578+0000 7f530effd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:47.590 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.579+0000 7f530effd640 1 -- 10.20.193.14:0/905151135 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3494128772 0 0) 0x7f53281fcc80 con 0x7f5328058da0 2026-02-24T19:16:47.590 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.579+0000 7f530effd640 10 monclient(hunting): _negotiate 2026-02-24T19:16:47.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.579+0000 7f530effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:47.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.579+0000 7f530effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:47.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.579+0000 7f530effd640 10 monclient(hunting): my global_id is 4213 2026-02-24T19:16:47.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.579+0000 7f530effd640 1 -- 10.20.193.14:0/905151135 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52f8003610 con 0x7f5328058da0 2026-02-24T19:16:47.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.579+0000 7f530effd640 1 -- 10.20.193.14:0/905151135 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3393014859 0 0) 0x7f53281fc9a0 con 0x7f53281626a0 2026-02-24T19:16:47.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.579+0000 7f530effd640 10 monclient(hunting): _negotiate 2026-02-24T19:16:47.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.579+0000 7f530effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:47.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.579+0000 7f530effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:47.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.579+0000 7f530effd640 10 monclient(hunting): my global_id is 4218 2026-02-24T19:16:47.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.579+0000 7f530effd640 1 -- 10.20.193.14:0/905151135 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53281fcc80 con 0x7f53281626a0 2026-02-24T19:16:47.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.580+0000 7f530effd640 10 client.?.objecter ms_handle_connect 0x7f53280b0410 2026-02-24T19:16:47.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.580+0000 7f530effd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:47.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.581+0000 7f530effd640 1 -- 10.20.193.14:0/905151135 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2100211230 0 0) 0x7f53281fcf60 con 0x7f53280b0410 2026-02-24T19:16:47.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.581+0000 7f530effd640 10 monclient(hunting): _negotiate 2026-02-24T19:16:47.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.581+0000 7f530effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:47.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.581+0000 7f530effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:47.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.581+0000 7f530effd640 10 monclient(hunting): my global_id is 4223 2026-02-24T19:16:47.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.581+0000 7f530effd640 1 -- 10.20.193.14:0/905151135 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53281fc9a0 con 0x7f53280b0410 2026-02-24T19:16:47.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.581+0000 7f530effd640 1 -- 10.20.193.14:0/905151135 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2285795198 0 0) 0x7f52f8003610 con 0x7f5328058da0 2026-02-24T19:16:47.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.581+0000 7f530effd640 1 -- 10.20.193.14:0/905151135 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f53281fcf60 con 0x7f5328058da0 2026-02-24T19:16:47.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.581+0000 7f530effd640 1 -- 10.20.193.14:0/905151135 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f53180030b0 con 0x7f5328058da0 2026-02-24T19:16:47.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.581+0000 7f530effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:47.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.581+0000 7f530effd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:16:47.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.581+0000 7f530effd640 10 monclient(hunting): dump: 2026-02-24T19:16:47.592 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:16:47.592 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:47.593 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:47.593 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:47.593 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:47.593 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:16:47.593 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:47.593 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:47.593 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:47.593 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:16:47.593 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.581+0000 7f530effd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:16:47.593 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.582+0000 7f530effd640 1 -- 10.20.193.14:0/905151135 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3127186156 0 0) 0x7f53281fcc80 con 0x7f53281626a0 2026-02-24T19:16:47.593 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.582+0000 7f530effd640 1 -- 10.20.193.14:0/905151135 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f52f8003610 con 0x7f53281626a0 2026-02-24T19:16:47.593 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.582+0000 7f530effd640 1 -- 10.20.193.14:0/905151135 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5324003690 con 0x7f53281626a0 2026-02-24T19:16:47.594 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.582+0000 7f530effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:47.594 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.582+0000 7f530effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:16:47.594 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.582+0000 7f530effd640 10 monclient(hunting): dump: 2026-02-24T19:16:47.594 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:16:47.594 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:47.594 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:47.594 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:47.594 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:47.594 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:16:47.594 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:47.594 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:47.594 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:47.594 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:16:47.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.583+0000 7f530effd640 1 -- 10.20.193.14:0/905151135 <== mon.1 v1:10.20.193.44:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 519977412 0 0) 0x7f53281fcf60 con 0x7f5328058da0 2026-02-24T19:16:47.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.583+0000 7f530effd640 1 -- 10.20.193.14:0/905151135 >> v1:10.20.193.170:6789/0 conn(0x7f53280b0410 legacy=0x7f532813d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:47.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.583+0000 7f530effd640 1 -- 10.20.193.14:0/905151135 >> v1:10.20.193.14:6789/0 conn(0x7f53281626a0 legacy=0x7f532813be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:47.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.583+0000 7f530effd640 10 monclient: _finish_hunting 0 2026-02-24T19:16:47.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.583+0000 7f530effd640 1 monclient: found mon.b 2026-02-24T19:16:47.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.583+0000 7f530effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:47.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.583+0000 7f530effd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:16:47.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.583+0000 7f530effd640 1 -- 10.20.193.14:0/905151135 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53281fd240 con 0x7f5328058da0 2026-02-24T19:16:47.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.583+0000 7f530effd640 10 monclient: _finish_auth 0 2026-02-24T19:16:47.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.583+0000 7f530effd640 10 monclient: _check_auth_tickets 2026-02-24T19:16:47.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.583+0000 7f530effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:47.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.583+0000 7f533044d640 5 monclient: authenticate success, global_id 4213 2026-02-24T19:16:47.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.583+0000 7f533044d640 10 monclient: _renew_subs 2026-02-24T19:16:47.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.583+0000 7f533044d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:16:47.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.583+0000 7f533044d640 1 -- 10.20.193.14:0/905151135 --> v1:10.20.193.44:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f532813daa0 con 0x7f5328058da0 2026-02-24T19:16:47.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.583+0000 7f533044d640 10 client.4213.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:16:47.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.583+0000 7f533044d640 10 monclient: _renew_subs 2026-02-24T19:16:47.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.583+0000 7f533044d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:16:47.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.583+0000 7f533044d640 1 -- 10.20.193.14:0/905151135 --> v1:10.20.193.44:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5328057270 con 0x7f5328058da0 2026-02-24T19:16:47.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.583+0000 7f533044d640 1 librados: init done 2026-02-24T19:16:47.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.584+0000 7f533044d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:47.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.584+0000 7f533044d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:47.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.584+0000 7f533044d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:16:47.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.584+0000 7f533044d640 1 -- 10.20.193.14:0/905151135 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53281398c0 con 0x7f5328058da0 2026-02-24T19:16:47.598 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.591+0000 7f530effd640 1 -- 10.20.193.14:0/905151135 <== mon.1 v1:10.20.193.44:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5318003250 con 0x7f5328058da0 2026-02-24T19:16:47.598 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.591+0000 7f530effd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:47.598 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.591+0000 7f530effd640 1 -- 10.20.193.14:0/905151135 <== mon.1 v1:10.20.193.44:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5318004ab0 con 0x7f5328058da0 2026-02-24T19:16:47.598 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.591+0000 7f530effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:47.598 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.591+0000 7f530effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:16:47.598 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.591+0000 7f532c9bf640 4 set_mon_vals no callback set 2026-02-24T19:16:47.598 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.591+0000 7f530effd640 10 monclient: dump: 2026-02-24T19:16:47.598 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:16:47.598 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:47.598 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:47.599 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:47.599 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:47.599 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:16:47.599 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:47.599 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:47.599 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:47.599 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:16:47.599 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.592+0000 7f530effd640 1 -- 10.20.193.14:0/905151135 <== mon.1 v1:10.20.193.44:6789/0 7 ==== mgrmap(e 4) ==== 101507+0+0 (unknown 1883626494 0 0) 0x7f531801d920 con 0x7f5328058da0 2026-02-24T19:16:47.599 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.593+0000 7f532d9c1640 10 monclient: get_auth_request con 0x7f52f8077bb0 auth_method 0 2026-02-24T19:16:47.599 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.593+0000 7f530effd640 10 client.4213.objecter ms_handle_connect 0x7f52f8077bb0 2026-02-24T19:16:47.679 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.678+0000 7f530effd640 1 -- 10.20.193.14:0/905151135 <== mon.1 v1:10.20.193.44:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 2560+0+0 (unknown 3182630602 0 0) 0x7f5318059660 con 0x7f5328058da0 2026-02-24T19:16:47.680 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.678+0000 7f530effd640 10 client.4213.objecter ms_dispatch2 0x7f5328000b90 osd_map(18..18 src has 1..18) 2026-02-24T19:16:47.680 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.678+0000 7f530effd640 3 client.4213.objecter handle_osd_map got epochs [18,18] > 0 2026-02-24T19:16:47.680 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.678+0000 7f530effd640 3 client.4213.objecter handle_osd_map decoding full epoch 18 2026-02-24T19:16:47.680 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.678+0000 7f530effd640 20 client.4213.objecter dump_active .. 0 homeless 2026-02-24T19:16:47.680 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.678+0000 7f530effd640 1 -- 10.20.193.14:0/905151135 <== mon.1 v1:10.20.193.44:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f531805ddd0 con 0x7f5328058da0 2026-02-24T19:16:47.680 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.678+0000 7f530effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:47.680 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.678+0000 7f530effd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:16:47.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.786+0000 7f533044d640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:16:47.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.786+0000 7f533044d640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:16:47.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.786+0000 7f533044d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:16:47.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.786+0000 7f533044d640 1 -- 10.20.193.14:0/905151135 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f53280b73e0 con 0x7f5328058da0 2026-02-24T19:16:47.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.806+0000 7f530effd640 1 -- 10.20.193.14:0/905151135 <== mon.1 v1:10.20.193.44:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12877 (unknown 3338201251 0 3973102980) 0x7f531805d6d0 con 0x7f5328058da0 2026-02-24T19:16:47.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.806+0000 7f530effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:16:47.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.806+0000 7f530effd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:16:47.807 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:16:47.808 INFO:teuthology.orchestra.run.trial014.stdout:{"epoch":18,"fsid":"829a649b-54c9-463b-96b9-ffa203d49fa7","created":"2026-02-24T19:16:40.561511+0000","modified":"2026-02-24T19:16:47.437972+0000","last_up_change":"0.000000","last_in_change":"2026-02-24T19:16:47.437972+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9a3fd69b-7f2a-443b-9ae1-673acfad8b00","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7dca8ec5-5aa3-420d-bf78-1331d974dafd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5a7b7c02-22f9-4eb1-a1b0-afb106604416","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"695eeb19-d0a7-4b16-8d9a-ec59206d7ecc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"09ca59ec-7e76-44ba-bf1a-1b752732db60","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"64319106-a5b4-4775-b122-8c50216df3a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"19f0033c-abbd-406a-8eae-94e7e81da9ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7cdd3b9b-4146-45b9-aaf6-df379c7a1e0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"a4833012-c50c-4a6e-b754-cf18fc6117fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"322914a2-9ba3-44b8-98ec-958b00c92f0c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"dbfdf855-de28-491b-9112-8009ab155fb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"253e9d0b-391d-4647-bd89-6ab4b57909aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"7b7d5fca-4759-46e5-a681-45509749b265","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"8d1f12c8-5787-425d-a4a6-ac820bbf6e8b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"866643a2-5f54-425c-b5ec-70607e191f02","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"4726a8b0-bcef-4e7f-aa36-e80228e2aec5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T19:16:47.810 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.808+0000 7f533044d640 10 librados: watch_flush enter 2026-02-24T19:16:47.810 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.808+0000 7f533044d640 10 librados: watch_flush exit 2026-02-24T19:16:47.810 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.808+0000 7f533044d640 20 client.4213.objecter shutdown clearing up homeless session... 2026-02-24T19:16:47.810 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.808+0000 7f533044d640 10 client.4213.objecter successfully canceled tick 2026-02-24T19:16:47.810 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.808+0000 7f533044d640 1 -- 10.20.193.14:0/905151135 >> v1:10.20.193.14:6800/4014096310 conn(0x7f52f8077bb0 legacy=0x7f52f8098060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:47.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.808+0000 7f533044d640 10 monclient: shutdown 2026-02-24T19:16:47.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.808+0000 7f533044d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:47.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.808+0000 7f533044d640 1 -- 10.20.193.14:0/905151135 >> v1:10.20.193.44:6789/0 conn(0x7f5328058da0 legacy=0x7f53281359d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:47.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.808+0000 7f533044d640 1 -- 10.20.193.14:0/905151135 shutdown_connections 2026-02-24T19:16:47.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.808+0000 7f533044d640 1 -- 10.20.193.14:0/905151135 >> 10.20.193.14:0/905151135 conn(0x7f53280b65f0 msgr2=0x7f53280b3790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:47.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.808+0000 7f533044d640 1 -- 10.20.193.14:0/905151135 shutdown_connections 2026-02-24T19:16:47.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.808+0000 7f533044d640 1 -- 10.20.193.14:0/905151135 wait complete. 2026-02-24T19:16:47.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:16:47.808+0000 7f533044d640 1 librados: shutdown 2026-02-24T19:16:47.819 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-24T19:16:47.819 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-24T19:16:49.429 DEBUG:teuthology.orchestra.run.trial014:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-24T19:16:49.490 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.488+0000 7fdfb695c640 10 monclient: get_monmap_and_config 2026-02-24T19:16:49.490 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.488+0000 7fdfb695c640 10 monclient: build_initial_monmap 2026-02-24T19:16:49.490 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.488+0000 7fdfb695c640 10 monclient: monmap: 2026-02-24T19:16:49.490 INFO:teuthology.misc.health.trial014.stderr:epoch 0 2026-02-24T19:16:49.491 INFO:teuthology.misc.health.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:49.491 INFO:teuthology.misc.health.trial014.stderr:last_changed 2026-02-24T19:16:49.489894+0000 2026-02-24T19:16:49.491 INFO:teuthology.misc.health.trial014.stderr:created 2026-02-24T19:16:49.489894+0000 2026-02-24T19:16:49.491 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:49.491 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 3 2026-02-24T19:16:49.491 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:49.491 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:49.491 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:49.491 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:16:49.493 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.488+0000 7fdfb695c640 1 Processor -- start 2026-02-24T19:16:49.493 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.488+0000 7fdfb695c640 1 -- start start 2026-02-24T19:16:49.493 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.488+0000 7fdfb695c640 10 monclient: init 2026-02-24T19:16:49.493 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.489+0000 7fdfb695c640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:49.493 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.489+0000 7fdfb695c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:16:49.493 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.489+0000 7fdfb695c640 10 monclient(hunting): picked mon.noname-c con 0x7fdfb0058da0 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:49.493 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.489+0000 7fdfb695c640 10 monclient(hunting): picked mon.noname-a con 0x7fdfb00b0410 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:49.493 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.489+0000 7fdfb695c640 10 monclient(hunting): picked mon.noname-b con 0x7fdfb01626a0 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:49.493 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.489+0000 7fdfb695c640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfb01655c0 con 0x7fdfb00b0410 2026-02-24T19:16:49.494 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.489+0000 7fdfb695c640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfb00b12b0 con 0x7fdfb01626a0 2026-02-24T19:16:49.494 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.489+0000 7fdfb695c640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfb00b1590 con 0x7fdfb0058da0 2026-02-24T19:16:49.494 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.489+0000 7fdfb695c640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:49.494 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.489+0000 7fdfb695c640 10 monclient(hunting): authenticate will time out at 3584.171275s 2026-02-24T19:16:49.494 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.489+0000 7fdfaffff640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7fdfb0058da0 0x7fdfb01647a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:36564/0 (socket says 10.20.193.14:36564) 2026-02-24T19:16:49.494 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.489+0000 7fdfaffff640 1 -- 10.20.193.14:0/4052848080 learned_addr learned my addr 10.20.193.14:0/4052848080 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:16:49.498 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.491+0000 7fdfaeffd640 1 -- 10.20.193.14:0/4052848080 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1441516708 0 0) 0x7fdfb00b12b0 con 0x7fdfb01626a0 2026-02-24T19:16:49.498 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.491+0000 7fdfaeffd640 10 monclient(hunting): _negotiate 2026-02-24T19:16:49.498 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.491+0000 7fdfaeffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:49.499 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.491+0000 7fdfaeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:49.499 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.491+0000 7fdfaeffd640 10 monclient(hunting): my global_id is 4216 2026-02-24T19:16:49.499 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.491+0000 7fdfaeffd640 1 -- 10.20.193.14:0/4052848080 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf94003610 con 0x7fdfb01626a0 2026-02-24T19:16:49.499 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.491+0000 7fdfaeffd640 1 -- 10.20.193.14:0/4052848080 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1985393728 0 0) 0x7fdfb00b1590 con 0x7fdfb0058da0 2026-02-24T19:16:49.499 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.491+0000 7fdfaeffd640 10 monclient(hunting): _negotiate 2026-02-24T19:16:49.499 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.491+0000 7fdfaeffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:49.499 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.491+0000 7fdfaeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:49.499 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.491+0000 7fdfaeffd640 10 monclient(hunting): my global_id is 4226 2026-02-24T19:16:49.499 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.491+0000 7fdfaeffd640 1 -- 10.20.193.14:0/4052848080 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfb00b12b0 con 0x7fdfb0058da0 2026-02-24T19:16:49.499 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.491+0000 7fdfaeffd640 1 -- 10.20.193.14:0/4052848080 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 451723994 0 0) 0x7fdfb01655c0 con 0x7fdfb00b0410 2026-02-24T19:16:49.499 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.491+0000 7fdfaeffd640 10 monclient(hunting): _negotiate 2026-02-24T19:16:49.499 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.491+0000 7fdfaeffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:49.500 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.491+0000 7fdfaeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:49.500 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.491+0000 7fdfaeffd640 10 monclient(hunting): my global_id is 4221 2026-02-24T19:16:49.500 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.491+0000 7fdfaeffd640 1 -- 10.20.193.14:0/4052848080 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfb00b1590 con 0x7fdfb00b0410 2026-02-24T19:16:49.500 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.493+0000 7fdfaeffd640 1 -- 10.20.193.14:0/4052848080 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3777259013 0 0) 0x7fdf94003610 con 0x7fdfb01626a0 2026-02-24T19:16:49.500 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.493+0000 7fdfaeffd640 1 -- 10.20.193.14:0/4052848080 >> v1:10.20.193.170:6789/0 conn(0x7fdfb0058da0 legacy=0x7fdfb01647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:49.500 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.493+0000 7fdfaeffd640 1 -- 10.20.193.14:0/4052848080 >> v1:10.20.193.14:6789/0 conn(0x7fdfb00b0410 legacy=0x7fdfb0164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:49.500 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.493+0000 7fdfaeffd640 10 monclient: _finish_hunting 0 2026-02-24T19:16:49.500 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.493+0000 7fdfaeffd640 1 monclient: found mon.noname-b 2026-02-24T19:16:49.500 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.493+0000 7fdfaeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:49.500 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.493+0000 7fdfaeffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.44:6789/0 2026-02-24T19:16:49.500 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.493+0000 7fdfaeffd640 1 -- 10.20.193.14:0/4052848080 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb00b1870 con 0x7fdfb01626a0 2026-02-24T19:16:49.500 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.493+0000 7fdfaeffd640 10 monclient: _finish_auth 0 2026-02-24T19:16:49.501 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.493+0000 7fdfaeffd640 10 monclient: _check_auth_tickets 2026-02-24T19:16:49.501 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.493+0000 7fdfaeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:49.501 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.493+0000 7fdfaeffd640 1 -- 10.20.193.14:0/4052848080 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fdfa4003170 con 0x7fdfb01626a0 2026-02-24T19:16:49.501 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.493+0000 7fdfaeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:49.501 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.493+0000 7fdfaeffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:16:49.501 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.493+0000 7fdfaeffd640 10 monclient: dump: 2026-02-24T19:16:49.501 INFO:teuthology.misc.health.trial014.stderr:epoch 1 2026-02-24T19:16:49.501 INFO:teuthology.misc.health.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:49.501 INFO:teuthology.misc.health.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:49.501 INFO:teuthology.misc.health.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:49.501 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:49.501 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 3 2026-02-24T19:16:49.502 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:49.502 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:49.502 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:49.502 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:16:49.502 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.493+0000 7fdfb695c640 5 monclient: authenticate success, global_id 4216 2026-02-24T19:16:49.502 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.493+0000 7fdfb695c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:16:49.502 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.494+0000 7fdfaeffd640 1 -- 10.20.193.14:0/4052848080 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdfa4003340 con 0x7fdfb01626a0 2026-02-24T19:16:49.502 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.494+0000 7fdfaeffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:49.502 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.494+0000 7fdfaeffd640 1 -- 10.20.193.14:0/4052848080 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fdfa4003780 con 0x7fdfb01626a0 2026-02-24T19:16:49.502 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.494+0000 7fdfaeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:49.502 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.494+0000 7fdfaeffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:16:49.502 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.494+0000 7fdfaeffd640 10 monclient: dump: 2026-02-24T19:16:49.502 INFO:teuthology.misc.health.trial014.stderr:epoch 1 2026-02-24T19:16:49.503 INFO:teuthology.misc.health.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:49.503 INFO:teuthology.misc.health.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:49.503 INFO:teuthology.misc.health.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:49.503 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:49.503 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 3 2026-02-24T19:16:49.503 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:49.503 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:49.503 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:49.503 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:16:49.503 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.494+0000 7fdfb695c640 10 monclient: get_monmap_and_config success 2026-02-24T19:16:49.503 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.494+0000 7fdfb695c640 4 set_mon_vals no callback set 2026-02-24T19:16:49.503 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.494+0000 7fdfb695c640 10 monclient: shutdown 2026-02-24T19:16:49.503 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.494+0000 7fdfb695c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:49.504 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.494+0000 7fdfb695c640 1 -- 10.20.193.14:0/4052848080 >> v1:10.20.193.44:6789/0 conn(0x7fdfb01626a0 legacy=0x7fdfb01c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:49.504 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.494+0000 7fdfb695c640 1 -- 10.20.193.14:0/4052848080 shutdown_connections 2026-02-24T19:16:49.504 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.494+0000 7fdfb695c640 1 -- 10.20.193.14:0/4052848080 >> 10.20.193.14:0/4052848080 conn(0x7fdfb00b65f0 msgr2=0x7fdfb00b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:49.504 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.494+0000 7fdfb695c640 1 -- 10.20.193.14:0/4052848080 shutdown_connections 2026-02-24T19:16:49.504 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.494+0000 7fdfb695c640 1 -- 10.20.193.14:0/4052848080 wait complete. 2026-02-24T19:16:49.504 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.494+0000 7fdfb695c640 10 monclient: build_initial_monmap 2026-02-24T19:16:49.504 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.494+0000 7fdfb695c640 10 monclient: monmap: 2026-02-24T19:16:49.504 INFO:teuthology.misc.health.trial014.stderr:epoch 0 2026-02-24T19:16:49.504 INFO:teuthology.misc.health.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:16:49.504 INFO:teuthology.misc.health.trial014.stderr:last_changed 0.000000 2026-02-24T19:16:49.504 INFO:teuthology.misc.health.trial014.stderr:created 0.000000 2026-02-24T19:16:49.504 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:49.504 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 1 2026-02-24T19:16:49.505 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:49.505 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:49.505 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:49.505 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:16:49.505 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.494+0000 7fdfb695c640 1 librados: starting msgr at 2026-02-24T19:16:49.505 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.494+0000 7fdfb695c640 1 librados: starting objecter 2026-02-24T19:16:49.505 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.495+0000 7fdfb695c640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:16:49.505 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.495+0000 7fdfb695c640 1 Processor -- start 2026-02-24T19:16:49.505 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.495+0000 7fdfb695c640 1 -- start start 2026-02-24T19:16:49.505 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.495+0000 7fdfb695c640 1 librados: setting wanted keys 2026-02-24T19:16:49.505 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.495+0000 7fdfb695c640 1 librados: calling monclient init 2026-02-24T19:16:49.505 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.495+0000 7fdfb695c640 10 monclient: init 2026-02-24T19:16:49.506 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.495+0000 7fdfb695c640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:49.506 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.495+0000 7fdfb695c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:16:49.506 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.495+0000 7fdfb695c640 10 monclient(hunting): picked mon.noname-c con 0x7fdfb0058da0 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:49.506 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.495+0000 7fdfb695c640 10 monclient(hunting): picked mon.noname-a con 0x7fdfb00b0410 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:49.506 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.495+0000 7fdfb695c640 10 monclient(hunting): picked mon.noname-b con 0x7fdfb01626a0 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:49.506 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.495+0000 7fdfb695c640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfb005b680 con 0x7fdfb00b0410 2026-02-24T19:16:49.506 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.495+0000 7fdfb695c640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfb0057030 con 0x7fdfb01626a0 2026-02-24T19:16:49.506 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.495+0000 7fdfb695c640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfb0161680 con 0x7fdfb0058da0 2026-02-24T19:16:49.506 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.495+0000 7fdfb695c640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:49.506 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.495+0000 7fdfb695c640 10 monclient(hunting): authenticate will time out at 3584.177494s 2026-02-24T19:16:49.506 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.495+0000 7fdfaf7fe640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7fdfb00b0410 0x7fdfb0056920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:46808/0 (socket says 10.20.193.14:46808) 2026-02-24T19:16:49.506 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.495+0000 7fdfaf7fe640 1 -- 10.20.193.14:0/491039176 learned_addr learned my addr 10.20.193.14:0/491039176 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:16:49.507 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.495+0000 7fdfacff9640 10 client.?.objecter ms_handle_connect 0x7fdfb00b0410 2026-02-24T19:16:49.507 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.495+0000 7fdfacff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:49.507 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.495+0000 7fdfacff9640 10 client.?.objecter ms_handle_connect 0x7fdfb0058da0 2026-02-24T19:16:49.507 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.495+0000 7fdfacff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:49.507 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.496+0000 7fdfacff9640 10 client.?.objecter ms_handle_connect 0x7fdfb01626a0 2026-02-24T19:16:49.507 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.496+0000 7fdfacff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:49.511 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.496+0000 7fdfacff9640 1 -- 10.20.193.14:0/491039176 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1337160693 0 0) 0x7fdfb0161680 con 0x7fdfb0058da0 2026-02-24T19:16:49.511 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.496+0000 7fdfacff9640 10 monclient(hunting): _negotiate 2026-02-24T19:16:49.511 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.496+0000 7fdfacff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:49.511 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.496+0000 7fdfacff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:49.511 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.496+0000 7fdfacff9640 10 monclient(hunting): my global_id is 4229 2026-02-24T19:16:49.511 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.496+0000 7fdfacff9640 1 -- 10.20.193.14:0/491039176 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf80003610 con 0x7fdfb0058da0 2026-02-24T19:16:49.511 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.496+0000 7fdfacff9640 1 -- 10.20.193.14:0/491039176 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3517581327 0 0) 0x7fdfb005b680 con 0x7fdfb00b0410 2026-02-24T19:16:49.511 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.496+0000 7fdfacff9640 10 monclient(hunting): _negotiate 2026-02-24T19:16:49.512 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.496+0000 7fdfacff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:49.512 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.496+0000 7fdfacff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:49.512 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.496+0000 7fdfacff9640 10 monclient(hunting): my global_id is 4224 2026-02-24T19:16:49.512 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.496+0000 7fdfacff9640 1 -- 10.20.193.14:0/491039176 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfb0161680 con 0x7fdfb00b0410 2026-02-24T19:16:49.512 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.497+0000 7fdfacff9640 1 -- 10.20.193.14:0/491039176 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 79108182 0 0) 0x7fdfb0057030 con 0x7fdfb01626a0 2026-02-24T19:16:49.512 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.497+0000 7fdfacff9640 10 monclient(hunting): _negotiate 2026-02-24T19:16:49.512 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.497+0000 7fdfacff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:49.512 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.497+0000 7fdfacff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:49.512 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.497+0000 7fdfacff9640 10 monclient(hunting): my global_id is 4219 2026-02-24T19:16:49.512 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.497+0000 7fdfacff9640 1 -- 10.20.193.14:0/491039176 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfb005b680 con 0x7fdfb01626a0 2026-02-24T19:16:49.512 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.499+0000 7fdfacff9640 1 -- 10.20.193.14:0/491039176 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 845094540 0 0) 0x7fdfb005b680 con 0x7fdfb01626a0 2026-02-24T19:16:49.512 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.499+0000 7fdfacff9640 1 -- 10.20.193.14:0/491039176 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdfb0057030 con 0x7fdfb01626a0 2026-02-24T19:16:49.513 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.499+0000 7fdfacff9640 1 -- 10.20.193.14:0/491039176 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fdfa40034f0 con 0x7fdfb01626a0 2026-02-24T19:16:49.513 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.499+0000 7fdfacff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:49.513 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.499+0000 7fdfacff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:16:49.513 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.499+0000 7fdfacff9640 10 monclient(hunting): dump: 2026-02-24T19:16:49.513 INFO:teuthology.misc.health.trial014.stderr:epoch 1 2026-02-24T19:16:49.513 INFO:teuthology.misc.health.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:49.513 INFO:teuthology.misc.health.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:49.513 INFO:teuthology.misc.health.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:49.513 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:49.513 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 3 2026-02-24T19:16:49.513 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:49.513 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:49.514 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:49.514 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:16:49.514 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.499+0000 7fdfacff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:16:49.514 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.499+0000 7fdfacff9640 1 -- 10.20.193.14:0/491039176 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2617313950 0 0) 0x7fdf80003610 con 0x7fdfb0058da0 2026-02-24T19:16:49.514 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.499+0000 7fdfacff9640 1 -- 10.20.193.14:0/491039176 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdfb005b680 con 0x7fdfb0058da0 2026-02-24T19:16:49.514 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.499+0000 7fdfacff9640 1 -- 10.20.193.14:0/491039176 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fdf9c0030b0 con 0x7fdfb0058da0 2026-02-24T19:16:49.514 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.499+0000 7fdfacff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:49.514 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.499+0000 7fdfacff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:16:49.514 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.499+0000 7fdfacff9640 10 monclient(hunting): dump: 2026-02-24T19:16:49.514 INFO:teuthology.misc.health.trial014.stderr:epoch 1 2026-02-24T19:16:49.514 INFO:teuthology.misc.health.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:49.514 INFO:teuthology.misc.health.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:49.515 INFO:teuthology.misc.health.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:49.515 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:49.515 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 3 2026-02-24T19:16:49.515 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:49.515 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:49.515 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:49.515 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:16:49.515 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.499+0000 7fdfacff9640 1 -- 10.20.193.14:0/491039176 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 854832651 0 0) 0x7fdfb0161680 con 0x7fdfb00b0410 2026-02-24T19:16:49.515 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.499+0000 7fdfacff9640 1 -- 10.20.193.14:0/491039176 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdf80003610 con 0x7fdfb00b0410 2026-02-24T19:16:49.515 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.499+0000 7fdfacff9640 1 -- 10.20.193.14:0/491039176 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fdfa0003170 con 0x7fdfb00b0410 2026-02-24T19:16:49.515 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.499+0000 7fdfacff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:49.515 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.499+0000 7fdfacff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:16:49.515 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.499+0000 7fdfacff9640 10 monclient(hunting): dump: 2026-02-24T19:16:49.516 INFO:teuthology.misc.health.trial014.stderr:epoch 1 2026-02-24T19:16:49.516 INFO:teuthology.misc.health.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:49.516 INFO:teuthology.misc.health.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:49.516 INFO:teuthology.misc.health.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:49.516 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:49.516 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 3 2026-02-24T19:16:49.516 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:49.516 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:49.516 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:49.516 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:16:49.516 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.501+0000 7fdfacff9640 1 -- 10.20.193.14:0/491039176 <== mon.1 v1:10.20.193.44:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 917269224 0 0) 0x7fdfb0057030 con 0x7fdfb01626a0 2026-02-24T19:16:49.516 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.501+0000 7fdfacff9640 1 -- 10.20.193.14:0/491039176 >> v1:10.20.193.170:6789/0 conn(0x7fdfb0058da0 legacy=0x7fdfb005c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:49.517 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.501+0000 7fdfacff9640 1 -- 10.20.193.14:0/491039176 >> v1:10.20.193.14:6789/0 conn(0x7fdfb00b0410 legacy=0x7fdfb0056920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:49.517 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.501+0000 7fdfacff9640 10 monclient: _finish_hunting 0 2026-02-24T19:16:49.517 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.501+0000 7fdfacff9640 1 monclient: found mon.b 2026-02-24T19:16:49.517 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.501+0000 7fdfacff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:49.517 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.501+0000 7fdfacff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:16:49.517 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.501+0000 7fdfacff9640 1 -- 10.20.193.14:0/491039176 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb005b920 con 0x7fdfb01626a0 2026-02-24T19:16:49.517 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.501+0000 7fdfacff9640 10 monclient: _finish_auth 0 2026-02-24T19:16:49.517 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.501+0000 7fdfacff9640 10 monclient: _check_auth_tickets 2026-02-24T19:16:49.517 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.501+0000 7fdfacff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:49.517 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.501+0000 7fdfb695c640 5 monclient: authenticate success, global_id 4219 2026-02-24T19:16:49.517 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.501+0000 7fdfb695c640 10 monclient: _renew_subs 2026-02-24T19:16:49.517 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.501+0000 7fdfb695c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:16:49.517 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.501+0000 7fdfb695c640 1 -- 10.20.193.14:0/491039176 --> v1:10.20.193.44:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdfb005bc00 con 0x7fdfb01626a0 2026-02-24T19:16:49.518 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.501+0000 7fdfb695c640 10 client.4219.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:16:49.518 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.501+0000 7fdfb695c640 10 monclient: _renew_subs 2026-02-24T19:16:49.518 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.501+0000 7fdfb695c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:16:49.518 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.501+0000 7fdfb695c640 1 -- 10.20.193.14:0/491039176 --> v1:10.20.193.44:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fdfb01fc0b0 con 0x7fdfb01626a0 2026-02-24T19:16:49.518 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.501+0000 7fdfb695c640 1 librados: init done 2026-02-24T19:16:49.518 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.501+0000 7fdfb695c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:49.518 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.501+0000 7fdfb695c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:49.518 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.501+0000 7fdfb695c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:16:49.518 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.501+0000 7fdfb695c640 1 -- 10.20.193.14:0/491039176 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfb00b6d40 con 0x7fdfb01626a0 2026-02-24T19:16:49.518 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.507+0000 7fdfacff9640 1 -- 10.20.193.14:0/491039176 <== mon.1 v1:10.20.193.44:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdfa40032f0 con 0x7fdfb01626a0 2026-02-24T19:16:49.518 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.507+0000 7fdfacff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:49.518 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.507+0000 7fdfacff9640 1 -- 10.20.193.14:0/491039176 <== mon.1 v1:10.20.193.44:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fdfa4003b50 con 0x7fdfb01626a0 2026-02-24T19:16:49.519 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.507+0000 7fdfacff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:49.519 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.507+0000 7fdfacff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:16:49.519 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.507+0000 7fdfae7fc640 4 set_mon_vals no callback set 2026-02-24T19:16:49.519 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.507+0000 7fdfacff9640 10 monclient: dump: 2026-02-24T19:16:49.519 INFO:teuthology.misc.health.trial014.stderr:epoch 1 2026-02-24T19:16:49.519 INFO:teuthology.misc.health.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:49.519 INFO:teuthology.misc.health.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:49.519 INFO:teuthology.misc.health.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:49.519 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:49.519 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 3 2026-02-24T19:16:49.519 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:49.519 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:49.520 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:49.520 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:16:49.521 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.509+0000 7fdfacff9640 1 -- 10.20.193.14:0/491039176 <== mon.1 v1:10.20.193.44:6789/0 7 ==== mgrmap(e 4) ==== 101507+0+0 (unknown 1883626494 0 0) 0x7fdfa401c980 con 0x7fdfb01626a0 2026-02-24T19:16:49.521 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.510+0000 7fdfaffff640 10 monclient: get_auth_request con 0x7fdf80077e40 auth_method 0 2026-02-24T19:16:49.521 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.510+0000 7fdfacff9640 10 client.4219.objecter ms_handle_connect 0x7fdf80077e40 2026-02-24T19:16:49.521 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.510+0000 7fdfacff9640 1 -- 10.20.193.14:0/491039176 <== mon.1 v1:10.20.193.44:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 2560+0+0 (unknown 3182630602 0 0) 0x7fdfa40584e0 con 0x7fdfb01626a0 2026-02-24T19:16:49.521 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.510+0000 7fdfacff9640 10 client.4219.objecter ms_dispatch2 0x7fdfb0000b90 osd_map(18..18 src has 1..18) 2026-02-24T19:16:49.522 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.510+0000 7fdfacff9640 3 client.4219.objecter handle_osd_map got epochs [18,18] > 0 2026-02-24T19:16:49.522 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.510+0000 7fdfacff9640 3 client.4219.objecter handle_osd_map decoding full epoch 18 2026-02-24T19:16:49.522 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.510+0000 7fdfacff9640 20 client.4219.objecter dump_active .. 0 homeless 2026-02-24T19:16:49.598 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.596+0000 7fdfacff9640 1 -- 10.20.193.14:0/491039176 <== mon.1 v1:10.20.193.44:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fdfa405cc50 con 0x7fdfb01626a0 2026-02-24T19:16:49.598 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.596+0000 7fdfacff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:49.598 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.596+0000 7fdfacff9640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:16:49.709 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.707+0000 7fdfb695c640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:16:49.709 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.707+0000 7fdfb695c640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:16:49.709 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.707+0000 7fdfb695c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:16:49.709 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.707+0000 7fdfb695c640 1 -- 10.20.193.14:0/491039176 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdfb00b6a60 con 0x7fdfb01626a0 2026-02-24T19:16:49.716 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.714+0000 7fdfacff9640 1 -- 10.20.193.14:0/491039176 <== mon.1 v1:10.20.193.44:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12877 (unknown 3338201251 0 3973102980) 0x7fdfa405c550 con 0x7fdfb01626a0 2026-02-24T19:16:49.716 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.714+0000 7fdfacff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:16:49.716 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.714+0000 7fdfacff9640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:16:49.717 INFO:teuthology.misc.health.trial014.stdout: 2026-02-24T19:16:49.717 INFO:teuthology.misc.health.trial014.stdout:{"epoch":18,"fsid":"829a649b-54c9-463b-96b9-ffa203d49fa7","created":"2026-02-24T19:16:40.561511+0000","modified":"2026-02-24T19:16:47.437972+0000","last_up_change":"0.000000","last_in_change":"2026-02-24T19:16:47.437972+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9a3fd69b-7f2a-443b-9ae1-673acfad8b00","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7dca8ec5-5aa3-420d-bf78-1331d974dafd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5a7b7c02-22f9-4eb1-a1b0-afb106604416","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"695eeb19-d0a7-4b16-8d9a-ec59206d7ecc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"09ca59ec-7e76-44ba-bf1a-1b752732db60","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"64319106-a5b4-4775-b122-8c50216df3a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"19f0033c-abbd-406a-8eae-94e7e81da9ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7cdd3b9b-4146-45b9-aaf6-df379c7a1e0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"a4833012-c50c-4a6e-b754-cf18fc6117fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"322914a2-9ba3-44b8-98ec-958b00c92f0c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"dbfdf855-de28-491b-9112-8009ab155fb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"253e9d0b-391d-4647-bd89-6ab4b57909aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"7b7d5fca-4759-46e5-a681-45509749b265","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"8d1f12c8-5787-425d-a4a6-ac820bbf6e8b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"866643a2-5f54-425c-b5ec-70607e191f02","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"4726a8b0-bcef-4e7f-aa36-e80228e2aec5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T19:16:49.720 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.717+0000 7fdfb695c640 10 librados: watch_flush enter 2026-02-24T19:16:49.720 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.717+0000 7fdfb695c640 10 librados: watch_flush exit 2026-02-24T19:16:49.720 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.717+0000 7fdfb695c640 20 client.4219.objecter shutdown clearing up homeless session... 2026-02-24T19:16:49.720 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.717+0000 7fdfb695c640 10 client.4219.objecter successfully canceled tick 2026-02-24T19:16:49.720 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.717+0000 7fdfb695c640 1 -- 10.20.193.14:0/491039176 >> v1:10.20.193.14:6800/4014096310 conn(0x7fdf80077e40 legacy=0x7fdf800982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:49.720 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.717+0000 7fdfb695c640 10 monclient: shutdown 2026-02-24T19:16:49.720 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.717+0000 7fdfb695c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:49.720 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.717+0000 7fdfb695c640 1 -- 10.20.193.14:0/491039176 >> v1:10.20.193.44:6789/0 conn(0x7fdfb01626a0 legacy=0x7fdfb01fd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:49.720 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.717+0000 7fdfb695c640 1 -- 10.20.193.14:0/491039176 shutdown_connections 2026-02-24T19:16:49.720 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.717+0000 7fdfb695c640 1 -- 10.20.193.14:0/491039176 >> 10.20.193.14:0/491039176 conn(0x7fdfb00b65f0 msgr2=0x7fdfb00579d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:49.721 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.717+0000 7fdfb695c640 1 -- 10.20.193.14:0/491039176 shutdown_connections 2026-02-24T19:16:49.721 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.717+0000 7fdfb695c640 1 -- 10.20.193.14:0/491039176 wait complete. 2026-02-24T19:16:49.721 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:49.717+0000 7fdfb695c640 1 librados: shutdown 2026-02-24T19:16:49.728 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-24T19:16:57.338 DEBUG:teuthology.orchestra.run.trial014:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-24T19:16:57.399 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.397+0000 7fa159ce1640 10 monclient: get_monmap_and_config 2026-02-24T19:16:57.400 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.397+0000 7fa159ce1640 10 monclient: build_initial_monmap 2026-02-24T19:16:57.400 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.397+0000 7fa159ce1640 10 monclient: monmap: 2026-02-24T19:16:57.400 INFO:teuthology.misc.health.trial014.stderr:epoch 0 2026-02-24T19:16:57.400 INFO:teuthology.misc.health.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:57.400 INFO:teuthology.misc.health.trial014.stderr:last_changed 2026-02-24T19:16:57.398750+0000 2026-02-24T19:16:57.400 INFO:teuthology.misc.health.trial014.stderr:created 2026-02-24T19:16:57.398750+0000 2026-02-24T19:16:57.400 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:57.400 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 3 2026-02-24T19:16:57.400 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:57.400 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:57.401 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:57.401 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:16:57.401 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.397+0000 7fa159ce1640 1 Processor -- start 2026-02-24T19:16:57.401 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.397+0000 7fa159ce1640 1 -- start start 2026-02-24T19:16:57.401 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.397+0000 7fa159ce1640 10 monclient: init 2026-02-24T19:16:57.403 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.398+0000 7fa159ce1640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:57.403 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.398+0000 7fa159ce1640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:16:57.403 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.398+0000 7fa159ce1640 10 monclient(hunting): picked mon.noname-a con 0x7fa154058da0 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:57.403 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.398+0000 7fa159ce1640 10 monclient(hunting): picked mon.noname-b con 0x7fa154059170 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:57.404 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.398+0000 7fa159ce1640 10 monclient(hunting): picked mon.noname-c con 0x7fa154159ee0 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:57.404 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.398+0000 7fa159ce1640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa15405d6e0 con 0x7fa154058da0 2026-02-24T19:16:57.404 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.398+0000 7fa159ce1640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa154164100 con 0x7fa154059170 2026-02-24T19:16:57.404 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.398+0000 7fa159ce1640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1540a8ff0 con 0x7fa154159ee0 2026-02-24T19:16:57.404 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.398+0000 7fa159ce1640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:57.404 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.398+0000 7fa159ce1640 10 monclient(hunting): authenticate will time out at 3592.080171s 2026-02-24T19:16:57.404 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.398+0000 7fa1537fe640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7fa154058da0 0x7fa15405cfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:46818/0 (socket says 10.20.193.14:46818) 2026-02-24T19:16:57.404 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.398+0000 7fa1537fe640 1 -- 10.20.193.14:0/1216446816 learned_addr learned my addr 10.20.193.14:0/1216446816 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:16:57.404 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.400+0000 7fa1527fc640 1 -- 10.20.193.14:0/1216446816 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2384520722 0 0) 0x7fa15405d6e0 con 0x7fa154058da0 2026-02-24T19:16:57.404 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.400+0000 7fa1527fc640 10 monclient(hunting): _negotiate 2026-02-24T19:16:57.404 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.400+0000 7fa1527fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:57.404 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.400+0000 7fa1527fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:57.405 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.400+0000 7fa1527fc640 10 monclient(hunting): my global_id is 4227 2026-02-24T19:16:57.405 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.400+0000 7fa1527fc640 1 -- 10.20.193.14:0/1216446816 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa138003610 con 0x7fa154058da0 2026-02-24T19:16:57.405 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.400+0000 7fa1527fc640 1 -- 10.20.193.14:0/1216446816 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 663253484 0 0) 0x7fa1540a8ff0 con 0x7fa154159ee0 2026-02-24T19:16:57.405 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.400+0000 7fa1527fc640 10 monclient(hunting): _negotiate 2026-02-24T19:16:57.405 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.400+0000 7fa1527fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:57.405 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.400+0000 7fa1527fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:57.405 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.400+0000 7fa1527fc640 10 monclient(hunting): my global_id is 4232 2026-02-24T19:16:57.405 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.400+0000 7fa1527fc640 1 -- 10.20.193.14:0/1216446816 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa15405d6e0 con 0x7fa154159ee0 2026-02-24T19:16:57.405 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.400+0000 7fa1527fc640 1 -- 10.20.193.14:0/1216446816 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1156693072 0 0) 0x7fa154164100 con 0x7fa154059170 2026-02-24T19:16:57.405 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.400+0000 7fa1527fc640 10 monclient(hunting): _negotiate 2026-02-24T19:16:57.405 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.400+0000 7fa1527fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:57.405 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.400+0000 7fa1527fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:57.406 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.400+0000 7fa1527fc640 10 monclient(hunting): my global_id is 4222 2026-02-24T19:16:57.406 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.400+0000 7fa1527fc640 1 -- 10.20.193.14:0/1216446816 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1540a8ff0 con 0x7fa154059170 2026-02-24T19:16:57.410 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.402+0000 7fa1527fc640 1 -- 10.20.193.14:0/1216446816 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2704046698 0 0) 0x7fa15405d6e0 con 0x7fa154159ee0 2026-02-24T19:16:57.410 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.402+0000 7fa1527fc640 1 -- 10.20.193.14:0/1216446816 >> v1:10.20.193.44:6789/0 conn(0x7fa154059170 legacy=0x7fa1541597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:57.410 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.402+0000 7fa1527fc640 1 -- 10.20.193.14:0/1216446816 >> v1:10.20.193.14:6789/0 conn(0x7fa154058da0 legacy=0x7fa15405cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:57.410 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.402+0000 7fa1527fc640 10 monclient: _finish_hunting 0 2026-02-24T19:16:57.410 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.402+0000 7fa1527fc640 1 monclient: found mon.noname-c 2026-02-24T19:16:57.410 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.402+0000 7fa1527fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:57.410 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.402+0000 7fa1527fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.170:6789/0 2026-02-24T19:16:57.410 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.402+0000 7fa1527fc640 1 -- 10.20.193.14:0/1216446816 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1540a92d0 con 0x7fa154159ee0 2026-02-24T19:16:57.410 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.402+0000 7fa1527fc640 10 monclient: _finish_auth 0 2026-02-24T19:16:57.410 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.402+0000 7fa1527fc640 10 monclient: _check_auth_tickets 2026-02-24T19:16:57.410 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.402+0000 7fa1527fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:57.411 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.402+0000 7fa1527fc640 1 -- 10.20.193.14:0/1216446816 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fa148003170 con 0x7fa154159ee0 2026-02-24T19:16:57.411 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.402+0000 7fa159ce1640 5 monclient: authenticate success, global_id 4232 2026-02-24T19:16:57.411 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.402+0000 7fa159ce1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:16:57.411 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.402+0000 7fa1527fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:57.411 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.402+0000 7fa1527fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:16:57.411 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.402+0000 7fa1527fc640 10 monclient: dump: 2026-02-24T19:16:57.411 INFO:teuthology.misc.health.trial014.stderr:epoch 1 2026-02-24T19:16:57.411 INFO:teuthology.misc.health.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:57.411 INFO:teuthology.misc.health.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:57.411 INFO:teuthology.misc.health.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:57.411 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:57.411 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 3 2026-02-24T19:16:57.412 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:57.412 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:57.412 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:57.412 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:16:57.412 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.402+0000 7fa159ce1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:16:57.412 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.403+0000 7fa1527fc640 1 -- 10.20.193.14:0/1216446816 <== mon.2 v1:10.20.193.170:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa148003340 con 0x7fa154159ee0 2026-02-24T19:16:57.412 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.403+0000 7fa1527fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:57.412 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.403+0000 7fa1527fc640 1 -- 10.20.193.14:0/1216446816 <== mon.2 v1:10.20.193.170:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fa148003780 con 0x7fa154159ee0 2026-02-24T19:16:57.412 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.403+0000 7fa1527fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:57.412 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.403+0000 7fa1527fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:16:57.412 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.403+0000 7fa1527fc640 10 monclient: dump: 2026-02-24T19:16:57.412 INFO:teuthology.misc.health.trial014.stderr:epoch 1 2026-02-24T19:16:57.413 INFO:teuthology.misc.health.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:57.413 INFO:teuthology.misc.health.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:57.413 INFO:teuthology.misc.health.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:57.413 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:57.413 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 3 2026-02-24T19:16:57.413 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:57.413 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:57.413 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:57.413 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:16:57.413 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.403+0000 7fa159ce1640 10 monclient: get_monmap_and_config success 2026-02-24T19:16:57.413 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.403+0000 7fa159ce1640 4 set_mon_vals no callback set 2026-02-24T19:16:57.413 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.403+0000 7fa159ce1640 10 monclient: shutdown 2026-02-24T19:16:57.413 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.403+0000 7fa159ce1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:57.414 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.403+0000 7fa159ce1640 1 -- 10.20.193.14:0/1216446816 >> v1:10.20.193.170:6789/0 conn(0x7fa154159ee0 legacy=0x7fa154163340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:57.414 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.403+0000 7fa159ce1640 1 -- 10.20.193.14:0/1216446816 shutdown_connections 2026-02-24T19:16:57.414 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.403+0000 7fa159ce1640 1 -- 10.20.193.14:0/1216446816 >> 10.20.193.14:0/1216446816 conn(0x7fa1540b65f0 msgr2=0x7fa1540b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:57.414 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.403+0000 7fa159ce1640 1 -- 10.20.193.14:0/1216446816 shutdown_connections 2026-02-24T19:16:57.414 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.403+0000 7fa159ce1640 1 -- 10.20.193.14:0/1216446816 wait complete. 2026-02-24T19:16:57.414 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.404+0000 7fa159ce1640 10 monclient: build_initial_monmap 2026-02-24T19:16:57.414 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.404+0000 7fa159ce1640 10 monclient: monmap: 2026-02-24T19:16:57.414 INFO:teuthology.misc.health.trial014.stderr:epoch 0 2026-02-24T19:16:57.414 INFO:teuthology.misc.health.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:16:57.414 INFO:teuthology.misc.health.trial014.stderr:last_changed 0.000000 2026-02-24T19:16:57.414 INFO:teuthology.misc.health.trial014.stderr:created 0.000000 2026-02-24T19:16:57.414 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:57.414 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 1 2026-02-24T19:16:57.415 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:16:57.415 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:16:57.415 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:16:57.415 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:16:57.415 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.404+0000 7fa159ce1640 1 librados: starting msgr at 2026-02-24T19:16:57.415 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.404+0000 7fa159ce1640 1 librados: starting objecter 2026-02-24T19:16:57.415 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.404+0000 7fa159ce1640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:16:57.415 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.404+0000 7fa159ce1640 1 Processor -- start 2026-02-24T19:16:57.415 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.404+0000 7fa159ce1640 1 -- start start 2026-02-24T19:16:57.415 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.404+0000 7fa159ce1640 1 librados: setting wanted keys 2026-02-24T19:16:57.415 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.404+0000 7fa159ce1640 1 librados: calling monclient init 2026-02-24T19:16:57.415 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.404+0000 7fa159ce1640 10 monclient: init 2026-02-24T19:16:57.415 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.404+0000 7fa159ce1640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:57.416 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.404+0000 7fa159ce1640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:16:57.416 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.404+0000 7fa159ce1640 10 monclient(hunting): picked mon.noname-a con 0x7fa154058da0 addr v1:10.20.193.14:6789/0 2026-02-24T19:16:57.416 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.404+0000 7fa159ce1640 10 monclient(hunting): picked mon.noname-c con 0x7fa154059170 addr v1:10.20.193.170:6789/0 2026-02-24T19:16:57.416 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.404+0000 7fa159ce1640 10 monclient(hunting): picked mon.noname-b con 0x7fa154159ee0 addr v1:10.20.193.44:6789/0 2026-02-24T19:16:57.416 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.404+0000 7fa159ce1640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa15411b950 con 0x7fa154058da0 2026-02-24T19:16:57.416 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.404+0000 7fa159ce1640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa154057690 con 0x7fa154159ee0 2026-02-24T19:16:57.416 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.404+0000 7fa159ce1640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa154057970 con 0x7fa154059170 2026-02-24T19:16:57.416 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.404+0000 7fa159ce1640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:57.416 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.404+0000 7fa159ce1640 10 monclient(hunting): authenticate will time out at 3592.086876s 2026-02-24T19:16:57.416 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.405+0000 7fa1537fe640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7fa154058da0 0x7fa154055980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:46824/0 (socket says 10.20.193.14:46824) 2026-02-24T19:16:57.416 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.405+0000 7fa1537fe640 1 -- 10.20.193.14:0/1151812311 learned_addr learned my addr 10.20.193.14:0/1151812311 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:16:57.416 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.405+0000 7fa12ffff640 10 client.?.objecter ms_handle_connect 0x7fa154058da0 2026-02-24T19:16:57.417 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.405+0000 7fa12ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:57.417 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.405+0000 7fa12ffff640 10 client.?.objecter ms_handle_connect 0x7fa154059170 2026-02-24T19:16:57.417 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.405+0000 7fa12ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:57.417 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.405+0000 7fa12ffff640 10 client.?.objecter ms_handle_connect 0x7fa154159ee0 2026-02-24T19:16:57.417 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.405+0000 7fa12ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:16:57.417 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.406+0000 7fa12ffff640 1 -- 10.20.193.14:0/1151812311 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1058504050 0 0) 0x7fa15411b950 con 0x7fa154058da0 2026-02-24T19:16:57.417 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.406+0000 7fa12ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:16:57.417 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.406+0000 7fa12ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:57.417 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.406+0000 7fa12ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:57.417 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.406+0000 7fa12ffff640 10 monclient(hunting): my global_id is 4230 2026-02-24T19:16:57.417 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.406+0000 7fa12ffff640 1 -- 10.20.193.14:0/1151812311 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa124003610 con 0x7fa154058da0 2026-02-24T19:16:57.417 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.406+0000 7fa12ffff640 1 -- 10.20.193.14:0/1151812311 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1625395744 0 0) 0x7fa154057970 con 0x7fa154059170 2026-02-24T19:16:57.417 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.406+0000 7fa12ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:16:57.418 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.406+0000 7fa12ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:57.418 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.406+0000 7fa12ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:57.418 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.406+0000 7fa12ffff640 10 monclient(hunting): my global_id is 4235 2026-02-24T19:16:57.418 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.406+0000 7fa12ffff640 1 -- 10.20.193.14:0/1151812311 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa15411b950 con 0x7fa154059170 2026-02-24T19:16:57.418 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.406+0000 7fa12ffff640 1 -- 10.20.193.14:0/1151812311 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3627322790 0 0) 0x7fa154057690 con 0x7fa154159ee0 2026-02-24T19:16:57.418 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.406+0000 7fa12ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:16:57.418 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.406+0000 7fa12ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:16:57.418 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.406+0000 7fa12ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:16:57.418 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.406+0000 7fa12ffff640 10 monclient(hunting): my global_id is 4225 2026-02-24T19:16:57.418 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.406+0000 7fa12ffff640 1 -- 10.20.193.14:0/1151812311 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa154057970 con 0x7fa154159ee0 2026-02-24T19:16:57.421 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.409+0000 7fa12ffff640 1 -- 10.20.193.14:0/1151812311 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1666339520 0 0) 0x7fa124003610 con 0x7fa154058da0 2026-02-24T19:16:57.421 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.409+0000 7fa12ffff640 1 -- 10.20.193.14:0/1151812311 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa154057690 con 0x7fa154058da0 2026-02-24T19:16:57.421 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.409+0000 7fa12ffff640 1 -- 10.20.193.14:0/1151812311 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fa1400030b0 con 0x7fa154058da0 2026-02-24T19:16:57.421 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.409+0000 7fa12ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:57.421 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.409+0000 7fa12ffff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:16:57.421 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.409+0000 7fa12ffff640 10 monclient(hunting): dump: 2026-02-24T19:16:57.421 INFO:teuthology.misc.health.trial014.stderr:epoch 1 2026-02-24T19:16:57.421 INFO:teuthology.misc.health.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:57.422 INFO:teuthology.misc.health.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:57.422 INFO:teuthology.misc.health.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:57.422 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:57.422 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 3 2026-02-24T19:16:57.422 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:57.422 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:57.422 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:57.422 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:16:57.422 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.409+0000 7fa12ffff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:16:57.422 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.409+0000 7fa12ffff640 1 -- 10.20.193.14:0/1151812311 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2185171694 0 0) 0x7fa15411b950 con 0x7fa154059170 2026-02-24T19:16:57.422 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.409+0000 7fa12ffff640 1 -- 10.20.193.14:0/1151812311 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa124003610 con 0x7fa154059170 2026-02-24T19:16:57.422 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.409+0000 7fa12ffff640 1 -- 10.20.193.14:0/1151812311 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fa144003060 con 0x7fa154059170 2026-02-24T19:16:57.423 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.409+0000 7fa12ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:57.423 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.409+0000 7fa12ffff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:16:57.423 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.409+0000 7fa12ffff640 10 monclient(hunting): dump: 2026-02-24T19:16:57.423 INFO:teuthology.misc.health.trial014.stderr:epoch 1 2026-02-24T19:16:57.423 INFO:teuthology.misc.health.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:57.423 INFO:teuthology.misc.health.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:57.423 INFO:teuthology.misc.health.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:57.423 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:57.423 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 3 2026-02-24T19:16:57.423 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:57.423 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:57.423 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:57.423 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:16:57.424 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.410+0000 7fa12ffff640 1 -- 10.20.193.14:0/1151812311 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 297794300 0 0) 0x7fa154057970 con 0x7fa154159ee0 2026-02-24T19:16:57.424 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.410+0000 7fa12ffff640 1 -- 10.20.193.14:0/1151812311 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa15411b950 con 0x7fa154159ee0 2026-02-24T19:16:57.424 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.410+0000 7fa12ffff640 1 -- 10.20.193.14:0/1151812311 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fa148003690 con 0x7fa154159ee0 2026-02-24T19:16:57.424 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.410+0000 7fa12ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:16:57.424 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.410+0000 7fa12ffff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:16:57.424 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.410+0000 7fa12ffff640 10 monclient(hunting): dump: 2026-02-24T19:16:57.424 INFO:teuthology.misc.health.trial014.stderr:epoch 1 2026-02-24T19:16:57.424 INFO:teuthology.misc.health.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:57.424 INFO:teuthology.misc.health.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:57.424 INFO:teuthology.misc.health.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:57.424 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:57.424 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 3 2026-02-24T19:16:57.424 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:57.425 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:57.425 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:57.425 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:16:57.425 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.411+0000 7fa12ffff640 1 -- 10.20.193.14:0/1151812311 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2303410298 0 0) 0x7fa124003610 con 0x7fa154059170 2026-02-24T19:16:57.425 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.411+0000 7fa12ffff640 1 -- 10.20.193.14:0/1151812311 >> v1:10.20.193.44:6789/0 conn(0x7fa154159ee0 legacy=0x7fa1540b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:57.425 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.411+0000 7fa12ffff640 1 -- 10.20.193.14:0/1151812311 >> v1:10.20.193.14:6789/0 conn(0x7fa154058da0 legacy=0x7fa154055980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:57.425 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.411+0000 7fa12ffff640 10 monclient: _finish_hunting 0 2026-02-24T19:16:57.425 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.411+0000 7fa12ffff640 1 monclient: found mon.c 2026-02-24T19:16:57.425 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.411+0000 7fa12ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:16:57.425 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.411+0000 7fa12ffff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:16:57.425 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.411+0000 7fa12ffff640 1 -- 10.20.193.14:0/1151812311 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa154057c50 con 0x7fa154059170 2026-02-24T19:16:57.425 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.411+0000 7fa12ffff640 10 monclient: _finish_auth 0 2026-02-24T19:16:57.425 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.411+0000 7fa12ffff640 10 monclient: _check_auth_tickets 2026-02-24T19:16:57.426 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.411+0000 7fa12ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:16:57.426 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.411+0000 7fa159ce1640 5 monclient: authenticate success, global_id 4235 2026-02-24T19:16:57.426 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.411+0000 7fa159ce1640 10 monclient: _renew_subs 2026-02-24T19:16:57.426 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.411+0000 7fa159ce1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:16:57.426 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.411+0000 7fa159ce1640 1 -- 10.20.193.14:0/1151812311 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa154057f30 con 0x7fa154059170 2026-02-24T19:16:57.426 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.411+0000 7fa159ce1640 10 client.4235.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:16:57.426 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.411+0000 7fa159ce1640 10 monclient: _renew_subs 2026-02-24T19:16:57.426 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.411+0000 7fa159ce1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:16:57.426 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.411+0000 7fa159ce1640 1 -- 10.20.193.14:0/1151812311 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa1540b2170 con 0x7fa154059170 2026-02-24T19:16:57.426 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.411+0000 7fa159ce1640 1 librados: init done 2026-02-24T19:16:57.426 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.411+0000 7fa159ce1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:57.426 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.411+0000 7fa159ce1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:57.426 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.411+0000 7fa159ce1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:16:57.427 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.411+0000 7fa159ce1640 1 -- 10.20.193.14:0/1151812311 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa154157b70 con 0x7fa154059170 2026-02-24T19:16:57.428 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.419+0000 7fa12ffff640 1 -- 10.20.193.14:0/1151812311 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa144003700 con 0x7fa154059170 2026-02-24T19:16:57.428 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.419+0000 7fa12ffff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:16:57.428 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.419+0000 7fa12ffff640 1 -- 10.20.193.14:0/1151812311 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fa144003a50 con 0x7fa154059170 2026-02-24T19:16:57.428 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.419+0000 7fa12ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:16:57.428 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.419+0000 7fa12ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:16:57.428 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.419+0000 7fa151ffb640 4 set_mon_vals no callback set 2026-02-24T19:16:57.428 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.419+0000 7fa12ffff640 10 monclient: dump: 2026-02-24T19:16:57.428 INFO:teuthology.misc.health.trial014.stderr:epoch 1 2026-02-24T19:16:57.428 INFO:teuthology.misc.health.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:16:57.429 INFO:teuthology.misc.health.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:57.429 INFO:teuthology.misc.health.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:16:57.429 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:16:57.429 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 3 2026-02-24T19:16:57.429 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:16:57.429 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:16:57.429 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:16:57.429 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:16:57.429 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.420+0000 7fa12ffff640 1 -- 10.20.193.14:0/1151812311 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 4) ==== 101507+0+0 (unknown 1883626494 0 0) 0x7fa14401c880 con 0x7fa154059170 2026-02-24T19:16:57.429 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.420+0000 7fa1537fe640 10 monclient: get_auth_request con 0x7fa124077e00 auth_method 0 2026-02-24T19:16:57.429 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.420+0000 7fa12ffff640 10 client.4235.objecter ms_handle_connect 0x7fa124077e00 2026-02-24T19:16:57.429 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.422+0000 7fa12ffff640 1 -- 10.20.193.14:0/1151812311 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 2560+0+0 (unknown 3182630602 0 0) 0x7fa144058220 con 0x7fa154059170 2026-02-24T19:16:57.430 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.422+0000 7fa12ffff640 10 client.4235.objecter ms_dispatch2 0x7fa154000b90 osd_map(18..18 src has 1..18) 2026-02-24T19:16:57.430 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.422+0000 7fa12ffff640 3 client.4235.objecter handle_osd_map got epochs [18,18] > 0 2026-02-24T19:16:57.430 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.422+0000 7fa12ffff640 3 client.4235.objecter handle_osd_map decoding full epoch 18 2026-02-24T19:16:57.430 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.422+0000 7fa12ffff640 20 client.4235.objecter dump_active .. 0 homeless 2026-02-24T19:16:57.510 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.508+0000 7fa12ffff640 1 -- 10.20.193.14:0/1151812311 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fa14405c990 con 0x7fa154059170 2026-02-24T19:16:57.510 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.508+0000 7fa12ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:16:57.510 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.508+0000 7fa12ffff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:16:57.624 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.622+0000 7fa159ce1640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:16:57.625 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.622+0000 7fa159ce1640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:16:57.625 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.622+0000 7fa159ce1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:16:57.625 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.622+0000 7fa159ce1640 1 -- 10.20.193.14:0/1151812311 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa154157890 con 0x7fa154059170 2026-02-24T19:16:57.648 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.645+0000 7fa12ffff640 1 -- 10.20.193.14:0/1151812311 <== mon.2 v1:10.20.193.170:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12877 (unknown 3338201251 0 3973102980) 0x7fa14405c290 con 0x7fa154059170 2026-02-24T19:16:57.648 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.645+0000 7fa12ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:16:57.648 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.645+0000 7fa12ffff640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:16:57.648 INFO:teuthology.misc.health.trial014.stdout: 2026-02-24T19:16:57.649 INFO:teuthology.misc.health.trial014.stdout:{"epoch":18,"fsid":"829a649b-54c9-463b-96b9-ffa203d49fa7","created":"2026-02-24T19:16:40.561511+0000","modified":"2026-02-24T19:16:47.437972+0000","last_up_change":"0.000000","last_in_change":"2026-02-24T19:16:47.437972+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9a3fd69b-7f2a-443b-9ae1-673acfad8b00","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7dca8ec5-5aa3-420d-bf78-1331d974dafd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5a7b7c02-22f9-4eb1-a1b0-afb106604416","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"695eeb19-d0a7-4b16-8d9a-ec59206d7ecc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"09ca59ec-7e76-44ba-bf1a-1b752732db60","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"64319106-a5b4-4775-b122-8c50216df3a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"19f0033c-abbd-406a-8eae-94e7e81da9ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7cdd3b9b-4146-45b9-aaf6-df379c7a1e0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"a4833012-c50c-4a6e-b754-cf18fc6117fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"322914a2-9ba3-44b8-98ec-958b00c92f0c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"dbfdf855-de28-491b-9112-8009ab155fb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"253e9d0b-391d-4647-bd89-6ab4b57909aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"7b7d5fca-4759-46e5-a681-45509749b265","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"8d1f12c8-5787-425d-a4a6-ac820bbf6e8b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"866643a2-5f54-425c-b5ec-70607e191f02","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"4726a8b0-bcef-4e7f-aa36-e80228e2aec5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T19:16:57.651 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.648+0000 7fa159ce1640 10 librados: watch_flush enter 2026-02-24T19:16:57.651 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.648+0000 7fa159ce1640 10 librados: watch_flush exit 2026-02-24T19:16:57.651 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.648+0000 7fa159ce1640 20 client.4235.objecter shutdown clearing up homeless session... 2026-02-24T19:16:57.652 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.648+0000 7fa159ce1640 10 client.4235.objecter successfully canceled tick 2026-02-24T19:16:57.652 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.648+0000 7fa159ce1640 1 -- 10.20.193.14:0/1151812311 >> v1:10.20.193.14:6800/4014096310 conn(0x7fa124077e00 legacy=0x7fa1240982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:57.652 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.648+0000 7fa159ce1640 10 monclient: shutdown 2026-02-24T19:16:57.652 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.648+0000 7fa159ce1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:16:57.652 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.648+0000 7fa159ce1640 1 -- 10.20.193.14:0/1151812311 >> v1:10.20.193.170:6789/0 conn(0x7fa154059170 legacy=0x7fa1541565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:16:57.652 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.648+0000 7fa159ce1640 1 -- 10.20.193.14:0/1151812311 shutdown_connections 2026-02-24T19:16:57.652 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.648+0000 7fa159ce1640 1 -- 10.20.193.14:0/1151812311 >> 10.20.193.14:0/1151812311 conn(0x7fa1540b65f0 msgr2=0x7fa1541595a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:16:57.652 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.648+0000 7fa159ce1640 1 -- 10.20.193.14:0/1151812311 shutdown_connections 2026-02-24T19:16:57.652 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.648+0000 7fa159ce1640 1 -- 10.20.193.14:0/1151812311 wait complete. 2026-02-24T19:16:57.652 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:16:57.648+0000 7fa159ce1640 1 librados: shutdown 2026-02-24T19:16:57.660 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-24T19:16:57.882 INFO:tasks.ceph.osd.13.trial044.stderr:--00:00:00:10.356 45009-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:16:57.884 INFO:tasks.ceph.osd.5.trial044.stderr:--00:00:00:10.363 45007-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:16:57.884 INFO:tasks.ceph.osd.9.trial044.stderr:--00:00:00:10.360 45008-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:16:57.886 INFO:tasks.ceph.osd.1.trial044.stderr:--00:00:00:10.368 45006-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:16:57.969 INFO:tasks.ceph.osd.3.trial195.stderr:--00:00:00:10.422 45171-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:16:57.977 INFO:tasks.ceph.osd.4.trial014.stderr:--00:00:00:10.470 44461-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:16:57.978 INFO:tasks.ceph.osd.0.trial014.stderr:--00:00:00:10.472 44460-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:16:57.978 INFO:tasks.ceph.osd.12.trial014.stderr:--00:00:00:10.463 44467-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:16:57.979 INFO:tasks.ceph.osd.8.trial014.stderr:--00:00:00:10.464 44466-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:16:57.991 INFO:tasks.ceph.osd.11.trial195.stderr:--00:00:00:10.443 45173-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:16:58.061 INFO:tasks.ceph.osd.6.trial170.stderr:--00:00:00:10.528 44835-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:16:58.066 INFO:tasks.ceph.osd.2.trial170.stderr:--00:00:00:10.535 44834-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:16:58.068 INFO:tasks.ceph.osd.15.trial195.stderr:--00:00:00:10.518 45174-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:16:58.072 INFO:tasks.ceph.osd.14.trial170.stderr:--00:00:00:10.534 44837-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:16:58.081 INFO:tasks.ceph.osd.10.trial170.stderr:--00:00:00:10.545 44836-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:16:58.152 INFO:tasks.ceph.osd.7.trial195.stderr:--00:00:00:10.605 45172-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:17:00.024 INFO:tasks.ceph.osd.13.trial044.stderr:==00:00:00:12.498 45009== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.035 INFO:tasks.ceph.osd.1.trial044.stderr:==00:00:00:12.516 45006== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.036 INFO:tasks.ceph.osd.9.trial044.stderr:==00:00:00:12.511 45008== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.053 INFO:tasks.ceph.osd.5.trial044.stderr:==00:00:00:12.531 45007== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.091 INFO:tasks.ceph.osd.3.trial195.stderr:==00:00:00:12.544 45171== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.098 INFO:tasks.ceph.osd.1.trial044.stderr:==00:00:00:12.580 45006== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.099 INFO:tasks.ceph.osd.13.trial044.stderr:==00:00:00:12.573 45009== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.104 INFO:tasks.ceph.osd.9.trial044.stderr:==00:00:00:12.580 45008== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.115 INFO:tasks.ceph.osd.5.trial044.stderr:==00:00:00:12.594 45007== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.125 INFO:tasks.ceph.osd.12.trial014.stderr:==00:00:00:12.610 44467== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.128 INFO:tasks.ceph.osd.1.trial044.stderr:==00:00:00:12.609 45006== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.129 INFO:tasks.ceph.osd.9.trial044.stderr:==00:00:00:12.605 45008== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.133 INFO:tasks.ceph.osd.11.trial195.stderr:==00:00:00:12.585 45173== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.133 INFO:tasks.ceph.osd.13.trial044.stderr:==00:00:00:12.607 45009== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.141 INFO:tasks.ceph.osd.5.trial044.stderr:==00:00:00:12.620 45007== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.144 INFO:tasks.ceph.osd.0.trial014.stderr:==00:00:00:12.637 44460== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.145 INFO:tasks.ceph.osd.4.trial014.stderr:==00:00:00:12.638 44461== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.153 INFO:tasks.ceph.osd.6.trial170.stderr:==00:00:00:12.620 44835== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.155 INFO:tasks.ceph.osd.9.trial044.stderr:==00:00:00:12.631 45008== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.158 INFO:tasks.ceph.osd.8.trial014.stderr:==00:00:00:12.643 44466== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.159 INFO:tasks.ceph.osd.1.trial044.stderr:==00:00:00:12.640 45006== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.161 INFO:tasks.ceph.osd.3.trial195.stderr:==00:00:00:12.615 45171== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.164 INFO:tasks.ceph.osd.13.trial044.stderr:==00:00:00:12.638 45009== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.176 INFO:tasks.ceph.osd.5.trial044.stderr:==00:00:00:12.655 45007== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.184 INFO:tasks.ceph.osd.1.trial044.stderr:==00:00:00:12.665 45006== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.184 INFO:tasks.ceph.osd.9.trial044.stderr:==00:00:00:12.660 45008== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.193 INFO:tasks.ceph.osd.13.trial044.stderr:==00:00:00:12.667 45009== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.195 INFO:tasks.ceph.osd.3.trial195.stderr:==00:00:00:12.648 45171== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.196 INFO:tasks.ceph.osd.12.trial014.stderr:==00:00:00:12.681 44467== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.196 INFO:tasks.ceph.osd.15.trial195.stderr:==00:00:00:12.646 45174== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.204 INFO:tasks.ceph.osd.5.trial044.stderr:==00:00:00:12.683 45007== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.206 INFO:tasks.ceph.osd.11.trial195.stderr:==00:00:00:12.658 45173== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.209 INFO:tasks.ceph.osd.0.trial014.stderr:==00:00:00:12.703 44460== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.214 INFO:tasks.ceph.osd.4.trial014.stderr:==00:00:00:12.707 44461== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.216 INFO:tasks.ceph.osd.13.trial044.stderr:==00:00:00:12.690 45009== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.216 INFO:tasks.ceph.osd.1.trial044.stderr:==00:00:00:12.697 45006== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.217 INFO:tasks.ceph.osd.9.trial044.stderr:==00:00:00:12.693 45008== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.222 INFO:tasks.ceph.osd.3.trial195.stderr:==00:00:00:12.676 45171== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.223 INFO:tasks.ceph.osd.12.trial014.stderr:==00:00:00:12.709 44467== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.226 INFO:tasks.ceph.osd.11.trial195.stderr:==00:00:00:12.678 45173== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.227 INFO:tasks.ceph.osd.8.trial014.stderr:==00:00:00:12.712 44466== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.230 INFO:tasks.ceph.osd.1.trial044.stderr:==00:00:00:12.712 45006== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.231 INFO:tasks.ceph.osd.13.trial044.stderr:==00:00:00:12.705 45009== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.232 INFO:tasks.ceph.osd.9.trial044.stderr:==00:00:00:12.708 45008== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.233 INFO:tasks.ceph.osd.5.trial044.stderr:==00:00:00:12.712 45007== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.234 INFO:tasks.ceph.osd.6.trial170.stderr:==00:00:00:12.701 44835== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.239 INFO:tasks.ceph.osd.2.trial170.stderr:==00:00:00:12.708 44834== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.240 INFO:tasks.ceph.osd.0.trial014.stderr:==00:00:00:12.733 44460== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.244 INFO:tasks.ceph.osd.4.trial014.stderr:==00:00:00:12.736 44461== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.245 INFO:tasks.ceph.osd.14.trial170.stderr:==00:00:00:12.706 44837== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.245 INFO:tasks.ceph.osd.7.trial195.stderr:==00:00:00:12.698 45172== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.248 INFO:tasks.ceph.osd.5.trial044.stderr:==00:00:00:12.727 45007== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.248 INFO:tasks.ceph.osd.12.trial014.stderr:==00:00:00:12.734 44467== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.252 INFO:tasks.ceph.osd.8.trial014.stderr:==00:00:00:12.738 44466== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.260 INFO:tasks.ceph.osd.0.trial014.stderr:==00:00:00:12.754 44460== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.262 INFO:tasks.ceph.osd.3.trial195.stderr:==00:00:00:12.716 45171== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.263 INFO:tasks.ceph.osd.10.trial170.stderr:==00:00:00:12.728 44836== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.264 INFO:tasks.ceph.osd.11.trial195.stderr:==00:00:00:12.716 45173== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.265 INFO:tasks.ceph.osd.4.trial014.stderr:==00:00:00:12.758 44461== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.273 INFO:tasks.ceph.osd.12.trial014.stderr:==00:00:00:12.758 44467== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.273 INFO:tasks.ceph.osd.8.trial014.stderr:==00:00:00:12.758 44466== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.276 INFO:tasks.ceph.osd.15.trial195.stderr:==00:00:00:12.726 45174== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.277 INFO:tasks.ceph.osd.6.trial170.stderr:==00:00:00:12.744 44835== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.283 INFO:tasks.ceph.osd.0.trial014.stderr:==00:00:00:12.776 44460== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.285 INFO:tasks.ceph.osd.11.trial195.stderr:==00:00:00:12.737 45173== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.289 INFO:tasks.ceph.osd.8.trial014.stderr:==00:00:00:12.775 44466== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.290 INFO:tasks.ceph.osd.4.trial014.stderr:==00:00:00:12.783 44461== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.296 INFO:tasks.ceph.osd.3.trial195.stderr:==00:00:00:12.750 45171== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.303 INFO:tasks.ceph.osd.12.trial014.stderr:==00:00:00:12.789 44467== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.311 INFO:tasks.ceph.osd.3.trial195.stderr:==00:00:00:12.764 45171== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.317 INFO:tasks.ceph.osd.0.trial014.stderr:==00:00:00:12.810 44460== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.317 INFO:tasks.ceph.osd.2.trial170.stderr:==00:00:00:12.786 44834== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.318 INFO:tasks.ceph.osd.12.trial014.stderr:==00:00:00:12.803 44467== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.319 INFO:tasks.ceph.osd.6.trial170.stderr:==00:00:00:12.786 44835== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.320 INFO:tasks.ceph.osd.4.trial014.stderr:==00:00:00:12.812 44461== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.320 INFO:tasks.ceph.osd.15.trial195.stderr:==00:00:00:12.769 45174== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.320 INFO:tasks.ceph.osd.7.trial195.stderr:==00:00:00:12.773 45172== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.322 INFO:tasks.ceph.osd.11.trial195.stderr:==00:00:00:12.773 45173== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.322 INFO:tasks.ceph.osd.14.trial170.stderr:==00:00:00:12.783 44837== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.323 INFO:tasks.ceph.osd.8.trial014.stderr:==00:00:00:12.808 44466== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.331 INFO:tasks.ceph.osd.0.trial014.stderr:==00:00:00:12.825 44460== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.334 INFO:tasks.ceph.osd.4.trial014.stderr:==00:00:00:12.826 44461== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.334 INFO:tasks.ceph.osd.13.trial044.stderr:2026-02-24T19:17:00.330+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:00.337 INFO:tasks.ceph.osd.11.trial195.stderr:==00:00:00:12.789 45173== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.338 INFO:tasks.ceph.osd.8.trial014.stderr:==00:00:00:12.823 44466== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.338 INFO:tasks.ceph.osd.1.trial044.stderr:2026-02-24T19:17:00.334+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:00.346 INFO:tasks.ceph.osd.9.trial044.stderr:2026-02-24T19:17:00.342+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:00.346 INFO:tasks.ceph.osd.10.trial170.stderr:==00:00:00:12.811 44836== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.349 INFO:tasks.ceph.osd.2.trial170.stderr:==00:00:00:12.818 44834== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.350 INFO:tasks.ceph.osd.5.trial044.stderr:2026-02-24T19:17:00.346+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:00.356 INFO:tasks.ceph.osd.7.trial195.stderr:==00:00:00:12.809 45172== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.356 INFO:tasks.ceph.osd.15.trial195.stderr:==00:00:00:12.806 45174== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.358 INFO:tasks.ceph.osd.6.trial170.stderr:==00:00:00:12.825 44835== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.358 INFO:tasks.ceph.osd.14.trial170.stderr:==00:00:00:12.820 44837== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.371 INFO:tasks.ceph.osd.10.trial170.stderr:==00:00:00:12.836 44836== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.372 INFO:tasks.ceph.osd.7.trial195.stderr:==00:00:00:12.825 45172== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.374 INFO:tasks.ceph.osd.2.trial170.stderr:==00:00:00:12.843 44834== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.379 INFO:tasks.ceph.osd.14.trial170.stderr:==00:00:00:12.841 44837== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.380 INFO:tasks.ceph.osd.15.trial195.stderr:==00:00:00:12.830 45174== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.381 INFO:tasks.ceph.osd.6.trial170.stderr:==00:00:00:12.848 44835== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.387 INFO:tasks.ceph.osd.7.trial195.stderr:==00:00:00:12.841 45172== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.395 INFO:tasks.ceph.osd.6.trial170.stderr:==00:00:00:12.863 44835== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.402 INFO:tasks.ceph.osd.10.trial170.stderr:==00:00:00:12.867 44836== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.407 INFO:tasks.ceph.osd.2.trial170.stderr:==00:00:00:12.876 44834== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.411 INFO:tasks.ceph.osd.3.trial195.stderr:2026-02-24T19:17:00.407+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:00.416 INFO:tasks.ceph.osd.14.trial170.stderr:==00:00:00:12.878 44837== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.418 INFO:tasks.ceph.osd.15.trial195.stderr:==00:00:00:12.868 45174== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.422 INFO:tasks.ceph.osd.12.trial014.stderr:2026-02-24T19:17:00.418+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:00.422 INFO:tasks.ceph.osd.7.trial195.stderr:==00:00:00:12.875 45172== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.429 INFO:tasks.ceph.osd.10.trial170.stderr:==00:00:00:12.894 44836== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.433 INFO:tasks.ceph.osd.15.trial195.stderr:==00:00:00:12.883 45174== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.437 INFO:tasks.ceph.osd.7.trial195.stderr:==00:00:00:12.890 45172== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.440 INFO:tasks.ceph.osd.4.trial014.stderr:2026-02-24T19:17:00.437+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:00.442 INFO:tasks.ceph.osd.2.trial170.stderr:==00:00:00:12.911 44834== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.443 INFO:tasks.ceph.osd.0.trial014.stderr:2026-02-24T19:17:00.438+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:00.444 INFO:tasks.ceph.osd.8.trial014.stderr:2026-02-24T19:17:00.440+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:00.445 INFO:tasks.ceph.osd.11.trial195.stderr:2026-02-24T19:17:00.440+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:00.457 INFO:tasks.ceph.osd.2.trial170.stderr:==00:00:00:12.926 44834== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.458 INFO:tasks.ceph.osd.14.trial170.stderr:==00:00:00:12.920 44837== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.466 INFO:tasks.ceph.osd.10.trial170.stderr:==00:00:00:12.930 44836== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.473 INFO:tasks.ceph.osd.14.trial170.stderr:==00:00:00:12.935 44837== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.481 INFO:tasks.ceph.osd.10.trial170.stderr:==00:00:00:12.946 44836== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.511 INFO:tasks.ceph.osd.6.trial170.stderr:2026-02-24T19:17:00.508+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:00.559 INFO:tasks.ceph.osd.7.trial195.stderr:2026-02-24T19:17:00.555+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:00.560 INFO:tasks.ceph.osd.15.trial195.stderr:2026-02-24T19:17:00.555+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:00.567 INFO:tasks.ceph.osd.2.trial170.stderr:2026-02-24T19:17:00.563+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:00.592 INFO:tasks.ceph.osd.10.trial170.stderr:2026-02-24T19:17:00.588+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:00.595 INFO:tasks.ceph.osd.14.trial170.stderr:2026-02-24T19:17:00.591+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:00.612 INFO:tasks.ceph.osd.1.trial044.stderr:==00:00:00:13.093 45006== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.612 INFO:tasks.ceph.osd.13.trial044.stderr:==00:00:00:13.086 45009== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.623 INFO:tasks.ceph.osd.9.trial044.stderr:==00:00:00:13.099 45008== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.624 INFO:tasks.ceph.osd.5.trial044.stderr:==00:00:00:13.103 45007== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.680 INFO:tasks.ceph.osd.3.trial195.stderr:==00:00:00:13.133 45171== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.696 INFO:tasks.ceph.osd.12.trial014.stderr:==00:00:00:13.181 44467== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.698 INFO:tasks.ceph.osd.13.trial044.stderr:==00:00:00:13.173 45009== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.707 INFO:tasks.ceph.osd.1.trial044.stderr:==00:00:00:13.189 45006== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.708 INFO:tasks.ceph.osd.5.trial044.stderr:==00:00:00:13.187 45007== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.711 INFO:tasks.ceph.osd.4.trial014.stderr:==00:00:00:13.204 44461== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.714 INFO:tasks.ceph.osd.0.trial014.stderr:==00:00:00:13.208 44460== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.716 INFO:tasks.ceph.osd.9.trial044.stderr:==00:00:00:13.192 45008== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.718 INFO:tasks.ceph.osd.11.trial195.stderr:==00:00:00:13.170 45173== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.719 INFO:tasks.ceph.osd.8.trial014.stderr:==00:00:00:13.205 44466== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.761 INFO:tasks.ceph.osd.5.trial044.stderr:==00:00:00:13.240 45007== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.775 INFO:tasks.ceph.osd.3.trial195.stderr:==00:00:00:13.228 45171== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.776 INFO:tasks.ceph.osd.13.trial044.stderr:==00:00:00:13.250 45009== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.780 INFO:tasks.ceph.osd.6.trial170.stderr:==00:00:00:13.247 44835== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.781 INFO:tasks.ceph.osd.1.trial044.stderr:==00:00:00:13.263 45006== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.782 INFO:tasks.ceph.osd.12.trial014.stderr:==00:00:00:13.267 44467== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.792 INFO:tasks.ceph.osd.9.trial044.stderr:==00:00:00:13.268 45008== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.800 INFO:tasks.ceph.osd.5.trial044.stderr:==00:00:00:13.279 45007== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.801 INFO:tasks.ceph.osd.4.trial014.stderr:==00:00:00:13.293 44461== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.804 INFO:tasks.ceph.osd.8.trial014.stderr:==00:00:00:13.289 44466== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.805 INFO:tasks.ceph.osd.0.trial014.stderr:==00:00:00:13.299 44460== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.812 INFO:tasks.ceph.osd.1.trial044.stderr:==00:00:00:13.294 45006== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.812 INFO:tasks.ceph.osd.13.trial044.stderr:==00:00:00:13.286 45009== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.821 INFO:tasks.ceph.osd.11.trial195.stderr:==00:00:00:13.273 45173== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.824 INFO:tasks.ceph.osd.5.trial044.stderr:==00:00:00:13.303 45007== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.828 INFO:tasks.ceph.osd.9.trial044.stderr:==00:00:00:13.304 45008== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.831 INFO:tasks.ceph.osd.7.trial195.stderr:==00:00:00:13.284 45172== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.831 INFO:tasks.ceph.osd.15.trial195.stderr:==00:00:00:13.281 45174== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.838 INFO:tasks.ceph.osd.2.trial170.stderr:==00:00:00:13.307 44834== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.848 INFO:tasks.ceph.osd.8.trial014.stderr:==00:00:00:13.333 44466== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.849 INFO:tasks.ceph.osd.13.trial044.stderr:==00:00:00:13.324 45009== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.854 INFO:tasks.ceph.osd.5.trial044.stderr:==00:00:00:13.333 45007== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.854 INFO:tasks.ceph.osd.1.trial044.stderr:==00:00:00:13.335 45006== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.857 INFO:tasks.ceph.osd.12.trial014.stderr:==00:00:00:13.343 44467== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.858 INFO:tasks.ceph.osd.3.trial195.stderr:==00:00:00:13.311 45171== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.867 INFO:tasks.ceph.osd.9.trial044.stderr:==00:00:00:13.343 45008== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.868 INFO:tasks.ceph.osd.10.trial170.stderr:==00:00:00:13.332 44836== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.868 INFO:tasks.ceph.osd.8.trial014.stderr:==00:00:00:13.352 44466== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.868 INFO:tasks.ceph.osd.4.trial014.stderr:==00:00:00:13.361 44461== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.876 INFO:tasks.ceph.osd.0.trial014.stderr:==00:00:00:13.370 44460== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.877 INFO:tasks.ceph.osd.14.trial170.stderr:==00:00:00:13.339 44837== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.882 INFO:tasks.ceph.osd.11.trial195.stderr:==00:00:00:13.334 45173== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.885 INFO:tasks.ceph.osd.6.trial170.stderr:==00:00:00:13.352 44835== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.895 INFO:tasks.ceph.osd.5.trial044.stderr:==00:00:00:13.374 45007== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.895 INFO:tasks.ceph.osd.1.trial044.stderr:==00:00:00:13.377 45006== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.897 INFO:tasks.ceph.osd.8.trial014.stderr:==00:00:00:13.382 44466== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.898 INFO:tasks.ceph.osd.3.trial195.stderr:==00:00:00:13.351 45171== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.900 INFO:tasks.ceph.osd.13.trial044.stderr:==00:00:00:13.375 45009== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.905 INFO:tasks.ceph.osd.12.trial014.stderr:==00:00:00:13.390 44467== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.908 INFO:tasks.ceph.osd.9.trial044.stderr:==00:00:00:13.384 45008== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.909 INFO:tasks.ceph.osd.4.trial014.stderr:==00:00:00:13.402 44461== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.910 INFO:tasks.ceph.osd.11.trial195.stderr:==00:00:00:13.362 45173== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.913 INFO:tasks.ceph.osd.0.trial014.stderr:==00:00:00:13.407 44460== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.916 INFO:tasks.ceph.osd.7.trial195.stderr:==00:00:00:13.370 45172== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.919 INFO:tasks.ceph.osd.15.trial195.stderr:==00:00:00:13.368 45174== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.922 INFO:tasks.ceph.osd.8.trial014.stderr:==00:00:00:13.407 44466== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.929 INFO:tasks.ceph.osd.5.trial044.stderr:==00:00:00:13.408 45007== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.929 INFO:tasks.ceph.osd.3.trial195.stderr:==00:00:00:13.382 45171== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.932 INFO:tasks.ceph.osd.2.trial170.stderr:==00:00:00:13.401 44834== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.937 INFO:tasks.ceph.osd.13.trial044.stderr:==00:00:00:13.411 45009== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.937 INFO:tasks.ceph.osd.1.trial044.stderr:==00:00:00:13.419 45006== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.938 INFO:tasks.ceph.osd.11.trial195.stderr:==00:00:00:13.390 45173== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.945 INFO:tasks.ceph.osd.6.trial170.stderr:==00:00:00:13.412 44835== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.949 INFO:tasks.ceph.osd.9.trial044.stderr:==00:00:00:13.425 45008== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.949 INFO:tasks.ceph.osd.8.trial014.stderr:==00:00:00:13.434 44466== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.951 INFO:tasks.ceph.osd.12.trial014.stderr:==00:00:00:13.436 44467== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.958 INFO:tasks.ceph.osd.0.trial014.stderr:==00:00:00:13.452 44460== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.958 INFO:tasks.ceph.osd.4.trial014.stderr:==00:00:00:13.450 44461== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.959 INFO:tasks.ceph.osd.10.trial170.stderr:==00:00:00:13.423 44836== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.961 INFO:tasks.ceph.osd.3.trial195.stderr:==00:00:00:13.414 45171== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.965 INFO:tasks.ceph.osd.11.trial195.stderr:==00:00:00:13.416 45173== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.965 INFO:tasks.ceph.osd.5.trial044.stderr:==00:00:00:13.444 45007== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.966 INFO:tasks.ceph.osd.7.trial195.stderr:==00:00:00:13.420 45172== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.972 INFO:tasks.ceph.osd.14.trial170.stderr:==00:00:00:13.434 44837== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.978 INFO:tasks.ceph.osd.8.trial014.stderr:==00:00:00:13.463 44466== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.981 INFO:tasks.ceph.osd.13.trial044.stderr:==00:00:00:13.455 45009== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.982 INFO:tasks.ceph.osd.6.trial170.stderr:==00:00:00:13.449 44835== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.987 INFO:tasks.ceph.osd.12.trial014.stderr:==00:00:00:13.472 44467== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.988 INFO:tasks.ceph.osd.1.trial044.stderr:==00:00:00:13.470 45006== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.990 INFO:tasks.ceph.osd.15.trial195.stderr:==00:00:00:13.440 45174== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.991 INFO:tasks.ceph.osd.0.trial014.stderr:==00:00:00:13.485 44460== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.992 INFO:tasks.ceph.osd.4.trial014.stderr:==00:00:00:13.484 44461== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.993 INFO:tasks.ceph.osd.9.trial044.stderr:==00:00:00:13.469 45008== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:00.994 INFO:tasks.ceph.osd.11.trial195.stderr:==00:00:00:13.446 45173== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.002 INFO:tasks.ceph.osd.7.trial195.stderr:==00:00:00:13.456 45172== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.007 INFO:tasks.ceph.osd.8.trial014.stderr:==00:00:00:13.492 44466== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.008 INFO:tasks.ceph.osd.3.trial195.stderr:==00:00:00:13.461 45171== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.011 INFO:tasks.ceph.osd.2.trial170.stderr:==00:00:00:13.481 44834== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.014 INFO:tasks.ceph.osd.6.trial170.stderr:==00:00:00:13.481 44835== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.020 INFO:tasks.ceph.osd.14.trial170.stderr:==00:00:00:13.482 44837== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.023 INFO:tasks.ceph.osd.13.trial044.stderr:==00:00:00:13.497 45009== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.027 INFO:tasks.ceph.osd.12.trial014.stderr:==00:00:00:13.512 44467== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.030 INFO:tasks.ceph.osd.1.trial044.stderr:==00:00:00:13.512 45006== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.031 INFO:tasks.ceph.osd.11.trial195.stderr:==00:00:00:13.483 45173== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.032 INFO:tasks.ceph.osd.0.trial014.stderr:==00:00:00:13.526 44460== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.032 INFO:tasks.ceph.osd.4.trial014.stderr:==00:00:00:13.524 44461== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.034 INFO:tasks.ceph.osd.9.trial044.stderr:==00:00:00:13.510 45008== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.035 INFO:tasks.ceph.osd.7.trial195.stderr:==00:00:00:13.488 45172== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.035 INFO:tasks.ceph.osd.15.trial195.stderr:==00:00:00:13.485 45174== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.036 INFO:tasks.ceph.osd.6.trial170.stderr:==00:00:00:13.503 44835== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.040 INFO:tasks.ceph.osd.3.trial195.stderr:==00:00:00:13.493 45171== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.041 INFO:tasks.ceph.osd.10.trial170.stderr:==00:00:00:13.506 44836== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.043 INFO:tasks.ceph.osd.14.trial170.stderr:==00:00:00:13.505 44837== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.044 INFO:tasks.ceph.osd.2.trial170.stderr:==00:00:00:13.514 44834== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.057 INFO:tasks.ceph.osd.7.trial195.stderr:==00:00:00:13.511 45172== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.061 INFO:tasks.ceph.osd.11.trial195.stderr:==00:00:00:13.513 45173== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.066 INFO:tasks.ceph.osd.15.trial195.stderr:==00:00:00:13.516 45174== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.067 INFO:tasks.ceph.osd.6.trial170.stderr:==00:00:00:13.534 44835== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.070 INFO:tasks.ceph.osd.12.trial014.stderr:==00:00:00:13.555 44467== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.075 INFO:tasks.ceph.osd.3.trial195.stderr:==00:00:00:13.528 45171== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.076 INFO:tasks.ceph.osd.14.trial170.stderr:==00:00:00:13.538 44837== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.078 INFO:tasks.ceph.osd.0.trial014.stderr:==00:00:00:13.571 44460== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.078 INFO:tasks.ceph.osd.4.trial014.stderr:==00:00:00:13.570 44461== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.080 INFO:tasks.ceph.osd.10.trial170.stderr:==00:00:00:13.545 44836== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.083 INFO:tasks.ceph.osd.7.trial195.stderr:==00:00:00:13.537 45172== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.088 INFO:tasks.ceph.osd.2.trial170.stderr:==00:00:00:13.557 44834== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.092 INFO:tasks.ceph.osd.5.trial044.stderr:==00:00:00:13.571 45007== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.102 INFO:tasks.ceph.osd.12.trial014.stderr:==00:00:00:13.587 44467== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.103 INFO:tasks.ceph.osd.15.trial195.stderr:==00:00:00:13.553 45174== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.104 INFO:tasks.ceph.osd.6.trial170.stderr:==00:00:00:13.571 44835== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.107 INFO:tasks.ceph.osd.7.trial195.stderr:==00:00:00:13.561 45172== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.111 INFO:tasks.ceph.osd.0.trial014.stderr:==00:00:00:13.604 44460== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.116 INFO:tasks.ceph.osd.14.trial170.stderr:==00:00:00:13.578 44837== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.119 INFO:tasks.ceph.osd.4.trial014.stderr:==00:00:00:13.611 44461== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.124 INFO:tasks.ceph.osd.10.trial170.stderr:==00:00:00:13.589 44836== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.125 INFO:tasks.ceph.osd.2.trial170.stderr:==00:00:00:13.593 44834== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.130 INFO:tasks.ceph.osd.8.trial014.stderr:==00:00:00:13.615 44466== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.132 INFO:tasks.ceph.osd.6.trial170.stderr:==00:00:00:13.599 44835== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.135 INFO:tasks.ceph.osd.14.trial170.stderr:==00:00:00:13.596 44837== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.141 INFO:tasks.ceph.osd.15.trial195.stderr:==00:00:00:13.591 45174== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.148 INFO:tasks.ceph.osd.7.trial195.stderr:==00:00:00:13.602 45172== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.158 INFO:tasks.ceph.osd.5.trial044.stderr:==00:00:00:13.637 45007== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.161 INFO:tasks.ceph.osd.10.trial170.stderr:==00:00:00:13.626 44836== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.168 INFO:tasks.ceph.osd.2.trial170.stderr:==00:00:00:13.637 44834== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.169 INFO:tasks.ceph.osd.14.trial170.stderr:==00:00:00:13.630 44837== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.176 INFO:tasks.ceph.osd.13.trial044.stderr:==00:00:00:13.650 45009== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.178 INFO:tasks.ceph.osd.1.trial044.stderr:==00:00:00:13.659 45006== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.184 INFO:tasks.ceph.osd.9.trial044.stderr:==00:00:00:13.660 45008== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.187 INFO:tasks.ceph.osd.11.trial195.stderr:==00:00:00:13.639 45173== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.187 INFO:tasks.ceph.osd.8.trial014.stderr:==00:00:00:13.673 44466== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.195 INFO:tasks.ceph.osd.5.trial044.stderr:==00:00:00:13.674 45007== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.196 INFO:tasks.ceph.osd.15.trial195.stderr:==00:00:00:13.646 45174== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.211 INFO:tasks.ceph.osd.3.trial195.stderr:==00:00:00:13.664 45171== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.212 INFO:tasks.ceph.osd.14.trial170.stderr:==00:00:00:13.674 44837== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.212 INFO:tasks.ceph.osd.10.trial170.stderr:==00:00:00:13.677 44836== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.218 INFO:tasks.ceph.osd.2.trial170.stderr:==00:00:00:13.687 44834== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.219 INFO:tasks.ceph.osd.5.trial044.stderr:==00:00:00:13.698 45007== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.221 INFO:tasks.ceph.osd.13.trial044.stderr:==00:00:00:13.695 45009== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.223 INFO:tasks.ceph.osd.5.trial044.stderr:==00:00:00:13.702 45007== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.234 INFO:tasks.ceph.osd.8.trial014.stderr:==00:00:00:13.719 44466== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.239 INFO:tasks.ceph.osd.11.trial195.stderr:==00:00:00:13.691 45173== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.240 INFO:tasks.ceph.osd.1.trial044.stderr:==00:00:00:13.721 45006== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.241 INFO:tasks.ceph.osd.9.trial044.stderr:==00:00:00:13.717 45008== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.245 INFO:tasks.ceph.osd.6.trial170.stderr:==00:00:00:13.712 44835== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.246 INFO:tasks.ceph.osd.12.trial014.stderr:==00:00:00:13.731 44467== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.247 INFO:tasks.ceph.osd.15.trial195.stderr:==00:00:00:13.697 45174== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.250 INFO:tasks.ceph.osd.0.trial014.stderr:==00:00:00:13.744 44460== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.254 INFO:tasks.ceph.osd.4.trial014.stderr:==00:00:00:13.746 44461== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.258 INFO:tasks.ceph.osd.8.trial014.stderr:==00:00:00:13.743 44466== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.259 INFO:tasks.ceph.osd.10.trial170.stderr:==00:00:00:13.724 44836== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.263 INFO:tasks.ceph.osd.8.trial014.stderr:==00:00:00:13.748 44466== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.263 INFO:tasks.ceph.osd.13.trial044.stderr:==00:00:00:13.738 45009== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.267 INFO:tasks.ceph.osd.2.trial170.stderr:==00:00:00:13.736 44834== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.271 INFO:tasks.ceph.osd.3.trial195.stderr:==00:00:00:13.724 45171== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.273 INFO:tasks.ceph.osd.11.trial195.stderr:==00:00:00:13.725 45173== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.276 INFO:tasks.ceph.osd.1.trial044.stderr:==00:00:00:13.758 45006== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.280 INFO:tasks.ceph.osd.9.trial044.stderr:==00:00:00:13.756 45008== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.281 INFO:tasks.ceph.osd.7.trial195.stderr:==00:00:00:13.735 45172== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.291 INFO:tasks.ceph.osd.13.trial044.stderr:==00:00:00:13.765 45009== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.291 INFO:tasks.ceph.osd.10.trial170.stderr:==00:00:00:13.756 44836== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.294 INFO:tasks.ceph.osd.6.trial170.stderr:==00:00:00:13.761 44835== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.295 INFO:tasks.ceph.osd.13.trial044.stderr:==00:00:00:13.769 45009== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.306 INFO:tasks.ceph.osd.11.trial195.stderr:==00:00:00:13.758 45173== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.307 INFO:tasks.ceph.osd.12.trial014.stderr:==00:00:00:13.792 44467== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.307 INFO:tasks.ceph.osd.1.trial044.stderr:==00:00:00:13.789 45006== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.308 INFO:tasks.ceph.osd.3.trial195.stderr:==00:00:00:13.762 45171== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.310 INFO:tasks.ceph.osd.0.trial014.stderr:==00:00:00:13.804 44460== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.311 INFO:tasks.ceph.osd.11.trial195.stderr:==00:00:00:13.763 45173== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.311 INFO:tasks.ceph.osd.4.trial014.stderr:==00:00:00:13.803 44461== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.313 INFO:tasks.ceph.osd.1.trial044.stderr:==00:00:00:13.794 45006== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.318 INFO:tasks.ceph.osd.9.trial044.stderr:==00:00:00:13.794 45008== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.323 INFO:tasks.ceph.osd.9.trial044.stderr:==00:00:00:13.799 45008== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.326 INFO:tasks.ceph.osd.7.trial195.stderr:==00:00:00:13.779 45172== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.335 INFO:tasks.ceph.osd.3.trial195.stderr:==00:00:00:13.788 45171== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.339 INFO:tasks.ceph.osd.6.trial170.stderr:==00:00:00:13.807 44835== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.340 INFO:tasks.ceph.osd.3.trial195.stderr:==00:00:00:13.794 45171== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.343 INFO:tasks.ceph.osd.0.trial014.stderr:==00:00:00:13.837 44460== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.347 INFO:tasks.ceph.osd.4.trial014.stderr:==00:00:00:13.840 44461== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.347 INFO:tasks.ceph.osd.12.trial014.stderr:==00:00:00:13.833 44467== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.353 INFO:tasks.ceph.osd.14.trial170.stderr:==00:00:00:13.815 44837== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.360 INFO:tasks.ceph.osd.7.trial195.stderr:==00:00:00:13.813 45172== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.364 INFO:tasks.ceph.osd.6.trial170.stderr:==00:00:00:13.831 44835== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.368 INFO:tasks.ceph.osd.0.trial014.stderr:==00:00:00:13.862 44460== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.369 INFO:tasks.ceph.osd.6.trial170.stderr:==00:00:00:13.836 44835== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.373 INFO:tasks.ceph.osd.0.trial014.stderr:==00:00:00:13.867 44460== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.375 INFO:tasks.ceph.osd.12.trial014.stderr:==00:00:00:13.860 44467== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.376 INFO:tasks.ceph.osd.4.trial014.stderr:==00:00:00:13.869 44461== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.379 INFO:tasks.ceph.osd.12.trial014.stderr:==00:00:00:13.865 44467== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.380 INFO:tasks.ceph.osd.15.trial195.stderr:==00:00:00:13.830 45174== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.381 INFO:tasks.ceph.osd.4.trial014.stderr:==00:00:00:13.873 44461== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.401 INFO:tasks.ceph.osd.7.trial195.stderr:==00:00:00:13.855 45172== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.407 INFO:tasks.ceph.osd.7.trial195.stderr:==00:00:00:13.860 45172== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.410 INFO:tasks.ceph.osd.14.trial170.stderr:==00:00:00:13.872 44837== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.411 INFO:tasks.ceph.osd.2.trial170.stderr:==00:00:00:13.880 44834== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.430 INFO:tasks.ceph.osd.10.trial170.stderr:==00:00:00:13.895 44836== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.432 INFO:tasks.ceph.osd.14.trial170.stderr:==00:00:00:13.894 44837== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.432 INFO:tasks.ceph.osd.15.trial195.stderr:==00:00:00:13.882 45174== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.459 INFO:tasks.ceph.osd.15.trial195.stderr:==00:00:00:13.909 45174== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.462 INFO:tasks.ceph.osd.2.trial170.stderr:==00:00:00:13.931 44834== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.464 INFO:tasks.ceph.osd.14.trial170.stderr:==00:00:00:13.925 44837== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.469 INFO:tasks.ceph.osd.14.trial170.stderr:==00:00:00:13.930 44837== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.486 INFO:tasks.ceph.osd.15.trial195.stderr:==00:00:00:13.936 45174== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.490 INFO:tasks.ceph.osd.2.trial170.stderr:==00:00:00:13.959 44834== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.490 INFO:tasks.ceph.osd.10.trial170.stderr:==00:00:00:13.955 44836== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.491 INFO:tasks.ceph.osd.15.trial195.stderr:==00:00:00:13.941 45174== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.514 INFO:tasks.ceph.osd.2.trial170.stderr:==00:00:00:13.983 44834== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.518 INFO:tasks.ceph.osd.2.trial170.stderr:==00:00:00:13.988 44834== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.530 INFO:tasks.ceph.osd.10.trial170.stderr:==00:00:00:13.995 44836== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.568 INFO:tasks.ceph.osd.10.trial170.stderr:==00:00:00:14.032 44836== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:01.573 INFO:tasks.ceph.osd.10.trial170.stderr:==00:00:00:14.037 44836== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:03.485 INFO:tasks.ceph.osd.5.trial044.stderr:==00:00:00:15.964 45007== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:03.528 INFO:tasks.ceph.osd.8.trial014.stderr:==00:00:00:16.013 44466== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:03.560 INFO:tasks.ceph.osd.13.trial044.stderr:==00:00:00:16.035 45009== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:03.590 INFO:tasks.ceph.osd.11.trial195.stderr:==00:00:00:16.042 45173== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:03.594 INFO:tasks.ceph.osd.1.trial044.stderr:==00:00:00:16.075 45006== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:03.602 INFO:tasks.ceph.osd.9.trial044.stderr:==00:00:00:16.078 45008== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:03.638 INFO:tasks.ceph.osd.6.trial170.stderr:==00:00:00:16.105 44835== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:03.642 INFO:tasks.ceph.osd.0.trial014.stderr:==00:00:00:16.136 44460== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:03.645 INFO:tasks.ceph.osd.3.trial195.stderr:==00:00:00:16.099 45171== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:03.651 INFO:tasks.ceph.osd.4.trial014.stderr:==00:00:00:16.143 44461== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:03.662 INFO:tasks.ceph.osd.12.trial014.stderr:==00:00:00:16.148 44467== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:03.699 INFO:tasks.ceph.osd.7.trial195.stderr:==00:00:00:16.153 45172== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:03.750 INFO:tasks.ceph.osd.14.trial170.stderr:==00:00:00:16.211 44837== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:03.798 INFO:tasks.ceph.osd.2.trial170.stderr:==00:00:00:16.267 44834== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:03.801 INFO:tasks.ceph.osd.15.trial195.stderr:==00:00:00:16.251 45174== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:03.862 INFO:tasks.ceph.osd.10.trial170.stderr:==00:00:00:16.326 44836== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:05.270 DEBUG:teuthology.orchestra.run.trial014:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-24T19:17:05.333 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.332+0000 7ff96946f640 10 monclient: get_monmap_and_config 2026-02-24T19:17:05.333 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.332+0000 7ff96946f640 10 monclient: build_initial_monmap 2026-02-24T19:17:05.333 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.332+0000 7ff96946f640 10 monclient: monmap: 2026-02-24T19:17:05.333 INFO:teuthology.misc.health.trial014.stderr:epoch 0 2026-02-24T19:17:05.333 INFO:teuthology.misc.health.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:05.334 INFO:teuthology.misc.health.trial014.stderr:last_changed 2026-02-24T19:17:05.332703+0000 2026-02-24T19:17:05.334 INFO:teuthology.misc.health.trial014.stderr:created 2026-02-24T19:17:05.332703+0000 2026-02-24T19:17:05.334 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:05.334 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 3 2026-02-24T19:17:05.334 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:05.334 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:05.334 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:05.334 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:17:05.336 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.332+0000 7ff96946f640 1 Processor -- start 2026-02-24T19:17:05.336 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.332+0000 7ff96946f640 1 -- start start 2026-02-24T19:17:05.336 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.332+0000 7ff96946f640 10 monclient: init 2026-02-24T19:17:05.336 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.333+0000 7ff96946f640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:05.336 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.333+0000 7ff96946f640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:05.336 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.333+0000 7ff96946f640 10 monclient(hunting): picked mon.noname-b con 0x7ff964058da0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:05.336 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.333+0000 7ff96946f640 10 monclient(hunting): picked mon.noname-c con 0x7ff9640b0410 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:05.336 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.333+0000 7ff96946f640 10 monclient(hunting): picked mon.noname-a con 0x7ff9641626a0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:05.337 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.333+0000 7ff96946f640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9641655c0 con 0x7ff9641626a0 2026-02-24T19:17:05.337 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.333+0000 7ff96946f640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9640b12b0 con 0x7ff964058da0 2026-02-24T19:17:05.337 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.333+0000 7ff96946f640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9640b1590 con 0x7ff9640b0410 2026-02-24T19:17:05.337 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.333+0000 7ff96946f640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:05.337 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.333+0000 7ff96946f640 10 monclient(hunting): authenticate will time out at 3600.014093s 2026-02-24T19:17:05.337 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.333+0000 7ff9627fc640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7ff9640b0410 0x7ff964164eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:60446/0 (socket says 10.20.193.14:60446) 2026-02-24T19:17:05.337 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.333+0000 7ff9627fc640 1 -- 10.20.193.14:0/3457071808 learned_addr learned my addr 10.20.193.14:0/3457071808 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:05.337 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.334+0000 7ff961ffb640 1 -- 10.20.193.14:0/3457071808 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1551689888 0 0) 0x7ff9640b1590 con 0x7ff9640b0410 2026-02-24T19:17:05.337 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.334+0000 7ff961ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:05.337 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.334+0000 7ff961ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:05.337 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.334+0000 7ff961ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:05.337 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.334+0000 7ff961ffb640 10 monclient(hunting): my global_id is 4286 2026-02-24T19:17:05.338 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.334+0000 7ff961ffb640 1 -- 10.20.193.14:0/3457071808 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff950003610 con 0x7ff9640b0410 2026-02-24T19:17:05.338 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.334+0000 7ff961ffb640 1 -- 10.20.193.14:0/3457071808 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 901988680 0 0) 0x7ff9641655c0 con 0x7ff9641626a0 2026-02-24T19:17:05.338 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.334+0000 7ff961ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:05.338 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.334+0000 7ff961ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:05.338 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.334+0000 7ff961ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:05.338 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.334+0000 7ff961ffb640 10 monclient(hunting): my global_id is 4281 2026-02-24T19:17:05.338 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.334+0000 7ff961ffb640 1 -- 10.20.193.14:0/3457071808 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9640b1590 con 0x7ff9641626a0 2026-02-24T19:17:05.342 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.335+0000 7ff961ffb640 1 -- 10.20.193.14:0/3457071808 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1895101805 0 0) 0x7ff9640b12b0 con 0x7ff964058da0 2026-02-24T19:17:05.342 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.335+0000 7ff961ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:05.343 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.335+0000 7ff961ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:05.343 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.335+0000 7ff961ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:05.343 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.335+0000 7ff961ffb640 10 monclient(hunting): my global_id is 4276 2026-02-24T19:17:05.343 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.335+0000 7ff961ffb640 1 -- 10.20.193.14:0/3457071808 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9641655c0 con 0x7ff964058da0 2026-02-24T19:17:05.343 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.336+0000 7ff961ffb640 1 -- 10.20.193.14:0/3457071808 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2389044282 0 0) 0x7ff9640b1590 con 0x7ff9641626a0 2026-02-24T19:17:05.343 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.336+0000 7ff961ffb640 1 -- 10.20.193.14:0/3457071808 >> v1:10.20.193.170:6789/0 conn(0x7ff9640b0410 legacy=0x7ff964164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:05.343 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.336+0000 7ff961ffb640 1 -- 10.20.193.14:0/3457071808 >> v1:10.20.193.44:6789/0 conn(0x7ff964058da0 legacy=0x7ff9641647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:05.343 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.336+0000 7ff961ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:05.343 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.336+0000 7ff961ffb640 1 monclient: found mon.noname-a 2026-02-24T19:17:05.343 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.336+0000 7ff961ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:05.343 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.336+0000 7ff961ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:17:05.343 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.336+0000 7ff961ffb640 1 -- 10.20.193.14:0/3457071808 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9640b1870 con 0x7ff9641626a0 2026-02-24T19:17:05.344 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.336+0000 7ff961ffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:05.344 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.336+0000 7ff961ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:05.344 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.336+0000 7ff961ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:05.344 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.336+0000 7ff961ffb640 1 -- 10.20.193.14:0/3457071808 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ff954003170 con 0x7ff9641626a0 2026-02-24T19:17:05.344 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.336+0000 7ff961ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:05.344 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.336+0000 7ff961ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:05.344 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.336+0000 7ff961ffb640 10 monclient: dump: 2026-02-24T19:17:05.344 INFO:teuthology.misc.health.trial014.stderr:epoch 1 2026-02-24T19:17:05.344 INFO:teuthology.misc.health.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:05.344 INFO:teuthology.misc.health.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:05.344 INFO:teuthology.misc.health.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:05.345 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:05.345 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 3 2026-02-24T19:17:05.345 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:05.345 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:05.345 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:05.345 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:17:05.345 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.336+0000 7ff96946f640 5 monclient: authenticate success, global_id 4281 2026-02-24T19:17:05.345 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.336+0000 7ff96946f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:05.345 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.337+0000 7ff961ffb640 1 -- 10.20.193.14:0/3457071808 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff954003340 con 0x7ff9641626a0 2026-02-24T19:17:05.345 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.337+0000 7ff961ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:05.345 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.337+0000 7ff961ffb640 1 -- 10.20.193.14:0/3457071808 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ff954003780 con 0x7ff9641626a0 2026-02-24T19:17:05.345 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.337+0000 7ff961ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:05.346 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.337+0000 7ff961ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:05.346 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.337+0000 7ff961ffb640 10 monclient: dump: 2026-02-24T19:17:05.346 INFO:teuthology.misc.health.trial014.stderr:epoch 1 2026-02-24T19:17:05.346 INFO:teuthology.misc.health.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:05.346 INFO:teuthology.misc.health.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:05.346 INFO:teuthology.misc.health.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:05.346 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:05.346 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 3 2026-02-24T19:17:05.346 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:05.346 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:05.346 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:05.347 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:17:05.347 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.337+0000 7ff96946f640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:05.347 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.337+0000 7ff96946f640 4 set_mon_vals no callback set 2026-02-24T19:17:05.347 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.337+0000 7ff96946f640 10 monclient: shutdown 2026-02-24T19:17:05.347 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.337+0000 7ff96946f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:05.347 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.337+0000 7ff96946f640 1 -- 10.20.193.14:0/3457071808 >> v1:10.20.193.14:6789/0 conn(0x7ff9641626a0 legacy=0x7ff9641c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:05.347 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.337+0000 7ff96946f640 1 -- 10.20.193.14:0/3457071808 shutdown_connections 2026-02-24T19:17:05.347 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.337+0000 7ff96946f640 1 -- 10.20.193.14:0/3457071808 >> 10.20.193.14:0/3457071808 conn(0x7ff9640b65f0 msgr2=0x7ff9640b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:05.347 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.337+0000 7ff96946f640 1 -- 10.20.193.14:0/3457071808 shutdown_connections 2026-02-24T19:17:05.347 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.337+0000 7ff96946f640 1 -- 10.20.193.14:0/3457071808 wait complete. 2026-02-24T19:17:05.347 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.338+0000 7ff96946f640 10 monclient: build_initial_monmap 2026-02-24T19:17:05.347 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.338+0000 7ff96946f640 10 monclient: monmap: 2026-02-24T19:17:05.348 INFO:teuthology.misc.health.trial014.stderr:epoch 0 2026-02-24T19:17:05.348 INFO:teuthology.misc.health.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:05.348 INFO:teuthology.misc.health.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:05.348 INFO:teuthology.misc.health.trial014.stderr:created 0.000000 2026-02-24T19:17:05.348 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:05.348 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 1 2026-02-24T19:17:05.348 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:05.348 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:05.348 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:05.348 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:17:05.348 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.338+0000 7ff96946f640 1 librados: starting msgr at 2026-02-24T19:17:05.348 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.338+0000 7ff96946f640 1 librados: starting objecter 2026-02-24T19:17:05.349 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.338+0000 7ff96946f640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:05.349 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.338+0000 7ff96946f640 1 Processor -- start 2026-02-24T19:17:05.349 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.338+0000 7ff96946f640 1 -- start start 2026-02-24T19:17:05.349 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.338+0000 7ff96946f640 1 librados: setting wanted keys 2026-02-24T19:17:05.349 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.338+0000 7ff96946f640 1 librados: calling monclient init 2026-02-24T19:17:05.349 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.338+0000 7ff96946f640 10 monclient: init 2026-02-24T19:17:05.349 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.338+0000 7ff96946f640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:05.349 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.338+0000 7ff96946f640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:05.349 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.338+0000 7ff96946f640 10 monclient(hunting): picked mon.noname-b con 0x7ff964058da0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:05.349 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.338+0000 7ff96946f640 10 monclient(hunting): picked mon.noname-c con 0x7ff9640b0410 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:05.349 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.338+0000 7ff96946f640 10 monclient(hunting): picked mon.noname-a con 0x7ff9641626a0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:05.349 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.338+0000 7ff96946f640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff964056ff0 con 0x7ff9641626a0 2026-02-24T19:17:05.350 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.338+0000 7ff96946f640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff96414d760 con 0x7ff964058da0 2026-02-24T19:17:05.350 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.338+0000 7ff96946f640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff96414da40 con 0x7ff9640b0410 2026-02-24T19:17:05.350 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.338+0000 7ff96946f640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:05.350 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.338+0000 7ff96946f640 10 monclient(hunting): authenticate will time out at 3600.019850s 2026-02-24T19:17:05.350 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.339+0000 7ff9637fe640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7ff9641626a0 0x7ff96405cdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:48420/0 (socket says 10.20.193.14:48420) 2026-02-24T19:17:05.350 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.339+0000 7ff9637fe640 1 -- 10.20.193.14:0/2771212200 learned_addr learned my addr 10.20.193.14:0/2771212200 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:05.350 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.339+0000 7ff9437fe640 10 client.?.objecter ms_handle_connect 0x7ff9641626a0 2026-02-24T19:17:05.350 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.339+0000 7ff9437fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:05.350 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.339+0000 7ff9437fe640 10 client.?.objecter ms_handle_connect 0x7ff9640b0410 2026-02-24T19:17:05.350 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.339+0000 7ff9437fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:05.350 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.339+0000 7ff9437fe640 10 client.?.objecter ms_handle_connect 0x7ff964058da0 2026-02-24T19:17:05.350 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.339+0000 7ff9437fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:05.350 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.340+0000 7ff9437fe640 1 -- 10.20.193.14:0/2771212200 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 572471692 0 0) 0x7ff964056ff0 con 0x7ff9641626a0 2026-02-24T19:17:05.351 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.340+0000 7ff9437fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:05.351 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.340+0000 7ff9437fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:05.351 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.340+0000 7ff9437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:05.351 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.340+0000 7ff9437fe640 10 monclient(hunting): my global_id is 4284 2026-02-24T19:17:05.351 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.340+0000 7ff9437fe640 1 -- 10.20.193.14:0/2771212200 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff930003610 con 0x7ff9641626a0 2026-02-24T19:17:05.351 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.340+0000 7ff9437fe640 1 -- 10.20.193.14:0/2771212200 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1356475200 0 0) 0x7ff96414da40 con 0x7ff9640b0410 2026-02-24T19:17:05.351 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.340+0000 7ff9437fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:05.351 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.340+0000 7ff9437fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:05.351 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.340+0000 7ff9437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:05.351 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.340+0000 7ff9437fe640 10 monclient(hunting): my global_id is 4289 2026-02-24T19:17:05.351 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.340+0000 7ff9437fe640 1 -- 10.20.193.14:0/2771212200 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff964056ff0 con 0x7ff9640b0410 2026-02-24T19:17:05.351 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.340+0000 7ff9437fe640 1 -- 10.20.193.14:0/2771212200 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 262639081 0 0) 0x7ff96414d760 con 0x7ff964058da0 2026-02-24T19:17:05.352 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.340+0000 7ff9437fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:05.352 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.340+0000 7ff9437fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:05.352 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.340+0000 7ff9437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:05.352 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.340+0000 7ff9437fe640 10 monclient(hunting): my global_id is 4279 2026-02-24T19:17:05.352 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.340+0000 7ff9437fe640 1 -- 10.20.193.14:0/2771212200 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff96414da40 con 0x7ff964058da0 2026-02-24T19:17:05.354 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.343+0000 7ff9437fe640 1 -- 10.20.193.14:0/2771212200 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3755819739 0 0) 0x7ff930003610 con 0x7ff9641626a0 2026-02-24T19:17:05.354 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.343+0000 7ff9437fe640 1 -- 10.20.193.14:0/2771212200 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff96414d760 con 0x7ff9641626a0 2026-02-24T19:17:05.354 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.343+0000 7ff9437fe640 1 -- 10.20.193.14:0/2771212200 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ff954003690 con 0x7ff9641626a0 2026-02-24T19:17:05.354 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.343+0000 7ff9437fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:05.354 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.343+0000 7ff9437fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:05.355 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.343+0000 7ff9437fe640 10 monclient(hunting): dump: 2026-02-24T19:17:05.355 INFO:teuthology.misc.health.trial014.stderr:epoch 1 2026-02-24T19:17:05.355 INFO:teuthology.misc.health.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:05.355 INFO:teuthology.misc.health.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:05.355 INFO:teuthology.misc.health.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:05.355 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:05.355 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 3 2026-02-24T19:17:05.355 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:05.355 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:05.355 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:05.355 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:17:05.355 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.343+0000 7ff9437fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:05.356 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.343+0000 7ff9437fe640 1 -- 10.20.193.14:0/2771212200 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 134270276 0 0) 0x7ff964056ff0 con 0x7ff9640b0410 2026-02-24T19:17:05.356 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.343+0000 7ff9437fe640 1 -- 10.20.193.14:0/2771212200 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff930003610 con 0x7ff9640b0410 2026-02-24T19:17:05.356 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.343+0000 7ff9437fe640 1 -- 10.20.193.14:0/2771212200 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ff94c0030b0 con 0x7ff9640b0410 2026-02-24T19:17:05.356 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.343+0000 7ff9437fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:05.356 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.343+0000 7ff9437fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:05.356 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.343+0000 7ff9437fe640 10 monclient(hunting): dump: 2026-02-24T19:17:05.356 INFO:teuthology.misc.health.trial014.stderr:epoch 1 2026-02-24T19:17:05.356 INFO:teuthology.misc.health.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:05.356 INFO:teuthology.misc.health.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:05.356 INFO:teuthology.misc.health.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:05.356 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:05.356 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 3 2026-02-24T19:17:05.357 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:05.357 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:05.357 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:05.357 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:17:05.357 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.343+0000 7ff9437fe640 1 -- 10.20.193.14:0/2771212200 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 776425747 0 0) 0x7ff96414da40 con 0x7ff964058da0 2026-02-24T19:17:05.357 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.343+0000 7ff9437fe640 1 -- 10.20.193.14:0/2771212200 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff964056ff0 con 0x7ff964058da0 2026-02-24T19:17:05.357 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.343+0000 7ff9437fe640 1 -- 10.20.193.14:0/2771212200 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ff958003060 con 0x7ff964058da0 2026-02-24T19:17:05.357 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.343+0000 7ff9437fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:05.357 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.343+0000 7ff9437fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:05.357 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.343+0000 7ff9437fe640 10 monclient(hunting): dump: 2026-02-24T19:17:05.357 INFO:teuthology.misc.health.trial014.stderr:epoch 1 2026-02-24T19:17:05.357 INFO:teuthology.misc.health.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:05.358 INFO:teuthology.misc.health.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:05.358 INFO:teuthology.misc.health.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:05.358 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:05.358 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 3 2026-02-24T19:17:05.358 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:05.358 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:05.358 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:05.358 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:17:05.358 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.344+0000 7ff9437fe640 1 -- 10.20.193.14:0/2771212200 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1759531572 0 0) 0x7ff96414d760 con 0x7ff9641626a0 2026-02-24T19:17:05.358 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.344+0000 7ff9437fe640 1 -- 10.20.193.14:0/2771212200 >> v1:10.20.193.170:6789/0 conn(0x7ff9640b0410 legacy=0x7ff9640568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:05.358 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.344+0000 7ff9437fe640 1 -- 10.20.193.14:0/2771212200 >> v1:10.20.193.44:6789/0 conn(0x7ff964058da0 legacy=0x7ff9640576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:05.358 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.344+0000 7ff9437fe640 10 monclient: _finish_hunting 0 2026-02-24T19:17:05.358 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.344+0000 7ff9437fe640 1 monclient: found mon.a 2026-02-24T19:17:05.359 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.344+0000 7ff9437fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:05.359 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.344+0000 7ff9437fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:05.359 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.344+0000 7ff9437fe640 1 -- 10.20.193.14:0/2771212200 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff96414dd20 con 0x7ff9641626a0 2026-02-24T19:17:05.359 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.344+0000 7ff9437fe640 10 monclient: _finish_auth 0 2026-02-24T19:17:05.359 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.344+0000 7ff9437fe640 10 monclient: _check_auth_tickets 2026-02-24T19:17:05.359 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.344+0000 7ff9437fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:05.359 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.344+0000 7ff96946f640 5 monclient: authenticate success, global_id 4284 2026-02-24T19:17:05.359 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.344+0000 7ff96946f640 10 monclient: _renew_subs 2026-02-24T19:17:05.359 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.344+0000 7ff96946f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:05.359 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.344+0000 7ff96946f640 1 -- 10.20.193.14:0/2771212200 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff96405c5f0 con 0x7ff9641626a0 2026-02-24T19:17:05.359 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.344+0000 7ff96946f640 10 client.4284.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:05.359 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.344+0000 7ff96946f640 10 monclient: _renew_subs 2026-02-24T19:17:05.359 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.344+0000 7ff96946f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:05.360 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.344+0000 7ff96946f640 1 -- 10.20.193.14:0/2771212200 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff96405d500 con 0x7ff9641626a0 2026-02-24T19:17:05.360 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.344+0000 7ff96946f640 1 librados: init done 2026-02-24T19:17:05.360 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.345+0000 7ff96946f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:05.360 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.345+0000 7ff96946f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:05.360 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.345+0000 7ff96946f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:05.360 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.345+0000 7ff96946f640 1 -- 10.20.193.14:0/2771212200 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff964055260 con 0x7ff9641626a0 2026-02-24T19:17:05.390 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.388+0000 7ff9437fe640 1 -- 10.20.193.14:0/2771212200 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff9540032f0 con 0x7ff9641626a0 2026-02-24T19:17:05.390 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.388+0000 7ff9437fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:05.390 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.388+0000 7ff9437fe640 1 -- 10.20.193.14:0/2771212200 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ff954003e70 con 0x7ff9641626a0 2026-02-24T19:17:05.390 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.388+0000 7ff9437fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:05.390 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.388+0000 7ff9437fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:05.390 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.388+0000 7ff9617fa640 4 set_mon_vals no callback set 2026-02-24T19:17:05.390 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.388+0000 7ff9437fe640 10 monclient: dump: 2026-02-24T19:17:05.391 INFO:teuthology.misc.health.trial014.stderr:epoch 1 2026-02-24T19:17:05.391 INFO:teuthology.misc.health.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:05.391 INFO:teuthology.misc.health.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:05.391 INFO:teuthology.misc.health.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:05.391 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:05.391 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 3 2026-02-24T19:17:05.391 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:05.391 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:05.391 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:05.391 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:17:05.392 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.389+0000 7ff9437fe640 1 -- 10.20.193.14:0/2771212200 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 4) ==== 101507+0+0 (unknown 1883626494 0 0) 0x7ff954004050 con 0x7ff9641626a0 2026-02-24T19:17:05.392 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.389+0000 7ff962ffd640 10 monclient: get_auth_request con 0x7ff930077d70 auth_method 0 2026-02-24T19:17:05.392 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.390+0000 7ff9437fe640 10 client.4284.objecter ms_handle_connect 0x7ff930077d70 2026-02-24T19:17:05.407 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.406+0000 7ff9437fe640 1 -- 10.20.193.14:0/2771212200 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 2560+0+0 (unknown 3182630602 0 0) 0x7ff954059650 con 0x7ff9641626a0 2026-02-24T19:17:05.407 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.406+0000 7ff9437fe640 10 client.4284.objecter ms_dispatch2 0x7ff964000b90 osd_map(18..18 src has 1..18) 2026-02-24T19:17:05.407 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.406+0000 7ff9437fe640 3 client.4284.objecter handle_osd_map got epochs [18,18] > 0 2026-02-24T19:17:05.407 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.406+0000 7ff9437fe640 3 client.4284.objecter handle_osd_map decoding full epoch 18 2026-02-24T19:17:05.407 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.406+0000 7ff9437fe640 20 client.4284.objecter dump_active .. 0 homeless 2026-02-24T19:17:05.452 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.451+0000 7ff9437fe640 1 -- 10.20.193.14:0/2771212200 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7ff964055260 con 0x7ff9641626a0 2026-02-24T19:17:05.452 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.451+0000 7ff9437fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:05.453 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.451+0000 7ff9437fe640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:05.565 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.564+0000 7ff96946f640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:05.565 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.564+0000 7ff96946f640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:05.565 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.564+0000 7ff96946f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:05.566 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.564+0000 7ff96946f640 1 -- 10.20.193.14:0/2771212200 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff964139830 con 0x7ff9641626a0 2026-02-24T19:17:05.586 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.584+0000 7ff9437fe640 1 -- 10.20.193.14:0/2771212200 <== mon.0 v1:10.20.193.14:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12877 (unknown 3338201251 0 3973102980) 0x7ff95405ddc0 con 0x7ff9641626a0 2026-02-24T19:17:05.586 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.584+0000 7ff9437fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:05.586 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.584+0000 7ff9437fe640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:05.586 INFO:teuthology.misc.health.trial014.stdout: 2026-02-24T19:17:05.587 INFO:teuthology.misc.health.trial014.stdout:{"epoch":18,"fsid":"829a649b-54c9-463b-96b9-ffa203d49fa7","created":"2026-02-24T19:16:40.561511+0000","modified":"2026-02-24T19:16:47.437972+0000","last_up_change":"0.000000","last_in_change":"2026-02-24T19:16:47.437972+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9a3fd69b-7f2a-443b-9ae1-673acfad8b00","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7dca8ec5-5aa3-420d-bf78-1331d974dafd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5a7b7c02-22f9-4eb1-a1b0-afb106604416","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"695eeb19-d0a7-4b16-8d9a-ec59206d7ecc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"09ca59ec-7e76-44ba-bf1a-1b752732db60","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"64319106-a5b4-4775-b122-8c50216df3a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"19f0033c-abbd-406a-8eae-94e7e81da9ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7cdd3b9b-4146-45b9-aaf6-df379c7a1e0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"a4833012-c50c-4a6e-b754-cf18fc6117fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"322914a2-9ba3-44b8-98ec-958b00c92f0c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"dbfdf855-de28-491b-9112-8009ab155fb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"253e9d0b-391d-4647-bd89-6ab4b57909aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"7b7d5fca-4759-46e5-a681-45509749b265","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"8d1f12c8-5787-425d-a4a6-ac820bbf6e8b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"866643a2-5f54-425c-b5ec-70607e191f02","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"4726a8b0-bcef-4e7f-aa36-e80228e2aec5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T19:17:05.589 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.587+0000 7ff96946f640 10 librados: watch_flush enter 2026-02-24T19:17:05.589 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.587+0000 7ff96946f640 10 librados: watch_flush exit 2026-02-24T19:17:05.589 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.587+0000 7ff96946f640 20 client.4284.objecter shutdown clearing up homeless session... 2026-02-24T19:17:05.589 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.587+0000 7ff96946f640 10 client.4284.objecter successfully canceled tick 2026-02-24T19:17:05.589 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.587+0000 7ff96946f640 1 -- 10.20.193.14:0/2771212200 >> v1:10.20.193.14:6800/4014096310 conn(0x7ff930077d70 legacy=0x7ff930098220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:05.589 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.587+0000 7ff96946f640 10 monclient: shutdown 2026-02-24T19:17:05.589 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.587+0000 7ff96946f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:05.589 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.587+0000 7ff96946f640 1 -- 10.20.193.14:0/2771212200 >> v1:10.20.193.14:6789/0 conn(0x7ff9641626a0 legacy=0x7ff96405cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:05.590 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.587+0000 7ff96946f640 1 -- 10.20.193.14:0/2771212200 shutdown_connections 2026-02-24T19:17:05.590 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.587+0000 7ff96946f640 1 -- 10.20.193.14:0/2771212200 >> 10.20.193.14:0/2771212200 conn(0x7ff9640b65f0 msgr2=0x7ff964163680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:05.590 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.587+0000 7ff96946f640 1 -- 10.20.193.14:0/2771212200 shutdown_connections 2026-02-24T19:17:05.590 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.587+0000 7ff96946f640 1 -- 10.20.193.14:0/2771212200 wait complete. 2026-02-24T19:17:05.590 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:05.587+0000 7ff96946f640 1 librados: shutdown 2026-02-24T19:17:05.596 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-24T19:17:05.745 INFO:tasks.ceph.osd.5.trial044.stderr:==00:00:00:18.224 45007== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:05.762 INFO:tasks.ceph.osd.8.trial014.stderr:==00:00:00:18.247 44466== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:05.776 INFO:tasks.ceph.osd.5.trial044.stderr:==00:00:00:18.255 45007== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:05.778 INFO:tasks.ceph.osd.5.trial044.stderr:==00:00:00:18.257 45007== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:05.790 INFO:tasks.ceph.osd.9.trial044.stderr:==00:00:00:18.266 45008== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:05.791 INFO:tasks.ceph.osd.13.trial044.stderr:==00:00:00:18.265 45009== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:05.804 INFO:tasks.ceph.osd.8.trial014.stderr:==00:00:00:18.289 44466== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:05.807 INFO:tasks.ceph.osd.8.trial014.stderr:==00:00:00:18.292 44466== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:05.810 INFO:tasks.ceph.osd.1.trial044.stderr:==00:00:00:18.291 45006== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:05.822 INFO:tasks.ceph.osd.9.trial044.stderr:==00:00:00:18.298 45008== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:05.824 INFO:tasks.ceph.osd.9.trial044.stderr:==00:00:00:18.300 45008== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:05.830 INFO:tasks.ceph.osd.13.trial044.stderr:==00:00:00:18.304 45009== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:05.833 INFO:tasks.ceph.osd.13.trial044.stderr:==00:00:00:18.307 45009== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:05.839 INFO:tasks.ceph.osd.1.trial044.stderr:==00:00:00:18.320 45006== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:05.841 INFO:tasks.ceph.osd.1.trial044.stderr:==00:00:00:18.323 45006== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:05.860 INFO:tasks.ceph.osd.11.trial195.stderr:==00:00:00:18.312 45173== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:05.861 INFO:tasks.ceph.osd.12.trial014.stderr:==00:00:00:18.347 44467== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:05.872 INFO:tasks.ceph.osd.0.trial014.stderr:==00:00:00:18.366 44460== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:05.876 INFO:tasks.ceph.osd.4.trial014.stderr:==00:00:00:18.368 44461== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:05.890 INFO:tasks.ceph.osd.12.trial014.stderr:==00:00:00:18.376 44467== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:05.892 INFO:tasks.ceph.osd.12.trial014.stderr:==00:00:00:18.378 44467== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:05.895 INFO:tasks.ceph.osd.11.trial195.stderr:==00:00:00:18.347 45173== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:05.897 INFO:tasks.ceph.osd.3.trial195.stderr:==00:00:00:18.350 45171== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:05.898 INFO:tasks.ceph.osd.11.trial195.stderr:==00:00:00:18.350 45173== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:05.901 INFO:tasks.ceph.osd.6.trial170.stderr:==00:00:00:18.368 44835== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:05.906 INFO:tasks.ceph.osd.0.trial014.stderr:==00:00:00:18.400 44460== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:05.909 INFO:tasks.ceph.osd.0.trial014.stderr:==00:00:00:18.403 44460== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:05.911 INFO:tasks.ceph.osd.4.trial014.stderr:==00:00:00:18.404 44461== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:05.914 INFO:tasks.ceph.osd.4.trial014.stderr:==00:00:00:18.407 44461== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:05.936 INFO:tasks.ceph.osd.3.trial195.stderr:==00:00:00:18.390 45171== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:05.939 INFO:tasks.ceph.osd.3.trial195.stderr:==00:00:00:18.392 45171== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:05.940 INFO:tasks.ceph.osd.6.trial170.stderr:==00:00:00:18.407 44835== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:05.943 INFO:tasks.ceph.osd.6.trial170.stderr:==00:00:00:18.410 44835== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:05.975 INFO:tasks.ceph.osd.7.trial195.stderr:==00:00:00:18.428 45172== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:06.000 INFO:tasks.ceph.osd.14.trial170.stderr:==00:00:00:18.462 44837== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:06.002 INFO:tasks.ceph.osd.7.trial195.stderr:==00:00:00:18.455 45172== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:06.005 INFO:tasks.ceph.osd.7.trial195.stderr:==00:00:00:18.458 45172== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:06.022 INFO:tasks.ceph.osd.15.trial195.stderr:==00:00:00:18.472 45174== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:06.033 INFO:tasks.ceph.osd.14.trial170.stderr:==00:00:00:18.494 44837== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:06.035 INFO:tasks.ceph.osd.14.trial170.stderr:==00:00:00:18.497 44837== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:06.039 INFO:tasks.ceph.osd.2.trial170.stderr:==00:00:00:18.509 44834== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:06.053 INFO:tasks.ceph.osd.15.trial195.stderr:==00:00:00:18.503 45174== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:06.056 INFO:tasks.ceph.osd.15.trial195.stderr:==00:00:00:18.507 45174== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:06.065 INFO:tasks.ceph.osd.10.trial170.stderr:==00:00:00:18.530 44836== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:06.072 INFO:tasks.ceph.osd.2.trial170.stderr:==00:00:00:18.541 44834== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:06.075 INFO:tasks.ceph.osd.2.trial170.stderr:==00:00:00:18.544 44834== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:06.109 INFO:tasks.ceph.osd.10.trial170.stderr:==00:00:00:18.573 44836== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:06.111 INFO:tasks.ceph.osd.10.trial170.stderr:==00:00:00:18.576 44836== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:07.378 INFO:tasks.ceph.osd.5.trial044.stderr:==00:00:00:19.857 45007== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:07.405 INFO:tasks.ceph.osd.8.trial014.stderr:==00:00:00:19.890 44466== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:07.433 INFO:tasks.ceph.osd.9.trial044.stderr:==00:00:00:19.909 45008== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:07.446 INFO:tasks.ceph.osd.1.trial044.stderr:==00:00:00:19.927 45006== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:07.446 INFO:tasks.ceph.osd.13.trial044.stderr:==00:00:00:19.920 45009== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:07.495 INFO:tasks.ceph.osd.12.trial014.stderr:==00:00:00:19.981 44467== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:07.514 INFO:tasks.ceph.osd.11.trial195.stderr:==00:00:00:19.966 45173== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:07.516 INFO:tasks.ceph.osd.0.trial014.stderr:==00:00:00:20.010 44460== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:07.518 INFO:tasks.ceph.osd.4.trial014.stderr:==00:00:00:20.010 44461== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:07.554 INFO:tasks.ceph.osd.3.trial195.stderr:==00:00:00:20.007 45171== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:07.562 INFO:tasks.ceph.osd.6.trial170.stderr:==00:00:00:20.029 44835== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:07.609 INFO:tasks.ceph.osd.7.trial195.stderr:==00:00:00:20.062 45172== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:07.648 INFO:tasks.ceph.osd.14.trial170.stderr:==00:00:00:20.109 44837== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:07.668 INFO:tasks.ceph.osd.2.trial170.stderr:==00:00:00:20.137 44834== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:07.713 INFO:tasks.ceph.osd.15.trial195.stderr:==00:00:00:20.163 45174== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:07.716 INFO:tasks.ceph.osd.10.trial170.stderr:==00:00:00:20.181 44836== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:10.156 INFO:tasks.ceph.osd.5.trial044.stderr:2026-02-24T19:17:10.151+0000 787f4c0 -1 osd.5 0 log_to_monitors true 2026-02-24T19:17:10.197 INFO:tasks.ceph.osd.8.trial014.stderr:2026-02-24T19:17:10.193+0000 787f4c0 -1 osd.8 0 log_to_monitors true 2026-02-24T19:17:10.225 INFO:tasks.ceph.osd.9.trial044.stderr:2026-02-24T19:17:10.221+0000 787f4c0 -1 osd.9 0 log_to_monitors true 2026-02-24T19:17:10.229 INFO:tasks.ceph.osd.1.trial044.stderr:2026-02-24T19:17:10.223+0000 787f4c0 -1 osd.1 0 log_to_monitors true 2026-02-24T19:17:10.237 INFO:tasks.ceph.osd.13.trial044.stderr:2026-02-24T19:17:10.233+0000 787f4c0 -1 osd.13 0 log_to_monitors true 2026-02-24T19:17:10.287 INFO:tasks.ceph.osd.0.trial014.stderr:2026-02-24T19:17:10.282+0000 787f4c0 -1 osd.0 0 log_to_monitors true 2026-02-24T19:17:10.305 INFO:tasks.ceph.osd.12.trial014.stderr:2026-02-24T19:17:10.302+0000 787f4c0 -1 osd.12 0 log_to_monitors true 2026-02-24T19:17:10.314 INFO:tasks.ceph.osd.4.trial014.stderr:2026-02-24T19:17:10.311+0000 787f4c0 -1 osd.4 0 log_to_monitors true 2026-02-24T19:17:10.316 INFO:tasks.ceph.osd.6.trial170.stderr:2026-02-24T19:17:10.313+0000 787f4c0 -1 osd.6 0 log_to_monitors true 2026-02-24T19:17:10.317 INFO:tasks.ceph.osd.11.trial195.stderr:2026-02-24T19:17:10.314+0000 787f4c0 -1 osd.11 0 log_to_monitors true 2026-02-24T19:17:10.347 INFO:tasks.ceph.osd.3.trial195.stderr:2026-02-24T19:17:10.344+0000 787f4c0 -1 osd.3 0 log_to_monitors true 2026-02-24T19:17:10.406 INFO:tasks.ceph.osd.7.trial195.stderr:2026-02-24T19:17:10.403+0000 787f4c0 -1 osd.7 0 log_to_monitors true 2026-02-24T19:17:10.411 INFO:tasks.ceph.osd.14.trial170.stderr:2026-02-24T19:17:10.409+0000 787f4c0 -1 osd.14 0 log_to_monitors true 2026-02-24T19:17:10.439 INFO:tasks.ceph.osd.2.trial170.stderr:2026-02-24T19:17:10.435+0000 787f4c0 -1 osd.2 0 log_to_monitors true 2026-02-24T19:17:10.508 INFO:tasks.ceph.osd.10.trial170.stderr:2026-02-24T19:17:10.506+0000 787f4c0 -1 osd.10 0 log_to_monitors true 2026-02-24T19:17:10.536 INFO:tasks.ceph.osd.15.trial195.stderr:2026-02-24T19:17:10.533+0000 787f4c0 -1 osd.15 0 log_to_monitors true 2026-02-24T19:17:12.860 INFO:tasks.ceph.osd.6.trial170.stderr:2026-02-24T19:17:12.858+0000 df79640 -1 osd.6 0 waiting for initial osdmap 2026-02-24T19:17:12.871 INFO:tasks.ceph.osd.4.trial014.stderr:2026-02-24T19:17:12.868+0000 cf66640 -1 osd.4 0 waiting for initial osdmap 2026-02-24T19:17:12.880 INFO:tasks.ceph.osd.11.trial195.stderr:2026-02-24T19:17:12.878+0000 cf66640 -1 osd.11 0 waiting for initial osdmap 2026-02-24T19:17:12.880 INFO:tasks.ceph.osd.14.trial170.stderr:2026-02-24T19:17:12.878+0000 df79640 -1 osd.14 0 waiting for initial osdmap 2026-02-24T19:17:12.883 INFO:tasks.ceph.osd.0.trial014.stderr:2026-02-24T19:17:12.879+0000 df79640 -1 osd.0 0 waiting for initial osdmap 2026-02-24T19:17:12.894 INFO:tasks.ceph.osd.8.trial014.stderr:2026-02-24T19:17:12.892+0000 df79640 -1 osd.8 0 waiting for initial osdmap 2026-02-24T19:17:12.899 INFO:tasks.ceph.osd.3.trial195.stderr:2026-02-24T19:17:12.897+0000 cf66640 -1 osd.3 0 waiting for initial osdmap 2026-02-24T19:17:12.901 INFO:tasks.ceph.osd.2.trial170.stderr:2026-02-24T19:17:12.898+0000 df79640 -1 osd.2 0 waiting for initial osdmap 2026-02-24T19:17:12.906 INFO:tasks.ceph.osd.1.trial044.stderr:2026-02-24T19:17:12.902+0000 df79640 -1 osd.1 0 waiting for initial osdmap 2026-02-24T19:17:12.909 INFO:tasks.ceph.osd.5.trial044.stderr:2026-02-24T19:17:12.906+0000 cf66640 -1 osd.5 0 waiting for initial osdmap 2026-02-24T19:17:12.912 INFO:tasks.ceph.osd.9.trial044.stderr:2026-02-24T19:17:12.909+0000 df79640 -1 osd.9 0 waiting for initial osdmap 2026-02-24T19:17:12.915 INFO:tasks.ceph.osd.13.trial044.stderr:2026-02-24T19:17:12.911+0000 df79640 -1 osd.13 0 waiting for initial osdmap 2026-02-24T19:17:12.920 INFO:tasks.ceph.osd.10.trial170.stderr:2026-02-24T19:17:12.918+0000 df79640 -1 osd.10 0 waiting for initial osdmap 2026-02-24T19:17:12.934 INFO:tasks.ceph.osd.12.trial014.stderr:2026-02-24T19:17:12.928+0000 df79640 -1 osd.12 0 waiting for initial osdmap 2026-02-24T19:17:12.940 INFO:tasks.ceph.osd.15.trial195.stderr:2026-02-24T19:17:12.937+0000 cf66640 -1 osd.15 0 waiting for initial osdmap 2026-02-24T19:17:12.951 INFO:tasks.ceph.osd.7.trial195.stderr:2026-02-24T19:17:12.947+0000 df79640 -1 osd.7 0 waiting for initial osdmap 2026-02-24T19:17:13.078 INFO:tasks.ceph.osd.4.trial014.stderr:2026-02-24T19:17:13.071+0000 16969640 -1 osd.4 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:13.086 INFO:tasks.ceph.osd.14.trial170.stderr:2026-02-24T19:17:13.078+0000 12561640 -1 osd.14 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:13.090 INFO:tasks.ceph.osd.11.trial195.stderr:2026-02-24T19:17:13.083+0000 12561640 -1 osd.11 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:13.090 INFO:tasks.ceph.osd.6.trial170.stderr:2026-02-24T19:17:13.082+0000 12561640 -1 osd.6 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:13.099 INFO:tasks.ceph.osd.0.trial014.stderr:2026-02-24T19:17:13.092+0000 16569640 -1 osd.0 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:13.100 INFO:tasks.ceph.osd.8.trial014.stderr:2026-02-24T19:17:13.093+0000 12561640 -1 osd.8 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:13.107 INFO:tasks.ceph.osd.3.trial195.stderr:2026-02-24T19:17:13.100+0000 16569640 -1 osd.3 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:13.109 INFO:tasks.ceph.osd.1.trial044.stderr:2026-02-24T19:17:13.100+0000 16569640 -1 osd.1 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:13.109 INFO:tasks.ceph.osd.2.trial170.stderr:2026-02-24T19:17:13.101+0000 16569640 -1 osd.2 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:13.115 INFO:tasks.ceph.osd.5.trial044.stderr:2026-02-24T19:17:13.107+0000 12561640 -1 osd.5 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:13.118 INFO:tasks.ceph.osd.9.trial044.stderr:2026-02-24T19:17:13.109+0000 16569640 -1 osd.9 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:13.122 INFO:tasks.ceph.osd.13.trial044.stderr:2026-02-24T19:17:13.114+0000 16569640 -1 osd.13 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:13.126 INFO:tasks.ceph.osd.10.trial170.stderr:2026-02-24T19:17:13.119+0000 16569640 -1 osd.10 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:13.140 INFO:tasks.ceph.osd.12.trial014.stderr:2026-02-24T19:17:13.133+0000 16569640 -1 osd.12 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:13.149 INFO:tasks.ceph.osd.15.trial195.stderr:2026-02-24T19:17:13.142+0000 16969640 -1 osd.15 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:13.153 INFO:tasks.ceph.osd.7.trial195.stderr:2026-02-24T19:17:13.146+0000 12561640 -1 osd.7 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:13.208 DEBUG:teuthology.orchestra.run.trial014:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-24T19:17:13.265 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.264+0000 7f401d7d9640 10 monclient: get_monmap_and_config 2026-02-24T19:17:13.266 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.264+0000 7f401d7d9640 10 monclient: build_initial_monmap 2026-02-24T19:17:13.266 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.264+0000 7f401d7d9640 10 monclient: monmap: 2026-02-24T19:17:13.266 INFO:teuthology.misc.health.trial014.stderr:epoch 0 2026-02-24T19:17:13.266 INFO:teuthology.misc.health.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:13.266 INFO:teuthology.misc.health.trial014.stderr:last_changed 2026-02-24T19:17:13.265476+0000 2026-02-24T19:17:13.266 INFO:teuthology.misc.health.trial014.stderr:created 2026-02-24T19:17:13.265476+0000 2026-02-24T19:17:13.266 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:13.266 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 3 2026-02-24T19:17:13.266 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:13.266 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:13.266 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:13.266 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:17:13.266 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.265+0000 7f401d7d9640 1 Processor -- start 2026-02-24T19:17:13.266 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.265+0000 7f401d7d9640 1 -- start start 2026-02-24T19:17:13.266 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.265+0000 7f401d7d9640 10 monclient: init 2026-02-24T19:17:13.266 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.265+0000 7f401d7d9640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:13.266 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.265+0000 7f401d7d9640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:13.266 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.265+0000 7f401d7d9640 10 monclient(hunting): picked mon.noname-b con 0x7f4018058da0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:13.266 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.265+0000 7f401d7d9640 10 monclient(hunting): picked mon.noname-c con 0x7f40180b0410 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:13.266 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.265+0000 7f401d7d9640 10 monclient(hunting): picked mon.noname-a con 0x7f40181626a0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:13.267 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.265+0000 7f401d7d9640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40181655c0 con 0x7f40181626a0 2026-02-24T19:17:13.267 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.265+0000 7f401d7d9640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40180b12b0 con 0x7f4018058da0 2026-02-24T19:17:13.267 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.265+0000 7f401d7d9640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40180b1590 con 0x7f40180b0410 2026-02-24T19:17:13.267 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.265+0000 7f401d7d9640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:13.267 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.265+0000 7f401d7d9640 10 monclient(hunting): authenticate will time out at 3607.946852s 2026-02-24T19:17:13.267 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.266+0000 7f40177fe640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f40181626a0 0x7f40181c6d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:47930/0 (socket says 10.20.193.14:47930) 2026-02-24T19:17:13.267 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.266+0000 7f40177fe640 1 -- 10.20.193.14:0/2869901275 learned_addr learned my addr 10.20.193.14:0/2869901275 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:13.268 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.267+0000 7f4015ffb640 1 -- 10.20.193.14:0/2869901275 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1886826039 0 0) 0x7f40180b12b0 con 0x7f4018058da0 2026-02-24T19:17:13.269 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.267+0000 7f4015ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:13.269 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.267+0000 7f4015ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:13.269 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.267+0000 7f4015ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:13.269 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.267+0000 7f4015ffb640 10 monclient(hunting): my global_id is 4330 2026-02-24T19:17:13.269 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.267+0000 7f4015ffb640 1 -- 10.20.193.14:0/2869901275 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4004003610 con 0x7f4018058da0 2026-02-24T19:17:13.269 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.267+0000 7f4015ffb640 1 -- 10.20.193.14:0/2869901275 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 661998858 0 0) 0x7f40181655c0 con 0x7f40181626a0 2026-02-24T19:17:13.269 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.267+0000 7f4015ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:13.269 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.267+0000 7f4015ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:13.269 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.267+0000 7f4015ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:13.269 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.267+0000 7f4015ffb640 10 monclient(hunting): my global_id is 4335 2026-02-24T19:17:13.269 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.267+0000 7f4015ffb640 1 -- 10.20.193.14:0/2869901275 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40180b12b0 con 0x7f40181626a0 2026-02-24T19:17:13.269 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.267+0000 7f4015ffb640 1 -- 10.20.193.14:0/2869901275 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1043681340 0 0) 0x7f40180b1590 con 0x7f40180b0410 2026-02-24T19:17:13.269 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.267+0000 7f4015ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:13.269 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.267+0000 7f4015ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:13.269 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.267+0000 7f4015ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:13.269 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.267+0000 7f4015ffb640 10 monclient(hunting): my global_id is 4340 2026-02-24T19:17:13.269 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.267+0000 7f4015ffb640 1 -- 10.20.193.14:0/2869901275 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40181655c0 con 0x7f40180b0410 2026-02-24T19:17:13.270 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.269+0000 7f4015ffb640 1 -- 10.20.193.14:0/2869901275 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3380304217 0 0) 0x7f4004003610 con 0x7f4018058da0 2026-02-24T19:17:13.270 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.269+0000 7f4015ffb640 1 -- 10.20.193.14:0/2869901275 >> v1:10.20.193.170:6789/0 conn(0x7f40180b0410 legacy=0x7f4018164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:13.270 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.269+0000 7f4015ffb640 1 -- 10.20.193.14:0/2869901275 >> v1:10.20.193.14:6789/0 conn(0x7f40181626a0 legacy=0x7f40181c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:13.270 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.269+0000 7f4015ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:13.270 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.269+0000 7f4015ffb640 1 monclient: found mon.noname-b 2026-02-24T19:17:13.270 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.269+0000 7f4015ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:13.271 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.269+0000 7f4015ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.44:6789/0 2026-02-24T19:17:13.271 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.269+0000 7f4015ffb640 1 -- 10.20.193.14:0/2869901275 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40180b1870 con 0x7f4018058da0 2026-02-24T19:17:13.271 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.269+0000 7f4015ffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:13.271 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.269+0000 7f4015ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:13.271 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.269+0000 7f4015ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:13.271 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.269+0000 7f401d7d9640 5 monclient: authenticate success, global_id 4330 2026-02-24T19:17:13.271 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.269+0000 7f401d7d9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:13.271 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.269+0000 7f4015ffb640 1 -- 10.20.193.14:0/2869901275 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f400c002df0 con 0x7f4018058da0 2026-02-24T19:17:13.271 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.269+0000 7f4015ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:13.271 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.269+0000 7f4015ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:13.271 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.269+0000 7f4015ffb640 10 monclient: dump: 2026-02-24T19:17:13.271 INFO:teuthology.misc.health.trial014.stderr:epoch 1 2026-02-24T19:17:13.271 INFO:teuthology.misc.health.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:13.271 INFO:teuthology.misc.health.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:13.271 INFO:teuthology.misc.health.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:13.271 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:13.271 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 3 2026-02-24T19:17:13.271 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:13.271 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:13.271 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:13.271 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:17:13.271 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.269+0000 7f401d7d9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:13.271 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.270+0000 7f4015ffb640 1 -- 10.20.193.14:0/2869901275 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f400c003000 con 0x7f4018058da0 2026-02-24T19:17:13.271 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.270+0000 7f4015ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:13.271 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.270+0000 7f4015ffb640 1 -- 10.20.193.14:0/2869901275 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f400c003400 con 0x7f4018058da0 2026-02-24T19:17:13.271 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.270+0000 7f401d7d9640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:13.271 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.270+0000 7f4015ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:13.271 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.270+0000 7f401d7d9640 4 set_mon_vals no callback set 2026-02-24T19:17:13.271 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.270+0000 7f4015ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:13.271 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.270+0000 7f4015ffb640 10 monclient: dump: 2026-02-24T19:17:13.272 INFO:teuthology.misc.health.trial014.stderr:epoch 1 2026-02-24T19:17:13.272 INFO:teuthology.misc.health.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:13.272 INFO:teuthology.misc.health.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:13.272 INFO:teuthology.misc.health.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:13.272 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:13.272 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 3 2026-02-24T19:17:13.272 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:13.272 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:13.272 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:13.272 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:17:13.272 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.270+0000 7f401d7d9640 10 monclient: shutdown 2026-02-24T19:17:13.272 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.270+0000 7f401d7d9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:13.272 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.270+0000 7f401d7d9640 1 -- 10.20.193.14:0/2869901275 >> v1:10.20.193.44:6789/0 conn(0x7f4018058da0 legacy=0x7f40181647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:13.272 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.270+0000 7f401d7d9640 1 -- 10.20.193.14:0/2869901275 shutdown_connections 2026-02-24T19:17:13.272 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.270+0000 7f401d7d9640 1 -- 10.20.193.14:0/2869901275 >> 10.20.193.14:0/2869901275 conn(0x7f40180b65f0 msgr2=0x7f40180b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:13.272 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.270+0000 7f401d7d9640 1 -- 10.20.193.14:0/2869901275 shutdown_connections 2026-02-24T19:17:13.272 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.270+0000 7f401d7d9640 1 -- 10.20.193.14:0/2869901275 wait complete. 2026-02-24T19:17:13.272 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.271+0000 7f401d7d9640 10 monclient: build_initial_monmap 2026-02-24T19:17:13.272 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.271+0000 7f401d7d9640 10 monclient: monmap: 2026-02-24T19:17:13.272 INFO:teuthology.misc.health.trial014.stderr:epoch 0 2026-02-24T19:17:13.272 INFO:teuthology.misc.health.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:13.272 INFO:teuthology.misc.health.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:13.272 INFO:teuthology.misc.health.trial014.stderr:created 0.000000 2026-02-24T19:17:13.272 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:13.272 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 1 2026-02-24T19:17:13.272 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:13.272 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:13.272 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:13.272 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:17:13.272 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.271+0000 7f401d7d9640 1 librados: starting msgr at 2026-02-24T19:17:13.272 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.271+0000 7f401d7d9640 1 librados: starting objecter 2026-02-24T19:17:13.273 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.271+0000 7f401d7d9640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:13.273 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.271+0000 7f401d7d9640 1 Processor -- start 2026-02-24T19:17:13.273 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.271+0000 7f401d7d9640 1 -- start start 2026-02-24T19:17:13.273 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.271+0000 7f401d7d9640 1 librados: setting wanted keys 2026-02-24T19:17:13.273 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.271+0000 7f401d7d9640 1 librados: calling monclient init 2026-02-24T19:17:13.273 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.271+0000 7f401d7d9640 10 monclient: init 2026-02-24T19:17:13.273 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.271+0000 7f401d7d9640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:13.273 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.271+0000 7f401d7d9640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:13.273 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.271+0000 7f401d7d9640 10 monclient(hunting): picked mon.noname-a con 0x7f4018058da0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:13.273 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.271+0000 7f401d7d9640 10 monclient(hunting): picked mon.noname-b con 0x7f40180b0410 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:13.273 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.271+0000 7f401d7d9640 10 monclient(hunting): picked mon.noname-c con 0x7f40181626a0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:13.273 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.271+0000 7f401d7d9640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4018140240 con 0x7f4018058da0 2026-02-24T19:17:13.273 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.271+0000 7f401d7d9640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40181373a0 con 0x7f40180b0410 2026-02-24T19:17:13.273 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.271+0000 7f401d7d9640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4018138da0 con 0x7f40181626a0 2026-02-24T19:17:13.273 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.271+0000 7f401d7d9640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:13.273 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.271+0000 7f401d7d9640 10 monclient(hunting): authenticate will time out at 3607.952981s 2026-02-24T19:17:13.273 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.272+0000 7f4016ffd640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f4018058da0 0x7f4018136c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:47934/0 (socket says 10.20.193.14:47934) 2026-02-24T19:17:13.273 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.272+0000 7f4016ffd640 1 -- 10.20.193.14:0/638867141 learned_addr learned my addr 10.20.193.14:0/638867141 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:13.273 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.272+0000 7f3ff77fe640 10 client.?.objecter ms_handle_connect 0x7f4018058da0 2026-02-24T19:17:13.273 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.272+0000 7f3ff77fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:13.273 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.272+0000 7f3ff77fe640 10 client.?.objecter ms_handle_connect 0x7f40181626a0 2026-02-24T19:17:13.273 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.272+0000 7f3ff77fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:13.273 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.272+0000 7f3ff77fe640 10 client.?.objecter ms_handle_connect 0x7f40180b0410 2026-02-24T19:17:13.273 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.272+0000 7f3ff77fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:13.274 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.273+0000 7f3ff77fe640 1 -- 10.20.193.14:0/638867141 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3511491333 0 0) 0x7f40181373a0 con 0x7f40180b0410 2026-02-24T19:17:13.274 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.273+0000 7f3ff77fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:13.274 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.273+0000 7f3ff77fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:13.274 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.273+0000 7f3ff77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:13.274 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.273+0000 7f3ff77fe640 10 monclient(hunting): my global_id is 4333 2026-02-24T19:17:13.274 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.273+0000 7f3ff77fe640 1 -- 10.20.193.14:0/638867141 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fe4003610 con 0x7f40180b0410 2026-02-24T19:17:13.274 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.273+0000 7f3ff77fe640 1 -- 10.20.193.14:0/638867141 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4070424212 0 0) 0x7f40180b1870 con 0x7f4018058da0 2026-02-24T19:17:13.274 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.273+0000 7f3ff77fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:13.274 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.273+0000 7f3ff77fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:13.274 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.273+0000 7f3ff77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:13.274 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.273+0000 7f3ff77fe640 10 monclient(hunting): my global_id is 4338 2026-02-24T19:17:13.274 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.273+0000 7f3ff77fe640 1 -- 10.20.193.14:0/638867141 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40181373a0 con 0x7f4018058da0 2026-02-24T19:17:13.274 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.273+0000 7f3ff77fe640 1 -- 10.20.193.14:0/638867141 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1226494725 0 0) 0x7f4018138da0 con 0x7f40181626a0 2026-02-24T19:17:13.274 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.273+0000 7f3ff77fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:13.274 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.273+0000 7f3ff77fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:13.274 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.273+0000 7f3ff77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:13.274 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.273+0000 7f3ff77fe640 10 monclient(hunting): my global_id is 4343 2026-02-24T19:17:13.275 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.273+0000 7f3ff77fe640 1 -- 10.20.193.14:0/638867141 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40180b1870 con 0x7f40181626a0 2026-02-24T19:17:13.277 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.276+0000 7f3ff77fe640 1 -- 10.20.193.14:0/638867141 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1332283156 0 0) 0x7f40181373a0 con 0x7f4018058da0 2026-02-24T19:17:13.277 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.276+0000 7f3ff77fe640 1 -- 10.20.193.14:0/638867141 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4018138da0 con 0x7f4018058da0 2026-02-24T19:17:13.277 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.276+0000 7f3ff77fe640 1 -- 10.20.193.14:0/638867141 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f400c002d00 con 0x7f4018058da0 2026-02-24T19:17:13.277 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.276+0000 7f3ff77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:13.277 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.276+0000 7f3ff77fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:13.277 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.276+0000 7f3ff77fe640 10 monclient(hunting): dump: 2026-02-24T19:17:13.277 INFO:teuthology.misc.health.trial014.stderr:epoch 1 2026-02-24T19:17:13.277 INFO:teuthology.misc.health.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:13.277 INFO:teuthology.misc.health.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:13.277 INFO:teuthology.misc.health.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:13.277 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:13.277 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 3 2026-02-24T19:17:13.277 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:13.277 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:13.277 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:13.277 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:17:13.277 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.276+0000 7f3ff77fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:13.277 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.276+0000 7f3ff77fe640 1 -- 10.20.193.14:0/638867141 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2760316892 0 0) 0x7f3fe4003610 con 0x7f40180b0410 2026-02-24T19:17:13.277 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.276+0000 7f3ff77fe640 1 -- 10.20.193.14:0/638867141 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f40181373a0 con 0x7f40180b0410 2026-02-24T19:17:13.277 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.276+0000 7f3ff77fe640 1 -- 10.20.193.14:0/638867141 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4000003060 con 0x7f40180b0410 2026-02-24T19:17:13.277 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.276+0000 7f3ff77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:13.277 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.276+0000 7f3ff77fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:13.277 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.276+0000 7f3ff77fe640 10 monclient(hunting): dump: 2026-02-24T19:17:13.277 INFO:teuthology.misc.health.trial014.stderr:epoch 1 2026-02-24T19:17:13.277 INFO:teuthology.misc.health.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:13.277 INFO:teuthology.misc.health.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:13.277 INFO:teuthology.misc.health.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:13.277 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:13.277 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 3 2026-02-24T19:17:13.277 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:13.277 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:13.277 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:13.277 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:17:13.278 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.277+0000 7f3ff77fe640 1 -- 10.20.193.14:0/638867141 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 919689582 0 0) 0x7f4018138da0 con 0x7f4018058da0 2026-02-24T19:17:13.278 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.277+0000 7f3ff77fe640 1 -- 10.20.193.14:0/638867141 >> v1:10.20.193.170:6789/0 conn(0x7f40181626a0 legacy=0x7f40180a7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:13.278 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.277+0000 7f3ff77fe640 1 -- 10.20.193.14:0/638867141 >> v1:10.20.193.44:6789/0 conn(0x7f40180b0410 legacy=0x7f401813eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:13.278 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.277+0000 7f3ff77fe640 10 monclient: _finish_hunting 0 2026-02-24T19:17:13.278 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.277+0000 7f3ff77fe640 1 monclient: found mon.a 2026-02-24T19:17:13.278 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.277+0000 7f3ff77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:13.278 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.277+0000 7f3ff77fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:13.278 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.277+0000 7f3ff77fe640 1 -- 10.20.193.14:0/638867141 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4018139080 con 0x7f4018058da0 2026-02-24T19:17:13.278 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.277+0000 7f3ff77fe640 10 monclient: _finish_auth 0 2026-02-24T19:17:13.278 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.277+0000 7f3ff77fe640 10 monclient: _check_auth_tickets 2026-02-24T19:17:13.278 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.277+0000 7f3ff77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:13.279 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.277+0000 7f401d7d9640 5 monclient: authenticate success, global_id 4338 2026-02-24T19:17:13.279 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.277+0000 7f401d7d9640 10 monclient: _renew_subs 2026-02-24T19:17:13.279 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.277+0000 7f401d7d9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:13.279 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.277+0000 7f401d7d9640 1 -- 10.20.193.14:0/638867141 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4018139360 con 0x7f4018058da0 2026-02-24T19:17:13.279 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.277+0000 7f401d7d9640 10 client.4338.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:13.279 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.277+0000 7f401d7d9640 10 monclient: _renew_subs 2026-02-24T19:17:13.279 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.277+0000 7f401d7d9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:13.279 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.277+0000 7f401d7d9640 1 -- 10.20.193.14:0/638867141 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4018139920 con 0x7f4018058da0 2026-02-24T19:17:13.279 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.277+0000 7f401d7d9640 1 librados: init done 2026-02-24T19:17:13.279 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.278+0000 7f401d7d9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:13.279 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.278+0000 7f401d7d9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:13.279 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.278+0000 7f401d7d9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:13.279 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.278+0000 7f401d7d9640 1 -- 10.20.193.14:0/638867141 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4018164050 con 0x7f4018058da0 2026-02-24T19:17:13.369 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.368+0000 7f3ff77fe640 1 -- 10.20.193.14:0/638867141 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f400c002ea0 con 0x7f4018058da0 2026-02-24T19:17:13.369 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.368+0000 7f3ff77fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:13.370 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.368+0000 7f3ff77fe640 1 -- 10.20.193.14:0/638867141 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f400c003b00 con 0x7f4018058da0 2026-02-24T19:17:13.370 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.368+0000 7f3ff77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:13.370 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.368+0000 7f3ff77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:13.370 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.368+0000 7f3ff77fe640 10 monclient: dump: 2026-02-24T19:17:13.370 INFO:teuthology.misc.health.trial014.stderr:epoch 1 2026-02-24T19:17:13.370 INFO:teuthology.misc.health.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:13.370 INFO:teuthology.misc.health.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:13.370 INFO:teuthology.misc.health.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:13.370 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:13.370 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 3 2026-02-24T19:17:13.370 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:13.370 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:13.370 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:13.370 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:17:13.370 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.368+0000 7f40157fa640 4 set_mon_vals no callback set 2026-02-24T19:17:13.370 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.369+0000 7f3ff77fe640 1 -- 10.20.193.14:0/638867141 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 4) ==== 101507+0+0 (unknown 1883626494 0 0) 0x7f400c003ce0 con 0x7f4018058da0 2026-02-24T19:17:13.370 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.370+0000 7f40167fc640 10 monclient: get_auth_request con 0x7f3fe4077c10 auth_method 0 2026-02-24T19:17:13.371 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.370+0000 7f3ff77fe640 10 client.4338.objecter ms_handle_connect 0x7f3fe4077c10 2026-02-24T19:17:13.374 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.373+0000 7f3ff77fe640 1 -- 10.20.193.14:0/638867141 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 5128+0+0 (unknown 3856626649 0 0) 0x7f400c0594f0 con 0x7f4018058da0 2026-02-24T19:17:13.374 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.373+0000 7f3ff77fe640 10 client.4338.objecter ms_dispatch2 0x7f4018000b90 osd_map(20..20 src has 1..20) 2026-02-24T19:17:13.374 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.373+0000 7f3ff77fe640 3 client.4338.objecter handle_osd_map got epochs [20,20] > 0 2026-02-24T19:17:13.374 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.373+0000 7f3ff77fe640 3 client.4338.objecter handle_osd_map decoding full epoch 20 2026-02-24T19:17:13.374 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.373+0000 7f3ff77fe640 20 client.4338.objecter dump_active .. 0 homeless 2026-02-24T19:17:13.374 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.373+0000 7f3ff77fe640 1 -- 10.20.193.14:0/638867141 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f4018140240 con 0x7f4018058da0 2026-02-24T19:17:13.374 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.373+0000 7f3ff77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:13.375 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.373+0000 7f3ff77fe640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:13.482 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.481+0000 7f401d7d9640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:13.482 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.481+0000 7f401d7d9640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:13.482 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.481+0000 7f401d7d9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:13.482 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.481+0000 7f401d7d9640 1 -- 10.20.193.14:0/638867141 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f40180b6ca0 con 0x7f4018058da0 2026-02-24T19:17:13.490 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.489+0000 7f3ff77fe640 1 -- 10.20.193.14:0/638867141 <== mon.0 v1:10.20.193.14:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+12877 (unknown 3413328019 0 4253295573) 0x7f400c05dc60 con 0x7f4018058da0 2026-02-24T19:17:13.490 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.489+0000 7f3ff77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:13.490 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.489+0000 7f3ff77fe640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:13.490 INFO:teuthology.misc.health.trial014.stdout: 2026-02-24T19:17:13.490 INFO:teuthology.misc.health.trial014.stdout:{"epoch":20,"fsid":"829a649b-54c9-463b-96b9-ffa203d49fa7","created":"2026-02-24T19:16:40.561511+0000","modified":"2026-02-24T19:17:12.634905+0000","last_up_change":"0.000000","last_in_change":"2026-02-24T19:16:47.437972+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9a3fd69b-7f2a-443b-9ae1-673acfad8b00","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7dca8ec5-5aa3-420d-bf78-1331d974dafd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5a7b7c02-22f9-4eb1-a1b0-afb106604416","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"695eeb19-d0a7-4b16-8d9a-ec59206d7ecc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"09ca59ec-7e76-44ba-bf1a-1b752732db60","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"64319106-a5b4-4775-b122-8c50216df3a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"19f0033c-abbd-406a-8eae-94e7e81da9ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7cdd3b9b-4146-45b9-aaf6-df379c7a1e0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"a4833012-c50c-4a6e-b754-cf18fc6117fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"322914a2-9ba3-44b8-98ec-958b00c92f0c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"dbfdf855-de28-491b-9112-8009ab155fb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"253e9d0b-391d-4647-bd89-6ab4b57909aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"7b7d5fca-4759-46e5-a681-45509749b265","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"8d1f12c8-5787-425d-a4a6-ac820bbf6e8b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"866643a2-5f54-425c-b5ec-70607e191f02","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"4726a8b0-bcef-4e7f-aa36-e80228e2aec5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T19:17:13.492 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.491+0000 7f401d7d9640 10 librados: watch_flush enter 2026-02-24T19:17:13.492 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.491+0000 7f401d7d9640 10 librados: watch_flush exit 2026-02-24T19:17:13.492 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.491+0000 7f401d7d9640 20 client.4338.objecter shutdown clearing up homeless session... 2026-02-24T19:17:13.492 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.491+0000 7f401d7d9640 10 client.4338.objecter successfully canceled tick 2026-02-24T19:17:13.492 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.491+0000 7f401d7d9640 1 -- 10.20.193.14:0/638867141 >> v1:10.20.193.14:6800/4014096310 conn(0x7f3fe4077c10 legacy=0x7f3fe40980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:13.492 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.491+0000 7f401d7d9640 10 monclient: shutdown 2026-02-24T19:17:13.492 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.491+0000 7f401d7d9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:13.492 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.491+0000 7f401d7d9640 1 -- 10.20.193.14:0/638867141 >> v1:10.20.193.14:6789/0 conn(0x7f4018058da0 legacy=0x7f4018136c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:13.492 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.491+0000 7f401d7d9640 1 -- 10.20.193.14:0/638867141 shutdown_connections 2026-02-24T19:17:13.492 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.491+0000 7f401d7d9640 1 -- 10.20.193.14:0/638867141 >> 10.20.193.14:0/638867141 conn(0x7f40180b65f0 msgr2=0x7f4018059bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:13.492 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.491+0000 7f401d7d9640 1 -- 10.20.193.14:0/638867141 shutdown_connections 2026-02-24T19:17:13.492 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.491+0000 7f401d7d9640 1 -- 10.20.193.14:0/638867141 wait complete. 2026-02-24T19:17:13.492 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:13.491+0000 7f401d7d9640 1 librados: shutdown 2026-02-24T19:17:13.498 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-24T19:17:21.107 DEBUG:teuthology.orchestra.run.trial014:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-24T19:17:21.165 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.163+0000 7fec4164d640 10 monclient: get_monmap_and_config 2026-02-24T19:17:21.165 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.163+0000 7fec4164d640 10 monclient: build_initial_monmap 2026-02-24T19:17:21.165 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.163+0000 7fec4164d640 10 monclient: monmap: 2026-02-24T19:17:21.165 INFO:teuthology.misc.health.trial014.stderr:epoch 0 2026-02-24T19:17:21.165 INFO:teuthology.misc.health.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:21.166 INFO:teuthology.misc.health.trial014.stderr:last_changed 2026-02-24T19:17:21.165163+0000 2026-02-24T19:17:21.166 INFO:teuthology.misc.health.trial014.stderr:created 2026-02-24T19:17:21.165163+0000 2026-02-24T19:17:21.166 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:21.166 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 3 2026-02-24T19:17:21.166 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:21.166 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:21.166 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:21.166 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:17:21.167 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.164+0000 7fec4164d640 1 Processor -- start 2026-02-24T19:17:21.167 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.164+0000 7fec4164d640 1 -- start start 2026-02-24T19:17:21.167 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.164+0000 7fec4164d640 10 monclient: init 2026-02-24T19:17:21.167 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.164+0000 7fec4164d640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:21.167 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.164+0000 7fec4164d640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:21.167 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.164+0000 7fec4164d640 10 monclient(hunting): picked mon.noname-b con 0x7fec3c1603a0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:21.167 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.164+0000 7fec4164d640 10 monclient(hunting): picked mon.noname-a con 0x7fec3c056690 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:21.167 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.164+0000 7fec4164d640 10 monclient(hunting): picked mon.noname-c con 0x7fec3c1613d0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:21.167 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.164+0000 7fec4164d640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec3c161850 con 0x7fec3c056690 2026-02-24T19:17:21.167 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.164+0000 7fec4164d640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec3c0592d0 con 0x7fec3c1603a0 2026-02-24T19:17:21.167 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.164+0000 7fec4164d640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec3c0595b0 con 0x7fec3c1613d0 2026-02-24T19:17:21.167 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.164+0000 7fec4164d640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:21.167 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.164+0000 7fec4164d640 10 monclient(hunting): authenticate will time out at 3615.846654s 2026-02-24T19:17:21.167 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.165+0000 7fec3b7fe640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7fec3c1613d0 0x7fec3c0b20c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:44690/0 (socket says 10.20.193.14:44690) 2026-02-24T19:17:21.167 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.165+0000 7fec3b7fe640 1 -- 10.20.193.14:0/4115425924 learned_addr learned my addr 10.20.193.14:0/4115425924 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:21.195 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.192+0000 7fec39ffb640 1 -- 10.20.193.14:0/4115425924 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1980336952 0 0) 0x7fec3c0592d0 con 0x7fec3c1603a0 2026-02-24T19:17:21.195 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.192+0000 7fec39ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:21.195 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.192+0000 7fec39ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:21.195 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.192+0000 7fec39ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:21.195 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.192+0000 7fec39ffb640 10 monclient(hunting): my global_id is 4342 2026-02-24T19:17:21.195 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.192+0000 7fec39ffb640 1 -- 10.20.193.14:0/4115425924 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec28003610 con 0x7fec3c1603a0 2026-02-24T19:17:21.195 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.193+0000 7fec39ffb640 1 -- 10.20.193.14:0/4115425924 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2869297638 0 0) 0x7fec24002910 con 0x7fec3c056690 2026-02-24T19:17:21.195 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.193+0000 7fec39ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:21.195 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.193+0000 7fec39ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:21.195 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.193+0000 7fec39ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:21.195 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.193+0000 7fec39ffb640 10 monclient(hunting): my global_id is 4347 2026-02-24T19:17:21.195 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.193+0000 7fec39ffb640 1 -- 10.20.193.14:0/4115425924 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec3c0592d0 con 0x7fec3c056690 2026-02-24T19:17:21.196 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.193+0000 7fec39ffb640 1 -- 10.20.193.14:0/4115425924 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 18273158 0 0) 0x7fec3c0595b0 con 0x7fec3c1613d0 2026-02-24T19:17:21.196 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.193+0000 7fec39ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:21.196 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.193+0000 7fec39ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:21.196 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.193+0000 7fec39ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:21.196 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.193+0000 7fec39ffb640 10 monclient(hunting): my global_id is 4352 2026-02-24T19:17:21.196 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.193+0000 7fec39ffb640 1 -- 10.20.193.14:0/4115425924 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec24002910 con 0x7fec3c1613d0 2026-02-24T19:17:21.197 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.194+0000 7fec39ffb640 1 -- 10.20.193.14:0/4115425924 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3049089638 0 0) 0x7fec28003610 con 0x7fec3c1603a0 2026-02-24T19:17:21.197 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.194+0000 7fec39ffb640 1 -- 10.20.193.14:0/4115425924 >> v1:10.20.193.170:6789/0 conn(0x7fec3c1613d0 legacy=0x7fec3c0b20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:21.197 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.194+0000 7fec39ffb640 1 -- 10.20.193.14:0/4115425924 >> v1:10.20.193.14:6789/0 conn(0x7fec3c056690 legacy=0x7fec3c057f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:21.197 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.194+0000 7fec39ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:21.197 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.194+0000 7fec39ffb640 1 monclient: found mon.noname-b 2026-02-24T19:17:21.197 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.194+0000 7fec39ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:21.197 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.194+0000 7fec39ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.44:6789/0 2026-02-24T19:17:21.197 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.194+0000 7fec39ffb640 1 -- 10.20.193.14:0/4115425924 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec3c059890 con 0x7fec3c1603a0 2026-02-24T19:17:21.197 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.194+0000 7fec39ffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:21.197 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.194+0000 7fec39ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:21.197 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.194+0000 7fec39ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:21.197 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.194+0000 7fec39ffb640 1 -- 10.20.193.14:0/4115425924 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fec30002df0 con 0x7fec3c1603a0 2026-02-24T19:17:21.197 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.194+0000 7fec39ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:21.197 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.194+0000 7fec39ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:21.197 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.194+0000 7fec39ffb640 10 monclient: dump: 2026-02-24T19:17:21.197 INFO:teuthology.misc.health.trial014.stderr:epoch 1 2026-02-24T19:17:21.197 INFO:teuthology.misc.health.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:21.198 INFO:teuthology.misc.health.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:21.198 INFO:teuthology.misc.health.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:21.198 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:21.198 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 3 2026-02-24T19:17:21.198 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:21.198 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:21.198 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:21.198 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:17:21.198 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.194+0000 7fec4164d640 5 monclient: authenticate success, global_id 4342 2026-02-24T19:17:21.198 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.194+0000 7fec4164d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:21.199 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.195+0000 7fec39ffb640 1 -- 10.20.193.14:0/4115425924 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fec30002fc0 con 0x7fec3c1603a0 2026-02-24T19:17:21.200 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.195+0000 7fec39ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:21.200 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.195+0000 7fec39ffb640 1 -- 10.20.193.14:0/4115425924 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fec30003400 con 0x7fec3c1603a0 2026-02-24T19:17:21.200 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.195+0000 7fec39ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:21.200 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.195+0000 7fec39ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:21.200 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.195+0000 7fec39ffb640 10 monclient: dump: 2026-02-24T19:17:21.200 INFO:teuthology.misc.health.trial014.stderr:epoch 1 2026-02-24T19:17:21.200 INFO:teuthology.misc.health.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:21.200 INFO:teuthology.misc.health.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:21.200 INFO:teuthology.misc.health.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:21.200 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:21.200 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 3 2026-02-24T19:17:21.200 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:21.200 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:21.200 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:21.200 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:17:21.200 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.195+0000 7fec4164d640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:21.200 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.195+0000 7fec4164d640 4 set_mon_vals no callback set 2026-02-24T19:17:21.200 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.196+0000 7fec4164d640 10 monclient: shutdown 2026-02-24T19:17:21.200 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.196+0000 7fec4164d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:21.200 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.196+0000 7fec4164d640 1 -- 10.20.193.14:0/4115425924 >> v1:10.20.193.44:6789/0 conn(0x7fec3c1603a0 legacy=0x7fec3c160770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:21.200 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.196+0000 7fec4164d640 1 -- 10.20.193.14:0/4115425924 shutdown_connections 2026-02-24T19:17:21.201 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.196+0000 7fec4164d640 1 -- 10.20.193.14:0/4115425924 >> 10.20.193.14:0/4115425924 conn(0x7fec3c0b65f0 msgr2=0x7fec3c0b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:21.201 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.196+0000 7fec4164d640 1 -- 10.20.193.14:0/4115425924 shutdown_connections 2026-02-24T19:17:21.201 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.196+0000 7fec4164d640 1 -- 10.20.193.14:0/4115425924 wait complete. 2026-02-24T19:17:21.201 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.196+0000 7fec4164d640 10 monclient: build_initial_monmap 2026-02-24T19:17:21.201 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.196+0000 7fec4164d640 10 monclient: monmap: 2026-02-24T19:17:21.201 INFO:teuthology.misc.health.trial014.stderr:epoch 0 2026-02-24T19:17:21.201 INFO:teuthology.misc.health.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:21.201 INFO:teuthology.misc.health.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:21.201 INFO:teuthology.misc.health.trial014.stderr:created 0.000000 2026-02-24T19:17:21.201 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:21.201 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 1 2026-02-24T19:17:21.201 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:21.201 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:21.201 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:21.201 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:17:21.201 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.197+0000 7fec4164d640 1 librados: starting msgr at 2026-02-24T19:17:21.201 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.197+0000 7fec4164d640 1 librados: starting objecter 2026-02-24T19:17:21.201 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.197+0000 7fec4164d640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:21.201 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.197+0000 7fec4164d640 1 Processor -- start 2026-02-24T19:17:21.201 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.197+0000 7fec4164d640 1 -- start start 2026-02-24T19:17:21.201 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.197+0000 7fec4164d640 1 librados: setting wanted keys 2026-02-24T19:17:21.201 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.197+0000 7fec4164d640 1 librados: calling monclient init 2026-02-24T19:17:21.201 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.197+0000 7fec4164d640 10 monclient: init 2026-02-24T19:17:21.201 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.197+0000 7fec4164d640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:21.202 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.197+0000 7fec4164d640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:21.202 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.197+0000 7fec4164d640 10 monclient(hunting): picked mon.noname-c con 0x7fec3c056690 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:21.202 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.197+0000 7fec4164d640 10 monclient(hunting): picked mon.noname-a con 0x7fec3c1603a0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:21.202 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.197+0000 7fec4164d640 10 monclient(hunting): picked mon.noname-b con 0x7fec3c1613d0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:21.202 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.197+0000 7fec4164d640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec3c0b1b00 con 0x7fec3c1603a0 2026-02-24T19:17:21.202 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.197+0000 7fec4164d640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec3c15ad70 con 0x7fec3c1613d0 2026-02-24T19:17:21.202 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.197+0000 7fec4164d640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec3c15b050 con 0x7fec3c056690 2026-02-24T19:17:21.202 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.197+0000 7fec4164d640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:21.202 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.197+0000 7fec4164d640 10 monclient(hunting): authenticate will time out at 3615.879652s 2026-02-24T19:17:21.202 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.197+0000 7fec3b7fe640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7fec3c1613d0 0x7fec3c0b13f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:60664/0 (socket says 10.20.193.14:60664) 2026-02-24T19:17:21.202 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.197+0000 7fec3b7fe640 1 -- 10.20.193.14:0/491708799 learned_addr learned my addr 10.20.193.14:0/491708799 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:21.203 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.198+0000 7fec1b7fe640 10 client.?.objecter ms_handle_connect 0x7fec3c1613d0 2026-02-24T19:17:21.203 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.198+0000 7fec1b7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:21.203 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.198+0000 7fec1b7fe640 10 client.?.objecter ms_handle_connect 0x7fec3c056690 2026-02-24T19:17:21.203 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.198+0000 7fec1b7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:21.203 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.199+0000 7fec1b7fe640 1 -- 10.20.193.14:0/491708799 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 893539099 0 0) 0x7fec3c15ad70 con 0x7fec3c1613d0 2026-02-24T19:17:21.203 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.199+0000 7fec1b7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:21.203 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.199+0000 7fec1b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:21.203 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.199+0000 7fec1b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:21.203 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.199+0000 7fec1b7fe640 10 monclient(hunting): my global_id is 4345 2026-02-24T19:17:21.203 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.199+0000 7fec1b7fe640 1 -- 10.20.193.14:0/491708799 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec08003610 con 0x7fec3c1613d0 2026-02-24T19:17:21.203 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.199+0000 7fec1b7fe640 10 client.?.objecter ms_handle_connect 0x7fec3c1603a0 2026-02-24T19:17:21.203 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.199+0000 7fec1b7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:21.203 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.199+0000 7fec1b7fe640 1 -- 10.20.193.14:0/491708799 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1179713177 0 0) 0x7fec3c15b050 con 0x7fec3c056690 2026-02-24T19:17:21.203 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.199+0000 7fec1b7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:21.204 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.199+0000 7fec1b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:21.204 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.199+0000 7fec1b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:21.204 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.199+0000 7fec1b7fe640 10 monclient(hunting): my global_id is 4355 2026-02-24T19:17:21.204 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.199+0000 7fec1b7fe640 1 -- 10.20.193.14:0/491708799 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec3c15ad70 con 0x7fec3c056690 2026-02-24T19:17:21.204 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.200+0000 7fec1b7fe640 1 -- 10.20.193.14:0/491708799 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1318488852 0 0) 0x7fec3c0b1b00 con 0x7fec3c1603a0 2026-02-24T19:17:21.204 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.200+0000 7fec1b7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:21.204 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.200+0000 7fec1b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:21.204 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.200+0000 7fec1b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:21.204 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.200+0000 7fec1b7fe640 10 monclient(hunting): my global_id is 4350 2026-02-24T19:17:21.204 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.200+0000 7fec1b7fe640 1 -- 10.20.193.14:0/491708799 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec3c15b050 con 0x7fec3c1603a0 2026-02-24T19:17:21.204 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.201+0000 7fec1b7fe640 1 -- 10.20.193.14:0/491708799 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4207842466 0 0) 0x7fec08003610 con 0x7fec3c1613d0 2026-02-24T19:17:21.204 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.201+0000 7fec1b7fe640 1 -- 10.20.193.14:0/491708799 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fec3c0b1b00 con 0x7fec3c1613d0 2026-02-24T19:17:21.204 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.201+0000 7fec1b7fe640 1 -- 10.20.193.14:0/491708799 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fec2c003410 con 0x7fec3c1613d0 2026-02-24T19:17:21.204 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.201+0000 7fec1b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:21.204 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.201+0000 7fec1b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:21.204 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.201+0000 7fec1b7fe640 10 monclient(hunting): dump: 2026-02-24T19:17:21.204 INFO:teuthology.misc.health.trial014.stderr:epoch 1 2026-02-24T19:17:21.204 INFO:teuthology.misc.health.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:21.204 INFO:teuthology.misc.health.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:21.204 INFO:teuthology.misc.health.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:21.204 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:21.204 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 3 2026-02-24T19:17:21.204 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:21.204 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:21.205 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:21.205 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:17:21.205 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.201+0000 7fec1b7fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:21.206 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.202+0000 7fec1b7fe640 1 -- 10.20.193.14:0/491708799 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3268321029 0 0) 0x7fec3c15ad70 con 0x7fec3c056690 2026-02-24T19:17:21.206 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.202+0000 7fec1b7fe640 1 -- 10.20.193.14:0/491708799 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fec08003610 con 0x7fec3c056690 2026-02-24T19:17:21.206 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.202+0000 7fec1b7fe640 1 -- 10.20.193.14:0/491708799 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fec30003310 con 0x7fec3c056690 2026-02-24T19:17:21.206 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.202+0000 7fec1b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:21.206 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.202+0000 7fec1b7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:21.206 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.202+0000 7fec1b7fe640 10 monclient(hunting): dump: 2026-02-24T19:17:21.206 INFO:teuthology.misc.health.trial014.stderr:epoch 1 2026-02-24T19:17:21.206 INFO:teuthology.misc.health.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:21.206 INFO:teuthology.misc.health.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:21.206 INFO:teuthology.misc.health.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:21.206 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:21.206 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 3 2026-02-24T19:17:21.206 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:21.206 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:21.206 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:21.206 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:17:21.206 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.202+0000 7fec1b7fe640 1 -- 10.20.193.14:0/491708799 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2586082453 0 0) 0x7fec3c15b050 con 0x7fec3c1603a0 2026-02-24T19:17:21.206 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.202+0000 7fec1b7fe640 1 -- 10.20.193.14:0/491708799 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fec3c15ad70 con 0x7fec3c1603a0 2026-02-24T19:17:21.207 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.202+0000 7fec1b7fe640 1 -- 10.20.193.14:0/491708799 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fec24003190 con 0x7fec3c1603a0 2026-02-24T19:17:21.207 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.202+0000 7fec1b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:21.207 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.202+0000 7fec1b7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:21.207 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.202+0000 7fec1b7fe640 10 monclient(hunting): dump: 2026-02-24T19:17:21.207 INFO:teuthology.misc.health.trial014.stderr:epoch 1 2026-02-24T19:17:21.207 INFO:teuthology.misc.health.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:21.207 INFO:teuthology.misc.health.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:21.207 INFO:teuthology.misc.health.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:21.207 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:21.207 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 3 2026-02-24T19:17:21.207 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:21.207 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:21.207 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:21.207 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:17:21.207 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.202+0000 7fec1b7fe640 1 -- 10.20.193.14:0/491708799 <== mon.1 v1:10.20.193.44:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2848387997 0 0) 0x7fec3c0b1b00 con 0x7fec3c1613d0 2026-02-24T19:17:21.207 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.202+0000 7fec1b7fe640 1 -- 10.20.193.14:0/491708799 >> v1:10.20.193.170:6789/0 conn(0x7fec3c056690 legacy=0x7fec3c137f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:21.207 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.202+0000 7fec1b7fe640 1 -- 10.20.193.14:0/491708799 >> v1:10.20.193.14:6789/0 conn(0x7fec3c1603a0 legacy=0x7fec3c136f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:21.207 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.202+0000 7fec1b7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:17:21.207 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.202+0000 7fec1b7fe640 1 monclient: found mon.b 2026-02-24T19:17:21.207 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.202+0000 7fec1b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:21.207 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.202+0000 7fec1b7fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:21.207 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.202+0000 7fec1b7fe640 1 -- 10.20.193.14:0/491708799 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec3c15b330 con 0x7fec3c1613d0 2026-02-24T19:17:21.208 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.202+0000 7fec1b7fe640 10 monclient: _finish_auth 0 2026-02-24T19:17:21.208 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.202+0000 7fec1b7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:17:21.208 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.202+0000 7fec1b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:21.208 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.202+0000 7fec4164d640 5 monclient: authenticate success, global_id 4345 2026-02-24T19:17:21.208 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.202+0000 7fec4164d640 10 monclient: _renew_subs 2026-02-24T19:17:21.208 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.202+0000 7fec4164d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:21.208 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.202+0000 7fec4164d640 1 -- 10.20.193.14:0/491708799 --> v1:10.20.193.44:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fec3c15b610 con 0x7fec3c1613d0 2026-02-24T19:17:21.208 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.202+0000 7fec4164d640 10 client.4345.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:21.208 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.202+0000 7fec4164d640 10 monclient: _renew_subs 2026-02-24T19:17:21.208 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.202+0000 7fec4164d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:21.208 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.202+0000 7fec4164d640 1 -- 10.20.193.14:0/491708799 --> v1:10.20.193.44:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fec3c15bbd0 con 0x7fec3c1613d0 2026-02-24T19:17:21.208 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.202+0000 7fec4164d640 1 librados: init done 2026-02-24T19:17:21.208 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.203+0000 7fec4164d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:21.208 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.203+0000 7fec4164d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:21.208 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.203+0000 7fec4164d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:21.208 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.203+0000 7fec4164d640 1 -- 10.20.193.14:0/491708799 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec3c15d900 con 0x7fec3c1613d0 2026-02-24T19:17:21.213 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.211+0000 7fec1b7fe640 1 -- 10.20.193.14:0/491708799 <== mon.1 v1:10.20.193.44:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fec2c004c50 con 0x7fec3c1613d0 2026-02-24T19:17:21.213 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.211+0000 7fec1b7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:21.213 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.211+0000 7fec1b7fe640 1 -- 10.20.193.14:0/491708799 <== mon.1 v1:10.20.193.44:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fec2c005060 con 0x7fec3c1613d0 2026-02-24T19:17:21.213 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.211+0000 7fec1b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:21.213 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.211+0000 7fec1b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:21.213 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.211+0000 7fec1b7fe640 10 monclient: dump: 2026-02-24T19:17:21.213 INFO:teuthology.misc.health.trial014.stderr:epoch 1 2026-02-24T19:17:21.214 INFO:teuthology.misc.health.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:21.214 INFO:teuthology.misc.health.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:21.214 INFO:teuthology.misc.health.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:21.214 INFO:teuthology.misc.health.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:21.214 INFO:teuthology.misc.health.trial014.stderr:election_strategy: 3 2026-02-24T19:17:21.214 INFO:teuthology.misc.health.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:21.214 INFO:teuthology.misc.health.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:21.214 INFO:teuthology.misc.health.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:21.214 INFO:teuthology.misc.health.trial014.stderr: 2026-02-24T19:17:21.214 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.211+0000 7fec397fa640 4 set_mon_vals no callback set 2026-02-24T19:17:21.214 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.212+0000 7fec1b7fe640 1 -- 10.20.193.14:0/491708799 <== mon.1 v1:10.20.193.44:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7fec2c005240 con 0x7fec3c1613d0 2026-02-24T19:17:21.214 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.212+0000 7fec3affd640 10 monclient: get_auth_request con 0x7fec08077eb0 auth_method 0 2026-02-24T19:17:21.215 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.213+0000 7fec1b7fe640 10 client.4345.objecter ms_handle_connect 0x7fec08077eb0 2026-02-24T19:17:21.216 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.214+0000 7fec1b7fe640 1 -- 10.20.193.14:0/491708799 <== mon.1 v1:10.20.193.44:6789/0 8 ==== osd_map(26..26 src has 1..26) ==== 7757+0+0 (unknown 2842002912 0 0) 0x7fec2c093550 con 0x7fec3c1613d0 2026-02-24T19:17:21.216 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.214+0000 7fec1b7fe640 10 client.4345.objecter ms_dispatch2 0x7fec3c000b90 osd_map(26..26 src has 1..26) 2026-02-24T19:17:21.216 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.214+0000 7fec1b7fe640 3 client.4345.objecter handle_osd_map got epochs [26,26] > 0 2026-02-24T19:17:21.216 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.214+0000 7fec1b7fe640 3 client.4345.objecter handle_osd_map decoding full epoch 26 2026-02-24T19:17:21.216 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.214+0000 7fec1b7fe640 20 client.4345.objecter dump_active .. 0 homeless 2026-02-24T19:17:21.300 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.298+0000 7fec1b7fe640 1 -- 10.20.193.14:0/491708799 <== mon.1 v1:10.20.193.44:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fec2c005060 con 0x7fec3c1613d0 2026-02-24T19:17:21.300 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.298+0000 7fec1b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:21.300 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.298+0000 7fec1b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:21.405 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.402+0000 7fec4164d640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:21.405 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.402+0000 7fec4164d640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:21.405 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.402+0000 7fec4164d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:21.405 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.402+0000 7fec4164d640 1 -- 10.20.193.14:0/491708799 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fec3c15fb80 con 0x7fec3c1613d0 2026-02-24T19:17:21.446 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.445+0000 7fec1b7fe640 1 -- 10.20.193.14:0/491708799 <== mon.1 v1:10.20.193.44:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18941 (unknown 675718476 0 412678238) 0x7fec2c05df80 con 0x7fec3c1613d0 2026-02-24T19:17:21.446 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.445+0000 7fec1b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:21.446 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.445+0000 7fec1b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:21.447 INFO:teuthology.misc.health.trial014.stdout: 2026-02-24T19:17:21.447 INFO:teuthology.misc.health.trial014.stdout:{"epoch":26,"fsid":"829a649b-54c9-463b-96b9-ffa203d49fa7","created":"2026-02-24T19:16:40.561511+0000","modified":"2026-02-24T19:17:19.075427+0000","last_up_change":"2026-02-24T19:17:13.710334+0000","last_in_change":"2026-02-24T19:16:47.437972+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T19:17:15.661742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9a3fd69b-7f2a-443b-9ae1-673acfad8b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6806","nonce":3263337386}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6810","nonce":3263337386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6813","nonce":3263337386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6812","nonce":3263337386}]},"public_addr":"10.20.193.14:6806/3263337386","cluster_addr":"10.20.193.14:6810/3263337386","heartbeat_back_addr":"10.20.193.14:6813/3263337386","heartbeat_front_addr":"10.20.193.14:6812/3263337386","state":["exists","up"]},{"osd":1,"uuid":"7dca8ec5-5aa3-420d-bf78-1331d974dafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6804","nonce":1955152616}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6805","nonce":1955152616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6807","nonce":1955152616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6806","nonce":1955152616}]},"public_addr":"10.20.193.44:6804/1955152616","cluster_addr":"10.20.193.44:6805/1955152616","heartbeat_back_addr":"10.20.193.44:6807/1955152616","heartbeat_front_addr":"10.20.193.44:6806/1955152616","state":["exists","up"]},{"osd":2,"uuid":"5a7b7c02-22f9-4eb1-a1b0-afb106604416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6804","nonce":993713135}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6805","nonce":993713135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6807","nonce":993713135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6806","nonce":993713135}]},"public_addr":"10.20.193.170:6804/993713135","cluster_addr":"10.20.193.170:6805/993713135","heartbeat_back_addr":"10.20.193.170:6807/993713135","heartbeat_front_addr":"10.20.193.170:6806/993713135","state":["exists","up"]},{"osd":3,"uuid":"695eeb19-d0a7-4b16-8d9a-ec59206d7ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6800","nonce":3081016231}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6801","nonce":3081016231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6803","nonce":3081016231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6802","nonce":3081016231}]},"public_addr":"10.20.193.195:6800/3081016231","cluster_addr":"10.20.193.195:6801/3081016231","heartbeat_back_addr":"10.20.193.195:6803/3081016231","heartbeat_front_addr":"10.20.193.195:6802/3081016231","state":["exists","up"]},{"osd":4,"uuid":"09ca59ec-7e76-44ba-bf1a-1b752732db60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6805","nonce":4020872388}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6807","nonce":4020872388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6811","nonce":4020872388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6808","nonce":4020872388}]},"public_addr":"10.20.193.14:6805/4020872388","cluster_addr":"10.20.193.14:6807/4020872388","heartbeat_back_addr":"10.20.193.14:6811/4020872388","heartbeat_front_addr":"10.20.193.14:6808/4020872388","state":["exists","up"]},{"osd":5,"uuid":"64319106-a5b4-4775-b122-8c50216df3a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6811","nonce":2261252351}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6813","nonce":2261252351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6815","nonce":2261252351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6814","nonce":2261252351}]},"public_addr":"10.20.193.44:6811/2261252351","cluster_addr":"10.20.193.44:6813/2261252351","heartbeat_back_addr":"10.20.193.44:6815/2261252351","heartbeat_front_addr":"10.20.193.44:6814/2261252351","state":["exists","up"]},{"osd":6,"uuid":"19f0033c-abbd-406a-8eae-94e7e81da9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6800","nonce":3031579126}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6801","nonce":3031579126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6803","nonce":3031579126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6802","nonce":3031579126}]},"public_addr":"10.20.193.170:6800/3031579126","cluster_addr":"10.20.193.170:6801/3031579126","heartbeat_back_addr":"10.20.193.170:6803/3031579126","heartbeat_front_addr":"10.20.193.170:6802/3031579126","state":["exists","up"]},{"osd":7,"uuid":"7cdd3b9b-4146-45b9-aaf6-df379c7a1e0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6808","nonce":798109025}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6810","nonce":798109025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6815","nonce":798109025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6812","nonce":798109025}]},"public_addr":"10.20.193.195:6808/798109025","cluster_addr":"10.20.193.195:6810/798109025","heartbeat_back_addr":"10.20.193.195:6815/798109025","heartbeat_front_addr":"10.20.193.195:6812/798109025","state":["exists","up"]},{"osd":8,"uuid":"a4833012-c50c-4a6e-b754-cf18fc6117fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6809","nonce":1223168292}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6814","nonce":1223168292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6816","nonce":1223168292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6815","nonce":1223168292}]},"public_addr":"10.20.193.14:6809/1223168292","cluster_addr":"10.20.193.14:6814/1223168292","heartbeat_back_addr":"10.20.193.14:6816/1223168292","heartbeat_front_addr":"10.20.193.14:6815/1223168292","state":["exists","up"]},{"osd":9,"uuid":"322914a2-9ba3-44b8-98ec-958b00c92f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6808","nonce":4259724385}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6809","nonce":4259724385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6812","nonce":4259724385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6810","nonce":4259724385}]},"public_addr":"10.20.193.44:6808/4259724385","cluster_addr":"10.20.193.44:6809/4259724385","heartbeat_back_addr":"10.20.193.44:6812/4259724385","heartbeat_front_addr":"10.20.193.44:6810/4259724385","state":["exists","up"]},{"osd":10,"uuid":"dbfdf855-de28-491b-9112-8009ab155fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6808","nonce":983512563}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6810","nonce":983512563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6813","nonce":983512563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6811","nonce":983512563}]},"public_addr":"10.20.193.170:6808/983512563","cluster_addr":"10.20.193.170:6810/983512563","heartbeat_back_addr":"10.20.193.170:6813/983512563","heartbeat_front_addr":"10.20.193.170:6811/983512563","state":["exists","up"]},{"osd":11,"uuid":"253e9d0b-391d-4647-bd89-6ab4b57909aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6804","nonce":2798179318}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6805","nonce":2798179318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6807","nonce":2798179318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6806","nonce":2798179318}]},"public_addr":"10.20.193.195:6804/2798179318","cluster_addr":"10.20.193.195:6805/2798179318","heartbeat_back_addr":"10.20.193.195:6807/2798179318","heartbeat_front_addr":"10.20.193.195:6806/2798179318","state":["exists","up"]},{"osd":12,"uuid":"7b7d5fca-4759-46e5-a681-45509749b265","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6801","nonce":1483397197}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6802","nonce":1483397197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6804","nonce":1483397197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6803","nonce":1483397197}]},"public_addr":"10.20.193.14:6801/1483397197","cluster_addr":"10.20.193.14:6802/1483397197","heartbeat_back_addr":"10.20.193.14:6804/1483397197","heartbeat_front_addr":"10.20.193.14:6803/1483397197","state":["exists","up"]},{"osd":13,"uuid":"8d1f12c8-5787-425d-a4a6-ac820bbf6e8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6800","nonce":3795416779}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6801","nonce":3795416779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6803","nonce":3795416779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6802","nonce":3795416779}]},"public_addr":"10.20.193.44:6800/3795416779","cluster_addr":"10.20.193.44:6801/3795416779","heartbeat_back_addr":"10.20.193.44:6803/3795416779","heartbeat_front_addr":"10.20.193.44:6802/3795416779","state":["exists","up"]},{"osd":14,"uuid":"866643a2-5f54-425c-b5ec-70607e191f02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6809","nonce":2177297767}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6812","nonce":2177297767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6815","nonce":2177297767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6814","nonce":2177297767}]},"public_addr":"10.20.193.170:6809/2177297767","cluster_addr":"10.20.193.170:6812/2177297767","heartbeat_back_addr":"10.20.193.170:6815/2177297767","heartbeat_front_addr":"10.20.193.170:6814/2177297767","state":["exists","up"]},{"osd":15,"uuid":"4726a8b0-bcef-4e7f-aa36-e80228e2aec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6809","nonce":3316970219}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6811","nonce":3316970219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6814","nonce":3316970219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6813","nonce":3316970219}]},"public_addr":"10.20.193.195:6809/3316970219","cluster_addr":"10.20.193.195:6811/3316970219","heartbeat_back_addr":"10.20.193.195:6814/3316970219","heartbeat_front_addr":"10.20.193.195:6813/3316970219","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.649198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.571073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.859654+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.714982+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.749516+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.546522+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.704013+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.829729+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.543314+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.580646+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.932784+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.682415+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.742679+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.618137+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.759234+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.913664+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T19:17:21.449 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.446+0000 7fec4164d640 10 librados: watch_flush enter 2026-02-24T19:17:21.449 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.446+0000 7fec4164d640 10 librados: watch_flush exit 2026-02-24T19:17:21.449 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.446+0000 7fec4164d640 20 client.4345.objecter shutdown clearing up homeless session... 2026-02-24T19:17:21.450 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.446+0000 7fec4164d640 10 client.4345.objecter successfully canceled tick 2026-02-24T19:17:21.450 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.446+0000 7fec4164d640 1 -- 10.20.193.14:0/491708799 >> v1:10.20.193.14:6800/4014096310 conn(0x7fec08077eb0 legacy=0x7fec08098360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:21.450 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.446+0000 7fec4164d640 10 monclient: shutdown 2026-02-24T19:17:21.450 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.446+0000 7fec4164d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:21.450 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.446+0000 7fec4164d640 1 -- 10.20.193.14:0/491708799 >> v1:10.20.193.44:6789/0 conn(0x7fec3c1613d0 legacy=0x7fec3c0b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:21.450 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.446+0000 7fec4164d640 1 -- 10.20.193.14:0/491708799 shutdown_connections 2026-02-24T19:17:21.450 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.446+0000 7fec4164d640 1 -- 10.20.193.14:0/491708799 >> 10.20.193.14:0/491708799 conn(0x7fec3c0b65f0 msgr2=0x7fec3c160770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:21.450 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.446+0000 7fec4164d640 1 -- 10.20.193.14:0/491708799 shutdown_connections 2026-02-24T19:17:21.450 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.446+0000 7fec4164d640 1 -- 10.20.193.14:0/491708799 wait complete. 2026-02-24T19:17:21.450 INFO:teuthology.misc.health.trial014.stderr:2026-02-24T19:17:21.446+0000 7fec4164d640 1 librados: shutdown 2026-02-24T19:17:21.456 DEBUG:teuthology.misc:16 of 16 OSDs are up 2026-02-24T19:17:21.456 INFO:tasks.ceph:Creating RBD pool 2026-02-24T19:17:21.456 DEBUG:teuthology.orchestra.run.trial014:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-24T19:17:21.520 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.518+0000 7fc9ec8e1640 10 monclient: get_monmap_and_config 2026-02-24T19:17:21.520 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.518+0000 7fc9ec8e1640 10 monclient: build_initial_monmap 2026-02-24T19:17:21.520 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.518+0000 7fc9ec8e1640 10 monclient: monmap: 2026-02-24T19:17:21.521 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:21.521 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:21.521 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:21.519856+0000 2026-02-24T19:17:21.521 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:21.519856+0000 2026-02-24T19:17:21.521 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:21.521 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:21.521 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:21.521 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:21.521 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:21.521 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:21.523 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.518+0000 7fc9ec8e1640 1 Processor -- start 2026-02-24T19:17:21.524 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.518+0000 7fc9ec8e1640 1 -- start start 2026-02-24T19:17:21.524 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.518+0000 7fc9ec8e1640 10 monclient: init 2026-02-24T19:17:21.524 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.519+0000 7fc9ec8e1640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:21.524 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.519+0000 7fc9ec8e1640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:21.524 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.519+0000 7fc9ec8e1640 10 monclient(hunting): picked mon.noname-c con 0x7fc9e415d030 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:21.524 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.519+0000 7fc9ec8e1640 10 monclient(hunting): picked mon.noname-b con 0x7fc9e40b6e40 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:21.524 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.519+0000 7fc9ec8e1640 10 monclient(hunting): picked mon.noname-a con 0x7fc9e40b78d0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:21.524 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.519+0000 7fc9ec8e1640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9e40b6170 con 0x7fc9e40b78d0 2026-02-24T19:17:21.524 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.519+0000 7fc9ec8e1640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9e4163bb0 con 0x7fc9e40b6e40 2026-02-24T19:17:21.524 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.519+0000 7fc9ec8e1640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9e4163e90 con 0x7fc9e415d030 2026-02-24T19:17:21.525 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.519+0000 7fc9ec8e1640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:21.525 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.519+0000 7fc9ec8e1640 10 monclient(hunting): authenticate will time out at 3616.201835s 2026-02-24T19:17:21.525 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.520+0000 7fc9eae57640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7fc9e40b78d0 0x7fc9e405a480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:44488/0 (socket says 10.20.193.14:44488) 2026-02-24T19:17:21.525 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.520+0000 7fc9eae57640 1 -- 10.20.193.14:0/339113624 learned_addr learned my addr 10.20.193.14:0/339113624 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:21.525 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.521+0000 7fc9e9654640 1 -- 10.20.193.14:0/339113624 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 710156893 0 0) 0x7fc9e40b6170 con 0x7fc9e40b78d0 2026-02-24T19:17:21.525 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.521+0000 7fc9e9654640 10 monclient(hunting): _negotiate 2026-02-24T19:17:21.525 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.521+0000 7fc9e9654640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:21.525 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.521+0000 7fc9e9654640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:21.525 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.521+0000 7fc9e9654640 10 monclient(hunting): my global_id is 4353 2026-02-24T19:17:21.525 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.521+0000 7fc9e9654640 1 -- 10.20.193.14:0/339113624 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9d4003610 con 0x7fc9e40b78d0 2026-02-24T19:17:21.525 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.521+0000 7fc9e9654640 1 -- 10.20.193.14:0/339113624 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3346471118 0 0) 0x7fc9e4163bb0 con 0x7fc9e40b6e40 2026-02-24T19:17:21.525 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.521+0000 7fc9e9654640 10 monclient(hunting): _negotiate 2026-02-24T19:17:21.525 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.521+0000 7fc9e9654640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:21.526 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.521+0000 7fc9e9654640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:21.526 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.521+0000 7fc9e9654640 10 monclient(hunting): my global_id is 4348 2026-02-24T19:17:21.526 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.521+0000 7fc9e9654640 1 -- 10.20.193.14:0/339113624 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9e40b6170 con 0x7fc9e40b6e40 2026-02-24T19:17:21.530 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.522+0000 7fc9e9654640 1 -- 10.20.193.14:0/339113624 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2316982653 0 0) 0x7fc9e4163e90 con 0x7fc9e415d030 2026-02-24T19:17:21.530 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.522+0000 7fc9e9654640 10 monclient(hunting): _negotiate 2026-02-24T19:17:21.530 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.522+0000 7fc9e9654640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:21.530 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.522+0000 7fc9e9654640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:21.531 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.522+0000 7fc9e9654640 10 monclient(hunting): my global_id is 4358 2026-02-24T19:17:21.531 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.522+0000 7fc9e9654640 1 -- 10.20.193.14:0/339113624 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9e4163bb0 con 0x7fc9e415d030 2026-02-24T19:17:21.531 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.523+0000 7fc9e9654640 1 -- 10.20.193.14:0/339113624 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1410680692 0 0) 0x7fc9d4003610 con 0x7fc9e40b78d0 2026-02-24T19:17:21.531 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.523+0000 7fc9e9654640 1 -- 10.20.193.14:0/339113624 >> v1:10.20.193.170:6789/0 conn(0x7fc9e415d030 legacy=0x7fc9e40b6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:21.531 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.523+0000 7fc9e9654640 1 -- 10.20.193.14:0/339113624 >> v1:10.20.193.44:6789/0 conn(0x7fc9e40b6e40 legacy=0x7fc9e4059d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:21.531 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.523+0000 7fc9e9654640 10 monclient: _finish_hunting 0 2026-02-24T19:17:21.531 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.523+0000 7fc9e9654640 1 monclient: found mon.noname-a 2026-02-24T19:17:21.531 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.523+0000 7fc9e9654640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:21.531 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.523+0000 7fc9e9654640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:17:21.531 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.523+0000 7fc9e9654640 1 -- 10.20.193.14:0/339113624 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e40b8030 con 0x7fc9e40b78d0 2026-02-24T19:17:21.531 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.523+0000 7fc9e9654640 10 monclient: _finish_auth 0 2026-02-24T19:17:21.531 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.523+0000 7fc9e9654640 10 monclient: _check_auth_tickets 2026-02-24T19:17:21.532 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.523+0000 7fc9e9654640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:21.532 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.523+0000 7fc9e9654640 1 -- 10.20.193.14:0/339113624 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc9d8003170 con 0x7fc9e40b78d0 2026-02-24T19:17:21.532 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.523+0000 7fc9e9654640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:21.532 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.523+0000 7fc9e9654640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:21.532 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.523+0000 7fc9e9654640 10 monclient: dump: 2026-02-24T19:17:21.532 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:21.532 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:21.532 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:21.532 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:21.532 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:21.532 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:21.532 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:21.532 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:21.533 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:21.533 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:21.533 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.523+0000 7fc9ec8e1640 5 monclient: authenticate success, global_id 4353 2026-02-24T19:17:21.533 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.523+0000 7fc9ec8e1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:21.533 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.524+0000 7fc9e9654640 1 -- 10.20.193.14:0/339113624 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc9d8003340 con 0x7fc9e40b78d0 2026-02-24T19:17:21.533 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.524+0000 7fc9e9654640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:21.533 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.524+0000 7fc9e9654640 1 -- 10.20.193.14:0/339113624 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc9d8003780 con 0x7fc9e40b78d0 2026-02-24T19:17:21.533 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.524+0000 7fc9e9654640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:21.533 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.524+0000 7fc9e9654640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:21.533 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.524+0000 7fc9e9654640 10 monclient: dump: 2026-02-24T19:17:21.533 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:21.534 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:21.534 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:21.534 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:21.534 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:21.534 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:21.534 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:21.534 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:21.534 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:21.534 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:21.534 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.524+0000 7fc9ec8e1640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:21.534 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.524+0000 7fc9ec8e1640 4 set_mon_vals no callback set 2026-02-24T19:17:21.534 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.524+0000 7fc9ec8e1640 10 monclient: shutdown 2026-02-24T19:17:21.534 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.524+0000 7fc9ec8e1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:21.535 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.524+0000 7fc9ec8e1640 1 -- 10.20.193.14:0/339113624 >> v1:10.20.193.14:6789/0 conn(0x7fc9e40b78d0 legacy=0x7fc9e405a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:21.535 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.524+0000 7fc9ec8e1640 1 -- 10.20.193.14:0/339113624 shutdown_connections 2026-02-24T19:17:21.535 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.524+0000 7fc9ec8e1640 1 -- 10.20.193.14:0/339113624 >> 10.20.193.14:0/339113624 conn(0x7fc9e40b5220 msgr2=0x7fc9e40b5620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:21.535 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.524+0000 7fc9ec8e1640 1 -- 10.20.193.14:0/339113624 shutdown_connections 2026-02-24T19:17:21.535 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.524+0000 7fc9ec8e1640 1 -- 10.20.193.14:0/339113624 wait complete. 2026-02-24T19:17:21.535 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.525+0000 7fc9ec8e1640 10 monclient: build_initial_monmap 2026-02-24T19:17:21.535 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.525+0000 7fc9ec8e1640 10 monclient: monmap: 2026-02-24T19:17:21.535 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:21.535 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:21.535 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:21.535 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:21.535 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:21.535 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:21.536 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:21.536 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:21.536 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:21.536 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:21.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.525+0000 7fc9ec8e1640 1 librados: starting msgr at 2026-02-24T19:17:21.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.525+0000 7fc9ec8e1640 1 librados: starting objecter 2026-02-24T19:17:21.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.525+0000 7fc9ec8e1640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:21.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.525+0000 7fc9ec8e1640 1 Processor -- start 2026-02-24T19:17:21.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.525+0000 7fc9ec8e1640 1 -- start start 2026-02-24T19:17:21.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.525+0000 7fc9ec8e1640 1 librados: setting wanted keys 2026-02-24T19:17:21.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.525+0000 7fc9ec8e1640 1 librados: calling monclient init 2026-02-24T19:17:21.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.525+0000 7fc9ec8e1640 10 monclient: init 2026-02-24T19:17:21.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.525+0000 7fc9ec8e1640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:21.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.525+0000 7fc9ec8e1640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:21.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.525+0000 7fc9ec8e1640 10 monclient(hunting): picked mon.noname-c con 0x7fc9e40b6e40 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:21.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.525+0000 7fc9ec8e1640 10 monclient(hunting): picked mon.noname-a con 0x7fc9e40b78d0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:21.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.525+0000 7fc9ec8e1640 10 monclient(hunting): picked mon.noname-b con 0x7fc9e415d030 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:21.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.525+0000 7fc9ec8e1640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9e4059360 con 0x7fc9e40b78d0 2026-02-24T19:17:21.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.525+0000 7fc9ec8e1640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9e4059640 con 0x7fc9e415d030 2026-02-24T19:17:21.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.525+0000 7fc9ec8e1640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9e4059920 con 0x7fc9e40b6e40 2026-02-24T19:17:21.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.525+0000 7fc9ec8e1640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:21.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.525+0000 7fc9ec8e1640 10 monclient(hunting): authenticate will time out at 3616.207834s 2026-02-24T19:17:21.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.526+0000 7fc9e9e55640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7fc9e40b78d0 0x7fc9e411f1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:44500/0 (socket says 10.20.193.14:44500) 2026-02-24T19:17:21.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.526+0000 7fc9e9e55640 1 -- 10.20.193.14:0/2792536557 learned_addr learned my addr 10.20.193.14:0/2792536557 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:21.538 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.526+0000 7fc9ceffd640 10 client.?.objecter ms_handle_connect 0x7fc9e40b78d0 2026-02-24T19:17:21.538 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.526+0000 7fc9ceffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:21.538 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.526+0000 7fc9ceffd640 10 client.?.objecter ms_handle_connect 0x7fc9e40b6e40 2026-02-24T19:17:21.538 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.526+0000 7fc9ceffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:21.538 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.526+0000 7fc9ceffd640 10 client.?.objecter ms_handle_connect 0x7fc9e415d030 2026-02-24T19:17:21.538 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.526+0000 7fc9ceffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:21.538 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.527+0000 7fc9ceffd640 1 -- 10.20.193.14:0/2792536557 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1170574409 0 0) 0x7fc9e4059360 con 0x7fc9e40b78d0 2026-02-24T19:17:21.538 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.527+0000 7fc9ceffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:21.538 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.527+0000 7fc9ceffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:21.538 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.527+0000 7fc9ceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:21.538 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.527+0000 7fc9ceffd640 10 monclient(hunting): my global_id is 4356 2026-02-24T19:17:21.538 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.527+0000 7fc9ceffd640 1 -- 10.20.193.14:0/2792536557 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9b4003610 con 0x7fc9e40b78d0 2026-02-24T19:17:21.539 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.527+0000 7fc9ceffd640 1 -- 10.20.193.14:0/2792536557 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2399823738 0 0) 0x7fc9e4059920 con 0x7fc9e40b6e40 2026-02-24T19:17:21.539 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.527+0000 7fc9ceffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:21.539 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.527+0000 7fc9ceffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:21.539 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.527+0000 7fc9ceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:21.539 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.527+0000 7fc9ceffd640 10 monclient(hunting): my global_id is 4361 2026-02-24T19:17:21.539 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.527+0000 7fc9ceffd640 1 -- 10.20.193.14:0/2792536557 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9e4059360 con 0x7fc9e40b6e40 2026-02-24T19:17:21.539 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.527+0000 7fc9ceffd640 1 -- 10.20.193.14:0/2792536557 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4114603947 0 0) 0x7fc9e4059640 con 0x7fc9e415d030 2026-02-24T19:17:21.539 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.527+0000 7fc9ceffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:21.539 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.527+0000 7fc9ceffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:21.539 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.527+0000 7fc9ceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:21.539 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.527+0000 7fc9ceffd640 10 monclient(hunting): my global_id is 4351 2026-02-24T19:17:21.539 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.527+0000 7fc9ceffd640 1 -- 10.20.193.14:0/2792536557 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9e4059920 con 0x7fc9e415d030 2026-02-24T19:17:21.541 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.529+0000 7fc9ceffd640 1 -- 10.20.193.14:0/2792536557 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1961878786 0 0) 0x7fc9b4003610 con 0x7fc9e40b78d0 2026-02-24T19:17:21.541 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.529+0000 7fc9ceffd640 1 -- 10.20.193.14:0/2792536557 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc9e4059640 con 0x7fc9e40b78d0 2026-02-24T19:17:21.541 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.529+0000 7fc9ceffd640 1 -- 10.20.193.14:0/2792536557 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc9d0003140 con 0x7fc9e40b78d0 2026-02-24T19:17:21.541 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.529+0000 7fc9ceffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:21.541 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.529+0000 7fc9ceffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:21.541 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.529+0000 7fc9ceffd640 10 monclient(hunting): dump: 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.529+0000 7fc9ceffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.530+0000 7fc9ceffd640 1 -- 10.20.193.14:0/2792536557 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3395500626 0 0) 0x7fc9e4059360 con 0x7fc9e40b6e40 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.530+0000 7fc9ceffd640 1 -- 10.20.193.14:0/2792536557 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc9b4003610 con 0x7fc9e40b6e40 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.530+0000 7fc9ceffd640 1 -- 10.20.193.14:0/2792536557 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc9dc0030d0 con 0x7fc9e40b6e40 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.530+0000 7fc9ceffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.530+0000 7fc9ceffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.530+0000 7fc9ceffd640 10 monclient(hunting): dump: 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.530+0000 7fc9ceffd640 1 -- 10.20.193.14:0/2792536557 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2189822934 0 0) 0x7fc9e4059920 con 0x7fc9e415d030 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.530+0000 7fc9ceffd640 1 -- 10.20.193.14:0/2792536557 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc9e4059360 con 0x7fc9e415d030 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.530+0000 7fc9ceffd640 1 -- 10.20.193.14:0/2792536557 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc9d80034f0 con 0x7fc9e415d030 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.530+0000 7fc9ceffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.530+0000 7fc9ceffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.530+0000 7fc9ceffd640 10 monclient(hunting): dump: 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:21.542 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:21.543 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:21.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.531+0000 7fc9ceffd640 1 -- 10.20.193.14:0/2792536557 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4190256086 0 0) 0x7fc9e4059640 con 0x7fc9e40b78d0 2026-02-24T19:17:21.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.531+0000 7fc9ceffd640 1 -- 10.20.193.14:0/2792536557 >> v1:10.20.193.170:6789/0 conn(0x7fc9e40b6e40 legacy=0x7fc9e411d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:21.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.531+0000 7fc9ceffd640 1 -- 10.20.193.14:0/2792536557 >> v1:10.20.193.44:6789/0 conn(0x7fc9e415d030 legacy=0x7fc9e4137d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:21.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.531+0000 7fc9ceffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:21.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.531+0000 7fc9ceffd640 1 monclient: found mon.a 2026-02-24T19:17:21.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.531+0000 7fc9ceffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:21.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.531+0000 7fc9ceffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:21.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.531+0000 7fc9ceffd640 1 -- 10.20.193.14:0/2792536557 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e4059c00 con 0x7fc9e40b78d0 2026-02-24T19:17:21.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.531+0000 7fc9ceffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:21.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.531+0000 7fc9ceffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:21.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.531+0000 7fc9ceffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:21.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.531+0000 7fc9ec8e1640 5 monclient: authenticate success, global_id 4356 2026-02-24T19:17:21.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.531+0000 7fc9ec8e1640 10 monclient: _renew_subs 2026-02-24T19:17:21.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.531+0000 7fc9ec8e1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:21.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.531+0000 7fc9ec8e1640 1 -- 10.20.193.14:0/2792536557 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc9e4059ee0 con 0x7fc9e40b78d0 2026-02-24T19:17:21.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.531+0000 7fc9ec8e1640 10 client.4356.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:21.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.531+0000 7fc9ec8e1640 10 monclient: _renew_subs 2026-02-24T19:17:21.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.531+0000 7fc9ec8e1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:21.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.531+0000 7fc9ec8e1640 1 -- 10.20.193.14:0/2792536557 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc9e405a6e0 con 0x7fc9e40b78d0 2026-02-24T19:17:21.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.531+0000 7fc9ec8e1640 1 librados: init done 2026-02-24T19:17:21.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.532+0000 7fc9ec8e1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:21.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.532+0000 7fc9ec8e1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:21.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.532+0000 7fc9ec8e1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:21.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.532+0000 7fc9ec8e1640 1 -- 10.20.193.14:0/2792536557 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9e405bf30 con 0x7fc9e40b78d0 2026-02-24T19:17:21.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.628+0000 7fc9ceffd640 1 -- 10.20.193.14:0/2792536557 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc9d00034f0 con 0x7fc9e40b78d0 2026-02-24T19:17:21.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.628+0000 7fc9ceffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:21.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.628+0000 7fc9ceffd640 1 -- 10.20.193.14:0/2792536557 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc9d0003b50 con 0x7fc9e40b78d0 2026-02-24T19:17:21.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.628+0000 7fc9ceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:21.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.628+0000 7fc9ceffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:21.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.628+0000 7fc9ceffd640 10 monclient: dump: 2026-02-24T19:17:21.630 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:21.630 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:21.630 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:21.630 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:21.630 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:21.630 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:21.630 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:21.630 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:21.630 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:21.630 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:21.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.628+0000 7fc9e8e53640 4 set_mon_vals no callback set 2026-02-24T19:17:21.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.628+0000 7fc9ceffd640 1 -- 10.20.193.14:0/2792536557 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7fc9d0003d30 con 0x7fc9e40b78d0 2026-02-24T19:17:21.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.629+0000 7fc9ea656640 10 monclient: get_auth_request con 0x7fc9b4077ea0 auth_method 0 2026-02-24T19:17:21.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.629+0000 7fc9ceffd640 10 client.4356.objecter ms_handle_connect 0x7fc9b4077ea0 2026-02-24T19:17:21.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.635+0000 7fc9ceffd640 1 -- 10.20.193.14:0/2792536557 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(26..26 src has 1..26) ==== 7757+0+0 (unknown 2842002912 0 0) 0x7fc9d00931c0 con 0x7fc9e40b78d0 2026-02-24T19:17:21.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.635+0000 7fc9ceffd640 10 client.4356.objecter ms_dispatch2 0x7fc9e4000b90 osd_map(26..26 src has 1..26) 2026-02-24T19:17:21.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.635+0000 7fc9ceffd640 3 client.4356.objecter handle_osd_map got epochs [26,26] > 0 2026-02-24T19:17:21.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.635+0000 7fc9ceffd640 3 client.4356.objecter handle_osd_map decoding full epoch 26 2026-02-24T19:17:21.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.635+0000 7fc9ceffd640 20 client.4356.objecter dump_active .. 0 homeless 2026-02-24T19:17:21.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.635+0000 7fc9ceffd640 1 -- 10.20.193.14:0/2792536557 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fc9d005dbf0 con 0x7fc9e40b78d0 2026-02-24T19:17:21.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.635+0000 7fc9ceffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:21.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.635+0000 7fc9ceffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:21.742 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.740+0000 7fc9ec8e1640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-24T19:17:21.742 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.740+0000 7fc9ec8e1640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-24T19:17:21.742 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.740+0000 7fc9ec8e1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:21.742 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:21.740+0000 7fc9ec8e1640 1 -- 10.20.193.14:0/2792536557 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7fc9e40b2bd0 con 0x7fc9e40b78d0 2026-02-24T19:17:22.237 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.235+0000 7fc9ceffd640 1 -- 10.20.193.14:0/2792536557 <== mon.0 v1:10.20.193.14:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v27) ==== 109+0+0 (unknown 1714090713 0 0) 0x7fc9d0003b50 con 0x7fc9e40b78d0 2026-02-24T19:17:22.237 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.235+0000 7fc9ceffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-24T19:17:22.237 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.235+0000 7fc9ceffd640 10 monclient: _finish_command 2 = system:0 pool 'rbd' created 2026-02-24T19:17:22.237 INFO:teuthology.orchestra.run.trial014.stderr:pool 'rbd' created 2026-02-24T19:17:22.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.238+0000 7fc9ec8e1640 10 librados: watch_flush enter 2026-02-24T19:17:22.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.238+0000 7fc9ec8e1640 10 librados: watch_flush exit 2026-02-24T19:17:22.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.238+0000 7fc9ec8e1640 20 client.4356.objecter shutdown clearing up homeless session... 2026-02-24T19:17:22.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.238+0000 7fc9ec8e1640 10 client.4356.objecter successfully canceled tick 2026-02-24T19:17:22.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.238+0000 7fc9ec8e1640 1 -- 10.20.193.14:0/2792536557 >> v1:10.20.193.14:6800/4014096310 conn(0x7fc9b4077ea0 legacy=0x7fc9b4098350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:22.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.238+0000 7fc9ec8e1640 10 monclient: shutdown 2026-02-24T19:17:22.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.238+0000 7fc9ec8e1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:22.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.238+0000 7fc9ec8e1640 1 -- 10.20.193.14:0/2792536557 >> v1:10.20.193.14:6789/0 conn(0x7fc9e40b78d0 legacy=0x7fc9e411f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:22.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.238+0000 7fc9ec8e1640 1 -- 10.20.193.14:0/2792536557 shutdown_connections 2026-02-24T19:17:22.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.238+0000 7fc9ec8e1640 1 -- 10.20.193.14:0/2792536557 >> 10.20.193.14:0/2792536557 conn(0x7fc9e40b5220 msgr2=0x7fc9e40b55f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:22.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.238+0000 7fc9ec8e1640 1 -- 10.20.193.14:0/2792536557 shutdown_connections 2026-02-24T19:17:22.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.238+0000 7fc9ec8e1640 1 -- 10.20.193.14:0/2792536557 wait complete. 2026-02-24T19:17:22.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.238+0000 7fc9ec8e1640 1 librados: shutdown 2026-02-24T19:17:22.249 DEBUG:teuthology.orchestra.run.trial014:> rbd --cluster ceph pool init rbd 2026-02-24T19:17:22.282 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.280+0000 7f0d1a541300 10 monclient: get_monmap_and_config 2026-02-24T19:17:22.282 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.280+0000 7f0d1a541300 10 monclient: build_initial_monmap 2026-02-24T19:17:22.282 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.280+0000 7f0d1a541300 10 monclient: monmap: 2026-02-24T19:17:22.282 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:22.282 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:22.282 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:22.281768+0000 2026-02-24T19:17:22.282 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:22.281768+0000 2026-02-24T19:17:22.282 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:22.282 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:22.282 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:22.282 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:22.282 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:22.282 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:22.282 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.280+0000 7f0d1a541300 1 Processor -- start 2026-02-24T19:17:22.282 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.280+0000 7f0d1a541300 1 -- start start 2026-02-24T19:17:22.282 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.280+0000 7f0d1a541300 10 monclient: init 2026-02-24T19:17:22.283 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.281+0000 7f0d1a541300 10 monclient: _reopen_session rank -1 2026-02-24T19:17:22.283 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.281+0000 7f0d1a541300 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:22.283 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.281+0000 7f0d1a541300 10 monclient(hunting): picked mon.noname-c con 0x5640074855d0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:22.283 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.281+0000 7f0d1a541300 10 monclient(hunting): picked mon.noname-b con 0x56400756edc0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:22.283 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.281+0000 7f0d1a541300 10 monclient(hunting): picked mon.noname-a con 0x5640074859a0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:22.283 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.281+0000 7f0d1a541300 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5640072de0c0 con 0x5640074859a0 2026-02-24T19:17:22.283 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.281+0000 7f0d1a541300 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5640072eda80 con 0x56400756edc0 2026-02-24T19:17:22.283 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.281+0000 7f0d1a541300 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x56400748ae90 con 0x5640074855d0 2026-02-24T19:17:22.283 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.281+0000 7f0d1a541300 10 monclient(hunting): _renew_subs 2026-02-24T19:17:22.283 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.281+0000 7f0d1a541300 10 monclient(hunting): authenticate will time out at 3616.963253s 2026-02-24T19:17:22.283 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.281+0000 7f0d1a27f640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x5640074859a0 0x5640075ddad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:44508/0 (socket says 10.20.193.14:44508) 2026-02-24T19:17:22.283 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.281+0000 7f0d1a27f640 1 -- 10.20.193.14:0/1412633662 learned_addr learned my addr 10.20.193.14:0/1412633662 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:22.285 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.283+0000 7f0d137fe640 1 -- 10.20.193.14:0/1412633662 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1932309476 0 0) 0x5640072eda80 con 0x56400756edc0 2026-02-24T19:17:22.285 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.283+0000 7f0d137fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:22.285 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.283+0000 7f0d137fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:22.285 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.283+0000 7f0d137fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:22.285 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.283+0000 7f0d137fe640 10 monclient(hunting): my global_id is 4354 2026-02-24T19:17:22.285 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.283+0000 7f0d137fe640 1 -- 10.20.193.14:0/1412633662 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d04001e10 con 0x56400756edc0 2026-02-24T19:17:22.285 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.283+0000 7f0d137fe640 1 -- 10.20.193.14:0/1412633662 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3840205200 0 0) 0x56400748ae90 con 0x5640074855d0 2026-02-24T19:17:22.285 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.283+0000 7f0d137fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:22.285 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.283+0000 7f0d137fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:22.285 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.283+0000 7f0d137fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:22.285 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.283+0000 7f0d137fe640 10 monclient(hunting): my global_id is 4364 2026-02-24T19:17:22.285 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.283+0000 7f0d137fe640 1 -- 10.20.193.14:0/1412633662 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x5640072eda80 con 0x5640074855d0 2026-02-24T19:17:22.285 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.283+0000 7f0d137fe640 1 -- 10.20.193.14:0/1412633662 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3474510255 0 0) 0x5640072de0c0 con 0x5640074859a0 2026-02-24T19:17:22.285 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.283+0000 7f0d137fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:22.285 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.283+0000 7f0d137fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:22.285 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.283+0000 7f0d137fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:22.285 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.283+0000 7f0d137fe640 10 monclient(hunting): my global_id is 4359 2026-02-24T19:17:22.285 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.283+0000 7f0d137fe640 1 -- 10.20.193.14:0/1412633662 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x56400748ae90 con 0x5640074859a0 2026-02-24T19:17:22.287 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.285+0000 7f0d137fe640 1 -- 10.20.193.14:0/1412633662 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4187552838 0 0) 0x7f0d04001e10 con 0x56400756edc0 2026-02-24T19:17:22.287 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.285+0000 7f0d137fe640 1 -- 10.20.193.14:0/1412633662 >> v1:10.20.193.170:6789/0 conn(0x5640074855d0 legacy=0x56400756e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:22.287 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.285+0000 7f0d137fe640 1 -- 10.20.193.14:0/1412633662 >> v1:10.20.193.14:6789/0 conn(0x5640074859a0 legacy=0x5640075ddad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:22.287 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.285+0000 7f0d137fe640 10 monclient: _finish_hunting 0 2026-02-24T19:17:22.287 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.285+0000 7f0d137fe640 1 monclient: found mon.noname-b 2026-02-24T19:17:22.287 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.285+0000 7f0d137fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:22.287 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.285+0000 7f0d137fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.44:6789/0 2026-02-24T19:17:22.287 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.285+0000 7f0d137fe640 1 -- 10.20.193.14:0/1412633662 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56400748b170 con 0x56400756edc0 2026-02-24T19:17:22.287 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.285+0000 7f0d137fe640 10 monclient: _finish_auth 0 2026-02-24T19:17:22.287 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.285+0000 7f0d137fe640 10 monclient: _check_auth_tickets 2026-02-24T19:17:22.287 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.285+0000 7f0d137fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:22.287 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.285+0000 7f0d137fe640 1 -- 10.20.193.14:0/1412633662 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f0d000015f0 con 0x56400756edc0 2026-02-24T19:17:22.287 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.285+0000 7f0d137fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:22.287 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.285+0000 7f0d137fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:22.287 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.285+0000 7f0d137fe640 10 monclient: dump: 2026-02-24T19:17:22.287 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:22.287 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:22.287 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:22.287 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:22.287 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:22.287 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:22.287 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:22.287 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:22.287 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:22.287 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:22.287 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.285+0000 7f0d1a541300 5 monclient: authenticate success, global_id 4354 2026-02-24T19:17:22.287 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.285+0000 7f0d1a541300 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:22.288 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.286+0000 7f0d137fe640 1 -- 10.20.193.14:0/1412633662 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0d000017c0 con 0x56400756edc0 2026-02-24T19:17:22.288 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.286+0000 7f0d137fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:22.288 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.286+0000 7f0d137fe640 1 -- 10.20.193.14:0/1412633662 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f0d00001c00 con 0x56400756edc0 2026-02-24T19:17:22.288 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.286+0000 7f0d137fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:22.288 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.286+0000 7f0d137fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:22.288 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.286+0000 7f0d137fe640 10 monclient: dump: 2026-02-24T19:17:22.288 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:22.288 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:22.288 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:22.288 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:22.288 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:22.288 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:22.288 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:22.288 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:22.288 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:22.288 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:22.288 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.286+0000 7f0d1a541300 10 monclient: get_monmap_and_config success 2026-02-24T19:17:22.288 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.286+0000 7f0d1a541300 4 set_mon_vals no callback set 2026-02-24T19:17:22.288 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.286+0000 7f0d1a541300 10 monclient: shutdown 2026-02-24T19:17:22.288 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.286+0000 7f0d1a541300 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:22.288 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.286+0000 7f0d1a541300 1 -- 10.20.193.14:0/1412633662 >> v1:10.20.193.44:6789/0 conn(0x56400756edc0 legacy=0x564007578500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:22.288 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.286+0000 7f0d1a541300 1 -- 10.20.193.14:0/1412633662 shutdown_connections 2026-02-24T19:17:22.288 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.286+0000 7f0d1a541300 1 -- 10.20.193.14:0/1412633662 >> 10.20.193.14:0/1412633662 conn(0x5640074cfed0 msgr2=0x5640074d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:22.288 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.286+0000 7f0d1a541300 1 -- 10.20.193.14:0/1412633662 shutdown_connections 2026-02-24T19:17:22.288 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.286+0000 7f0d1a541300 1 -- 10.20.193.14:0/1412633662 wait complete. 2026-02-24T19:17:22.288 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.286+0000 7f0d1a541300 10 monclient: build_initial_monmap 2026-02-24T19:17:22.289 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.286+0000 7f0d1a541300 10 monclient: monmap: 2026-02-24T19:17:22.289 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:22.289 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:22.289 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:22.289 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:22.289 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:22.289 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:22.289 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:22.289 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:22.289 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:22.289 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:22.289 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.286+0000 7f0d1a541300 1 librados: starting msgr at 2026-02-24T19:17:22.289 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.286+0000 7f0d1a541300 1 librados: starting objecter 2026-02-24T19:17:22.289 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.286+0000 7f0d1a541300 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:22.289 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.287+0000 7f0d1a541300 1 Processor -- start 2026-02-24T19:17:22.289 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.287+0000 7f0d1a541300 1 -- start start 2026-02-24T19:17:22.289 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.287+0000 7f0d1a541300 1 librados: setting wanted keys 2026-02-24T19:17:22.289 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.287+0000 7f0d1a541300 1 librados: calling monclient init 2026-02-24T19:17:22.289 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.287+0000 7f0d1a541300 10 monclient: init 2026-02-24T19:17:22.289 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.287+0000 7f0d1a541300 10 monclient: _reopen_session rank -1 2026-02-24T19:17:22.289 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.287+0000 7f0d1a541300 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:22.289 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.287+0000 7f0d1a541300 10 monclient(hunting): picked mon.noname-b con 0x5640074855d0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:22.289 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.287+0000 7f0d1a541300 10 monclient(hunting): picked mon.noname-a con 0x5640074859a0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:22.289 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.287+0000 7f0d1a541300 10 monclient(hunting): picked mon.noname-c con 0x56400756edc0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:22.289 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.287+0000 7f0d1a541300 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5640074c8e30 con 0x5640074859a0 2026-02-24T19:17:22.289 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.287+0000 7f0d1a541300 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5640074c90f0 con 0x5640074855d0 2026-02-24T19:17:22.289 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.287+0000 7f0d1a541300 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5640074c93d0 con 0x56400756edc0 2026-02-24T19:17:22.290 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.287+0000 7f0d1a541300 10 monclient(hunting): _renew_subs 2026-02-24T19:17:22.290 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.287+0000 7f0d1a541300 10 monclient(hunting): authenticate will time out at 3616.969459s 2026-02-24T19:17:22.290 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.287+0000 7f0d13fff640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x5640074859a0 0x564007567620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:44520/0 (socket says 10.20.193.14:44520) 2026-02-24T19:17:22.290 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.287+0000 7f0d13fff640 1 -- 10.20.193.14:0/1638543867 learned_addr learned my addr 10.20.193.14:0/1638543867 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:22.290 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.287+0000 7f0d10ff9640 10 client.?.objecter ms_handle_connect 0x5640074859a0 2026-02-24T19:17:22.290 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.287+0000 7f0d10ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:22.290 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.288+0000 7f0d10ff9640 10 client.?.objecter ms_handle_connect 0x5640074855d0 2026-02-24T19:17:22.290 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.288+0000 7f0d10ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:22.290 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.288+0000 7f0d10ff9640 10 client.?.objecter ms_handle_connect 0x56400756edc0 2026-02-24T19:17:22.290 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.288+0000 7f0d10ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:22.290 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.288+0000 7f0d10ff9640 1 -- 10.20.193.14:0/1638543867 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2755689501 0 0) 0x5640074c8e30 con 0x5640074859a0 2026-02-24T19:17:22.290 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.288+0000 7f0d10ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:22.290 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.288+0000 7f0d10ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:22.290 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.288+0000 7f0d10ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:22.290 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.288+0000 7f0d10ff9640 10 monclient(hunting): my global_id is 4362 2026-02-24T19:17:22.291 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.288+0000 7f0d10ff9640 1 -- 10.20.193.14:0/1638543867 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0cf8001e10 con 0x5640074859a0 2026-02-24T19:17:22.291 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.289+0000 7f0d10ff9640 1 -- 10.20.193.14:0/1638543867 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3986838873 0 0) 0x5640074c93d0 con 0x56400756edc0 2026-02-24T19:17:22.291 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.289+0000 7f0d10ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:22.291 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.289+0000 7f0d10ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:22.291 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.289+0000 7f0d10ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:22.291 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.289+0000 7f0d10ff9640 10 monclient(hunting): my global_id is 4367 2026-02-24T19:17:22.291 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.289+0000 7f0d10ff9640 1 -- 10.20.193.14:0/1638543867 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x5640074c8e30 con 0x56400756edc0 2026-02-24T19:17:22.291 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.289+0000 7f0d10ff9640 1 -- 10.20.193.14:0/1638543867 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 445377296 0 0) 0x5640074c90f0 con 0x5640074855d0 2026-02-24T19:17:22.291 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.289+0000 7f0d10ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:22.291 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.289+0000 7f0d10ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:22.291 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.289+0000 7f0d10ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:22.291 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.289+0000 7f0d10ff9640 10 monclient(hunting): my global_id is 4357 2026-02-24T19:17:22.291 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.289+0000 7f0d10ff9640 1 -- 10.20.193.14:0/1638543867 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x5640074c93d0 con 0x5640074855d0 2026-02-24T19:17:22.293 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.291+0000 7f0d10ff9640 1 -- 10.20.193.14:0/1638543867 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2490804114 0 0) 0x5640074c8e30 con 0x56400756edc0 2026-02-24T19:17:22.293 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.291+0000 7f0d10ff9640 1 -- 10.20.193.14:0/1638543867 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x5640074c90f0 con 0x56400756edc0 2026-02-24T19:17:22.293 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.291+0000 7f0d10ff9640 1 -- 10.20.193.14:0/1638543867 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f0d0c001b90 con 0x56400756edc0 2026-02-24T19:17:22.293 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.291+0000 7f0d10ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:22.293 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.291+0000 7f0d10ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:22.293 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.291+0000 7f0d10ff9640 10 monclient(hunting): dump: 2026-02-24T19:17:22.293 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:22.293 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:22.293 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:22.293 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:22.293 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:22.293 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:22.293 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:22.293 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:22.293 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:22.293 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:22.294 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.291+0000 7f0d10ff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:22.294 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.291+0000 7f0d10ff9640 1 -- 10.20.193.14:0/1638543867 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3840704704 0 0) 0x7f0cf8001e10 con 0x5640074859a0 2026-02-24T19:17:22.294 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.291+0000 7f0d10ff9640 1 -- 10.20.193.14:0/1638543867 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x5640074c8e30 con 0x5640074859a0 2026-02-24T19:17:22.294 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.291+0000 7f0d10ff9640 1 -- 10.20.193.14:0/1638543867 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f0d00001910 con 0x5640074859a0 2026-02-24T19:17:22.294 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.291+0000 7f0d10ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:22.294 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.291+0000 7f0d10ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:22.294 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.291+0000 7f0d10ff9640 10 monclient(hunting): dump: 2026-02-24T19:17:22.294 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:22.294 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:22.294 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:22.294 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:22.294 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:22.294 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:22.294 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:22.294 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:22.294 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:22.294 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:22.295 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.293+0000 7f0d10ff9640 1 -- 10.20.193.14:0/1638543867 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3148343528 0 0) 0x5640074c90f0 con 0x56400756edc0 2026-02-24T19:17:22.295 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.293+0000 7f0d10ff9640 1 -- 10.20.193.14:0/1638543867 >> v1:10.20.193.44:6789/0 conn(0x5640074855d0 legacy=0x564007566980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:22.295 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.293+0000 7f0d10ff9640 1 -- 10.20.193.14:0/1638543867 >> v1:10.20.193.14:6789/0 conn(0x5640074859a0 legacy=0x564007567620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:22.295 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.293+0000 7f0d10ff9640 10 monclient: _finish_hunting 0 2026-02-24T19:17:22.295 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.293+0000 7f0d10ff9640 1 monclient: found mon.c 2026-02-24T19:17:22.295 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.293+0000 7f0d10ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:22.295 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.293+0000 7f0d10ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:22.295 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.293+0000 7f0d10ff9640 1 -- 10.20.193.14:0/1638543867 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640074c96b0 con 0x56400756edc0 2026-02-24T19:17:22.295 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.293+0000 7f0d10ff9640 10 monclient: _finish_auth 0 2026-02-24T19:17:22.295 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.293+0000 7f0d10ff9640 10 monclient: _check_auth_tickets 2026-02-24T19:17:22.295 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.293+0000 7f0d10ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:22.295 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.293+0000 7f0d1a541300 5 monclient: authenticate success, global_id 4367 2026-02-24T19:17:22.295 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.293+0000 7f0d1a541300 10 monclient: _renew_subs 2026-02-24T19:17:22.295 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.293+0000 7f0d1a541300 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:22.295 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.293+0000 7f0d1a541300 1 -- 10.20.193.14:0/1638543867 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x5640074c9990 con 0x56400756edc0 2026-02-24T19:17:22.295 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.293+0000 7f0d1a541300 10 client.4367.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:22.295 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.293+0000 7f0d1a541300 10 monclient: _renew_subs 2026-02-24T19:17:22.295 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.293+0000 7f0d1a541300 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:22.295 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.293+0000 7f0d1a541300 1 -- 10.20.193.14:0/1638543867 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x564007567090 con 0x56400756edc0 2026-02-24T19:17:22.295 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.293+0000 7f0d1a541300 1 librados: init done 2026-02-24T19:17:22.295 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.293+0000 7f0d1a541300 10 librados: wait_for_osdmap waiting 2026-02-24T19:17:22.302 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.300+0000 7f0d10ff9640 1 -- 10.20.193.14:0/1638543867 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0d0c003450 con 0x56400756edc0 2026-02-24T19:17:22.302 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.300+0000 7f0d10ff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:22.302 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.300+0000 7f0d10ff9640 1 -- 10.20.193.14:0/1638543867 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f0d0c003890 con 0x56400756edc0 2026-02-24T19:17:22.302 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.300+0000 7f0d10ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:22.303 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.300+0000 7f0d10ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:22.303 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.300+0000 7f0d10ff9640 10 monclient: dump: 2026-02-24T19:17:22.303 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:22.303 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:22.303 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:22.303 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:22.303 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:22.303 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:22.303 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:22.303 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:22.303 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:22.303 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:22.303 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.300+0000 7f0d12ffd640 4 set_mon_vals no callback set 2026-02-24T19:17:22.303 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.301+0000 7f0d10ff9640 1 -- 10.20.193.14:0/1638543867 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f0d0c003aa0 con 0x56400756edc0 2026-02-24T19:17:22.304 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.302+0000 7f0d18ff6640 10 monclient: get_auth_request con 0x7f0cf80764c0 auth_method 0 2026-02-24T19:17:22.304 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.302+0000 7f0d10ff9640 10 client.4367.objecter ms_handle_connect 0x7f0cf80764c0 2026-02-24T19:17:22.304 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.302+0000 7f0d10ff9640 1 -- 10.20.193.14:0/1638543867 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(27..27 src has 1..27) ==== 8102+0+0 (unknown 3352190725 0 0) 0x7f0d0c091e40 con 0x56400756edc0 2026-02-24T19:17:22.304 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.302+0000 7f0d10ff9640 10 client.4367.objecter ms_dispatch2 0x56400739ad50 osd_map(27..27 src has 1..27) 2026-02-24T19:17:22.304 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.302+0000 7f0d10ff9640 3 client.4367.objecter handle_osd_map got epochs [27,27] > 0 2026-02-24T19:17:22.304 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.302+0000 7f0d10ff9640 3 client.4367.objecter handle_osd_map decoding full epoch 27 2026-02-24T19:17:22.304 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.302+0000 7f0d10ff9640 20 client.4367.objecter dump_active .. 0 homeless 2026-02-24T19:17:22.304 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.302+0000 7f0d1a541300 10 librados: wait_for_osdmap done waiting 2026-02-24T19:17:22.304 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.302+0000 7f0d1a541300 10 start_mon_command cmd=[{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-24T19:17:22.304 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.302+0000 7f0d1a541300 10 monclient: _send_command 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-24T19:17:22.304 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.302+0000 7f0d1a541300 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:22.304 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:22.302+0000 7f0d1a541300 1 -- 10.20.193.14:0/1638543867 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x564007567f40 con 0x56400756edc0 2026-02-24T19:17:23.701 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:23.699+0000 7f0d10ff9640 1 -- 10.20.193.14:0/1638543867 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v28) ==== 141+0+0 (unknown 2346181095 0 0) 0x7f0d0c05c870 con 0x56400756edc0 2026-02-24T19:17:23.701 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:23.699+0000 7f0d10ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-24T19:17:23.701 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:23.699+0000 7f0d10ff9640 10 monclient: _finish_command 1 = system:0 enabled application 'rbd' on pool 'rbd' 2026-02-24T19:17:23.701 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:23.699+0000 7f0d1a541300 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:23.701 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:23.699+0000 7f0d1a541300 1 -- 10.20.193.14:0/1638543867 --> v1:10.20.193.170:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x564007376fb0 con 0x56400756edc0 2026-02-24T19:17:23.702 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:23.700+0000 7f0d10ff9640 1 -- 10.20.193.14:0/1638543867 <== mon.2 v1:10.20.193.170:6789/0 10 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7f0d0c0584e0 con 0x56400756edc0 2026-02-24T19:17:23.702 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:23.700+0000 7f0d10ff9640 10 monclient: handle_get_version_reply finishing 1 version 28 2026-02-24T19:17:23.702 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:23.700+0000 7f0d12ffd640 10 client.4367.objecter _get_latest_version latest 28, waiting 2026-02-24T19:17:23.702 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:23.700+0000 7f0d12ffd640 10 client.4367.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:23.702 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:23.700+0000 7f0d12ffd640 10 monclient: _renew_subs 2026-02-24T19:17:23.702 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:23.700+0000 7f0d12ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:23.702 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:23.700+0000 7f0d12ffd640 1 -- 10.20.193.14:0/1638543867 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=28}) -- 0x7f0cf0002ae0 con 0x56400756edc0 2026-02-24T19:17:23.703 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:23.701+0000 7f0d10ff9640 1 -- 10.20.193.14:0/1638543867 <== mon.2 v1:10.20.193.170:6789/0 11 ==== osd_map(28..28 src has 1..28) ==== 653+0+0 (unknown 2564572226 0 0) 0x7f0d0c05ba30 con 0x56400756edc0 2026-02-24T19:17:23.703 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:23.701+0000 7f0d10ff9640 10 client.4367.objecter ms_dispatch2 0x56400739ad50 osd_map(28..28 src has 1..28) 2026-02-24T19:17:23.703 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:23.701+0000 7f0d10ff9640 3 client.4367.objecter handle_osd_map got epochs [28,28] > 27 2026-02-24T19:17:23.703 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:23.701+0000 7f0d10ff9640 3 client.4367.objecter handle_osd_map decoding incremental epoch 28 2026-02-24T19:17:23.703 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:23.701+0000 7f0d10ff9640 20 client.4367.objecter dump_active .. 0 homeless 2026-02-24T19:17:23.703 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:23.701+0000 7f0d1a541300 10 librados: create oid=rbd_trash nspace= 2026-02-24T19:17:23.703 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:23.701+0000 7f0d1a541300 10 client.4367.objecter _op_submit op 0x5640075692d0 2026-02-24T19:17:23.703 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:23.701+0000 7f0d1a541300 20 client.4367.objecter _calc_target epoch 28 base rbd_trash @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:17:23.703 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:23.701+0000 7f0d1a541300 20 client.4367.objecter _calc_target target rbd_trash @2 -> pgid 2.5a749323 2026-02-24T19:17:23.703 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:23.701+0000 7f0d1a541300 10 client.4367.objecter _calc_target raw pgid 2.5a749323 -> actual 2.3 acting [15,11] primary 15 2026-02-24T19:17:23.704 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:23.701+0000 7f0d1a541300 20 client.4367.objecter _get_session s=0x5640072f7280 osd=15 3 2026-02-24T19:17:23.704 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:23.701+0000 7f0d1a541300 10 client.4367.objecter _op_submit oid rbd_trash '@2' '@2' [create] tid 1 osd.15 2026-02-24T19:17:23.704 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:23.701+0000 7f0d1a541300 20 client.4367.objecter get_session s=0x5640072f7280 osd=15 3 2026-02-24T19:17:23.704 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:23.701+0000 7f0d1a541300 15 client.4367.objecter _session_op_assign 15 1 2026-02-24T19:17:23.704 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:23.701+0000 7f0d1a541300 15 client.4367.objecter _send_op 1 to 2.3 on osd.15 2026-02-24T19:17:23.704 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:23.701+0000 7f0d1a541300 1 -- 10.20.193.14:0/1638543867 --> v1:10.20.193.195:6809/3316970219 -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) -- 0x56400760fa20 con 0x5640075edf20 2026-02-24T19:17:23.704 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:23.701+0000 7f0d1a541300 20 client.4367.objecter put_session s=0x5640072f7280 osd=15 4 2026-02-24T19:17:23.704 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:23.701+0000 7f0d1a541300 5 client.4367.objecter 1 in flight 2026-02-24T19:17:23.704 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:23.701+0000 7f0d13fff640 10 monclient: get_auth_request con 0x5640075edf20 auth_method 0 2026-02-24T19:17:23.704 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:23.702+0000 7f0d10ff9640 10 client.4367.objecter ms_handle_connect 0x5640075edf20 2026-02-24T19:17:24.981 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:24.979+0000 7f0d10ff9640 1 -- 10.20.193.14:0/1638543867 <== osd.15 v1:10.20.193.195:6809/3316970219 1 ==== osd_map(29..29 src has 1..29) ==== 304+0+0 (unknown 1428932903 0 0) 0x7f0d00001ed0 con 0x5640075edf20 2026-02-24T19:17:24.981 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:24.979+0000 7f0d10ff9640 10 client.4367.objecter ms_dispatch2 0x56400739ad50 osd_map(29..29 src has 1..29) 2026-02-24T19:17:24.981 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:24.979+0000 7f0d10ff9640 3 client.4367.objecter handle_osd_map got epochs [29,29] > 28 2026-02-24T19:17:24.981 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:24.979+0000 7f0d10ff9640 3 client.4367.objecter handle_osd_map decoding incremental epoch 29 2026-02-24T19:17:24.981 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:24.979+0000 7f0d10ff9640 10 client.4367.objecter checking op 1 2026-02-24T19:17:24.981 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:24.979+0000 7f0d10ff9640 20 client.4367.objecter _calc_target epoch 29 base rbd_trash @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:17:24.982 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:24.979+0000 7f0d10ff9640 20 client.4367.objecter _calc_target target rbd_trash @2 -> pgid 2.5a749323 2026-02-24T19:17:24.982 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:24.979+0000 7f0d10ff9640 20 client.4367.objecter dump_active .. 0 homeless 2026-02-24T19:17:24.982 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:24.979+0000 7f0d10ff9640 20 client.4367.objecter 1 2.5a749323 osd.15 rbd_trash [create] 2026-02-24T19:17:25.145 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.143+0000 7f0d13fff640 1 -- 10.20.193.14:0/1638543867 <== osd.15 v1:10.20.193.195:6809/3316970219 2 ==== osd_op_reply(1 rbd_trash [create] v29'1 uv1 ondisk = 0) ==== 153+0+0 (unknown 1295514924 0 0) 0x7f0d00004500 con 0x5640075edf20 2026-02-24T19:17:25.145 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.143+0000 7f0d13fff640 10 client.4367.objecter ms_dispatch2 0x56400739ad50 osd_op_reply(1 rbd_trash [create] v29'1 uv1 ondisk = 0) 2026-02-24T19:17:25.145 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.143+0000 7f0d13fff640 10 client.4367.objecter in handle_osd_op_reply 2026-02-24T19:17:25.145 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.143+0000 7f0d13fff640 7 client.4367.objecter handle_osd_op_reply 1 ondisk uv 1 in 2.3 attempt 0 2026-02-24T19:17:25.145 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.143+0000 7f0d13fff640 10 client.4367.objecter op 0 rval 0 len 0 2026-02-24T19:17:25.145 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.143+0000 7f0d13fff640 15 client.4367.objecter handle_osd_op_reply completed tid 1 2026-02-24T19:17:25.145 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.143+0000 7f0d13fff640 15 client.4367.objecter _finish_op 1 2026-02-24T19:17:25.145 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.143+0000 7f0d13fff640 20 client.4367.objecter put_session s=0x5640072f7280 osd=15 4 2026-02-24T19:17:25.145 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.143+0000 7f0d13fff640 15 client.4367.objecter _session_op_remove 15 1 2026-02-24T19:17:25.146 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.143+0000 7f0d13fff640 5 client.4367.objecter 0 in flight 2026-02-24T19:17:25.146 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.143+0000 7f0d1a541300 10 librados: Objecter returned from create r=0 2026-02-24T19:17:25.147 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.145+0000 7f0d1a541300 10 client.4367.objecter _op_submit op 0x56400764a6d0 2026-02-24T19:17:25.147 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.145+0000 7f0d1a541300 20 client.4367.objecter _calc_target epoch 29 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:17:25.147 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.145+0000 7f0d1a541300 20 client.4367.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-24T19:17:25.147 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.145+0000 7f0d1a541300 10 client.4367.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [15,10] primary 15 2026-02-24T19:17:25.147 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.145+0000 7f0d1a541300 10 client.4367.objecter chose random osd.15 of [15,10] 2026-02-24T19:17:25.147 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.145+0000 7f0d1a541300 20 client.4367.objecter _get_session s=0x5640072f7280 osd=15 3 2026-02-24T19:17:25.147 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.145+0000 7f0d1a541300 10 client.4367.objecter _op_submit oid rbd_info '@2' '@2' [call rbd.metadata_list in=33b] tid 2 osd.15 2026-02-24T19:17:25.147 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.145+0000 7f0d1a541300 20 client.4367.objecter get_session s=0x5640072f7280 osd=15 3 2026-02-24T19:17:25.147 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.145+0000 7f0d1a541300 15 client.4367.objecter _session_op_assign 15 2 2026-02-24T19:17:25.147 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.145+0000 7f0d1a541300 15 client.4367.objecter _send_op 2 to 2.2 on osd.15 2026-02-24T19:17:25.147 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.145+0000 7f0d1a541300 1 -- 10.20.193.14:0/1638543867 --> v1:10.20.193.195:6809/3316970219 -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e29) -- 0x56400764ac00 con 0x5640075edf20 2026-02-24T19:17:25.147 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.145+0000 7f0d1a541300 20 client.4367.objecter put_session s=0x5640072f7280 osd=15 4 2026-02-24T19:17:25.147 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.145+0000 7f0d1a541300 5 client.4367.objecter 1 in flight 2026-02-24T19:17:25.160 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.158+0000 7f0d13fff640 1 -- 10.20.193.14:0/1638543867 <== osd.15 v1:10.20.193.195:6809/3316970219 3 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (unknown 1209997940 0 0) 0x7f0d00004500 con 0x5640075edf20 2026-02-24T19:17:25.160 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.158+0000 7f0d13fff640 10 client.4367.objecter ms_dispatch2 0x56400739ad50 osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:17:25.160 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.158+0000 7f0d13fff640 10 client.4367.objecter in handle_osd_op_reply 2026-02-24T19:17:25.160 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.158+0000 7f0d13fff640 7 client.4367.objecter handle_osd_op_reply 2 ondisk uv 0 in 2.2 attempt 0 2026-02-24T19:17:25.160 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.158+0000 7f0d13fff640 10 client.4367.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:17:25.160 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.158+0000 7f0d13fff640 10 client.4367.objecter op 0 rval 0 len 0 2026-02-24T19:17:25.160 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.158+0000 7f0d13fff640 15 client.4367.objecter handle_osd_op_reply completed tid 2 2026-02-24T19:17:25.160 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.158+0000 7f0d13fff640 15 client.4367.objecter _finish_op 2 2026-02-24T19:17:25.160 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.158+0000 7f0d13fff640 20 client.4367.objecter put_session s=0x5640072f7280 osd=15 4 2026-02-24T19:17:25.160 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.158+0000 7f0d13fff640 15 client.4367.objecter _session_op_remove 15 2 2026-02-24T19:17:25.161 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.158+0000 7f0d13fff640 5 client.4367.objecter 0 in flight 2026-02-24T19:17:25.161 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.158+0000 7f0d1a541300 10 client.4367.objecter _op_submit op 0x564007649830 2026-02-24T19:17:25.161 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.158+0000 7f0d1a541300 20 client.4367.objecter _calc_target epoch 29 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:17:25.161 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.158+0000 7f0d1a541300 20 client.4367.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-24T19:17:25.161 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.158+0000 7f0d1a541300 10 client.4367.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [15,10] primary 15 2026-02-24T19:17:25.161 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.158+0000 7f0d1a541300 10 client.4367.objecter chose random osd.10 of [15,10] 2026-02-24T19:17:25.161 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.158+0000 7f0d1a541300 20 client.4367.objecter _get_session s=0x564007649ce0 osd=10 3 2026-02-24T19:17:25.161 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.158+0000 7f0d1a541300 10 client.4367.objecter _op_submit oid rbd_info '@2' '@2' [read 0~0] tid 3 osd.10 2026-02-24T19:17:25.161 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.158+0000 7f0d1a541300 20 client.4367.objecter get_session s=0x564007649ce0 osd=10 3 2026-02-24T19:17:25.161 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.158+0000 7f0d1a541300 15 client.4367.objecter _session_op_assign 10 3 2026-02-24T19:17:25.161 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.158+0000 7f0d1a541300 15 client.4367.objecter _send_op 3 to 2.2 on osd.10 2026-02-24T19:17:25.161 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.158+0000 7f0d1a541300 1 -- 10.20.193.14:0/1638543867 --> v1:10.20.193.170:6808/983512563 -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e29) -- 0x56400764a790 con 0x56400764a360 2026-02-24T19:17:25.161 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.158+0000 7f0d1a541300 20 client.4367.objecter put_session s=0x564007649ce0 osd=10 4 2026-02-24T19:17:25.161 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.158+0000 7f0d1a541300 5 client.4367.objecter 1 in flight 2026-02-24T19:17:25.161 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.158+0000 7f0d18ff6640 10 monclient: get_auth_request con 0x56400764a360 auth_method 0 2026-02-24T19:17:25.162 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.161+0000 7f0d10ff9640 10 client.4367.objecter ms_handle_connect 0x56400764a360 2026-02-24T19:17:25.215 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.213+0000 7f0d18ff6640 1 -- 10.20.193.14:0/1638543867 <== osd.10 v1:10.20.193.170:6808/983512563 1 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (unknown 1229971576 0 0) 0x7f0d08003b40 con 0x56400764a360 2026-02-24T19:17:25.216 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.213+0000 7f0d18ff6640 10 client.4367.objecter ms_dispatch2 0x56400739ad50 osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:17:25.216 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.213+0000 7f0d18ff6640 10 client.4367.objecter in handle_osd_op_reply 2026-02-24T19:17:25.216 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.213+0000 7f0d18ff6640 7 client.4367.objecter handle_osd_op_reply 3 ondisk uv 0 in 2.2 attempt 0 2026-02-24T19:17:25.216 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.213+0000 7f0d18ff6640 10 client.4367.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:17:25.216 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.213+0000 7f0d18ff6640 10 client.4367.objecter op 0 rval 0 len 0 2026-02-24T19:17:25.216 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.213+0000 7f0d18ff6640 15 client.4367.objecter handle_osd_op_reply completed tid 3 2026-02-24T19:17:25.216 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.213+0000 7f0d18ff6640 15 client.4367.objecter _finish_op 3 2026-02-24T19:17:25.216 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.213+0000 7f0d18ff6640 20 client.4367.objecter put_session s=0x564007649ce0 osd=10 4 2026-02-24T19:17:25.216 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.213+0000 7f0d18ff6640 15 client.4367.objecter _session_op_remove 10 3 2026-02-24T19:17:25.217 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.213+0000 7f0d18ff6640 5 client.4367.objecter 0 in flight 2026-02-24T19:17:25.217 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.213+0000 7f0d127fc640 10 client.4367.objecter allocate_selfmanaged_snap; pool: 2 2026-02-24T19:17:25.217 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.213+0000 7f0d127fc640 10 client.4367.objecter pool_op_submit 4 2026-02-24T19:17:25.217 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.213+0000 7f0d127fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:25.217 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.213+0000 7f0d127fc640 1 -- 10.20.193.14:0/1638543867 --> v1:10.20.193.170:6789/0 -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f0cf4003110 con 0x56400756edc0 2026-02-24T19:17:25.289 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.288+0000 7f0cff7fe640 10 monclient: tick 2026-02-24T19:17:25.290 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.288+0000 7f0cff7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:17:25.290 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.288+0000 7f0cff7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:25.290 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.288+0000 7f0cff7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:25.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.818+0000 7f0d10ff9640 1 -- 10.20.193.14:0/1638543867 <== mon.2 v1:10.20.193.170:6789/0 12 ==== pool_op_reply(tid 4 (0) Success v30) ==== 55+0+0 (unknown 3956781517 0 0) 0x7f0d0c05c170 con 0x56400756edc0 2026-02-24T19:17:25.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.818+0000 7f0d10ff9640 10 client.4367.objecter ms_dispatch2 0x56400739ad50 pool_op_reply(tid 4 (0) Success v30) 2026-02-24T19:17:25.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.818+0000 7f0d10ff9640 10 client.4367.objecter handle_pool_op_reply pool_op_reply(tid 4 (0) Success v30) 2026-02-24T19:17:25.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.818+0000 7f0d10ff9640 10 client.4367.objecter have request 4 at 0x7f0cf40030a0 Op: create unmanaged snap 2026-02-24T19:17:25.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.818+0000 7f0d10ff9640 20 client.4367.objecter waiting for client to reach epoch 30 before calling back 2026-02-24T19:17:25.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.818+0000 7f0d10ff9640 10 client.4367.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:25.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.818+0000 7f0d10ff9640 10 monclient: _renew_subs 2026-02-24T19:17:25.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.818+0000 7f0d10ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:25.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.818+0000 7f0d10ff9640 1 -- 10.20.193.14:0/1638543867 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=30}) -- 0x5640074c90f0 con 0x56400756edc0 2026-02-24T19:17:25.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.818+0000 7f0d10ff9640 10 client.4367.objecter done 2026-02-24T19:17:25.823 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.820+0000 7f0d10ff9640 1 -- 10.20.193.14:0/1638543867 <== mon.2 v1:10.20.193.170:6789/0 13 ==== osd_map(30..30 src has 1..30) ==== 629+0+0 (unknown 3964734390 0 0) 0x7f0d0c05bc30 con 0x56400756edc0 2026-02-24T19:17:25.823 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.820+0000 7f0d10ff9640 10 client.4367.objecter ms_dispatch2 0x56400739ad50 osd_map(30..30 src has 1..30) 2026-02-24T19:17:25.823 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.820+0000 7f0d10ff9640 3 client.4367.objecter handle_osd_map got epochs [30,30] > 29 2026-02-24T19:17:25.823 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.820+0000 7f0d10ff9640 3 client.4367.objecter handle_osd_map decoding incremental epoch 30 2026-02-24T19:17:25.823 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.820+0000 7f0d10ff9640 20 client.4367.objecter dump_active .. 0 homeless 2026-02-24T19:17:25.823 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.820+0000 7f0d12ffd640 20 librados: queue_aio_write 0x564007645c60 completion 0x5640075791f0 write_seq 1 2026-02-24T19:17:25.823 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.820+0000 7f0d12ffd640 10 client.4367.objecter _op_submit op 0x7f0cf00063b0 2026-02-24T19:17:25.824 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.820+0000 7f0d12ffd640 20 client.4367.objecter _calc_target epoch 30 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:17:25.824 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.820+0000 7f0d12ffd640 20 client.4367.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-24T19:17:25.824 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.820+0000 7f0d12ffd640 10 client.4367.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [15,10] primary 15 2026-02-24T19:17:25.824 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.820+0000 7f0d12ffd640 20 client.4367.objecter _get_session s=0x5640072f7280 osd=15 3 2026-02-24T19:17:25.824 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.820+0000 7f0d12ffd640 10 client.4367.objecter _op_submit oid rbd_info '@2' '@2' [create,write 0~8 in=8b] tid 5 osd.15 2026-02-24T19:17:25.824 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.820+0000 7f0d12ffd640 20 client.4367.objecter get_session s=0x5640072f7280 osd=15 3 2026-02-24T19:17:25.824 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.820+0000 7f0d12ffd640 15 client.4367.objecter _session_op_assign 15 5 2026-02-24T19:17:25.824 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.820+0000 7f0d12ffd640 15 client.4367.objecter _send_op 5 to 2.2 on osd.15 2026-02-24T19:17:25.824 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.820+0000 7f0d12ffd640 1 -- 10.20.193.14:0/1638543867 --> v1:10.20.193.195:6809/3316970219 -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x7f0cf00068c0 con 0x5640075edf20 2026-02-24T19:17:25.824 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.820+0000 7f0d12ffd640 20 client.4367.objecter put_session s=0x5640072f7280 osd=15 4 2026-02-24T19:17:25.824 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.820+0000 7f0d12ffd640 5 client.4367.objecter 1 in flight 2026-02-24T19:17:25.943 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.941+0000 7f0d13fff640 1 -- 10.20.193.14:0/1638543867 <== osd.15 v1:10.20.193.195:6809/3316970219 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v30'1 uv1 ondisk = 0) ==== 194+0+0 (unknown 4267054912 0 0) 0x7f0d00004500 con 0x5640075edf20 2026-02-24T19:17:25.943 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.941+0000 7f0d13fff640 10 client.4367.objecter ms_dispatch2 0x56400739ad50 osd_op_reply(5 rbd_info [create,write 0~8] v30'1 uv1 ondisk = 0) 2026-02-24T19:17:25.943 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.941+0000 7f0d13fff640 10 client.4367.objecter in handle_osd_op_reply 2026-02-24T19:17:25.943 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.941+0000 7f0d13fff640 7 client.4367.objecter handle_osd_op_reply 5 ondisk uv 1 in 2.2 attempt 0 2026-02-24T19:17:25.943 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.941+0000 7f0d13fff640 10 client.4367.objecter op 0 rval 0 len 0 2026-02-24T19:17:25.943 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.941+0000 7f0d13fff640 10 client.4367.objecter op 1 rval 0 len 0 2026-02-24T19:17:25.943 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.941+0000 7f0d13fff640 15 client.4367.objecter handle_osd_op_reply completed tid 5 2026-02-24T19:17:25.944 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.941+0000 7f0d13fff640 15 client.4367.objecter _finish_op 5 2026-02-24T19:17:25.944 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.941+0000 7f0d13fff640 20 client.4367.objecter put_session s=0x5640072f7280 osd=15 4 2026-02-24T19:17:25.944 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.941+0000 7f0d13fff640 15 client.4367.objecter _session_op_remove 15 5 2026-02-24T19:17:25.944 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.941+0000 7f0d13fff640 5 client.4367.objecter 0 in flight 2026-02-24T19:17:25.944 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.941+0000 7f0d13fff640 20 librados: complete_aio_write 0x5640075791f0 2026-02-24T19:17:25.944 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.941+0000 7f0d127fc640 10 client.4367.objecter delete_selfmanaged_snap; pool: 2; snap: 2 2026-02-24T19:17:25.944 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.941+0000 7f0d127fc640 10 client.4367.objecter pool_op_submit 6 2026-02-24T19:17:25.944 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.941+0000 7f0d127fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:25.944 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:25.941+0000 7f0d127fc640 1 -- 10.20.193.14:0/1638543867 --> v1:10.20.193.170:6789/0 -- pool_op(delete unmanaged snap pool 2 tid 6 name v30) -- 0x7f0cf40033b0 con 0x56400756edc0 2026-02-24T19:17:26.289 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.288+0000 7f0cff7fe640 10 monclient: tick 2026-02-24T19:17:26.290 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.288+0000 7f0cff7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:17:26.290 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.288+0000 7f0cff7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:26.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.856+0000 7f0d10ff9640 1 -- 10.20.193.14:0/1638543867 <== mon.2 v1:10.20.193.170:6789/0 14 ==== pool_op_reply(tid 6 (0) Success v31) ==== 43+0+0 (unknown 2354434040 0 0) 0x7f0d0c061850 con 0x56400756edc0 2026-02-24T19:17:26.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.856+0000 7f0d10ff9640 10 client.4367.objecter ms_dispatch2 0x56400739ad50 pool_op_reply(tid 6 (0) Success v31) 2026-02-24T19:17:26.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.856+0000 7f0d10ff9640 10 client.4367.objecter handle_pool_op_reply pool_op_reply(tid 6 (0) Success v31) 2026-02-24T19:17:26.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.856+0000 7f0d10ff9640 10 client.4367.objecter have request 6 at 0x7f0cf40030a0 Op: delete unmanaged snap 2026-02-24T19:17:26.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.856+0000 7f0d10ff9640 20 client.4367.objecter waiting for client to reach epoch 31 before calling back 2026-02-24T19:17:26.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.856+0000 7f0d10ff9640 10 client.4367.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:26.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.856+0000 7f0d10ff9640 10 monclient: _renew_subs 2026-02-24T19:17:26.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.856+0000 7f0d10ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:26.859 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.856+0000 7f0d10ff9640 1 -- 10.20.193.14:0/1638543867 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=31}) -- 0x7f0cf8001e10 con 0x56400756edc0 2026-02-24T19:17:26.859 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.856+0000 7f0d10ff9640 10 client.4367.objecter done 2026-02-24T19:17:26.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.858+0000 7f0d10ff9640 1 -- 10.20.193.14:0/1638543867 <== mon.2 v1:10.20.193.170:6789/0 15 ==== osd_map(31..31 src has 1..31) ==== 657+0+0 (unknown 2621941913 0 0) 0x7f0d0c059e70 con 0x56400756edc0 2026-02-24T19:17:26.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.858+0000 7f0d10ff9640 10 client.4367.objecter ms_dispatch2 0x56400739ad50 osd_map(31..31 src has 1..31) 2026-02-24T19:17:26.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.858+0000 7f0d10ff9640 3 client.4367.objecter handle_osd_map got epochs [31,31] > 30 2026-02-24T19:17:26.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.858+0000 7f0d10ff9640 3 client.4367.objecter handle_osd_map decoding incremental epoch 31 2026-02-24T19:17:26.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.858+0000 7f0d10ff9640 20 client.4367.objecter dump_active .. 0 homeless 2026-02-24T19:17:26.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.858+0000 7f0d12ffd640 20 librados: queue_aio_write 0x564007645c60 completion 0x7f0cf4001da0 write_seq 2 2026-02-24T19:17:26.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.858+0000 7f0d12ffd640 10 client.4367.objecter _op_submit op 0x7f0cf00063b0 2026-02-24T19:17:26.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.858+0000 7f0d12ffd640 20 client.4367.objecter _calc_target epoch 31 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:17:26.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.858+0000 7f0d12ffd640 20 client.4367.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-24T19:17:26.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.858+0000 7f0d12ffd640 10 client.4367.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [15,10] primary 15 2026-02-24T19:17:26.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.858+0000 7f0d12ffd640 20 client.4367.objecter _get_session s=0x5640072f7280 osd=15 3 2026-02-24T19:17:26.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.858+0000 7f0d12ffd640 10 client.4367.objecter _op_submit oid rbd_info '@2' '@2' [write 0~19 in=19b] tid 7 osd.15 2026-02-24T19:17:26.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.858+0000 7f0d12ffd640 20 client.4367.objecter get_session s=0x5640072f7280 osd=15 3 2026-02-24T19:17:26.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.858+0000 7f0d12ffd640 15 client.4367.objecter _session_op_assign 15 7 2026-02-24T19:17:26.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.858+0000 7f0d12ffd640 15 client.4367.objecter _send_op 7 to 2.2 on osd.15 2026-02-24T19:17:26.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.858+0000 7f0d12ffd640 1 -- 10.20.193.14:0/1638543867 --> v1:10.20.193.195:6809/3316970219 -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x7f0cf0006df0 con 0x5640075edf20 2026-02-24T19:17:26.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.858+0000 7f0d12ffd640 20 client.4367.objecter put_session s=0x5640072f7280 osd=15 4 2026-02-24T19:17:26.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.858+0000 7f0d12ffd640 5 client.4367.objecter 1 in flight 2026-02-24T19:17:26.968 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.966+0000 7f0d13fff640 1 -- 10.20.193.14:0/1638543867 <== osd.15 v1:10.20.193.195:6809/3316970219 5 ==== osd_op_reply(7 rbd_info [write 0~19] v31'2 uv2 ondisk = 0) ==== 152+0+0 (unknown 488379212 0 0) 0x7f0d00004500 con 0x5640075edf20 2026-02-24T19:17:26.969 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.966+0000 7f0d13fff640 10 client.4367.objecter ms_dispatch2 0x56400739ad50 osd_op_reply(7 rbd_info [write 0~19] v31'2 uv2 ondisk = 0) 2026-02-24T19:17:26.969 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.966+0000 7f0d13fff640 10 client.4367.objecter in handle_osd_op_reply 2026-02-24T19:17:26.969 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.966+0000 7f0d13fff640 7 client.4367.objecter handle_osd_op_reply 7 ondisk uv 2 in 2.2 attempt 0 2026-02-24T19:17:26.969 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.966+0000 7f0d13fff640 10 client.4367.objecter op 0 rval 0 len 0 2026-02-24T19:17:26.969 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.966+0000 7f0d13fff640 15 client.4367.objecter handle_osd_op_reply completed tid 7 2026-02-24T19:17:26.969 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.966+0000 7f0d13fff640 15 client.4367.objecter _finish_op 7 2026-02-24T19:17:26.969 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.966+0000 7f0d13fff640 20 client.4367.objecter put_session s=0x5640072f7280 osd=15 4 2026-02-24T19:17:26.969 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.966+0000 7f0d13fff640 15 client.4367.objecter _session_op_remove 15 7 2026-02-24T19:17:26.969 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.966+0000 7f0d13fff640 5 client.4367.objecter 0 in flight 2026-02-24T19:17:26.969 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.966+0000 7f0d13fff640 20 librados: complete_aio_write 0x7f0cf4001da0 2026-02-24T19:17:26.970 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.966+0000 7f0d1a541300 10 librados: watch_flush enter 2026-02-24T19:17:26.970 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.966+0000 7f0d1a541300 10 librados: watch_flush exit 2026-02-24T19:17:26.970 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.966+0000 7f0d1a541300 10 client.4367.objecter close_session for osd.10 2026-02-24T19:17:26.970 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.966+0000 7f0d1a541300 1 -- 10.20.193.14:0/1638543867 >> v1:10.20.193.170:6808/983512563 conn(0x56400764a360 legacy=0x564007645dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:26.970 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.966+0000 7f0d1a541300 20 client.4367.objecter put_session s=0x564007649ce0 osd=10 1 2026-02-24T19:17:26.970 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.966+0000 7f0d1a541300 10 client.4367.objecter close_session for osd.15 2026-02-24T19:17:26.970 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.966+0000 7f0d1a541300 1 -- 10.20.193.14:0/1638543867 >> v1:10.20.193.195:6809/3316970219 conn(0x5640075edf20 legacy=0x56400760e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:26.970 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.966+0000 7f0d1a541300 20 client.4367.objecter put_session s=0x5640072f7280 osd=15 1 2026-02-24T19:17:26.970 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.966+0000 7f0d1a541300 20 client.4367.objecter shutdown clearing up homeless session... 2026-02-24T19:17:26.970 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.966+0000 7f0d1a541300 10 client.4367.objecter successfully canceled tick 2026-02-24T19:17:26.970 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.966+0000 7f0d1a541300 1 -- 10.20.193.14:0/1638543867 >> v1:10.20.193.14:6800/4014096310 conn(0x7f0cf80764c0 legacy=0x7f0cf8096970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:26.970 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.966+0000 7f0d1a541300 10 monclient: shutdown 2026-02-24T19:17:26.971 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.966+0000 7f0d1a541300 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:26.971 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.966+0000 7f0d1a541300 1 -- 10.20.193.14:0/1638543867 >> v1:10.20.193.170:6789/0 conn(0x56400756edc0 legacy=0x564007568bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:26.971 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.966+0000 7f0d1a27f640 1 -- 10.20.193.14:0/1638543867 reap_dead start 2026-02-24T19:17:26.971 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.966+0000 7f0d1a541300 1 -- 10.20.193.14:0/1638543867 shutdown_connections 2026-02-24T19:17:26.971 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.966+0000 7f0d1a541300 1 -- 10.20.193.14:0/1638543867 >> 10.20.193.14:0/1638543867 conn(0x5640074cfed0 msgr2=0x5640074cb650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:26.971 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.966+0000 7f0d1a541300 1 -- 10.20.193.14:0/1638543867 shutdown_connections 2026-02-24T19:17:26.971 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.966+0000 7f0d1a541300 1 -- 10.20.193.14:0/1638543867 wait complete. 2026-02-24T19:17:26.971 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:26.966+0000 7f0d1a541300 1 librados: shutdown 2026-02-24T19:17:26.972 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-24T19:17:26.973 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-24T19:17:26.974 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-24T19:17:27.081 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.079+0000 7f54900a7640 10 monclient: get_monmap_and_config 2026-02-24T19:17:27.081 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.079+0000 7f54900a7640 10 monclient: build_initial_monmap 2026-02-24T19:17:27.081 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.079+0000 7f54900a7640 10 monclient: monmap: 2026-02-24T19:17:27.081 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:27.081 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:27.081 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:27.080367+0000 2026-02-24T19:17:27.081 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:27.080367+0000 2026-02-24T19:17:27.081 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:27.081 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:27.082 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:27.082 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:27.082 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:27.082 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:27.084 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.080+0000 7f54900a7640 1 Processor -- start 2026-02-24T19:17:27.084 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.080+0000 7f54900a7640 1 -- start start 2026-02-24T19:17:27.084 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.080+0000 7f54900a7640 10 monclient: init 2026-02-24T19:17:27.084 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.080+0000 7f54900a7640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:27.084 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.080+0000 7f54900a7640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:27.084 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.080+0000 7f54900a7640 10 monclient(hunting): picked mon.noname-c con 0x7f5488157780 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:27.085 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.080+0000 7f54900a7640 10 monclient(hunting): picked mon.noname-a con 0x7f5488157b50 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:27.085 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.080+0000 7f54900a7640 10 monclient(hunting): picked mon.noname-b con 0x7f5488164d00 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:27.085 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.080+0000 7f54900a7640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f548805de70 con 0x7f5488157b50 2026-02-24T19:17:27.085 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.080+0000 7f54900a7640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5488055b20 con 0x7f5488164d00 2026-02-24T19:17:27.085 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.080+0000 7f54900a7640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5488055e00 con 0x7f5488157780 2026-02-24T19:17:27.085 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.080+0000 7f54900a7640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:27.085 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.080+0000 7f54900a7640 10 monclient(hunting): authenticate will time out at 3621.761849s 2026-02-24T19:17:27.085 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.081+0000 7f548d61b640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f5488157b50 0x7f54881645f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:44540/0 (socket says 10.20.193.14:44540) 2026-02-24T19:17:27.085 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.081+0000 7f548d61b640 1 -- 10.20.193.14:0/684255149 learned_addr learned my addr 10.20.193.14:0/684255149 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:27.085 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.082+0000 7f548ce1a640 1 -- 10.20.193.14:0/684255149 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1826841480 0 0) 0x7f548805de70 con 0x7f5488157b50 2026-02-24T19:17:27.085 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.082+0000 7f548ce1a640 10 monclient(hunting): _negotiate 2026-02-24T19:17:27.085 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.082+0000 7f548ce1a640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:27.086 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.082+0000 7f548ce1a640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:27.086 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.082+0000 7f548ce1a640 10 monclient(hunting): my global_id is 4368 2026-02-24T19:17:27.086 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.082+0000 7f548ce1a640 1 -- 10.20.193.14:0/684255149 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5470003610 con 0x7f5488157b50 2026-02-24T19:17:27.086 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.083+0000 7f548ce1a640 1 -- 10.20.193.14:0/684255149 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2701357516 0 0) 0x7f5488055b20 con 0x7f5488164d00 2026-02-24T19:17:27.086 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.083+0000 7f548ce1a640 10 monclient(hunting): _negotiate 2026-02-24T19:17:27.086 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.083+0000 7f548ce1a640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:27.086 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.083+0000 7f548ce1a640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:27.086 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.083+0000 7f548ce1a640 10 monclient(hunting): my global_id is 4363 2026-02-24T19:17:27.086 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.083+0000 7f548ce1a640 1 -- 10.20.193.14:0/684255149 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f548805de70 con 0x7f5488164d00 2026-02-24T19:17:27.091 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.083+0000 7f548ce1a640 1 -- 10.20.193.14:0/684255149 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2480777820 0 0) 0x7f5488055e00 con 0x7f5488157780 2026-02-24T19:17:27.091 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.083+0000 7f548ce1a640 10 monclient(hunting): _negotiate 2026-02-24T19:17:27.091 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.083+0000 7f548ce1a640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:27.091 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.083+0000 7f548ce1a640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:27.091 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.083+0000 7f548ce1a640 10 monclient(hunting): my global_id is 4373 2026-02-24T19:17:27.091 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.083+0000 7f548ce1a640 1 -- 10.20.193.14:0/684255149 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5488055b20 con 0x7f5488157780 2026-02-24T19:17:27.092 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.084+0000 7f548ce1a640 1 -- 10.20.193.14:0/684255149 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1535057050 0 0) 0x7f5470003610 con 0x7f5488157b50 2026-02-24T19:17:27.092 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.084+0000 7f548ce1a640 1 -- 10.20.193.14:0/684255149 >> v1:10.20.193.170:6789/0 conn(0x7f5488157780 legacy=0x7f5488056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:27.092 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.084+0000 7f548ce1a640 1 -- 10.20.193.14:0/684255149 >> v1:10.20.193.44:6789/0 conn(0x7f5488164d00 legacy=0x7f54881c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:27.092 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.084+0000 7f548ce1a640 10 monclient: _finish_hunting 0 2026-02-24T19:17:27.092 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.084+0000 7f548ce1a640 1 monclient: found mon.noname-a 2026-02-24T19:17:27.092 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.084+0000 7f548ce1a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:27.092 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.084+0000 7f548ce1a640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:17:27.092 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.084+0000 7f548ce1a640 1 -- 10.20.193.14:0/684255149 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54880560e0 con 0x7f5488157b50 2026-02-24T19:17:27.092 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.084+0000 7f548ce1a640 10 monclient: _finish_auth 0 2026-02-24T19:17:27.092 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.084+0000 7f548ce1a640 10 monclient: _check_auth_tickets 2026-02-24T19:17:27.092 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.084+0000 7f548ce1a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:27.093 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.084+0000 7f548ce1a640 1 -- 10.20.193.14:0/684255149 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f547c002df0 con 0x7f5488157b50 2026-02-24T19:17:27.093 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.084+0000 7f548ce1a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:27.093 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.084+0000 7f548ce1a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:27.093 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.084+0000 7f548ce1a640 10 monclient: dump: 2026-02-24T19:17:27.093 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:27.093 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:27.093 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:27.093 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:27.093 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:27.093 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:27.093 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:27.094 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:27.094 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:27.094 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:27.094 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.084+0000 7f54900a7640 5 monclient: authenticate success, global_id 4368 2026-02-24T19:17:27.094 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.084+0000 7f54900a7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:27.094 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.085+0000 7f548ce1a640 1 -- 10.20.193.14:0/684255149 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f547c002fc0 con 0x7f5488157b50 2026-02-24T19:17:27.094 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.085+0000 7f548ce1a640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:27.094 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.085+0000 7f548ce1a640 1 -- 10.20.193.14:0/684255149 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f547c003400 con 0x7f5488157b50 2026-02-24T19:17:27.094 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.085+0000 7f548ce1a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:27.094 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.085+0000 7f548ce1a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:27.094 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.085+0000 7f548ce1a640 10 monclient: dump: 2026-02-24T19:17:27.094 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:27.095 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:27.095 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:27.095 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:27.095 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:27.095 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:27.095 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:27.095 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:27.095 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:27.095 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:27.095 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.085+0000 7f54900a7640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:27.095 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.085+0000 7f54900a7640 4 set_mon_vals no callback set 2026-02-24T19:17:27.095 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.085+0000 7f54900a7640 10 monclient: shutdown 2026-02-24T19:17:27.096 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.085+0000 7f54900a7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:27.096 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.085+0000 7f54900a7640 1 -- 10.20.193.14:0/684255149 >> v1:10.20.193.14:6789/0 conn(0x7f5488157b50 legacy=0x7f54881645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:27.096 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.085+0000 7f54900a7640 1 -- 10.20.193.14:0/684255149 shutdown_connections 2026-02-24T19:17:27.096 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.085+0000 7f54900a7640 1 -- 10.20.193.14:0/684255149 >> 10.20.193.14:0/684255149 conn(0x7f54880b2ef0 msgr2=0x7f54880b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:27.096 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.085+0000 7f54900a7640 1 -- 10.20.193.14:0/684255149 shutdown_connections 2026-02-24T19:17:27.096 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.085+0000 7f54900a7640 1 -- 10.20.193.14:0/684255149 wait complete. 2026-02-24T19:17:27.096 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.086+0000 7f54900a7640 10 monclient: build_initial_monmap 2026-02-24T19:17:27.096 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.086+0000 7f54900a7640 10 monclient: monmap: 2026-02-24T19:17:27.096 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:27.096 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:27.096 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:27.096 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:27.096 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:27.097 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:27.097 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:27.097 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:27.097 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:27.097 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:27.097 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.086+0000 7f54900a7640 1 librados: starting msgr at 2026-02-24T19:17:27.097 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.086+0000 7f54900a7640 1 librados: starting objecter 2026-02-24T19:17:27.097 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.086+0000 7f54900a7640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:27.097 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.086+0000 7f54900a7640 1 Processor -- start 2026-02-24T19:17:27.097 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.086+0000 7f54900a7640 1 -- start start 2026-02-24T19:17:27.097 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.086+0000 7f54900a7640 1 librados: setting wanted keys 2026-02-24T19:17:27.097 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.086+0000 7f54900a7640 1 librados: calling monclient init 2026-02-24T19:17:27.098 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.086+0000 7f54900a7640 10 monclient: init 2026-02-24T19:17:27.098 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.087+0000 7f54900a7640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:27.098 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.087+0000 7f54900a7640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:27.098 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.087+0000 7f54900a7640 10 monclient(hunting): picked mon.noname-c con 0x7f5488157780 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:27.098 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.087+0000 7f54900a7640 10 monclient(hunting): picked mon.noname-a con 0x7f5488157b50 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:27.098 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.087+0000 7f54900a7640 10 monclient(hunting): picked mon.noname-b con 0x7f5488164d00 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:27.098 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.087+0000 7f54900a7640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f548813b1b0 con 0x7f5488157b50 2026-02-24T19:17:27.098 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.087+0000 7f54900a7640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f548813b490 con 0x7f5488164d00 2026-02-24T19:17:27.098 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.087+0000 7f54900a7640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f548813b770 con 0x7f5488157780 2026-02-24T19:17:27.098 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.087+0000 7f54900a7640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:27.098 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.087+0000 7f54900a7640 10 monclient(hunting): authenticate will time out at 3621.768252s 2026-02-24T19:17:27.098 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.087+0000 7f548d61b640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f5488157b50 0x7f548813cc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:44550/0 (socket says 10.20.193.14:44550) 2026-02-24T19:17:27.099 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.087+0000 7f548d61b640 1 -- 10.20.193.14:0/470012013 learned_addr learned my addr 10.20.193.14:0/470012013 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:27.099 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.087+0000 7f54767fc640 10 client.?.objecter ms_handle_connect 0x7f5488157b50 2026-02-24T19:17:27.099 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.087+0000 7f54767fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:27.099 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.087+0000 7f54767fc640 10 client.?.objecter ms_handle_connect 0x7f5488164d00 2026-02-24T19:17:27.099 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.087+0000 7f54767fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:27.099 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.088+0000 7f54767fc640 10 client.?.objecter ms_handle_connect 0x7f5488157780 2026-02-24T19:17:27.099 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.088+0000 7f54767fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:27.099 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.088+0000 7f54767fc640 1 -- 10.20.193.14:0/470012013 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 602568252 0 0) 0x7f548813b1b0 con 0x7f5488157b50 2026-02-24T19:17:27.099 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.088+0000 7f54767fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:27.099 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.088+0000 7f54767fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:27.099 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.088+0000 7f54767fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:27.099 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.088+0000 7f54767fc640 10 monclient(hunting): my global_id is 4371 2026-02-24T19:17:27.100 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.088+0000 7f54767fc640 1 -- 10.20.193.14:0/470012013 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5458003610 con 0x7f5488157b50 2026-02-24T19:17:27.100 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.088+0000 7f54767fc640 1 -- 10.20.193.14:0/470012013 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1837107295 0 0) 0x7f548813b490 con 0x7f5488164d00 2026-02-24T19:17:27.100 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.088+0000 7f54767fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:27.100 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.088+0000 7f54767fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:27.100 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.088+0000 7f54767fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:27.100 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.088+0000 7f54767fc640 10 monclient(hunting): my global_id is 4366 2026-02-24T19:17:27.100 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.088+0000 7f54767fc640 1 -- 10.20.193.14:0/470012013 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f548813b1b0 con 0x7f5488164d00 2026-02-24T19:17:27.100 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.089+0000 7f54767fc640 1 -- 10.20.193.14:0/470012013 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2195002663 0 0) 0x7f548813b770 con 0x7f5488157780 2026-02-24T19:17:27.100 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.089+0000 7f54767fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:27.100 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.089+0000 7f54767fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:27.100 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.089+0000 7f54767fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:27.100 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.089+0000 7f54767fc640 10 monclient(hunting): my global_id is 4376 2026-02-24T19:17:27.101 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.089+0000 7f54767fc640 1 -- 10.20.193.14:0/470012013 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f548813b490 con 0x7f5488157780 2026-02-24T19:17:27.104 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.091+0000 7f54767fc640 1 -- 10.20.193.14:0/470012013 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2668072654 0 0) 0x7f548813b1b0 con 0x7f5488164d00 2026-02-24T19:17:27.104 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.091+0000 7f54767fc640 1 -- 10.20.193.14:0/470012013 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f548813b770 con 0x7f5488164d00 2026-02-24T19:17:27.104 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.091+0000 7f54767fc640 1 -- 10.20.193.14:0/470012013 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f54840032f0 con 0x7f5488164d00 2026-02-24T19:17:27.104 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.091+0000 7f54767fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:27.104 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.091+0000 7f54767fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:27.105 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.091+0000 7f54767fc640 10 monclient(hunting): dump: 2026-02-24T19:17:27.105 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:27.105 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:27.105 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:27.105 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:27.105 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:27.105 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:27.105 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:27.105 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:27.105 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:27.105 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:27.106 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.091+0000 7f54767fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:27.106 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.091+0000 7f54767fc640 1 -- 10.20.193.14:0/470012013 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 712198283 0 0) 0x7f5458003610 con 0x7f5488157b50 2026-02-24T19:17:27.106 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.091+0000 7f54767fc640 1 -- 10.20.193.14:0/470012013 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f548813b1b0 con 0x7f5488157b50 2026-02-24T19:17:27.106 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.091+0000 7f54767fc640 1 -- 10.20.193.14:0/470012013 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f547c003310 con 0x7f5488157b50 2026-02-24T19:17:27.106 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.091+0000 7f54767fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:27.106 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.091+0000 7f54767fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:27.106 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.091+0000 7f54767fc640 10 monclient(hunting): dump: 2026-02-24T19:17:27.106 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:27.106 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:27.106 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:27.106 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:27.107 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:27.107 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:27.107 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:27.107 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:27.107 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:27.107 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:27.107 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.092+0000 7f54767fc640 1 -- 10.20.193.14:0/470012013 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3668928615 0 0) 0x7f548813b490 con 0x7f5488157780 2026-02-24T19:17:27.107 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.092+0000 7f54767fc640 1 -- 10.20.193.14:0/470012013 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5458003610 con 0x7f5488157780 2026-02-24T19:17:27.107 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.092+0000 7f54767fc640 1 -- 10.20.193.14:0/470012013 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5478003060 con 0x7f5488157780 2026-02-24T19:17:27.107 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.092+0000 7f54767fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:27.107 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.092+0000 7f54767fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:27.107 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.092+0000 7f54767fc640 10 monclient(hunting): dump: 2026-02-24T19:17:27.108 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:27.108 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:27.108 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:27.108 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:27.108 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:27.108 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:27.108 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:27.108 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:27.108 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:27.108 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:27.108 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.093+0000 7f54767fc640 1 -- 10.20.193.14:0/470012013 <== mon.1 v1:10.20.193.44:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 352811780 0 0) 0x7f548813b770 con 0x7f5488164d00 2026-02-24T19:17:27.108 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.093+0000 7f54767fc640 1 -- 10.20.193.14:0/470012013 >> v1:10.20.193.170:6789/0 conn(0x7f5488157780 legacy=0x7f548813a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:27.109 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.093+0000 7f54767fc640 1 -- 10.20.193.14:0/470012013 >> v1:10.20.193.14:6789/0 conn(0x7f5488157b50 legacy=0x7f548813cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:27.109 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.093+0000 7f54767fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:27.109 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.093+0000 7f54767fc640 1 monclient: found mon.b 2026-02-24T19:17:27.109 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.093+0000 7f54767fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:27.109 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.093+0000 7f54767fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:27.109 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.093+0000 7f54767fc640 1 -- 10.20.193.14:0/470012013 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f548813ba50 con 0x7f5488164d00 2026-02-24T19:17:27.109 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.093+0000 7f54767fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:27.109 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.093+0000 7f54767fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:27.109 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.093+0000 7f54767fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:27.109 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.093+0000 7f54900a7640 5 monclient: authenticate success, global_id 4366 2026-02-24T19:17:27.109 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.093+0000 7f54900a7640 10 monclient: _renew_subs 2026-02-24T19:17:27.109 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.093+0000 7f54900a7640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:27.110 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.093+0000 7f54900a7640 1 -- 10.20.193.14:0/470012013 --> v1:10.20.193.44:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f548813bd30 con 0x7f5488164d00 2026-02-24T19:17:27.110 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.093+0000 7f54900a7640 10 client.4366.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:27.110 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.093+0000 7f54900a7640 10 monclient: _renew_subs 2026-02-24T19:17:27.110 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.093+0000 7f54900a7640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:27.110 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.093+0000 7f54900a7640 1 -- 10.20.193.14:0/470012013 --> v1:10.20.193.44:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f548813d350 con 0x7f5488164d00 2026-02-24T19:17:27.110 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.093+0000 7f54900a7640 1 librados: init done 2026-02-24T19:17:27.110 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.093+0000 7f54900a7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:27.110 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.093+0000 7f54900a7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:27.110 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.093+0000 7f54900a7640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:27.110 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.093+0000 7f54900a7640 1 -- 10.20.193.14:0/470012013 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f548805e250 con 0x7f5488164d00 2026-02-24T19:17:27.110 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.100+0000 7f54767fc640 1 -- 10.20.193.14:0/470012013 <== mon.1 v1:10.20.193.44:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5484003490 con 0x7f5488164d00 2026-02-24T19:17:27.110 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.100+0000 7f54767fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:27.111 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.100+0000 7f54767fc640 1 -- 10.20.193.14:0/470012013 <== mon.1 v1:10.20.193.44:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5484003b30 con 0x7f5488164d00 2026-02-24T19:17:27.111 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.100+0000 7f54767fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:27.111 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.100+0000 7f54767fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:27.111 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.100+0000 7f5477fff640 4 set_mon_vals no callback set 2026-02-24T19:17:27.111 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.100+0000 7f54767fc640 10 monclient: dump: 2026-02-24T19:17:27.111 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:27.111 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:27.111 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:27.111 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:27.111 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:27.111 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:27.111 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:27.111 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:27.112 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:27.112 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:27.112 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.102+0000 7f54767fc640 1 -- 10.20.193.14:0/470012013 <== mon.1 v1:10.20.193.44:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f548401c9e0 con 0x7f5488164d00 2026-02-24T19:17:27.112 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.102+0000 7f548de1c640 10 monclient: get_auth_request con 0x7f5458077eb0 auth_method 0 2026-02-24T19:17:27.112 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.103+0000 7f54767fc640 1 -- 10.20.193.14:0/470012013 <== mon.1 v1:10.20.193.44:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7f5484092220 con 0x7f5488164d00 2026-02-24T19:17:27.112 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.103+0000 7f54767fc640 10 client.4366.objecter ms_dispatch2 0x7f5488000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:27.112 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.103+0000 7f54767fc640 3 client.4366.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:27.112 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.103+0000 7f54767fc640 3 client.4366.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:27.112 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.103+0000 7f54767fc640 20 client.4366.objecter dump_active .. 0 homeless 2026-02-24T19:17:27.112 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.103+0000 7f54767fc640 10 client.4366.objecter ms_handle_connect 0x7f5458077eb0 2026-02-24T19:17:27.192 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.190+0000 7f54767fc640 1 -- 10.20.193.14:0/470012013 <== mon.1 v1:10.20.193.44:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f548805e250 con 0x7f5488164d00 2026-02-24T19:17:27.192 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.190+0000 7f54767fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:27.192 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.190+0000 7f54767fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:27.297 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.296+0000 7f54900a7640 10 start_mon_command cmd=[{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-24T19:17:27.297 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.296+0000 7f54900a7640 10 monclient: _send_command 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-24T19:17:27.297 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.296+0000 7f54900a7640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:27.297 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.296+0000 7f54900a7640 1 -- 10.20.193.14:0/470012013 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f54880b59d0 con 0x7f5488164d00 2026-02-24T19:17:27.303 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.302+0000 7f54767fc640 1 -- 10.20.193.14:0/470012013 <== mon.1 v1:10.20.193.44:6789/0 10 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v1) ==== 86+0+61 (unknown 4269106227 0 102270264) 0x7f548405cc50 con 0x7f5488164d00 2026-02-24T19:17:27.303 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.302+0000 7f54767fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-24T19:17:27.303 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.302+0000 7f54767fc640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:27.304 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:17:27.305 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.303+0000 7f54900a7640 10 librados: watch_flush enter 2026-02-24T19:17:27.305 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.303+0000 7f54900a7640 10 librados: watch_flush exit 2026-02-24T19:17:27.305 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.303+0000 7f54900a7640 20 client.4366.objecter shutdown clearing up homeless session... 2026-02-24T19:17:27.305 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.303+0000 7f54900a7640 10 client.4366.objecter successfully canceled tick 2026-02-24T19:17:27.305 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.303+0000 7f54900a7640 1 -- 10.20.193.14:0/470012013 >> v1:10.20.193.14:6800/4014096310 conn(0x7f5458077eb0 legacy=0x7f5458098360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:27.306 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.303+0000 7f54900a7640 10 monclient: shutdown 2026-02-24T19:17:27.306 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.303+0000 7f54900a7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:27.306 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.303+0000 7f54900a7640 1 -- 10.20.193.14:0/470012013 >> v1:10.20.193.44:6789/0 conn(0x7f5488164d00 legacy=0x7f5488160e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:27.306 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.303+0000 7f54900a7640 1 -- 10.20.193.14:0/470012013 shutdown_connections 2026-02-24T19:17:27.306 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.303+0000 7f54900a7640 1 -- 10.20.193.14:0/470012013 >> 10.20.193.14:0/470012013 conn(0x7f54880b2ef0 msgr2=0x7f54880b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:27.306 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.303+0000 7f54900a7640 1 -- 10.20.193.14:0/470012013 shutdown_connections 2026-02-24T19:17:27.306 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.303+0000 7f54900a7640 1 -- 10.20.193.14:0/470012013 wait complete. 2026-02-24T19:17:27.306 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.303+0000 7f54900a7640 1 librados: shutdown 2026-02-24T19:17:27.312 INFO:teuthology.orchestra.run.trial014.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2026-02-24T19:17:27.313 INFO:tasks.ceph_manager:config epoch is 1 2026-02-24T19:17:27.313 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-24T19:17:27.313 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-24T19:17:27.313 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-24T19:17:27.381 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.380+0000 7ffb217e0640 10 monclient: get_monmap_and_config 2026-02-24T19:17:27.381 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.380+0000 7ffb217e0640 10 monclient: build_initial_monmap 2026-02-24T19:17:27.381 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.380+0000 7ffb217e0640 10 monclient: monmap: 2026-02-24T19:17:27.382 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:27.382 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:27.382 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:27.380937+0000 2026-02-24T19:17:27.382 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:27.380937+0000 2026-02-24T19:17:27.382 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:27.382 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:27.382 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:27.382 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:27.382 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:27.382 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:27.384 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.380+0000 7ffb217e0640 1 Processor -- start 2026-02-24T19:17:27.384 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.380+0000 7ffb217e0640 1 -- start start 2026-02-24T19:17:27.384 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.380+0000 7ffb217e0640 10 monclient: init 2026-02-24T19:17:27.384 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.381+0000 7ffb217e0640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:27.384 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.381+0000 7ffb217e0640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:27.384 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.381+0000 7ffb217e0640 10 monclient(hunting): picked mon.noname-b con 0x7ffb1c058da0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:27.384 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.381+0000 7ffb217e0640 10 monclient(hunting): picked mon.noname-c con 0x7ffb1c0b0410 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:27.384 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.381+0000 7ffb217e0640 10 monclient(hunting): picked mon.noname-a con 0x7ffb1c1626a0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:27.384 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.381+0000 7ffb217e0640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb1c1655c0 con 0x7ffb1c1626a0 2026-02-24T19:17:27.385 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.381+0000 7ffb217e0640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb1c0b12b0 con 0x7ffb1c058da0 2026-02-24T19:17:27.385 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.381+0000 7ffb217e0640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb1c0b1590 con 0x7ffb1c0b0410 2026-02-24T19:17:27.385 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.381+0000 7ffb217e0640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:27.385 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.381+0000 7ffb217e0640 10 monclient(hunting): authenticate will time out at 3622.062357s 2026-02-24T19:17:27.385 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.381+0000 7ffb1affd640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7ffb1c058da0 0x7ffb1c1647a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:60720/0 (socket says 10.20.193.14:60720) 2026-02-24T19:17:27.385 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.381+0000 7ffb1affd640 1 -- 10.20.193.14:0/2937970535 learned_addr learned my addr 10.20.193.14:0/2937970535 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:27.385 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.381+0000 7ffb1a7fc640 1 --1- 10.20.193.14:0/2937970535 >> v1:10.20.193.170:6789/0 conn(0x7ffb1c0b0410 0x7ffb1c164eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:44782/0 (socket says 10.20.193.14:44782) 2026-02-24T19:17:27.389 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.383+0000 7ffb19ffb640 1 -- 10.20.193.14:0/2937970535 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1980691636 0 0) 0x7ffb1c0b12b0 con 0x7ffb1c058da0 2026-02-24T19:17:27.389 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.383+0000 7ffb19ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:27.389 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.383+0000 7ffb19ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:27.390 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.383+0000 7ffb19ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:27.390 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.383+0000 7ffb19ffb640 10 monclient(hunting): my global_id is 4369 2026-02-24T19:17:27.390 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.383+0000 7ffb19ffb640 1 -- 10.20.193.14:0/2937970535 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb08003610 con 0x7ffb1c058da0 2026-02-24T19:17:27.390 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.383+0000 7ffb19ffb640 1 -- 10.20.193.14:0/2937970535 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3065607920 0 0) 0x7ffb1c0b1590 con 0x7ffb1c0b0410 2026-02-24T19:17:27.390 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.383+0000 7ffb19ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:27.390 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.383+0000 7ffb19ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:27.390 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.383+0000 7ffb19ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:27.390 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.383+0000 7ffb19ffb640 10 monclient(hunting): my global_id is 4379 2026-02-24T19:17:27.390 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.383+0000 7ffb19ffb640 1 -- 10.20.193.14:0/2937970535 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb1c0b12b0 con 0x7ffb1c0b0410 2026-02-24T19:17:27.390 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.384+0000 7ffb19ffb640 1 -- 10.20.193.14:0/2937970535 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1232186843 0 0) 0x7ffb1c1655c0 con 0x7ffb1c1626a0 2026-02-24T19:17:27.390 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.384+0000 7ffb19ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:27.390 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.384+0000 7ffb19ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:27.391 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.384+0000 7ffb19ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:27.391 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.384+0000 7ffb19ffb640 10 monclient(hunting): my global_id is 4374 2026-02-24T19:17:27.391 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.384+0000 7ffb19ffb640 1 -- 10.20.193.14:0/2937970535 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb1c0b1590 con 0x7ffb1c1626a0 2026-02-24T19:17:27.391 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.385+0000 7ffb19ffb640 1 -- 10.20.193.14:0/2937970535 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2595458267 0 0) 0x7ffb1c0b12b0 con 0x7ffb1c0b0410 2026-02-24T19:17:27.391 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.385+0000 7ffb19ffb640 1 -- 10.20.193.14:0/2937970535 >> v1:10.20.193.44:6789/0 conn(0x7ffb1c058da0 legacy=0x7ffb1c1647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:27.391 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.385+0000 7ffb19ffb640 1 -- 10.20.193.14:0/2937970535 >> v1:10.20.193.14:6789/0 conn(0x7ffb1c1626a0 legacy=0x7ffb1c1c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:27.391 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.385+0000 7ffb19ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:27.391 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.385+0000 7ffb19ffb640 1 monclient: found mon.noname-c 2026-02-24T19:17:27.391 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.385+0000 7ffb19ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:27.391 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.385+0000 7ffb19ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.170:6789/0 2026-02-24T19:17:27.391 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.385+0000 7ffb19ffb640 1 -- 10.20.193.14:0/2937970535 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb1c0b1870 con 0x7ffb1c0b0410 2026-02-24T19:17:27.391 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.385+0000 7ffb19ffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:27.392 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.385+0000 7ffb19ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:27.392 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.385+0000 7ffb19ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:27.392 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.385+0000 7ffb19ffb640 1 -- 10.20.193.14:0/2937970535 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ffb04002df0 con 0x7ffb1c0b0410 2026-02-24T19:17:27.392 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.385+0000 7ffb19ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:27.392 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.385+0000 7ffb19ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:27.392 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.385+0000 7ffb19ffb640 10 monclient: dump: 2026-02-24T19:17:27.392 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:27.392 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:27.392 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:27.392 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:27.392 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:27.392 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:27.392 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:27.393 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:27.393 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:27.393 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:27.393 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.385+0000 7ffb217e0640 5 monclient: authenticate success, global_id 4379 2026-02-24T19:17:27.393 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.385+0000 7ffb217e0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:27.393 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.386+0000 7ffb19ffb640 1 -- 10.20.193.14:0/2937970535 <== mon.2 v1:10.20.193.170:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffb04002f90 con 0x7ffb1c0b0410 2026-02-24T19:17:27.393 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.386+0000 7ffb19ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:27.393 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.386+0000 7ffb19ffb640 1 -- 10.20.193.14:0/2937970535 <== mon.2 v1:10.20.193.170:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ffb040033d0 con 0x7ffb1c0b0410 2026-02-24T19:17:27.393 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.386+0000 7ffb19ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:27.393 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.386+0000 7ffb19ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:27.393 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.386+0000 7ffb19ffb640 10 monclient: dump: 2026-02-24T19:17:27.393 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:27.394 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:27.394 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:27.394 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:27.394 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:27.394 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:27.394 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:27.394 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:27.394 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:27.394 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:27.394 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.386+0000 7ffb217e0640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:27.394 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.386+0000 7ffb217e0640 4 set_mon_vals no callback set 2026-02-24T19:17:27.394 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.386+0000 7ffb217e0640 10 monclient: shutdown 2026-02-24T19:17:27.394 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.386+0000 7ffb217e0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:27.395 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.386+0000 7ffb217e0640 1 -- 10.20.193.14:0/2937970535 >> v1:10.20.193.170:6789/0 conn(0x7ffb1c0b0410 legacy=0x7ffb1c164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:27.395 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.386+0000 7ffb217e0640 1 -- 10.20.193.14:0/2937970535 shutdown_connections 2026-02-24T19:17:27.395 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.386+0000 7ffb217e0640 1 -- 10.20.193.14:0/2937970535 >> 10.20.193.14:0/2937970535 conn(0x7ffb1c0b65f0 msgr2=0x7ffb1c0b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:27.395 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.386+0000 7ffb217e0640 1 -- 10.20.193.14:0/2937970535 shutdown_connections 2026-02-24T19:17:27.395 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.386+0000 7ffb217e0640 1 -- 10.20.193.14:0/2937970535 wait complete. 2026-02-24T19:17:27.395 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.387+0000 7ffb217e0640 10 monclient: build_initial_monmap 2026-02-24T19:17:27.395 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.387+0000 7ffb217e0640 10 monclient: monmap: 2026-02-24T19:17:27.395 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:27.395 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:27.395 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:27.395 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:27.395 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:27.395 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:27.396 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:27.396 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:27.396 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:27.396 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:27.396 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.387+0000 7ffb217e0640 1 librados: starting msgr at 2026-02-24T19:17:27.396 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.387+0000 7ffb217e0640 1 librados: starting objecter 2026-02-24T19:17:27.396 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.387+0000 7ffb217e0640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:27.396 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.387+0000 7ffb217e0640 1 Processor -- start 2026-02-24T19:17:27.396 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.387+0000 7ffb217e0640 1 -- start start 2026-02-24T19:17:27.396 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.387+0000 7ffb217e0640 1 librados: setting wanted keys 2026-02-24T19:17:27.396 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.387+0000 7ffb217e0640 1 librados: calling monclient init 2026-02-24T19:17:27.396 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.387+0000 7ffb217e0640 10 monclient: init 2026-02-24T19:17:27.396 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.387+0000 7ffb217e0640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:27.397 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.387+0000 7ffb217e0640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:27.397 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.387+0000 7ffb217e0640 10 monclient(hunting): picked mon.noname-b con 0x7ffb1c058da0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:27.397 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.387+0000 7ffb217e0640 10 monclient(hunting): picked mon.noname-a con 0x7ffb1c0b0410 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:27.397 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.387+0000 7ffb217e0640 10 monclient(hunting): picked mon.noname-c con 0x7ffb1c1626a0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:27.397 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.387+0000 7ffb217e0640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb1c0b01a0 con 0x7ffb1c0b0410 2026-02-24T19:17:27.397 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.387+0000 7ffb217e0640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb1c164db0 con 0x7ffb1c058da0 2026-02-24T19:17:27.397 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.387+0000 7ffb217e0640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb1c149fe0 con 0x7ffb1c1626a0 2026-02-24T19:17:27.397 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.387+0000 7ffb217e0640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:27.397 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.387+0000 7ffb217e0640 10 monclient(hunting): authenticate will time out at 3622.068963s 2026-02-24T19:17:27.397 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.388+0000 7ffb1a7fc640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7ffb1c0b0410 0x7ffb1c138b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:44560/0 (socket says 10.20.193.14:44560) 2026-02-24T19:17:27.397 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.388+0000 7ffb1a7fc640 1 -- 10.20.193.14:0/1354901725 learned_addr learned my addr 10.20.193.14:0/1354901725 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:27.398 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.388+0000 7ffafb7fe640 10 client.?.objecter ms_handle_connect 0x7ffb1c0b0410 2026-02-24T19:17:27.398 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.388+0000 7ffafb7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:27.398 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.388+0000 7ffafb7fe640 10 client.?.objecter ms_handle_connect 0x7ffb1c058da0 2026-02-24T19:17:27.398 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.388+0000 7ffafb7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:27.398 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.388+0000 7ffafb7fe640 10 client.?.objecter ms_handle_connect 0x7ffb1c1626a0 2026-02-24T19:17:27.398 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.388+0000 7ffafb7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:27.401 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.389+0000 7ffafb7fe640 1 -- 10.20.193.14:0/1354901725 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3711023104 0 0) 0x7ffb1c164db0 con 0x7ffb1c058da0 2026-02-24T19:17:27.401 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.389+0000 7ffafb7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:27.401 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.389+0000 7ffafb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:27.401 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.389+0000 7ffafb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:27.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.389+0000 7ffafb7fe640 10 monclient(hunting): my global_id is 4372 2026-02-24T19:17:27.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.389+0000 7ffafb7fe640 1 -- 10.20.193.14:0/1354901725 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffae8003610 con 0x7ffb1c058da0 2026-02-24T19:17:27.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.389+0000 7ffafb7fe640 1 -- 10.20.193.14:0/1354901725 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3005563897 0 0) 0x7ffb1c0b01a0 con 0x7ffb1c0b0410 2026-02-24T19:17:27.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.389+0000 7ffafb7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:27.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.389+0000 7ffafb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:27.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.389+0000 7ffafb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:27.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.389+0000 7ffafb7fe640 10 monclient(hunting): my global_id is 4377 2026-02-24T19:17:27.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.389+0000 7ffafb7fe640 1 -- 10.20.193.14:0/1354901725 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb1c164db0 con 0x7ffb1c0b0410 2026-02-24T19:17:27.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.389+0000 7ffafb7fe640 1 -- 10.20.193.14:0/1354901725 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3693152304 0 0) 0x7ffb1c149fe0 con 0x7ffb1c1626a0 2026-02-24T19:17:27.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.389+0000 7ffafb7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:27.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.389+0000 7ffafb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:27.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.389+0000 7ffafb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:27.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.389+0000 7ffafb7fe640 10 monclient(hunting): my global_id is 4382 2026-02-24T19:17:27.403 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.389+0000 7ffafb7fe640 1 -- 10.20.193.14:0/1354901725 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb1c0b01a0 con 0x7ffb1c1626a0 2026-02-24T19:17:27.403 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.391+0000 7ffafb7fe640 1 -- 10.20.193.14:0/1354901725 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3847021220 0 0) 0x7ffae8003610 con 0x7ffb1c058da0 2026-02-24T19:17:27.403 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.391+0000 7ffafb7fe640 1 -- 10.20.193.14:0/1354901725 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffb1c149fe0 con 0x7ffb1c058da0 2026-02-24T19:17:27.403 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.391+0000 7ffafb7fe640 1 -- 10.20.193.14:0/1354901725 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ffb10003020 con 0x7ffb1c058da0 2026-02-24T19:17:27.403 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.391+0000 7ffafb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:27.403 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.391+0000 7ffafb7fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:27.403 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.391+0000 7ffafb7fe640 10 monclient(hunting): dump: 2026-02-24T19:17:27.403 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:27.403 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:27.403 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:27.403 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:27.403 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:27.404 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:27.404 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:27.404 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:27.404 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:27.404 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:27.404 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.391+0000 7ffafb7fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:27.404 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.391+0000 7ffafb7fe640 1 -- 10.20.193.14:0/1354901725 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3126714013 0 0) 0x7ffb1c0b01a0 con 0x7ffb1c1626a0 2026-02-24T19:17:27.404 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.391+0000 7ffafb7fe640 1 -- 10.20.193.14:0/1354901725 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffae8003610 con 0x7ffb1c1626a0 2026-02-24T19:17:27.404 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.392+0000 7ffafb7fe640 1 -- 10.20.193.14:0/1354901725 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2984382996 0 0) 0x7ffb1c164db0 con 0x7ffb1c0b0410 2026-02-24T19:17:27.404 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.392+0000 7ffafb7fe640 1 -- 10.20.193.14:0/1354901725 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffb1c0b01a0 con 0x7ffb1c0b0410 2026-02-24T19:17:27.404 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.392+0000 7ffafb7fe640 1 -- 10.20.193.14:0/1354901725 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ffb040032e0 con 0x7ffb1c0b0410 2026-02-24T19:17:27.404 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.392+0000 7ffafb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:27.405 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.392+0000 7ffafb7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:27.405 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.392+0000 7ffafb7fe640 10 monclient(hunting): dump: 2026-02-24T19:17:27.405 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:27.405 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:27.405 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:27.405 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:27.405 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:27.405 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:27.405 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:27.405 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:27.405 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:27.405 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:27.405 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.392+0000 7ffafb7fe640 1 -- 10.20.193.14:0/1354901725 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ffb0c003450 con 0x7ffb1c1626a0 2026-02-24T19:17:27.406 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.392+0000 7ffafb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:27.406 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.392+0000 7ffafb7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:27.406 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.392+0000 7ffafb7fe640 10 monclient(hunting): dump: 2026-02-24T19:17:27.406 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:27.406 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:27.406 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:27.406 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:27.406 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:27.406 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:27.406 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:27.406 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:27.406 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:27.406 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:27.407 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.393+0000 7ffafb7fe640 1 -- 10.20.193.14:0/1354901725 <== mon.1 v1:10.20.193.44:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2040142691 0 0) 0x7ffb1c149fe0 con 0x7ffb1c058da0 2026-02-24T19:17:27.407 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.393+0000 7ffafb7fe640 1 -- 10.20.193.14:0/1354901725 >> v1:10.20.193.170:6789/0 conn(0x7ffb1c1626a0 legacy=0x7ffb1c14d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:27.407 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.393+0000 7ffafb7fe640 1 -- 10.20.193.14:0/1354901725 >> v1:10.20.193.14:6789/0 conn(0x7ffb1c0b0410 legacy=0x7ffb1c138b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:27.407 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.393+0000 7ffafb7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:17:27.407 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.393+0000 7ffafb7fe640 1 monclient: found mon.b 2026-02-24T19:17:27.407 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.393+0000 7ffafb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:27.407 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.393+0000 7ffafb7fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:27.407 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.393+0000 7ffafb7fe640 1 -- 10.20.193.14:0/1354901725 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb1c14a2c0 con 0x7ffb1c058da0 2026-02-24T19:17:27.407 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.393+0000 7ffafb7fe640 10 monclient: _finish_auth 0 2026-02-24T19:17:27.407 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.393+0000 7ffafb7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:17:27.407 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.393+0000 7ffafb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:27.407 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.393+0000 7ffb217e0640 5 monclient: authenticate success, global_id 4372 2026-02-24T19:17:27.408 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.393+0000 7ffb217e0640 10 monclient: _renew_subs 2026-02-24T19:17:27.408 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.393+0000 7ffb217e0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:27.408 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.393+0000 7ffb217e0640 1 -- 10.20.193.14:0/1354901725 --> v1:10.20.193.44:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ffb1c14a5a0 con 0x7ffb1c058da0 2026-02-24T19:17:27.408 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.393+0000 7ffb217e0640 10 client.4372.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:27.408 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.393+0000 7ffb217e0640 10 monclient: _renew_subs 2026-02-24T19:17:27.408 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.393+0000 7ffb217e0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:27.408 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.393+0000 7ffb217e0640 1 -- 10.20.193.14:0/1354901725 --> v1:10.20.193.44:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ffb1c14ab60 con 0x7ffb1c058da0 2026-02-24T19:17:27.408 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.393+0000 7ffb217e0640 1 librados: init done 2026-02-24T19:17:27.408 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.394+0000 7ffb217e0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:27.408 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.394+0000 7ffb217e0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:27.408 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.394+0000 7ffb217e0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:27.408 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.394+0000 7ffb217e0640 1 -- 10.20.193.14:0/1354901725 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb1c0a85d0 con 0x7ffb1c058da0 2026-02-24T19:17:27.410 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.401+0000 7ffafb7fe640 1 -- 10.20.193.14:0/1354901725 <== mon.1 v1:10.20.193.44:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffb100048d0 con 0x7ffb1c058da0 2026-02-24T19:17:27.410 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.401+0000 7ffafb7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:27.410 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.401+0000 7ffafb7fe640 1 -- 10.20.193.14:0/1354901725 <== mon.1 v1:10.20.193.44:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ffb10004a80 con 0x7ffb1c058da0 2026-02-24T19:17:27.410 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.401+0000 7ffafb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:27.410 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.402+0000 7ffafb7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:27.410 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.402+0000 7ffafb7fe640 10 monclient: dump: 2026-02-24T19:17:27.411 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:27.411 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:27.411 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:27.411 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:27.411 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:27.411 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:27.411 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:27.411 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:27.411 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:27.411 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:27.411 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.402+0000 7ffb197fa640 4 set_mon_vals no callback set 2026-02-24T19:17:27.411 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.402+0000 7ffafb7fe640 1 -- 10.20.193.14:0/1354901725 <== mon.1 v1:10.20.193.44:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7ffb1001d8f0 con 0x7ffb1c058da0 2026-02-24T19:17:27.411 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.403+0000 7ffb1a7fc640 10 monclient: get_auth_request con 0x7ffae8077e40 auth_method 0 2026-02-24T19:17:27.412 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.403+0000 7ffafb7fe640 10 client.4372.objecter ms_handle_connect 0x7ffae8077e40 2026-02-24T19:17:27.412 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.404+0000 7ffafb7fe640 1 -- 10.20.193.14:0/1354901725 <== mon.1 v1:10.20.193.44:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7ffb10093100 con 0x7ffb1c058da0 2026-02-24T19:17:27.412 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.404+0000 7ffafb7fe640 10 client.4372.objecter ms_dispatch2 0x7ffb1c000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:27.412 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.404+0000 7ffafb7fe640 3 client.4372.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:27.412 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.404+0000 7ffafb7fe640 3 client.4372.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:27.412 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.404+0000 7ffafb7fe640 20 client.4372.objecter dump_active .. 0 homeless 2026-02-24T19:17:27.489 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.488+0000 7ffafb7fe640 1 -- 10.20.193.14:0/1354901725 <== mon.1 v1:10.20.193.44:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7ffb1005db30 con 0x7ffb1c058da0 2026-02-24T19:17:27.489 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.488+0000 7ffafb7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:27.489 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.488+0000 7ffafb7fe640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:27.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.628+0000 7ffb217e0640 10 start_mon_command cmd=[{"prefix": "mgr dump", "format": "json"}] 2026-02-24T19:17:27.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.628+0000 7ffb217e0640 10 monclient: _send_command 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-24T19:17:27.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.628+0000 7ffb217e0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:27.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.628+0000 7ffb217e0640 1 -- 10.20.193.14:0/1354901725 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7ffb1c0a82f0 con 0x7ffb1c058da0 2026-02-24T19:17:27.674 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.673+0000 7ffafb7fe640 1 -- 10.20.193.14:0/1354901725 <== mon.1 v1:10.20.193.44:6789/0 10 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+193212 (unknown 481731318 0 3612726360) 0x7ffb1005d430 con 0x7ffb1c058da0 2026-02-24T19:17:27.675 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.673+0000 7ffafb7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-24T19:17:27.675 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.673+0000 7ffafb7fe640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:27.678 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:17:27.682 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.676+0000 7ffb217e0640 10 librados: watch_flush enter 2026-02-24T19:17:27.682 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.676+0000 7ffb217e0640 10 librados: watch_flush exit 2026-02-24T19:17:27.682 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.676+0000 7ffb217e0640 20 client.4372.objecter shutdown clearing up homeless session... 2026-02-24T19:17:27.682 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.676+0000 7ffb217e0640 10 client.4372.objecter successfully canceled tick 2026-02-24T19:17:27.682 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.676+0000 7ffb217e0640 1 -- 10.20.193.14:0/1354901725 >> v1:10.20.193.14:6800/4014096310 conn(0x7ffae8077e40 legacy=0x7ffae80982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:27.682 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.676+0000 7ffb217e0640 10 monclient: shutdown 2026-02-24T19:17:27.682 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.676+0000 7ffb217e0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:27.682 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.676+0000 7ffb217e0640 1 -- 10.20.193.14:0/1354901725 >> v1:10.20.193.44:6789/0 conn(0x7ffb1c058da0 legacy=0x7ffb1c1646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:27.682 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.676+0000 7ffb217e0640 1 -- 10.20.193.14:0/1354901725 shutdown_connections 2026-02-24T19:17:27.682 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.676+0000 7ffb217e0640 1 -- 10.20.193.14:0/1354901725 >> 10.20.193.14:0/1354901725 conn(0x7ffb1c0b65f0 msgr2=0x7ffb1c0a8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:27.683 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.676+0000 7ffb217e0640 1 -- 10.20.193.14:0/1354901725 shutdown_connections 2026-02-24T19:17:27.683 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.676+0000 7ffb217e0640 1 -- 10.20.193.14:0/1354901725 wait complete. 2026-02-24T19:17:27.683 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.676+0000 7ffb217e0640 1 librados: shutdown 2026-02-24T19:17:27.687 INFO:teuthology.orchestra.run.trial014.stdout:{"epoch":5,"flags":0,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6800","nonce":4014096310}]},"active_addr":"10.20.193.14:6800/4014096310","active_change":"2026-02-24T19:16:43.386468+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[{"gid":4107,"name":"x","mgr_features":4544132024016699391,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self certificates generated and signed by cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.5","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"how frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self certificates generated and signed by cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.5","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"how frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.14:0","nonce":2018377893}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.14:0","nonce":542625497}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.14:0","nonce":2659802435}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.14:0","nonce":3804227684}]}]} 2026-02-24T19:17:27.696 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-24T19:17:27.696 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-24T19:17:27.697 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-24T19:17:27.795 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.794+0000 7fdfff577640 10 monclient: get_monmap_and_config 2026-02-24T19:17:27.795 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.794+0000 7fdfff577640 10 monclient: build_initial_monmap 2026-02-24T19:17:27.795 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.794+0000 7fdfff577640 10 monclient: monmap: 2026-02-24T19:17:27.796 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:27.796 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:27.796 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:27.794946+0000 2026-02-24T19:17:27.796 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:27.794946+0000 2026-02-24T19:17:27.796 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:27.796 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:27.796 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:27.796 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:27.796 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:27.796 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:27.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.794+0000 7fdfff577640 1 Processor -- start 2026-02-24T19:17:27.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.794+0000 7fdfff577640 1 -- start start 2026-02-24T19:17:27.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.794+0000 7fdfff577640 10 monclient: init 2026-02-24T19:17:27.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.795+0000 7fdfff577640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:27.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.795+0000 7fdfff577640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:27.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.795+0000 7fdfff577640 10 monclient(hunting): picked mon.noname-c con 0x7fe00015afb0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:27.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.795+0000 7fdfff577640 10 monclient(hunting): picked mon.noname-b con 0x7fe0000a9e80 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:27.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.795+0000 7fdfff577640 10 monclient(hunting): picked mon.noname-a con 0x7fe000164a50 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:27.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.795+0000 7fdfff577640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0000b0e70 con 0x7fe000164a50 2026-02-24T19:17:27.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.795+0000 7fdfff577640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0000b1150 con 0x7fe0000a9e80 2026-02-24T19:17:27.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.795+0000 7fdfff577640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0000b1430 con 0x7fe00015afb0 2026-02-24T19:17:27.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.795+0000 7fdfff577640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:27.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.795+0000 7fdfff577640 10 monclient(hunting): authenticate will time out at 3622.476535s 2026-02-24T19:17:27.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.795+0000 7fdffe575640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7fe00015afb0 0x7fe0000b1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:44798/0 (socket says 10.20.193.14:44798) 2026-02-24T19:17:27.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.795+0000 7fdffe575640 1 -- 10.20.193.14:0/120688764 learned_addr learned my addr 10.20.193.14:0/120688764 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:27.804 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.797+0000 7fdffd573640 1 -- 10.20.193.14:0/120688764 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 717276294 0 0) 0x7fe0000b1430 con 0x7fe00015afb0 2026-02-24T19:17:27.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.797+0000 7fdffd573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:27.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.797+0000 7fdffd573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:27.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.797+0000 7fdffd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:27.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.797+0000 7fdffd573640 10 monclient(hunting): my global_id is 4385 2026-02-24T19:17:27.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.797+0000 7fdffd573640 1 -- 10.20.193.14:0/120688764 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfec003610 con 0x7fe00015afb0 2026-02-24T19:17:27.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.797+0000 7fdffd573640 1 -- 10.20.193.14:0/120688764 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2000115029 0 0) 0x7fe0000b0e70 con 0x7fe000164a50 2026-02-24T19:17:27.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.797+0000 7fdffd573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:27.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.797+0000 7fdffd573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:27.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.797+0000 7fdffd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:27.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.797+0000 7fdffd573640 10 monclient(hunting): my global_id is 4380 2026-02-24T19:17:27.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.797+0000 7fdffd573640 1 -- 10.20.193.14:0/120688764 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0000b1430 con 0x7fe000164a50 2026-02-24T19:17:27.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.797+0000 7fdffd573640 1 -- 10.20.193.14:0/120688764 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2818844781 0 0) 0x7fe0000b1150 con 0x7fe0000a9e80 2026-02-24T19:17:27.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.797+0000 7fdffd573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:27.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.797+0000 7fdffd573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:27.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.797+0000 7fdffd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:27.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.797+0000 7fdffd573640 10 monclient(hunting): my global_id is 4375 2026-02-24T19:17:27.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.797+0000 7fdffd573640 1 -- 10.20.193.14:0/120688764 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0000b0e70 con 0x7fe0000a9e80 2026-02-24T19:17:27.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.799+0000 7fdffd573640 1 -- 10.20.193.14:0/120688764 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3373945944 0 0) 0x7fdfec003610 con 0x7fe00015afb0 2026-02-24T19:17:27.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.799+0000 7fdffd573640 1 -- 10.20.193.14:0/120688764 >> v1:10.20.193.44:6789/0 conn(0x7fe0000a9e80 legacy=0x7fe000164340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:27.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.799+0000 7fdffd573640 1 -- 10.20.193.14:0/120688764 >> v1:10.20.193.14:6789/0 conn(0x7fe000164a50 legacy=0x7fe0000ac300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:27.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.799+0000 7fdffd573640 10 monclient: _finish_hunting 0 2026-02-24T19:17:27.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.799+0000 7fdffd573640 1 monclient: found mon.noname-c 2026-02-24T19:17:27.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.799+0000 7fdffd573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:27.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.799+0000 7fdffd573640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.170:6789/0 2026-02-24T19:17:27.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.799+0000 7fdffd573640 1 -- 10.20.193.14:0/120688764 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0000b1710 con 0x7fe00015afb0 2026-02-24T19:17:27.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.799+0000 7fdffd573640 10 monclient: _finish_auth 0 2026-02-24T19:17:27.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.799+0000 7fdffd573640 10 monclient: _check_auth_tickets 2026-02-24T19:17:27.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.799+0000 7fdffd573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:27.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.799+0000 7fdffd573640 1 -- 10.20.193.14:0/120688764 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fdff4002df0 con 0x7fe00015afb0 2026-02-24T19:17:27.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.799+0000 7fdfff577640 5 monclient: authenticate success, global_id 4385 2026-02-24T19:17:27.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.799+0000 7fdfff577640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:27.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.799+0000 7fdffd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:27.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.799+0000 7fdffd573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:27.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.799+0000 7fdffd573640 10 monclient: dump: 2026-02-24T19:17:27.807 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:27.807 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:27.808 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:27.808 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:27.808 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:27.808 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:27.808 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:27.808 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:27.808 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:27.808 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:27.808 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.799+0000 7fdfff577640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:27.808 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.799+0000 7fdffd573640 1 -- 10.20.193.14:0/120688764 <== mon.2 v1:10.20.193.170:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdff4003030 con 0x7fe00015afb0 2026-02-24T19:17:27.808 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.799+0000 7fdffd573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:27.808 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.799+0000 7fdffd573640 1 -- 10.20.193.14:0/120688764 <== mon.2 v1:10.20.193.170:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fdff4003470 con 0x7fe00015afb0 2026-02-24T19:17:27.808 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.799+0000 7fdffd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:27.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.799+0000 7fdffd573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:27.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.799+0000 7fdffd573640 10 monclient: dump: 2026-02-24T19:17:27.809 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:27.809 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:27.809 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:27.809 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:27.809 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:27.809 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:27.809 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:27.809 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:27.809 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:27.809 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:27.810 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.799+0000 7fdfff577640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:27.810 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.799+0000 7fdfff577640 4 set_mon_vals no callback set 2026-02-24T19:17:27.810 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.800+0000 7fdfff577640 10 monclient: shutdown 2026-02-24T19:17:27.810 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.800+0000 7fdfff577640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:27.810 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.800+0000 7fdfff577640 1 -- 10.20.193.14:0/120688764 >> v1:10.20.193.170:6789/0 conn(0x7fe00015afb0 legacy=0x7fe0000b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:27.810 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.800+0000 7fdfff577640 1 -- 10.20.193.14:0/120688764 shutdown_connections 2026-02-24T19:17:27.810 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.800+0000 7fdfff577640 1 -- 10.20.193.14:0/120688764 >> 10.20.193.14:0/120688764 conn(0x7fe0000b42c0 msgr2=0x7fe0000b4690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:27.810 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.800+0000 7fdfff577640 1 -- 10.20.193.14:0/120688764 shutdown_connections 2026-02-24T19:17:27.810 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.800+0000 7fdfff577640 1 -- 10.20.193.14:0/120688764 wait complete. 2026-02-24T19:17:27.810 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.800+0000 7fdfff577640 10 monclient: build_initial_monmap 2026-02-24T19:17:27.810 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.800+0000 7fdfff577640 10 monclient: monmap: 2026-02-24T19:17:27.810 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:27.810 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:27.811 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:27.811 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:27.811 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:27.811 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:27.811 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:27.811 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:27.811 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:27.811 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:27.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.800+0000 7fdfff577640 1 librados: starting msgr at 2026-02-24T19:17:27.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.800+0000 7fdfff577640 1 librados: starting objecter 2026-02-24T19:17:27.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.800+0000 7fdfff577640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:27.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.800+0000 7fdfff577640 1 Processor -- start 2026-02-24T19:17:27.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.800+0000 7fdfff577640 1 -- start start 2026-02-24T19:17:27.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.800+0000 7fdfff577640 1 librados: setting wanted keys 2026-02-24T19:17:27.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.800+0000 7fdfff577640 1 librados: calling monclient init 2026-02-24T19:17:27.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.800+0000 7fdfff577640 10 monclient: init 2026-02-24T19:17:27.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.801+0000 7fdfff577640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:27.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.801+0000 7fdfff577640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:27.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.801+0000 7fdfff577640 10 monclient(hunting): picked mon.noname-c con 0x7fe0000a9e80 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:27.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.801+0000 7fdfff577640 10 monclient(hunting): picked mon.noname-b con 0x7fe00015afb0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:27.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.801+0000 7fdfff577640 10 monclient(hunting): picked mon.noname-a con 0x7fe000164a50 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:27.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.801+0000 7fdfff577640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe00013d480 con 0x7fe000164a50 2026-02-24T19:17:27.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.801+0000 7fdfff577640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe00005b410 con 0x7fe00015afb0 2026-02-24T19:17:27.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.801+0000 7fdfff577640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe00005b6f0 con 0x7fe0000a9e80 2026-02-24T19:17:27.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.801+0000 7fdfff577640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:27.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.801+0000 7fdfff577640 10 monclient(hunting): authenticate will time out at 3622.482400s 2026-02-24T19:17:27.813 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.801+0000 7fdffed76640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7fe000164a50 0x7fe00013a880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:44568/0 (socket says 10.20.193.14:44568) 2026-02-24T19:17:27.813 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.801+0000 7fdffed76640 1 -- 10.20.193.14:0/3547503411 learned_addr learned my addr 10.20.193.14:0/3547503411 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:27.813 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.801+0000 7fdfe6ffd640 10 client.?.objecter ms_handle_connect 0x7fe000164a50 2026-02-24T19:17:27.813 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.801+0000 7fdfe6ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:27.813 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.802+0000 7fdfe6ffd640 10 client.?.objecter ms_handle_connect 0x7fe00015afb0 2026-02-24T19:17:27.813 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.802+0000 7fdfe6ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:27.813 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.802+0000 7fdfe6ffd640 10 client.?.objecter ms_handle_connect 0x7fe0000a9e80 2026-02-24T19:17:27.813 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.802+0000 7fdfe6ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:27.813 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.802+0000 7fdfe6ffd640 1 -- 10.20.193.14:0/3547503411 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2291640655 0 0) 0x7fe00013d480 con 0x7fe000164a50 2026-02-24T19:17:27.813 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.802+0000 7fdfe6ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:27.813 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.802+0000 7fdfe6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:27.813 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.802+0000 7fdfe6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:27.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.802+0000 7fdfe6ffd640 10 monclient(hunting): my global_id is 4383 2026-02-24T19:17:27.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.802+0000 7fdfe6ffd640 1 -- 10.20.193.14:0/3547503411 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfcc003610 con 0x7fe000164a50 2026-02-24T19:17:27.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.803+0000 7fdfe6ffd640 1 -- 10.20.193.14:0/3547503411 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2044163526 0 0) 0x7fe00005b410 con 0x7fe00015afb0 2026-02-24T19:17:27.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.803+0000 7fdfe6ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:27.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.803+0000 7fdfe6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:27.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.803+0000 7fdfe6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:27.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.803+0000 7fdfe6ffd640 10 monclient(hunting): my global_id is 4378 2026-02-24T19:17:27.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.803+0000 7fdfe6ffd640 1 -- 10.20.193.14:0/3547503411 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe00013d480 con 0x7fe00015afb0 2026-02-24T19:17:27.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.803+0000 7fdfe6ffd640 1 -- 10.20.193.14:0/3547503411 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1894184763 0 0) 0x7fe00005b6f0 con 0x7fe0000a9e80 2026-02-24T19:17:27.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.803+0000 7fdfe6ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:27.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.803+0000 7fdfe6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:27.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.803+0000 7fdfe6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:27.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.803+0000 7fdfe6ffd640 10 monclient(hunting): my global_id is 4388 2026-02-24T19:17:27.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.803+0000 7fdfe6ffd640 1 -- 10.20.193.14:0/3547503411 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe00005b410 con 0x7fe0000a9e80 2026-02-24T19:17:27.817 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.805+0000 7fdfe6ffd640 1 -- 10.20.193.14:0/3547503411 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 970956019 0 0) 0x7fdfcc003610 con 0x7fe000164a50 2026-02-24T19:17:27.818 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.805+0000 7fdfe6ffd640 1 -- 10.20.193.14:0/3547503411 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe00005b6f0 con 0x7fe000164a50 2026-02-24T19:17:27.818 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.805+0000 7fdfe6ffd640 1 -- 10.20.193.14:0/3547503411 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fdff00033f0 con 0x7fe000164a50 2026-02-24T19:17:27.818 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.805+0000 7fdfe6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:27.818 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.805+0000 7fdfe6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:27.818 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.805+0000 7fdfe6ffd640 10 monclient(hunting): dump: 2026-02-24T19:17:27.818 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:27.818 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:27.818 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:27.818 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:27.818 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:27.818 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:27.819 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:27.819 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:27.819 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:27.819 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:27.819 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.805+0000 7fdfe6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:27.819 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.805+0000 7fdfe6ffd640 1 -- 10.20.193.14:0/3547503411 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1838990538 0 0) 0x7fe00013d480 con 0x7fe00015afb0 2026-02-24T19:17:27.819 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.805+0000 7fdfe6ffd640 1 -- 10.20.193.14:0/3547503411 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdfcc003610 con 0x7fe00015afb0 2026-02-24T19:17:27.819 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.805+0000 7fdfe6ffd640 1 -- 10.20.193.14:0/3547503411 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fdfe8003060 con 0x7fe00015afb0 2026-02-24T19:17:27.819 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.805+0000 7fdfe6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:27.819 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.805+0000 7fdfe6ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:27.819 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.805+0000 7fdfe6ffd640 10 monclient(hunting): dump: 2026-02-24T19:17:27.819 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:27.820 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:27.820 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:27.820 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:27.820 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:27.820 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:27.820 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:27.820 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:27.820 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:27.820 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:27.820 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.805+0000 7fdfe6ffd640 1 -- 10.20.193.14:0/3547503411 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4278627686 0 0) 0x7fe00005b410 con 0x7fe0000a9e80 2026-02-24T19:17:27.820 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.805+0000 7fdfe6ffd640 1 -- 10.20.193.14:0/3547503411 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe00013d480 con 0x7fe0000a9e80 2026-02-24T19:17:27.820 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.805+0000 7fdfe6ffd640 1 -- 10.20.193.14:0/3547503411 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fdff40031e0 con 0x7fe0000a9e80 2026-02-24T19:17:27.820 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.805+0000 7fdfe6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:27.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.805+0000 7fdfe6ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:27.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.805+0000 7fdfe6ffd640 10 monclient(hunting): dump: 2026-02-24T19:17:27.821 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:27.821 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:27.821 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:27.821 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:27.821 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:27.821 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:27.821 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:27.821 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:27.821 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:27.821 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:27.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.807+0000 7fdfe6ffd640 1 -- 10.20.193.14:0/3547503411 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1470557514 0 0) 0x7fe00005b6f0 con 0x7fe000164a50 2026-02-24T19:17:27.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.807+0000 7fdfe6ffd640 1 -- 10.20.193.14:0/3547503411 >> v1:10.20.193.170:6789/0 conn(0x7fe0000a9e80 legacy=0x7fe00005ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:27.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.807+0000 7fdfe6ffd640 1 -- 10.20.193.14:0/3547503411 >> v1:10.20.193.44:6789/0 conn(0x7fe00015afb0 legacy=0x7fe000138610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:27.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.807+0000 7fdfe6ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:27.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.807+0000 7fdfe6ffd640 1 monclient: found mon.a 2026-02-24T19:17:27.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.807+0000 7fdfe6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:27.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.807+0000 7fdfe6ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:27.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.807+0000 7fdfe6ffd640 1 -- 10.20.193.14:0/3547503411 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe00005b9d0 con 0x7fe000164a50 2026-02-24T19:17:27.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.807+0000 7fdfe6ffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:27.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.807+0000 7fdfe6ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:27.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.807+0000 7fdfe6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:27.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.807+0000 7fdfff577640 5 monclient: authenticate success, global_id 4383 2026-02-24T19:17:27.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.807+0000 7fdfff577640 10 monclient: _renew_subs 2026-02-24T19:17:27.823 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.807+0000 7fdfff577640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:27.823 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.807+0000 7fdfff577640 1 -- 10.20.193.14:0/3547503411 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe00005bcb0 con 0x7fe000164a50 2026-02-24T19:17:27.823 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.807+0000 7fdfff577640 10 client.4383.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:27.823 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.807+0000 7fdfff577640 10 monclient: _renew_subs 2026-02-24T19:17:27.823 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.807+0000 7fdfff577640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:27.823 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.807+0000 7fdfff577640 1 -- 10.20.193.14:0/3547503411 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe00013af90 con 0x7fe000164a50 2026-02-24T19:17:27.823 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.807+0000 7fdfff577640 1 librados: init done 2026-02-24T19:17:27.823 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.807+0000 7fdfff577640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:27.823 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.807+0000 7fdfff577640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:27.823 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.807+0000 7fdfff577640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:27.823 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.807+0000 7fdfff577640 1 -- 10.20.193.14:0/3547503411 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe000133880 con 0x7fe000164a50 2026-02-24T19:17:27.901 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.900+0000 7fdfe6ffd640 1 -- 10.20.193.14:0/3547503411 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdff0003a80 con 0x7fe000164a50 2026-02-24T19:17:27.901 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.900+0000 7fdfe6ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:27.901 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.900+0000 7fdfe6ffd640 1 -- 10.20.193.14:0/3547503411 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fdff0003e50 con 0x7fe000164a50 2026-02-24T19:17:27.901 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.900+0000 7fdfe6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:27.901 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.900+0000 7fdfe6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:27.901 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.900+0000 7fdfe6ffd640 10 monclient: dump: 2026-02-24T19:17:27.902 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:27.902 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:27.902 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:27.902 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:27.902 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:27.902 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:27.902 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:27.902 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:27.902 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:27.902 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:27.902 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.900+0000 7fdffcd72640 4 set_mon_vals no callback set 2026-02-24T19:17:27.903 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.900+0000 7fdfe6ffd640 1 -- 10.20.193.14:0/3547503411 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7fdff0004030 con 0x7fe000164a50 2026-02-24T19:17:27.903 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.901+0000 7fdffe575640 10 monclient: get_auth_request con 0x7fdfcc077f40 auth_method 0 2026-02-24T19:17:27.903 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.901+0000 7fdfe6ffd640 10 client.4383.objecter ms_handle_connect 0x7fdfcc077f40 2026-02-24T19:17:27.904 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.903+0000 7fdfe6ffd640 1 -- 10.20.193.14:0/3547503411 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7fdff0093500 con 0x7fe000164a50 2026-02-24T19:17:27.904 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.903+0000 7fdfe6ffd640 10 client.4383.objecter ms_dispatch2 0x7fe000000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:27.905 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.903+0000 7fdfe6ffd640 3 client.4383.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:27.905 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.903+0000 7fdfe6ffd640 3 client.4383.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:27.905 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.903+0000 7fdfe6ffd640 20 client.4383.objecter dump_active .. 0 homeless 2026-02-24T19:17:27.905 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.903+0000 7fdfe6ffd640 1 -- 10.20.193.14:0/3547503411 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fdff005df30 con 0x7fe000164a50 2026-02-24T19:17:27.905 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.903+0000 7fdfe6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:27.905 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:27.903+0000 7fdfe6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:28.011 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.010+0000 7fdfff577640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:28.011 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.010+0000 7fdfff577640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:28.011 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.010+0000 7fdfff577640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.011 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.010+0000 7fdfff577640 1 -- 10.20.193.14:0/3547503411 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe0000b5180 con 0x7fe000164a50 2026-02-24T19:17:28.054 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.053+0000 7fdfe6ffd640 1 -- 10.20.193.14:0/3547503411 <== mon.0 v1:10.20.193.14:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+20944 (unknown 587782500 0 1684956309) 0x7fdff0003e50 con 0x7fe000164a50 2026-02-24T19:17:28.054 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.053+0000 7fdfe6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:28.054 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.053+0000 7fdfe6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:28.055 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:17:28.055 INFO:teuthology.orchestra.run.trial014.stdout:{"epoch":31,"fsid":"829a649b-54c9-463b-96b9-ffa203d49fa7","created":"2026-02-24T19:16:40.561511+0000","modified":"2026-02-24T19:17:26.781545+0000","last_up_change":"2026-02-24T19:17:13.710334+0000","last_in_change":"2026-02-24T19:16:47.437972+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T19:17:15.661742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-24T19:17:21.746458+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":31,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":5.9899997711181641,"score_stable":5.9899997711181641,"optimal_score":0.68999999761581421,"raw_score_acting":4.130000114440918,"raw_score_stable":4.130000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9a3fd69b-7f2a-443b-9ae1-673acfad8b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6806","nonce":3263337386}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6810","nonce":3263337386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6813","nonce":3263337386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6812","nonce":3263337386}]},"public_addr":"10.20.193.14:6806/3263337386","cluster_addr":"10.20.193.14:6810/3263337386","heartbeat_back_addr":"10.20.193.14:6813/3263337386","heartbeat_front_addr":"10.20.193.14:6812/3263337386","state":["exists","up"]},{"osd":1,"uuid":"7dca8ec5-5aa3-420d-bf78-1331d974dafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6804","nonce":1955152616}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6805","nonce":1955152616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6807","nonce":1955152616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6806","nonce":1955152616}]},"public_addr":"10.20.193.44:6804/1955152616","cluster_addr":"10.20.193.44:6805/1955152616","heartbeat_back_addr":"10.20.193.44:6807/1955152616","heartbeat_front_addr":"10.20.193.44:6806/1955152616","state":["exists","up"]},{"osd":2,"uuid":"5a7b7c02-22f9-4eb1-a1b0-afb106604416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6804","nonce":993713135}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6805","nonce":993713135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6807","nonce":993713135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6806","nonce":993713135}]},"public_addr":"10.20.193.170:6804/993713135","cluster_addr":"10.20.193.170:6805/993713135","heartbeat_back_addr":"10.20.193.170:6807/993713135","heartbeat_front_addr":"10.20.193.170:6806/993713135","state":["exists","up"]},{"osd":3,"uuid":"695eeb19-d0a7-4b16-8d9a-ec59206d7ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6800","nonce":3081016231}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6801","nonce":3081016231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6803","nonce":3081016231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6802","nonce":3081016231}]},"public_addr":"10.20.193.195:6800/3081016231","cluster_addr":"10.20.193.195:6801/3081016231","heartbeat_back_addr":"10.20.193.195:6803/3081016231","heartbeat_front_addr":"10.20.193.195:6802/3081016231","state":["exists","up"]},{"osd":4,"uuid":"09ca59ec-7e76-44ba-bf1a-1b752732db60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6805","nonce":4020872388}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6807","nonce":4020872388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6811","nonce":4020872388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6808","nonce":4020872388}]},"public_addr":"10.20.193.14:6805/4020872388","cluster_addr":"10.20.193.14:6807/4020872388","heartbeat_back_addr":"10.20.193.14:6811/4020872388","heartbeat_front_addr":"10.20.193.14:6808/4020872388","state":["exists","up"]},{"osd":5,"uuid":"64319106-a5b4-4775-b122-8c50216df3a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6811","nonce":2261252351}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6813","nonce":2261252351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6815","nonce":2261252351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6814","nonce":2261252351}]},"public_addr":"10.20.193.44:6811/2261252351","cluster_addr":"10.20.193.44:6813/2261252351","heartbeat_back_addr":"10.20.193.44:6815/2261252351","heartbeat_front_addr":"10.20.193.44:6814/2261252351","state":["exists","up"]},{"osd":6,"uuid":"19f0033c-abbd-406a-8eae-94e7e81da9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6800","nonce":3031579126}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6801","nonce":3031579126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6803","nonce":3031579126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6802","nonce":3031579126}]},"public_addr":"10.20.193.170:6800/3031579126","cluster_addr":"10.20.193.170:6801/3031579126","heartbeat_back_addr":"10.20.193.170:6803/3031579126","heartbeat_front_addr":"10.20.193.170:6802/3031579126","state":["exists","up"]},{"osd":7,"uuid":"7cdd3b9b-4146-45b9-aaf6-df379c7a1e0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6808","nonce":798109025}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6810","nonce":798109025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6815","nonce":798109025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6812","nonce":798109025}]},"public_addr":"10.20.193.195:6808/798109025","cluster_addr":"10.20.193.195:6810/798109025","heartbeat_back_addr":"10.20.193.195:6815/798109025","heartbeat_front_addr":"10.20.193.195:6812/798109025","state":["exists","up"]},{"osd":8,"uuid":"a4833012-c50c-4a6e-b754-cf18fc6117fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6809","nonce":1223168292}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6814","nonce":1223168292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6816","nonce":1223168292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6815","nonce":1223168292}]},"public_addr":"10.20.193.14:6809/1223168292","cluster_addr":"10.20.193.14:6814/1223168292","heartbeat_back_addr":"10.20.193.14:6816/1223168292","heartbeat_front_addr":"10.20.193.14:6815/1223168292","state":["exists","up"]},{"osd":9,"uuid":"322914a2-9ba3-44b8-98ec-958b00c92f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6808","nonce":4259724385}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6809","nonce":4259724385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6812","nonce":4259724385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6810","nonce":4259724385}]},"public_addr":"10.20.193.44:6808/4259724385","cluster_addr":"10.20.193.44:6809/4259724385","heartbeat_back_addr":"10.20.193.44:6812/4259724385","heartbeat_front_addr":"10.20.193.44:6810/4259724385","state":["exists","up"]},{"osd":10,"uuid":"dbfdf855-de28-491b-9112-8009ab155fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6808","nonce":983512563}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6810","nonce":983512563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6813","nonce":983512563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6811","nonce":983512563}]},"public_addr":"10.20.193.170:6808/983512563","cluster_addr":"10.20.193.170:6810/983512563","heartbeat_back_addr":"10.20.193.170:6813/983512563","heartbeat_front_addr":"10.20.193.170:6811/983512563","state":["exists","up"]},{"osd":11,"uuid":"253e9d0b-391d-4647-bd89-6ab4b57909aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6804","nonce":2798179318}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6805","nonce":2798179318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6807","nonce":2798179318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6806","nonce":2798179318}]},"public_addr":"10.20.193.195:6804/2798179318","cluster_addr":"10.20.193.195:6805/2798179318","heartbeat_back_addr":"10.20.193.195:6807/2798179318","heartbeat_front_addr":"10.20.193.195:6806/2798179318","state":["exists","up"]},{"osd":12,"uuid":"7b7d5fca-4759-46e5-a681-45509749b265","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6801","nonce":1483397197}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6802","nonce":1483397197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6804","nonce":1483397197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6803","nonce":1483397197}]},"public_addr":"10.20.193.14:6801/1483397197","cluster_addr":"10.20.193.14:6802/1483397197","heartbeat_back_addr":"10.20.193.14:6804/1483397197","heartbeat_front_addr":"10.20.193.14:6803/1483397197","state":["exists","up"]},{"osd":13,"uuid":"8d1f12c8-5787-425d-a4a6-ac820bbf6e8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6800","nonce":3795416779}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6801","nonce":3795416779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6803","nonce":3795416779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6802","nonce":3795416779}]},"public_addr":"10.20.193.44:6800/3795416779","cluster_addr":"10.20.193.44:6801/3795416779","heartbeat_back_addr":"10.20.193.44:6803/3795416779","heartbeat_front_addr":"10.20.193.44:6802/3795416779","state":["exists","up"]},{"osd":14,"uuid":"866643a2-5f54-425c-b5ec-70607e191f02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6809","nonce":2177297767}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6812","nonce":2177297767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6815","nonce":2177297767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6814","nonce":2177297767}]},"public_addr":"10.20.193.170:6809/2177297767","cluster_addr":"10.20.193.170:6812/2177297767","heartbeat_back_addr":"10.20.193.170:6815/2177297767","heartbeat_front_addr":"10.20.193.170:6814/2177297767","state":["exists","up"]},{"osd":15,"uuid":"4726a8b0-bcef-4e7f-aa36-e80228e2aec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6809","nonce":3316970219}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6811","nonce":3316970219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6814","nonce":3316970219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6813","nonce":3316970219}]},"public_addr":"10.20.193.195:6809/3316970219","cluster_addr":"10.20.193.195:6811/3316970219","heartbeat_back_addr":"10.20.193.195:6814/3316970219","heartbeat_front_addr":"10.20.193.195:6813/3316970219","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.649198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.571073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.859654+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.714982+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.749516+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.546522+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.704013+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.829729+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.543314+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.580646+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.932784+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.682415+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.742679+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.618137+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.759234+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.913664+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T19:17:28.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.055+0000 7fdfff577640 10 librados: watch_flush enter 2026-02-24T19:17:28.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.055+0000 7fdfff577640 10 librados: watch_flush exit 2026-02-24T19:17:28.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.055+0000 7fdfff577640 20 client.4383.objecter shutdown clearing up homeless session... 2026-02-24T19:17:28.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.055+0000 7fdfff577640 10 client.4383.objecter successfully canceled tick 2026-02-24T19:17:28.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.055+0000 7fdfff577640 1 -- 10.20.193.14:0/3547503411 >> v1:10.20.193.14:6800/4014096310 conn(0x7fdfcc077f40 legacy=0x7fdfcc0983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.055+0000 7fdfff577640 10 monclient: shutdown 2026-02-24T19:17:28.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.055+0000 7fdfff577640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.055+0000 7fdfff577640 1 -- 10.20.193.14:0/3547503411 >> v1:10.20.193.14:6789/0 conn(0x7fe000164a50 legacy=0x7fe00013a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.058 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.055+0000 7fdfff577640 1 -- 10.20.193.14:0/3547503411 shutdown_connections 2026-02-24T19:17:28.058 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.055+0000 7fdfff577640 1 -- 10.20.193.14:0/3547503411 >> 10.20.193.14:0/3547503411 conn(0x7fe0000b42c0 msgr2=0x7fe0000b56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.058 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.055+0000 7fdfff577640 1 -- 10.20.193.14:0/3547503411 shutdown_connections 2026-02-24T19:17:28.058 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.055+0000 7fdfff577640 1 -- 10.20.193.14:0/3547503411 wait complete. 2026-02-24T19:17:28.058 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.055+0000 7fdfff577640 1 librados: shutdown 2026-02-24T19:17:28.066 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-24T19:17:28.066 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-24T19:17:28.133 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.132+0000 7fcfc7509640 10 monclient: get_monmap_and_config 2026-02-24T19:17:28.133 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.132+0000 7fcfc7509640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.133 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.132+0000 7fcfc7509640 10 monclient: monmap: 2026-02-24T19:17:28.134 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.134 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.134 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:28.132972+0000 2026-02-24T19:17:28.134 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:28.132972+0000 2026-02-24T19:17:28.134 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.134 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.134 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.134 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.134 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.134 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.136 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.132+0000 7fcfc7509640 1 Processor -- start 2026-02-24T19:17:28.137 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.132+0000 7fcfc7509640 1 -- start start 2026-02-24T19:17:28.137 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.132+0000 7fcfc7509640 10 monclient: init 2026-02-24T19:17:28.137 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.133+0000 7fcfc7509640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.137 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.133+0000 7fcfc7509640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:28.137 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.133+0000 7fcfc7509640 10 monclient(hunting): picked mon.noname-c con 0x7fcfc0058da0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.137 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.133+0000 7fcfc7509640 10 monclient(hunting): picked mon.noname-a con 0x7fcfc00b0410 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.137 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.133+0000 7fcfc7509640 10 monclient(hunting): picked mon.noname-b con 0x7fcfc01626a0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.137 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.133+0000 7fcfc7509640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfc01655c0 con 0x7fcfc00b0410 2026-02-24T19:17:28.137 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.133+0000 7fcfc7509640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfc00b12b0 con 0x7fcfc01626a0 2026-02-24T19:17:28.137 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.133+0000 7fcfc7509640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfc00b1590 con 0x7fcfc0058da0 2026-02-24T19:17:28.137 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.133+0000 7fcfc7509640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.137 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.133+0000 7fcfc7509640 10 monclient(hunting): authenticate will time out at 3622.814369s 2026-02-24T19:17:28.138 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.133+0000 7fcfc4a7d640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7fcfc00b0410 0x7fcfc0164eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:54606/0 (socket says 10.20.193.14:54606) 2026-02-24T19:17:28.138 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.133+0000 7fcfc4a7d640 1 -- 10.20.193.14:0/964634221 learned_addr learned my addr 10.20.193.14:0/964634221 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.138 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.135+0000 7fcfaffff640 1 -- 10.20.193.14:0/964634221 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 186406224 0 0) 0x7fcfc00b12b0 con 0x7fcfc01626a0 2026-02-24T19:17:28.138 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.135+0000 7fcfaffff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.138 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.135+0000 7fcfaffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.138 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.135+0000 7fcfaffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.138 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.135+0000 7fcfaffff640 10 monclient(hunting): my global_id is 4381 2026-02-24T19:17:28.138 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.135+0000 7fcfaffff640 1 -- 10.20.193.14:0/964634221 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfa8003610 con 0x7fcfc01626a0 2026-02-24T19:17:28.138 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.135+0000 7fcfaffff640 1 -- 10.20.193.14:0/964634221 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1147159812 0 0) 0x7fcfc01655c0 con 0x7fcfc00b0410 2026-02-24T19:17:28.138 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.135+0000 7fcfaffff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.138 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.135+0000 7fcfaffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.138 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.135+0000 7fcfaffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.139 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.135+0000 7fcfaffff640 10 monclient(hunting): my global_id is 4386 2026-02-24T19:17:28.139 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.135+0000 7fcfaffff640 1 -- 10.20.193.14:0/964634221 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfc00b12b0 con 0x7fcfc00b0410 2026-02-24T19:17:28.139 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.135+0000 7fcfaffff640 1 -- 10.20.193.14:0/964634221 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2262387718 0 0) 0x7fcfc00b1590 con 0x7fcfc0058da0 2026-02-24T19:17:28.139 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.135+0000 7fcfaffff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.139 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.135+0000 7fcfaffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.139 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.135+0000 7fcfaffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.139 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.135+0000 7fcfaffff640 10 monclient(hunting): my global_id is 4391 2026-02-24T19:17:28.139 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.135+0000 7fcfaffff640 1 -- 10.20.193.14:0/964634221 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfc01655c0 con 0x7fcfc0058da0 2026-02-24T19:17:28.143 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.136+0000 7fcfaffff640 1 -- 10.20.193.14:0/964634221 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 737369078 0 0) 0x7fcfa8003610 con 0x7fcfc01626a0 2026-02-24T19:17:28.144 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.136+0000 7fcfaffff640 1 -- 10.20.193.14:0/964634221 >> v1:10.20.193.170:6789/0 conn(0x7fcfc0058da0 legacy=0x7fcfc01647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.144 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.136+0000 7fcfaffff640 1 -- 10.20.193.14:0/964634221 >> v1:10.20.193.14:6789/0 conn(0x7fcfc00b0410 legacy=0x7fcfc0164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.144 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.136+0000 7fcfaffff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.144 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.136+0000 7fcfaffff640 1 monclient: found mon.noname-b 2026-02-24T19:17:28.144 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.136+0000 7fcfaffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.144 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.136+0000 7fcfaffff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.144 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.136+0000 7fcfaffff640 1 -- 10.20.193.14:0/964634221 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc00b1870 con 0x7fcfc01626a0 2026-02-24T19:17:28.144 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.136+0000 7fcfaffff640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.144 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.136+0000 7fcfaffff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.144 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.136+0000 7fcfaffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.144 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.136+0000 7fcfaffff640 1 -- 10.20.193.14:0/964634221 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fcfbc003170 con 0x7fcfc01626a0 2026-02-24T19:17:28.144 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.136+0000 7fcfaffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.145 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.136+0000 7fcfaffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:28.145 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.136+0000 7fcfaffff640 10 monclient: dump: 2026-02-24T19:17:28.145 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.145 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.145 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.145 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.145 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.145 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.145 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.145 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.145 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.145 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.146 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.136+0000 7fcfc7509640 5 monclient: authenticate success, global_id 4381 2026-02-24T19:17:28.146 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.136+0000 7fcfc7509640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.146 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.137+0000 7fcfaffff640 1 -- 10.20.193.14:0/964634221 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcfbc003340 con 0x7fcfc01626a0 2026-02-24T19:17:28.146 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.137+0000 7fcfaffff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.146 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.137+0000 7fcfaffff640 1 -- 10.20.193.14:0/964634221 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fcfbc003780 con 0x7fcfc01626a0 2026-02-24T19:17:28.146 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.137+0000 7fcfaffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.146 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.137+0000 7fcfaffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:28.146 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.137+0000 7fcfaffff640 10 monclient: dump: 2026-02-24T19:17:28.146 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.146 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.146 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.146 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.147 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.147 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.147 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.147 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.147 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.147 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.147 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.137+0000 7fcfc7509640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:28.147 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.137+0000 7fcfc7509640 4 set_mon_vals no callback set 2026-02-24T19:17:28.147 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.137+0000 7fcfc7509640 10 monclient: shutdown 2026-02-24T19:17:28.147 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.137+0000 7fcfc7509640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.147 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.137+0000 7fcfc7509640 1 -- 10.20.193.14:0/964634221 >> v1:10.20.193.44:6789/0 conn(0x7fcfc01626a0 legacy=0x7fcfc01c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.147 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.138+0000 7fcfc7509640 1 -- 10.20.193.14:0/964634221 shutdown_connections 2026-02-24T19:17:28.147 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.138+0000 7fcfc7509640 1 -- 10.20.193.14:0/964634221 >> 10.20.193.14:0/964634221 conn(0x7fcfc00b65f0 msgr2=0x7fcfc00b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.148 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.138+0000 7fcfc7509640 1 -- 10.20.193.14:0/964634221 shutdown_connections 2026-02-24T19:17:28.148 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.138+0000 7fcfc7509640 1 -- 10.20.193.14:0/964634221 wait complete. 2026-02-24T19:17:28.148 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.138+0000 7fcfc7509640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.148 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.138+0000 7fcfc7509640 10 monclient: monmap: 2026-02-24T19:17:28.148 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.148 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:28.148 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:28.148 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:28.148 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.148 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:28.148 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.148 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.148 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.149 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.149 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.138+0000 7fcfc7509640 1 librados: starting msgr at 2026-02-24T19:17:28.149 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.138+0000 7fcfc7509640 1 librados: starting objecter 2026-02-24T19:17:28.149 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.138+0000 7fcfc7509640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:28.149 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.138+0000 7fcfc7509640 1 Processor -- start 2026-02-24T19:17:28.149 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.138+0000 7fcfc7509640 1 -- start start 2026-02-24T19:17:28.149 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.138+0000 7fcfc7509640 1 librados: setting wanted keys 2026-02-24T19:17:28.149 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.138+0000 7fcfc7509640 1 librados: calling monclient init 2026-02-24T19:17:28.149 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.138+0000 7fcfc7509640 10 monclient: init 2026-02-24T19:17:28.149 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.139+0000 7fcfc7509640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.149 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.139+0000 7fcfc7509640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:28.149 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.139+0000 7fcfc7509640 10 monclient(hunting): picked mon.noname-a con 0x7fcfc0058da0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.149 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.139+0000 7fcfc7509640 10 monclient(hunting): picked mon.noname-c con 0x7fcfc00b0410 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.150 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.139+0000 7fcfc7509640 10 monclient(hunting): picked mon.noname-b con 0x7fcfc01626a0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.150 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.139+0000 7fcfc7509640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfc0131260 con 0x7fcfc0058da0 2026-02-24T19:17:28.150 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.139+0000 7fcfc7509640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfc00aff60 con 0x7fcfc01626a0 2026-02-24T19:17:28.150 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.139+0000 7fcfc7509640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfc013b7f0 con 0x7fcfc00b0410 2026-02-24T19:17:28.150 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.139+0000 7fcfc7509640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.150 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.139+0000 7fcfc7509640 10 monclient(hunting): authenticate will time out at 3622.820379s 2026-02-24T19:17:28.150 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.139+0000 7fcfc527e640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7fcfc0058da0 0x7fcfc013b0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:54618/0 (socket says 10.20.193.14:54618) 2026-02-24T19:17:28.150 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.139+0000 7fcfc527e640 1 -- 10.20.193.14:0/422654884 learned_addr learned my addr 10.20.193.14:0/422654884 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.150 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.139+0000 7fcfadffb640 10 client.?.objecter ms_handle_connect 0x7fcfc0058da0 2026-02-24T19:17:28.150 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.139+0000 7fcfadffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.150 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.139+0000 7fcfadffb640 10 client.?.objecter ms_handle_connect 0x7fcfc01626a0 2026-02-24T19:17:28.150 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.139+0000 7fcfadffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.151 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.140+0000 7fcfadffb640 10 client.?.objecter ms_handle_connect 0x7fcfc00b0410 2026-02-24T19:17:28.151 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.140+0000 7fcfadffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.151 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.140+0000 7fcfadffb640 1 -- 10.20.193.14:0/422654884 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4121296998 0 0) 0x7fcfc0131260 con 0x7fcfc0058da0 2026-02-24T19:17:28.151 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.140+0000 7fcfadffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.151 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.140+0000 7fcfadffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.151 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.140+0000 7fcfadffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.151 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.140+0000 7fcfadffb640 10 monclient(hunting): my global_id is 4389 2026-02-24T19:17:28.151 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.140+0000 7fcfadffb640 1 -- 10.20.193.14:0/422654884 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf90003610 con 0x7fcfc0058da0 2026-02-24T19:17:28.151 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.140+0000 7fcfadffb640 1 -- 10.20.193.14:0/422654884 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1544467376 0 0) 0x7fcfc00aff60 con 0x7fcfc01626a0 2026-02-24T19:17:28.151 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.140+0000 7fcfadffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.151 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.140+0000 7fcfadffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.151 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.140+0000 7fcfadffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.151 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.140+0000 7fcfadffb640 10 monclient(hunting): my global_id is 4384 2026-02-24T19:17:28.152 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.140+0000 7fcfadffb640 1 -- 10.20.193.14:0/422654884 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfc0131260 con 0x7fcfc01626a0 2026-02-24T19:17:28.152 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.141+0000 7fcfadffb640 1 -- 10.20.193.14:0/422654884 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3548405230 0 0) 0x7fcfc013b7f0 con 0x7fcfc00b0410 2026-02-24T19:17:28.152 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.141+0000 7fcfadffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.152 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.141+0000 7fcfadffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.152 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.141+0000 7fcfadffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.152 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.141+0000 7fcfadffb640 10 monclient(hunting): my global_id is 4394 2026-02-24T19:17:28.152 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.141+0000 7fcfadffb640 1 -- 10.20.193.14:0/422654884 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfc00aff60 con 0x7fcfc00b0410 2026-02-24T19:17:28.155 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.143+0000 7fcfadffb640 1 -- 10.20.193.14:0/422654884 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3043643033 0 0) 0x7fcfc0131260 con 0x7fcfc01626a0 2026-02-24T19:17:28.155 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.143+0000 7fcfadffb640 1 -- 10.20.193.14:0/422654884 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcfc013b7f0 con 0x7fcfc01626a0 2026-02-24T19:17:28.155 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.143+0000 7fcfadffb640 1 -- 10.20.193.14:0/422654884 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fcfbc0034f0 con 0x7fcfc01626a0 2026-02-24T19:17:28.155 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.143+0000 7fcfadffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.155 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.143+0000 7fcfadffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:28.155 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.143+0000 7fcfadffb640 10 monclient(hunting): dump: 2026-02-24T19:17:28.155 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.155 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.155 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.155 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.155 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.155 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.156 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.156 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.156 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.156 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.156 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.143+0000 7fcfadffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:28.156 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.143+0000 7fcfadffb640 1 -- 10.20.193.14:0/422654884 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1039581373 0 0) 0x7fcf90003610 con 0x7fcfc0058da0 2026-02-24T19:17:28.156 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.143+0000 7fcfadffb640 1 -- 10.20.193.14:0/422654884 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcfc0131260 con 0x7fcfc0058da0 2026-02-24T19:17:28.156 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.143+0000 7fcfadffb640 1 -- 10.20.193.14:0/422654884 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fcfb0003170 con 0x7fcfc0058da0 2026-02-24T19:17:28.156 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.143+0000 7fcfadffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.156 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.143+0000 7fcfadffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.156 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.143+0000 7fcfadffb640 10 monclient(hunting): dump: 2026-02-24T19:17:28.156 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.157 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.157 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.157 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.157 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.157 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.157 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.157 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.157 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.157 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.157 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.143+0000 7fcfadffb640 1 -- 10.20.193.14:0/422654884 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3496422733 0 0) 0x7fcfc00aff60 con 0x7fcfc00b0410 2026-02-24T19:17:28.157 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.143+0000 7fcfadffb640 1 -- 10.20.193.14:0/422654884 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcf90003610 con 0x7fcfc00b0410 2026-02-24T19:17:28.157 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.143+0000 7fcfadffb640 1 -- 10.20.193.14:0/422654884 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fcfb40030b0 con 0x7fcfc00b0410 2026-02-24T19:17:28.157 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.143+0000 7fcfadffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.158 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.143+0000 7fcfadffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:28.158 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.143+0000 7fcfadffb640 10 monclient(hunting): dump: 2026-02-24T19:17:28.158 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.158 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.158 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.158 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.158 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.158 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.158 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.158 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.158 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.158 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.159 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.145+0000 7fcfadffb640 1 -- 10.20.193.14:0/422654884 <== mon.1 v1:10.20.193.44:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2029915381 0 0) 0x7fcfc013b7f0 con 0x7fcfc01626a0 2026-02-24T19:17:28.159 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.145+0000 7fcfadffb640 1 -- 10.20.193.14:0/422654884 >> v1:10.20.193.170:6789/0 conn(0x7fcfc00b0410 legacy=0x7fcfc0131740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.159 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.145+0000 7fcfadffb640 1 -- 10.20.193.14:0/422654884 >> v1:10.20.193.14:6789/0 conn(0x7fcfc0058da0 legacy=0x7fcfc013b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.159 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.145+0000 7fcfadffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.159 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.145+0000 7fcfadffb640 1 monclient: found mon.b 2026-02-24T19:17:28.159 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.145+0000 7fcfadffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.159 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.145+0000 7fcfadffb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.159 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.145+0000 7fcfadffb640 1 -- 10.20.193.14:0/422654884 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc0147d30 con 0x7fcfc01626a0 2026-02-24T19:17:28.159 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.145+0000 7fcfadffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.159 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.145+0000 7fcfadffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.159 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.145+0000 7fcfadffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.159 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.145+0000 7fcfc7509640 5 monclient: authenticate success, global_id 4384 2026-02-24T19:17:28.159 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.145+0000 7fcfc7509640 10 monclient: _renew_subs 2026-02-24T19:17:28.160 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.145+0000 7fcfc7509640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.160 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.145+0000 7fcfc7509640 1 -- 10.20.193.14:0/422654884 --> v1:10.20.193.44:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcfc0148010 con 0x7fcfc01626a0 2026-02-24T19:17:28.160 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.145+0000 7fcfc7509640 10 client.4384.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.160 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.145+0000 7fcfc7509640 10 monclient: _renew_subs 2026-02-24T19:17:28.160 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.145+0000 7fcfc7509640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.160 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.145+0000 7fcfc7509640 1 -- 10.20.193.14:0/422654884 --> v1:10.20.193.44:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fcfc01485d0 con 0x7fcfc01626a0 2026-02-24T19:17:28.160 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.145+0000 7fcfc7509640 1 librados: init done 2026-02-24T19:17:28.160 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.145+0000 7fcfc7509640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.160 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.145+0000 7fcfc7509640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.160 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.145+0000 7fcfc7509640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.160 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.145+0000 7fcfc7509640 1 -- 10.20.193.14:0/422654884 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfc00a9490 con 0x7fcfc01626a0 2026-02-24T19:17:28.235 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.233+0000 7fcfadffb640 1 -- 10.20.193.14:0/422654884 <== mon.1 v1:10.20.193.44:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcfbc003300 con 0x7fcfc01626a0 2026-02-24T19:17:28.235 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.233+0000 7fcfadffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.235 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.233+0000 7fcfadffb640 1 -- 10.20.193.14:0/422654884 <== mon.1 v1:10.20.193.44:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fcfbc003ae0 con 0x7fcfc01626a0 2026-02-24T19:17:28.235 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.233+0000 7fcfadffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.235 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.233+0000 7fcfadffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:28.235 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.233+0000 7fcfaf7fe640 4 set_mon_vals no callback set 2026-02-24T19:17:28.235 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.233+0000 7fcfadffb640 10 monclient: dump: 2026-02-24T19:17:28.235 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.235 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.235 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.236 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.236 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.236 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.236 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.236 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.236 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.236 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.237 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.234+0000 7fcfadffb640 1 -- 10.20.193.14:0/422654884 <== mon.1 v1:10.20.193.44:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7fcfbc003cc0 con 0x7fcfc01626a0 2026-02-24T19:17:28.237 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.234+0000 7fcfc527e640 10 monclient: get_auth_request con 0x7fcf90077ef0 auth_method 0 2026-02-24T19:17:28.237 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.234+0000 7fcfadffb640 10 client.4384.objecter ms_handle_connect 0x7fcf90077ef0 2026-02-24T19:17:28.237 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.235+0000 7fcfadffb640 1 -- 10.20.193.14:0/422654884 <== mon.1 v1:10.20.193.44:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7fcfbc092030 con 0x7fcfc01626a0 2026-02-24T19:17:28.237 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.235+0000 7fcfadffb640 10 client.4384.objecter ms_dispatch2 0x7fcfc0000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:28.237 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.235+0000 7fcfadffb640 3 client.4384.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:28.237 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.235+0000 7fcfadffb640 3 client.4384.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:28.238 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.235+0000 7fcfadffb640 20 client.4384.objecter dump_active .. 0 homeless 2026-02-24T19:17:28.238 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.236+0000 7fcfadffb640 1 -- 10.20.193.14:0/422654884 <== mon.1 v1:10.20.193.44:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fcfc00a9490 con 0x7fcfc01626a0 2026-02-24T19:17:28.238 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.236+0000 7fcfadffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.238 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.236+0000 7fcfadffb640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:28.345 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.344+0000 7fcfc7509640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:28.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.344+0000 7fcfc7509640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:28.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.344+0000 7fcfc7509640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.344+0000 7fcfc7509640 1 -- 10.20.193.14:0/422654884 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcfc0148810 con 0x7fcfc01626a0 2026-02-24T19:17:28.361 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.360+0000 7fcfadffb640 1 -- 10.20.193.14:0/422654884 <== mon.1 v1:10.20.193.44:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+20944 (unknown 587782500 0 1684956309) 0x7fcfbc003ae0 con 0x7fcfc01626a0 2026-02-24T19:17:28.361 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.360+0000 7fcfadffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:28.361 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.360+0000 7fcfadffb640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:28.362 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:17:28.362 INFO:teuthology.orchestra.run.trial014.stdout:{"epoch":31,"fsid":"829a649b-54c9-463b-96b9-ffa203d49fa7","created":"2026-02-24T19:16:40.561511+0000","modified":"2026-02-24T19:17:26.781545+0000","last_up_change":"2026-02-24T19:17:13.710334+0000","last_in_change":"2026-02-24T19:16:47.437972+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T19:17:15.661742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-24T19:17:21.746458+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":31,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":5.9899997711181641,"score_stable":5.9899997711181641,"optimal_score":0.68999999761581421,"raw_score_acting":4.130000114440918,"raw_score_stable":4.130000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9a3fd69b-7f2a-443b-9ae1-673acfad8b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6806","nonce":3263337386}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6810","nonce":3263337386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6813","nonce":3263337386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6812","nonce":3263337386}]},"public_addr":"10.20.193.14:6806/3263337386","cluster_addr":"10.20.193.14:6810/3263337386","heartbeat_back_addr":"10.20.193.14:6813/3263337386","heartbeat_front_addr":"10.20.193.14:6812/3263337386","state":["exists","up"]},{"osd":1,"uuid":"7dca8ec5-5aa3-420d-bf78-1331d974dafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6804","nonce":1955152616}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6805","nonce":1955152616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6807","nonce":1955152616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6806","nonce":1955152616}]},"public_addr":"10.20.193.44:6804/1955152616","cluster_addr":"10.20.193.44:6805/1955152616","heartbeat_back_addr":"10.20.193.44:6807/1955152616","heartbeat_front_addr":"10.20.193.44:6806/1955152616","state":["exists","up"]},{"osd":2,"uuid":"5a7b7c02-22f9-4eb1-a1b0-afb106604416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6804","nonce":993713135}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6805","nonce":993713135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6807","nonce":993713135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6806","nonce":993713135}]},"public_addr":"10.20.193.170:6804/993713135","cluster_addr":"10.20.193.170:6805/993713135","heartbeat_back_addr":"10.20.193.170:6807/993713135","heartbeat_front_addr":"10.20.193.170:6806/993713135","state":["exists","up"]},{"osd":3,"uuid":"695eeb19-d0a7-4b16-8d9a-ec59206d7ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6800","nonce":3081016231}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6801","nonce":3081016231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6803","nonce":3081016231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6802","nonce":3081016231}]},"public_addr":"10.20.193.195:6800/3081016231","cluster_addr":"10.20.193.195:6801/3081016231","heartbeat_back_addr":"10.20.193.195:6803/3081016231","heartbeat_front_addr":"10.20.193.195:6802/3081016231","state":["exists","up"]},{"osd":4,"uuid":"09ca59ec-7e76-44ba-bf1a-1b752732db60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6805","nonce":4020872388}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6807","nonce":4020872388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6811","nonce":4020872388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6808","nonce":4020872388}]},"public_addr":"10.20.193.14:6805/4020872388","cluster_addr":"10.20.193.14:6807/4020872388","heartbeat_back_addr":"10.20.193.14:6811/4020872388","heartbeat_front_addr":"10.20.193.14:6808/4020872388","state":["exists","up"]},{"osd":5,"uuid":"64319106-a5b4-4775-b122-8c50216df3a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6811","nonce":2261252351}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6813","nonce":2261252351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6815","nonce":2261252351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6814","nonce":2261252351}]},"public_addr":"10.20.193.44:6811/2261252351","cluster_addr":"10.20.193.44:6813/2261252351","heartbeat_back_addr":"10.20.193.44:6815/2261252351","heartbeat_front_addr":"10.20.193.44:6814/2261252351","state":["exists","up"]},{"osd":6,"uuid":"19f0033c-abbd-406a-8eae-94e7e81da9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6800","nonce":3031579126}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6801","nonce":3031579126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6803","nonce":3031579126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6802","nonce":3031579126}]},"public_addr":"10.20.193.170:6800/3031579126","cluster_addr":"10.20.193.170:6801/3031579126","heartbeat_back_addr":"10.20.193.170:6803/3031579126","heartbeat_front_addr":"10.20.193.170:6802/3031579126","state":["exists","up"]},{"osd":7,"uuid":"7cdd3b9b-4146-45b9-aaf6-df379c7a1e0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6808","nonce":798109025}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6810","nonce":798109025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6815","nonce":798109025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6812","nonce":798109025}]},"public_addr":"10.20.193.195:6808/798109025","cluster_addr":"10.20.193.195:6810/798109025","heartbeat_back_addr":"10.20.193.195:6815/798109025","heartbeat_front_addr":"10.20.193.195:6812/798109025","state":["exists","up"]},{"osd":8,"uuid":"a4833012-c50c-4a6e-b754-cf18fc6117fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6809","nonce":1223168292}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6814","nonce":1223168292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6816","nonce":1223168292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6815","nonce":1223168292}]},"public_addr":"10.20.193.14:6809/1223168292","cluster_addr":"10.20.193.14:6814/1223168292","heartbeat_back_addr":"10.20.193.14:6816/1223168292","heartbeat_front_addr":"10.20.193.14:6815/1223168292","state":["exists","up"]},{"osd":9,"uuid":"322914a2-9ba3-44b8-98ec-958b00c92f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6808","nonce":4259724385}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6809","nonce":4259724385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6812","nonce":4259724385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6810","nonce":4259724385}]},"public_addr":"10.20.193.44:6808/4259724385","cluster_addr":"10.20.193.44:6809/4259724385","heartbeat_back_addr":"10.20.193.44:6812/4259724385","heartbeat_front_addr":"10.20.193.44:6810/4259724385","state":["exists","up"]},{"osd":10,"uuid":"dbfdf855-de28-491b-9112-8009ab155fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6808","nonce":983512563}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6810","nonce":983512563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6813","nonce":983512563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6811","nonce":983512563}]},"public_addr":"10.20.193.170:6808/983512563","cluster_addr":"10.20.193.170:6810/983512563","heartbeat_back_addr":"10.20.193.170:6813/983512563","heartbeat_front_addr":"10.20.193.170:6811/983512563","state":["exists","up"]},{"osd":11,"uuid":"253e9d0b-391d-4647-bd89-6ab4b57909aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6804","nonce":2798179318}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6805","nonce":2798179318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6807","nonce":2798179318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6806","nonce":2798179318}]},"public_addr":"10.20.193.195:6804/2798179318","cluster_addr":"10.20.193.195:6805/2798179318","heartbeat_back_addr":"10.20.193.195:6807/2798179318","heartbeat_front_addr":"10.20.193.195:6806/2798179318","state":["exists","up"]},{"osd":12,"uuid":"7b7d5fca-4759-46e5-a681-45509749b265","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6801","nonce":1483397197}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6802","nonce":1483397197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6804","nonce":1483397197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6803","nonce":1483397197}]},"public_addr":"10.20.193.14:6801/1483397197","cluster_addr":"10.20.193.14:6802/1483397197","heartbeat_back_addr":"10.20.193.14:6804/1483397197","heartbeat_front_addr":"10.20.193.14:6803/1483397197","state":["exists","up"]},{"osd":13,"uuid":"8d1f12c8-5787-425d-a4a6-ac820bbf6e8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6800","nonce":3795416779}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6801","nonce":3795416779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6803","nonce":3795416779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6802","nonce":3795416779}]},"public_addr":"10.20.193.44:6800/3795416779","cluster_addr":"10.20.193.44:6801/3795416779","heartbeat_back_addr":"10.20.193.44:6803/3795416779","heartbeat_front_addr":"10.20.193.44:6802/3795416779","state":["exists","up"]},{"osd":14,"uuid":"866643a2-5f54-425c-b5ec-70607e191f02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6809","nonce":2177297767}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6812","nonce":2177297767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6815","nonce":2177297767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6814","nonce":2177297767}]},"public_addr":"10.20.193.170:6809/2177297767","cluster_addr":"10.20.193.170:6812/2177297767","heartbeat_back_addr":"10.20.193.170:6815/2177297767","heartbeat_front_addr":"10.20.193.170:6814/2177297767","state":["exists","up"]},{"osd":15,"uuid":"4726a8b0-bcef-4e7f-aa36-e80228e2aec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6809","nonce":3316970219}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6811","nonce":3316970219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6814","nonce":3316970219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6813","nonce":3316970219}]},"public_addr":"10.20.193.195:6809/3316970219","cluster_addr":"10.20.193.195:6811/3316970219","heartbeat_back_addr":"10.20.193.195:6814/3316970219","heartbeat_front_addr":"10.20.193.195:6813/3316970219","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.649198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.571073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.859654+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.714982+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.749516+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.546522+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.704013+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.829729+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.543314+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.580646+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.932784+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.682415+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.742679+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.618137+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.759234+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.913664+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T19:17:28.364 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.362+0000 7fcfc7509640 10 librados: watch_flush enter 2026-02-24T19:17:28.364 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.362+0000 7fcfc7509640 10 librados: watch_flush exit 2026-02-24T19:17:28.364 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.362+0000 7fcfc7509640 20 client.4384.objecter shutdown clearing up homeless session... 2026-02-24T19:17:28.364 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.362+0000 7fcfc7509640 10 client.4384.objecter successfully canceled tick 2026-02-24T19:17:28.364 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.362+0000 7fcfc7509640 1 -- 10.20.193.14:0/422654884 >> v1:10.20.193.14:6800/4014096310 conn(0x7fcf90077ef0 legacy=0x7fcf900983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.364 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.362+0000 7fcfc7509640 10 monclient: shutdown 2026-02-24T19:17:28.365 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.362+0000 7fcfc7509640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.365 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.362+0000 7fcfc7509640 1 -- 10.20.193.14:0/422654884 >> v1:10.20.193.44:6789/0 conn(0x7fcfc01626a0 legacy=0x7fcfc014aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.365 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.362+0000 7fcfc7509640 1 -- 10.20.193.14:0/422654884 shutdown_connections 2026-02-24T19:17:28.365 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.362+0000 7fcfc7509640 1 -- 10.20.193.14:0/422654884 >> 10.20.193.14:0/422654884 conn(0x7fcfc00b65f0 msgr2=0x7fcfc0055980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.365 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.362+0000 7fcfc7509640 1 -- 10.20.193.14:0/422654884 shutdown_connections 2026-02-24T19:17:28.365 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.362+0000 7fcfc7509640 1 -- 10.20.193.14:0/422654884 wait complete. 2026-02-24T19:17:28.365 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.362+0000 7fcfc7509640 1 librados: shutdown 2026-02-24T19:17:28.374 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-24T19:17:28.375 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-24T19:17:28.375 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-24T19:17:28.376 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-24T19:17:28.376 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2026-02-24T19:17:28.376 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2026-02-24T19:17:28.377 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2026-02-24T19:17:28.377 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2026-02-24T19:17:28.378 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2026-02-24T19:17:28.378 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2026-02-24T19:17:28.379 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 flush_pg_stats 2026-02-24T19:17:28.379 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 flush_pg_stats 2026-02-24T19:17:28.379 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 flush_pg_stats 2026-02-24T19:17:28.380 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 flush_pg_stats 2026-02-24T19:17:28.380 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 flush_pg_stats 2026-02-24T19:17:28.380 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 flush_pg_stats 2026-02-24T19:17:28.464 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.462+0000 7f28cdbb3640 10 monclient: get_monmap_and_config 2026-02-24T19:17:28.464 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.462+0000 7f28cdbb3640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.464 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.462+0000 7f28cdbb3640 10 monclient: monmap: 2026-02-24T19:17:28.464 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.464 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.464 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:28.463418+0000 2026-02-24T19:17:28.465 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:28.463418+0000 2026-02-24T19:17:28.465 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.465 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.465 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.465 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.465 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.465 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.466 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.462+0000 7f56ed25c640 10 monclient: get_monmap_and_config 2026-02-24T19:17:28.466 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.462+0000 7f56ed25c640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.466 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.462+0000 7f56ed25c640 10 monclient: monmap: 2026-02-24T19:17:28.466 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.466 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.466 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:28.463519+0000 2026-02-24T19:17:28.466 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:28.463519+0000 2026-02-24T19:17:28.466 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.466 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.466 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.467 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.467 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.467 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.467 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.463+0000 7f0e88ded640 10 monclient: get_monmap_and_config 2026-02-24T19:17:28.467 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.463+0000 7f0e88ded640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.467 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.463+0000 7f0e88ded640 10 monclient: monmap: 2026-02-24T19:17:28.467 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.467 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.468 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:28.463780+0000 2026-02-24T19:17:28.468 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:28.463780+0000 2026-02-24T19:17:28.468 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.468 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.468 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.468 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.468 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.468 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.469 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.463+0000 7f28cdbb3640 1 Processor -- start 2026-02-24T19:17:28.469 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.463+0000 7f28cdbb3640 1 -- start start 2026-02-24T19:17:28.469 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.463+0000 7f28cdbb3640 10 monclient: init 2026-02-24T19:17:28.469 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.463+0000 7f56ed25c640 1 Processor -- start 2026-02-24T19:17:28.469 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.463+0000 7f56ed25c640 1 -- start start 2026-02-24T19:17:28.469 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.463+0000 7f56ed25c640 10 monclient: init 2026-02-24T19:17:28.470 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.463+0000 7f0e88ded640 1 Processor -- start 2026-02-24T19:17:28.470 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.463+0000 7f0e88ded640 1 -- start start 2026-02-24T19:17:28.470 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.463+0000 7f0e88ded640 10 monclient: init 2026-02-24T19:17:28.471 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.464+0000 7f28cdbb3640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.471 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.464+0000 7f28cdbb3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:28.471 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.464+0000 7f28cdbb3640 10 monclient(hunting): picked mon.noname-c con 0x7f28c815b0a0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.471 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.464+0000 7f28cdbb3640 10 monclient(hunting): picked mon.noname-a con 0x7f28c80b3190 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.472 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.464+0000 7f56ed25c640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.472 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.464+0000 7f56ed25c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:28.472 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.464+0000 7f56ed25c640 10 monclient(hunting): picked mon.noname-c con 0x7f56e8157780 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.472 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.464+0000 7f56ed25c640 10 monclient(hunting): picked mon.noname-a con 0x7f56e8157b50 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.472 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.464+0000 7f56ed25c640 10 monclient(hunting): picked mon.noname-b con 0x7f56e8164d00 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.472 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.464+0000 7f56ed25c640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56e805de70 con 0x7f56e8157b50 2026-02-24T19:17:28.472 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.464+0000 7f56ed25c640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56e8055b20 con 0x7f56e8164d00 2026-02-24T19:17:28.473 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.464+0000 7f56ed25c640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56e8055e00 con 0x7f56e8157780 2026-02-24T19:17:28.473 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.464+0000 7f56ed25c640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.473 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.464+0000 7f56ed25c640 10 monclient(hunting): authenticate will time out at 3623.145399s 2026-02-24T19:17:28.473 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.464+0000 7f28cdbb3640 10 monclient(hunting): picked mon.noname-b con 0x7f28c80b5da0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.473 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.464+0000 7f28cdbb3640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28c80b3610 con 0x7f28c80b3190 2026-02-24T19:17:28.474 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.464+0000 7f28cdbb3640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28c80b38f0 con 0x7f28c80b5da0 2026-02-24T19:17:28.474 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.464+0000 7f28cdbb3640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28c80b3bd0 con 0x7f28c815b0a0 2026-02-24T19:17:28.474 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.464+0000 7f28cdbb3640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.474 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.464+0000 7f28cdbb3640 10 monclient(hunting): authenticate will time out at 3623.145509s 2026-02-24T19:17:28.475 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.464+0000 7f0e88ded640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.475 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.464+0000 7f0e88ded640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:28.475 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.464+0000 7f0e88ded640 10 monclient(hunting): picked mon.noname-c con 0x7f0e84159a70 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.475 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.464+0000 7f0e88ded640 10 monclient(hunting): picked mon.noname-b con 0x7f0e84159e40 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.475 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.464+0000 7f0e88ded640 10 monclient(hunting): picked mon.noname-a con 0x7f0e84058070 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.475 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.464+0000 7f0e88ded640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e84163930 con 0x7f0e84058070 2026-02-24T19:17:28.475 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.464+0000 7f0e88ded640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e84163bf0 con 0x7f0e84159e40 2026-02-24T19:17:28.475 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.464+0000 7f0e88ded640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e84163ed0 con 0x7f0e84159a70 2026-02-24T19:17:28.475 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.464+0000 7f0e88ded640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.476 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.464+0000 7f0e88ded640 10 monclient(hunting): authenticate will time out at 3623.145641s 2026-02-24T19:17:28.476 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.464+0000 7ff14612c640 10 monclient: get_monmap_and_config 2026-02-24T19:17:28.476 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.464+0000 7ff14612c640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.476 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.464+0000 7ff14612c640 10 monclient: monmap: 2026-02-24T19:17:28.477 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.477 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.477 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:28.465310+0000 2026-02-24T19:17:28.477 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:28.465310+0000 2026-02-24T19:17:28.477 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.477 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.477 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.477 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.477 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.477 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.464+0000 7f28c77fe640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7f28c815b0a0 0x7f28c8162300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:44668/0 (socket says 10.20.193.14:44668) 2026-02-24T19:17:28.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.464+0000 7f28c77fe640 1 -- 10.20.193.14:0/505935506 learned_addr learned my addr 10.20.193.14:0/505935506 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.465+0000 7ff14612c640 1 Processor -- start 2026-02-24T19:17:28.479 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.465+0000 7f56e7577640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7f56e8164d00 0x7f56e81c5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:34330/0 (socket says 10.20.193.14:34330) 2026-02-24T19:17:28.479 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.465+0000 7f56e7577640 1 -- 10.20.193.14:0/1644971506 learned_addr learned my addr 10.20.193.14:0/1644971506 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.479 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.465+0000 7ff14612c640 1 -- start start 2026-02-24T19:17:28.479 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.465+0000 7ff14612c640 10 monclient: init 2026-02-24T19:17:28.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.465+0000 7f0e82d76640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f0e84058070 0x7f0e84058460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:54654/0 (socket says 10.20.193.14:54654) 2026-02-24T19:17:28.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.465+0000 7f0e82d76640 1 -- 10.20.193.14:0/2149769258 learned_addr learned my addr 10.20.193.14:0/2149769258 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.465+0000 7f0e81d74640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7f0e84159e40 0x7f0e84163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:34344/0 (socket says 10.20.193.14:34344) 2026-02-24T19:17:28.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.465+0000 7ff14612c640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.465+0000 7ff14612c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:28.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.465+0000 7ff14612c640 10 monclient(hunting): picked mon.noname-a con 0x7ff1400b9f80 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.465+0000 7ff14612c640 10 monclient(hunting): picked mon.noname-b con 0x7ff1400ba350 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.465+0000 7ff14612c640 10 monclient(hunting): picked mon.noname-c con 0x7ff1400585e0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.465+0000 7ff14612c640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff140163930 con 0x7ff1400b9f80 2026-02-24T19:17:28.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.465+0000 7ff14612c640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff140163bb0 con 0x7ff1400ba350 2026-02-24T19:17:28.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.465+0000 7f7785bd9640 10 monclient: get_monmap_and_config 2026-02-24T19:17:28.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.465+0000 7f7785bd9640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.482 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.465+0000 7f7785bd9640 10 monclient: monmap: 2026-02-24T19:17:28.482 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.482 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.482 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:28.466455+0000 2026-02-24T19:17:28.482 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:28.466455+0000 2026-02-24T19:17:28.482 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.482 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.482 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.482 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.482 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.482 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.483 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.466+0000 7ff14612c640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff140163e90 con 0x7ff1400585e0 2026-02-24T19:17:28.483 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.466+0000 7ff14612c640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.483 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.466+0000 7ff14612c640 10 monclient(hunting): authenticate will time out at 3623.147039s 2026-02-24T19:17:28.483 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.466+0000 7f7785bd9640 1 Processor -- start 2026-02-24T19:17:28.484 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.466+0000 7f7785bd9640 1 -- start start 2026-02-24T19:17:28.484 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.466+0000 7f7785bd9640 10 monclient: init 2026-02-24T19:17:28.484 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.466+0000 7f4ecf88b640 10 monclient: get_monmap_and_config 2026-02-24T19:17:28.484 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.466+0000 7f4ecf88b640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.484 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.466+0000 7f4ecf88b640 10 monclient: monmap: 2026-02-24T19:17:28.484 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.484 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.484 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:28.467208+0000 2026-02-24T19:17:28.485 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:28.467208+0000 2026-02-24T19:17:28.485 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.485 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.485 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.485 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.485 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.485 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.466+0000 7f7785bd9640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.466+0000 7f7785bd9640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:28.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.466+0000 7f7785bd9640 10 monclient(hunting): picked mon.noname-c con 0x7f778015b0a0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.466+0000 7f7785bd9640 10 monclient(hunting): picked mon.noname-b con 0x7f77800b3190 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7f7785bd9640 10 monclient(hunting): picked mon.noname-a con 0x7f77800b5da0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7f7785bd9640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77800b3610 con 0x7f77800b5da0 2026-02-24T19:17:28.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7f7785bd9640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77800b38f0 con 0x7f77800b3190 2026-02-24T19:17:28.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7f7785bd9640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77800b3bd0 con 0x7f778015b0a0 2026-02-24T19:17:28.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7f7785bd9640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7f7785bd9640 10 monclient(hunting): authenticate will time out at 3623.148041s 2026-02-24T19:17:28.487 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7f4ecf88b640 1 Processor -- start 2026-02-24T19:17:28.487 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7f4ecf88b640 1 -- start start 2026-02-24T19:17:28.487 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7f4ecf88b640 10 monclient: init 2026-02-24T19:17:28.487 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7f5973d45640 10 monclient: get_monmap_and_config 2026-02-24T19:17:28.488 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7f5973d45640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.488 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7f5973d45640 10 monclient: monmap: 2026-02-24T19:17:28.488 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.488 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.488 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:28.467881+0000 2026-02-24T19:17:28.488 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:28.467881+0000 2026-02-24T19:17:28.488 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.488 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.488 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.488 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.488 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.489 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.489 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7f28c67fc640 1 -- 10.20.193.14:0/505935506 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 746896403 0 0) 0x7f28c80b3bd0 con 0x7f28c815b0a0 2026-02-24T19:17:28.489 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7f28c67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.489 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7f28c67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.489 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7f28c67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.489 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7f28c67fc640 10 monclient(hunting): my global_id is 4397 2026-02-24T19:17:28.489 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7f28c67fc640 1 -- 10.20.193.14:0/505935506 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28ac003610 con 0x7f28c815b0a0 2026-02-24T19:17:28.490 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7f56e5d74640 1 -- 10.20.193.14:0/1644971506 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 419324045 0 0) 0x7f56e8055b20 con 0x7f56e8164d00 2026-02-24T19:17:28.490 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7f56e5d74640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.490 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7f56e5d74640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.490 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7f56e5d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.490 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7f56e5d74640 10 monclient(hunting): my global_id is 4387 2026-02-24T19:17:28.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7ff13f7fe640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7ff1400b9f80 0x7ff140163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:54656/0 (socket says 10.20.193.14:54656) 2026-02-24T19:17:28.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7ff13f7fe640 1 -- 10.20.193.14:0/3191870825 learned_addr learned my addr 10.20.193.14:0/3191870825 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7f56e5d74640 1 -- 10.20.193.14:0/1644971506 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56d4003610 con 0x7f56e8164d00 2026-02-24T19:17:28.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7fc5ac955640 10 monclient: get_monmap_and_config 2026-02-24T19:17:28.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7fc5ac955640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7fc5ac955640 10 monclient: monmap: 2026-02-24T19:17:28.492 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.492 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.492 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:28.468355+0000 2026-02-24T19:17:28.492 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:28.468355+0000 2026-02-24T19:17:28.492 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.492 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.492 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.492 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.492 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.492 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.493 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7f4ecf88b640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.493 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7f4ecf88b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:28.493 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7f5973d45640 1 Processor -- start 2026-02-24T19:17:28.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7f4ecf88b640 10 monclient(hunting): picked mon.noname-c con 0x7f4ec80b9f80 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7f4ecf88b640 10 monclient(hunting): picked mon.noname-b con 0x7f4ec80ba350 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7f4ecf88b640 10 monclient(hunting): picked mon.noname-a con 0x7f4ec80585e0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7f4ecf88b640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ec8163930 con 0x7f4ec80585e0 2026-02-24T19:17:28.495 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7f5973d45640 1 -- start start 2026-02-24T19:17:28.495 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7f5973d45640 10 monclient: init 2026-02-24T19:17:28.495 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7f4ecf88b640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ec8163bb0 con 0x7f4ec80ba350 2026-02-24T19:17:28.496 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7f4ecf88b640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ec8163e90 con 0x7f4ec80b9f80 2026-02-24T19:17:28.496 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7f4ecf88b640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.496 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.467+0000 7f4ecf88b640 10 monclient(hunting): authenticate will time out at 3623.148994s 2026-02-24T19:17:28.496 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.468+0000 7fc5ac955640 1 Processor -- start 2026-02-24T19:17:28.496 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.468+0000 7fc5ac955640 1 -- start start 2026-02-24T19:17:28.496 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.468+0000 7fc5ac955640 10 monclient: init 2026-02-24T19:17:28.497 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.468+0000 7f5973d45640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.497 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.468+0000 7f5973d45640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:28.497 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.468+0000 7f5973d45640 10 monclient(hunting): picked mon.noname-c con 0x7f596c0b9f80 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.497 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.468+0000 7f5973d45640 10 monclient(hunting): picked mon.noname-b con 0x7f596c0ba350 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.497 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.468+0000 7f5973d45640 10 monclient(hunting): picked mon.noname-a con 0x7f596c0585e0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.498 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.468+0000 7f5973d45640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f596c163930 con 0x7f596c0585e0 2026-02-24T19:17:28.498 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.468+0000 7f5973d45640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f596c163bb0 con 0x7f596c0ba350 2026-02-24T19:17:28.498 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.468+0000 7f5973d45640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f596c163e90 con 0x7f596c0b9f80 2026-02-24T19:17:28.498 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.468+0000 7f5973d45640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.498 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.468+0000 7f5973d45640 10 monclient(hunting): authenticate will time out at 3623.149584s 2026-02-24T19:17:28.498 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.468+0000 7fc5ac955640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.498 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.468+0000 7fc5ac955640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:28.499 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.468+0000 7fc5ac955640 10 monclient(hunting): picked mon.noname-a con 0x7fc5a415af80 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.499 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.468+0000 7fc5ac955640 10 monclient(hunting): picked mon.noname-b con 0x7fc5a415b350 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.499 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.468+0000 7fc5ac955640 10 monclient(hunting): picked mon.noname-c con 0x7fc5a40b5d80 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.499 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.468+0000 7fc5ac955640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5a4059130 con 0x7fc5a415af80 2026-02-24T19:17:28.499 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.468+0000 7fc5ac955640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5a4059410 con 0x7fc5a415b350 2026-02-24T19:17:28.499 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.469+0000 7fc5ac955640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5a40596f0 con 0x7fc5a40b5d80 2026-02-24T19:17:28.499 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.469+0000 7fc5ac955640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.499 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.469+0000 7fc5ac955640 10 monclient(hunting): authenticate will time out at 3623.150006s 2026-02-24T19:17:28.499 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.469+0000 7f28c67fc640 1 -- 10.20.193.14:0/505935506 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2906749187 0 0) 0x7f28c80b38f0 con 0x7f28c80b5da0 2026-02-24T19:17:28.499 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.469+0000 7f28c67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.500 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.469+0000 7f28c67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.500 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.469+0000 7f28c67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.500 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.469+0000 7f28c67fc640 10 monclient(hunting): my global_id is 4390 2026-02-24T19:17:28.500 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.469+0000 7f28c67fc640 1 -- 10.20.193.14:0/505935506 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28c80b3bd0 con 0x7f28c80b5da0 2026-02-24T19:17:28.500 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.469+0000 7f0e81573640 1 -- 10.20.193.14:0/2149769258 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3259291659 0 0) 0x7f0e84163bf0 con 0x7f0e84159e40 2026-02-24T19:17:28.500 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.469+0000 7f0e81573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.500 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.469+0000 7f0e81573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.501 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.469+0000 7f0e81573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.501 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.469+0000 7f0e81573640 10 monclient(hunting): my global_id is 4393 2026-02-24T19:17:28.501 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.469+0000 7f0e81573640 1 -- 10.20.193.14:0/2149769258 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e70003610 con 0x7f0e84159e40 2026-02-24T19:17:28.501 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.470+0000 7f0e81573640 1 -- 10.20.193.14:0/2149769258 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3354732658 0 0) 0x7f0e84163930 con 0x7f0e84058070 2026-02-24T19:17:28.501 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.470+0000 7f0e81573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.501 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.470+0000 7f0e81573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.501 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.470+0000 7f0e81573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.501 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.470+0000 7f0e81573640 10 monclient(hunting): my global_id is 4392 2026-02-24T19:17:28.501 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.470+0000 7f0e81573640 1 -- 10.20.193.14:0/2149769258 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e84163bf0 con 0x7f0e84058070 2026-02-24T19:17:28.502 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.470+0000 7f4eccdff640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7f4ec80ba350 0x7f4ec8057ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:34370/0 (socket says 10.20.193.14:34370) 2026-02-24T19:17:28.502 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.470+0000 7f4eccdff640 1 -- 10.20.193.14:0/1119703420 learned_addr learned my addr 10.20.193.14:0/1119703420 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.502 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.470+0000 7f28c67fc640 1 -- 10.20.193.14:0/505935506 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 413070999 0 0) 0x7f28c80b3610 con 0x7f28c80b3190 2026-02-24T19:17:28.502 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.470+0000 7f28c67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.502 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.470+0000 7f28c67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.502 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.470+0000 7f28c67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.502 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.470+0000 7f28c67fc640 10 monclient(hunting): my global_id is 4395 2026-02-24T19:17:28.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.470+0000 7f28c67fc640 1 -- 10.20.193.14:0/505935506 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28c80b38f0 con 0x7f28c80b3190 2026-02-24T19:17:28.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.470+0000 7f0e81573640 1 -- 10.20.193.14:0/2149769258 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2119792406 0 0) 0x7f0e84163ed0 con 0x7f0e84159a70 2026-02-24T19:17:28.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.470+0000 7f0e81573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.470+0000 7f0e81573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.470+0000 7f0e81573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.470+0000 7f0e81573640 10 monclient(hunting): my global_id is 4403 2026-02-24T19:17:28.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.470+0000 7f0e81573640 1 -- 10.20.193.14:0/2149769258 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e84163930 con 0x7f0e84159a70 2026-02-24T19:17:28.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.471+0000 7ff13e7fc640 1 -- 10.20.193.14:0/3191870825 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 613199732 0 0) 0x7ff12c002910 con 0x7ff1400b9f80 2026-02-24T19:17:28.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.471+0000 7ff13e7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.471+0000 7ff13e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.471+0000 7ff13e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.471+0000 7ff13e7fc640 10 monclient(hunting): my global_id is 4398 2026-02-24T19:17:28.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.471+0000 7ff13e7fc640 1 -- 10.20.193.14:0/3191870825 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff124003610 con 0x7ff1400b9f80 2026-02-24T19:17:28.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.471+0000 7f59722bb640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f596c0585e0 0x7f596c166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:54696/0 (socket says 10.20.193.14:54696) 2026-02-24T19:17:28.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.471+0000 7f59722bb640 1 -- 10.20.193.14:0/2760581683 learned_addr learned my addr 10.20.193.14:0/2760581683 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.471+0000 7f56e5d74640 1 -- 10.20.193.14:0/1644971506 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4211959560 0 0) 0x7f56e8055e00 con 0x7f56e8157780 2026-02-24T19:17:28.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.471+0000 7f56e5d74640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.505 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.471+0000 7f56e5d74640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.505 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.471+0000 7f56e5d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.505 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.471+0000 7f56e5d74640 10 monclient(hunting): my global_id is 4400 2026-02-24T19:17:28.505 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.471+0000 7f56e5d74640 1 -- 10.20.193.14:0/1644971506 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56e8055b20 con 0x7f56e8157780 2026-02-24T19:17:28.505 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.471+0000 7f777effd640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7f77800b3190 0x7f77800b7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:34362/0 (socket says 10.20.193.14:34362) 2026-02-24T19:17:28.505 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.471+0000 7f777effd640 1 -- 10.20.193.14:0/3654713008 learned_addr learned my addr 10.20.193.14:0/3654713008 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.505 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.472+0000 7fa29fa9c640 10 monclient: get_monmap_and_config 2026-02-24T19:17:28.505 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.472+0000 7fa29fa9c640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.505 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.473+0000 7fa29fa9c640 10 monclient: monmap: 2026-02-24T19:17:28.505 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.506 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.506 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:28.473591+0000 2026-02-24T19:17:28.506 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:28.473591+0000 2026-02-24T19:17:28.506 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.506 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.506 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.506 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.506 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.506 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.506 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.473+0000 7fab46cd8640 10 monclient: get_monmap_and_config 2026-02-24T19:17:28.506 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.473+0000 7fab46cd8640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.506 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.473+0000 7fab46cd8640 10 monclient: monmap: 2026-02-24T19:17:28.506 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.507 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.507 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:28.473894+0000 2026-02-24T19:17:28.507 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:28.473894+0000 2026-02-24T19:17:28.507 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.507 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.507 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.507 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.507 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.507 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.507 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.473+0000 7f28c67fc640 1 -- 10.20.193.14:0/505935506 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2788535632 0 0) 0x7f28ac003610 con 0x7f28c815b0a0 2026-02-24T19:17:28.507 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.473+0000 7f28c67fc640 1 -- 10.20.193.14:0/505935506 >> v1:10.20.193.44:6789/0 conn(0x7f28c80b5da0 legacy=0x7f28c80b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.507 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.473+0000 7f28c67fc640 1 -- 10.20.193.14:0/505935506 >> v1:10.20.193.14:6789/0 conn(0x7f28c80b3190 legacy=0x7f28c80b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.507 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.473+0000 7f28c67fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.508 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.473+0000 7f28c67fc640 1 monclient: found mon.noname-c 2026-02-24T19:17:28.508 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.473+0000 7fa29fa9c640 1 Processor -- start 2026-02-24T19:17:28.508 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.473+0000 7fa29fa9c640 1 -- start start 2026-02-24T19:17:28.508 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.473+0000 7fa29fa9c640 10 monclient: init 2026-02-24T19:17:28.508 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.473+0000 7f28c67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.508 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.473+0000 7f28c67fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.508 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.473+0000 7f28c67fc640 1 -- 10.20.193.14:0/505935506 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28c80b3eb0 con 0x7f28c815b0a0 2026-02-24T19:17:28.508 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.473+0000 7f28c67fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.508 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.473+0000 7f28c67fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.508 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.473+0000 7f28c67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.509 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.473+0000 7f28c67fc640 1 -- 10.20.193.14:0/505935506 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f28b4002df0 con 0x7f28c815b0a0 2026-02-24T19:17:28.509 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.473+0000 7f28c67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.509 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.473+0000 7f28c67fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:28.509 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.473+0000 7f28c67fc640 10 monclient: dump: 2026-02-24T19:17:28.509 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.509 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.509 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.509 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.509 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.509 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.509 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.509 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.509 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.509 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.509 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.473+0000 7f28cdbb3640 5 monclient: authenticate success, global_id 4397 2026-02-24T19:17:28.509 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.473+0000 7f28cdbb3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.510 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.473+0000 7fab46cd8640 1 Processor -- start 2026-02-24T19:17:28.510 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.474+0000 7fa29fa9c640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.510 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.474+0000 7fa29fa9c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:28.510 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.474+0000 7fa29fa9c640 10 monclient(hunting): picked mon.noname-a con 0x7fa29815deb0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.510 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.474+0000 7fa29fa9c640 10 monclient(hunting): picked mon.noname-c con 0x7fa29815e280 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.510 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.474+0000 7fa29fa9c640 10 monclient(hunting): picked mon.noname-b con 0x7fa2980ba3b0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.510 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.474+0000 7fa29fa9c640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2980b5880 con 0x7fa29815deb0 2026-02-24T19:17:28.511 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.474+0000 7fa29fa9c640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2980b5b60 con 0x7fa2980ba3b0 2026-02-24T19:17:28.511 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.474+0000 7fa29fa9c640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2980b5e40 con 0x7fa29815e280 2026-02-24T19:17:28.511 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.474+0000 7fa29fa9c640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.511 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.474+0000 7fa29fa9c640 10 monclient(hunting): authenticate will time out at 3623.155371s 2026-02-24T19:17:28.511 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.473+0000 7fab46cd8640 1 -- start start 2026-02-24T19:17:28.511 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.473+0000 7fab46cd8640 10 monclient: init 2026-02-24T19:17:28.511 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.474+0000 7fab46cd8640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.511 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.474+0000 7fab46cd8640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:28.511 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.474+0000 7f4dd85c3640 10 monclient: get_monmap_and_config 2026-02-24T19:17:28.511 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.474+0000 7f4dd85c3640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.511 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.474+0000 7f4dd85c3640 10 monclient: monmap: 2026-02-24T19:17:28.512 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.512 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.512 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:28.475119+0000 2026-02-24T19:17:28.512 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:28.475119+0000 2026-02-24T19:17:28.512 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.512 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.512 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.512 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.512 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.512 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.513 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.474+0000 7fab46cd8640 10 monclient(hunting): picked mon.noname-b con 0x7fab400b9f80 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.513 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.474+0000 7fab46cd8640 10 monclient(hunting): picked mon.noname-a con 0x7fab400ba350 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.513 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.474+0000 7fab46cd8640 10 monclient(hunting): picked mon.noname-c con 0x7fab400585e0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.513 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.474+0000 7fab46cd8640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab40163930 con 0x7fab400ba350 2026-02-24T19:17:28.513 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.474+0000 7fab46cd8640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab40163bb0 con 0x7fab400b9f80 2026-02-24T19:17:28.513 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.474+0000 7fab46cd8640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab40163e90 con 0x7fab400585e0 2026-02-24T19:17:28.513 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.474+0000 7fab46cd8640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.513 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.474+0000 7fab46cd8640 10 monclient(hunting): authenticate will time out at 3623.155801s 2026-02-24T19:17:28.513 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.474+0000 7f4dd85c3640 1 Processor -- start 2026-02-24T19:17:28.513 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.475+0000 7fc5a9ec9640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7fc5a415b350 0x7fc5a41623c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:34396/0 (socket says 10.20.193.14:34396) 2026-02-24T19:17:28.513 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.475+0000 7fc5a9ec9640 1 -- 10.20.193.14:0/2043353022 learned_addr learned my addr 10.20.193.14:0/2043353022 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.514 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.475+0000 7f4eb7fff640 1 -- 10.20.193.14:0/1119703420 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1970243685 0 0) 0x7f4ec8163e90 con 0x7f4ec80b9f80 2026-02-24T19:17:28.514 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.475+0000 7f4eb7fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.514 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.475+0000 7f4eb7fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.514 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.475+0000 7f4eb7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.514 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.475+0000 7f4eb7fff640 10 monclient(hunting): my global_id is 4409 2026-02-24T19:17:28.514 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.475+0000 7f4eb7fff640 1 -- 10.20.193.14:0/1119703420 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4eb0003610 con 0x7f4ec80b9f80 2026-02-24T19:17:28.514 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.475+0000 7f4dd85c3640 1 -- start start 2026-02-24T19:17:28.514 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.475+0000 7f4dd85c3640 10 monclient: init 2026-02-24T19:17:28.514 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.475+0000 7f4dd85c3640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.515 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.475+0000 7f4dd85c3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:28.515 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.475+0000 7f4dd85c3640 10 monclient(hunting): picked mon.noname-c con 0x7f4dd00b9f80 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.515 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.475+0000 7f4dd85c3640 10 monclient(hunting): picked mon.noname-a con 0x7f4dd00ba350 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.515 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.475+0000 7f4dd85c3640 10 monclient(hunting): picked mon.noname-b con 0x7f4dd00585e0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.515 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.475+0000 7f4dd85c3640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dd0163930 con 0x7f4dd00ba350 2026-02-24T19:17:28.515 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.475+0000 7f4dd85c3640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dd0163bb0 con 0x7f4dd00585e0 2026-02-24T19:17:28.515 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.475+0000 7f4dd85c3640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dd0163e90 con 0x7f4dd00b9f80 2026-02-24T19:17:28.515 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.475+0000 7f4dd85c3640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.515 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.475+0000 7f4dd85c3640 10 monclient(hunting): authenticate will time out at 3623.156740s 2026-02-24T19:17:28.516 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.476+0000 7f0e81573640 1 -- 10.20.193.14:0/2149769258 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4226723118 0 0) 0x7f0e84163930 con 0x7f0e84159a70 2026-02-24T19:17:28.516 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.476+0000 7f0e81573640 1 -- 10.20.193.14:0/2149769258 >> v1:10.20.193.44:6789/0 conn(0x7f0e84159e40 legacy=0x7f0e84163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.516 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.476+0000 7f0e81573640 1 -- 10.20.193.14:0/2149769258 >> v1:10.20.193.14:6789/0 conn(0x7f0e84058070 legacy=0x7f0e84058460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.516 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.476+0000 7f0e81573640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.516 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.476+0000 7f0e81573640 1 monclient: found mon.noname-c 2026-02-24T19:17:28.516 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.476+0000 7f0e81573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.516 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.476+0000 7f0e81573640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.516 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.476+0000 7f0e81573640 1 -- 10.20.193.14:0/2149769258 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e84057590 con 0x7f0e84159a70 2026-02-24T19:17:28.516 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.476+0000 7f0e81573640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.516 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.476+0000 7f0e81573640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.516 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.476+0000 7f0e81573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.516 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.476+0000 7f0e81573640 1 -- 10.20.193.14:0/2149769258 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f0e78002dd0 con 0x7f0e84159a70 2026-02-24T19:17:28.517 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.476+0000 7f0e88ded640 5 monclient: authenticate success, global_id 4403 2026-02-24T19:17:28.517 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.476+0000 7f0e88ded640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.517 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.476+0000 7f0e81573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.517 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.476+0000 7f0e81573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:28.517 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.476+0000 7f0e81573640 10 monclient: dump: 2026-02-24T19:17:28.517 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.517 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.517 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.517 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.517 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.517 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.517 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.517 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.517 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.517 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.517 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.476+0000 7f0e88ded640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.517 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.477+0000 7ff13e7fc640 1 -- 10.20.193.14:0/3191870825 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 238959204 0 0) 0x7ff140163e90 con 0x7ff1400585e0 2026-02-24T19:17:28.517 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.477+0000 7ff13e7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.518 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.477+0000 7ff13e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.518 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.477+0000 7ff13e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.518 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.477+0000 7ff13e7fc640 10 monclient(hunting): my global_id is 4406 2026-02-24T19:17:28.518 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.477+0000 7ff13e7fc640 1 -- 10.20.193.14:0/3191870825 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff12c002910 con 0x7ff1400585e0 2026-02-24T19:17:28.518 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.477+0000 7f8303ca6640 10 monclient: get_monmap_and_config 2026-02-24T19:17:28.518 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.477+0000 7f8303ca6640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.518 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.477+0000 7f8303ca6640 10 monclient: monmap: 2026-02-24T19:17:28.518 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.518 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.518 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:28.478126+0000 2026-02-24T19:17:28.518 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:28.478126+0000 2026-02-24T19:17:28.518 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.518 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.518 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.518 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.518 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.518 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.519 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.477+0000 7f4eb7fff640 1 -- 10.20.193.14:0/1119703420 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 403358566 0 0) 0x7f4ec4002c90 con 0x7f4ec80585e0 2026-02-24T19:17:28.519 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.477+0000 7f4eb7fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.519 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.477+0000 7f4eb7fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.519 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.477+0000 7f4eb7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.519 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.477+0000 7f4eb7fff640 10 monclient(hunting): my global_id is 4401 2026-02-24T19:17:28.519 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.477+0000 7f4eb7fff640 1 -- 10.20.193.14:0/1119703420 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ec8163e90 con 0x7f4ec80585e0 2026-02-24T19:17:28.519 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.477+0000 7f5f80ee8640 10 monclient: get_monmap_and_config 2026-02-24T19:17:28.519 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.477+0000 7f5f80ee8640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.519 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.477+0000 7f5f80ee8640 10 monclient: monmap: 2026-02-24T19:17:28.519 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.519 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.520 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:28.478572+0000 2026-02-24T19:17:28.520 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:28.478572+0000 2026-02-24T19:17:28.520 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.520 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.520 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.520 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.520 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.520 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.520 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.478+0000 7f8303ca6640 1 Processor -- start 2026-02-24T19:17:28.520 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.478+0000 7f5970ab8640 1 -- 10.20.193.14:0/2760581683 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3279809629 0 0) 0x7f5968002c90 con 0x7f596c0585e0 2026-02-24T19:17:28.520 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.478+0000 7f5970ab8640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.520 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.478+0000 7f5970ab8640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.520 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.478+0000 7f5970ab8640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.520 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.478+0000 7f5970ab8640 10 monclient(hunting): my global_id is 4404 2026-02-24T19:17:28.520 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.478+0000 7f5970ab8640 1 -- 10.20.193.14:0/2760581683 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5954003610 con 0x7f596c0585e0 2026-02-24T19:17:28.521 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.478+0000 7f8303ca6640 1 -- start start 2026-02-24T19:17:28.521 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.478+0000 7f8303ca6640 10 monclient: init 2026-02-24T19:17:28.521 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.478+0000 7f8303ca6640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.521 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.478+0000 7f8303ca6640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:28.521 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.478+0000 7f8303ca6640 10 monclient(hunting): picked mon.noname-b con 0x7f82fc0b9f80 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.521 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.478+0000 7f5f80ee8640 1 Processor -- start 2026-02-24T19:17:28.521 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.478+0000 7f5f80ee8640 1 -- start start 2026-02-24T19:17:28.521 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.478+0000 7f5f80ee8640 10 monclient: init 2026-02-24T19:17:28.521 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.478+0000 7feee249f640 10 monclient: get_monmap_and_config 2026-02-24T19:17:28.521 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.478+0000 7feee249f640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.521 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.478+0000 7feee249f640 10 monclient: monmap: 2026-02-24T19:17:28.521 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.521 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.521 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:28.479307+0000 2026-02-24T19:17:28.521 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:28.479307+0000 2026-02-24T19:17:28.522 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.522 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.522 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.522 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.522 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.522 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.522 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.478+0000 7f8303ca6640 10 monclient(hunting): picked mon.noname-c con 0x7f82fc0ba350 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.522 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.478+0000 7f8303ca6640 10 monclient(hunting): picked mon.noname-a con 0x7f82fc0585e0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.522 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.478+0000 7f8303ca6640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82fc163930 con 0x7f82fc0585e0 2026-02-24T19:17:28.522 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.478+0000 7f8303ca6640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82fc163bb0 con 0x7f82fc0b9f80 2026-02-24T19:17:28.522 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.478+0000 7f8303ca6640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82fc163e90 con 0x7f82fc0ba350 2026-02-24T19:17:28.522 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.478+0000 7f8303ca6640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.522 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.478+0000 7f8303ca6640 10 monclient(hunting): authenticate will time out at 3623.159887s 2026-02-24T19:17:28.523 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.479+0000 7f5f80ee8640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.523 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.479+0000 7f5f80ee8640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:28.523 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.479+0000 7f48c915c640 10 monclient: get_monmap_and_config 2026-02-24T19:17:28.523 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.479+0000 7f48c915c640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.523 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.479+0000 7f5f80ee8640 10 monclient(hunting): picked mon.noname-b con 0x7f5f7c159a70 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.523 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.479+0000 7f5f80ee8640 10 monclient(hunting): picked mon.noname-a con 0x7f5f7c159e40 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.523 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.479+0000 7feee249f640 1 Processor -- start 2026-02-24T19:17:28.523 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.479+0000 7f48c915c640 10 monclient: monmap: 2026-02-24T19:17:28.523 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.523 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.524 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:28.479761+0000 2026-02-24T19:17:28.524 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:28.479761+0000 2026-02-24T19:17:28.524 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.524 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.524 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.524 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.524 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.524 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.524 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.479+0000 7f5f80ee8640 10 monclient(hunting): picked mon.noname-c con 0x7f5f7c058070 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.524 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.479+0000 7f5f80ee8640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f7c163930 con 0x7f5f7c159e40 2026-02-24T19:17:28.524 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.479+0000 7feee249f640 1 -- start start 2026-02-24T19:17:28.524 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.479+0000 7feee249f640 10 monclient: init 2026-02-24T19:17:28.524 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.479+0000 7f5f80ee8640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f7c163bf0 con 0x7f5f7c159a70 2026-02-24T19:17:28.524 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.479+0000 7f5f80ee8640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f7c163ed0 con 0x7f5f7c058070 2026-02-24T19:17:28.524 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.479+0000 7f5f80ee8640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.524 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.479+0000 7f5f80ee8640 10 monclient(hunting): authenticate will time out at 3623.160340s 2026-02-24T19:17:28.525 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.479+0000 7feee249f640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.525 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.479+0000 7feee249f640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:28.525 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.479+0000 7feee249f640 10 monclient(hunting): picked mon.noname-a con 0x7feedc0b9f80 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.525 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.479+0000 7feee249f640 10 monclient(hunting): picked mon.noname-c con 0x7feedc0ba350 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.525 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7feee249f640 10 monclient(hunting): picked mon.noname-b con 0x7feedc0585e0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.525 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7feee249f640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feedc163930 con 0x7feedc0b9f80 2026-02-24T19:17:28.525 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7feee249f640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feedc163bb0 con 0x7feedc0585e0 2026-02-24T19:17:28.525 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f48c915c640 1 Processor -- start 2026-02-24T19:17:28.525 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7feee249f640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feedc163e90 con 0x7feedc0ba350 2026-02-24T19:17:28.525 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7feee249f640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.525 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7feee249f640 10 monclient(hunting): authenticate will time out at 3623.161034s 2026-02-24T19:17:28.526 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f4eb7fff640 1 -- 10.20.193.14:0/1119703420 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3323132203 0 0) 0x7f4ec8163bb0 con 0x7f4ec80ba350 2026-02-24T19:17:28.526 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f4eb7fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.526 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f4eb7fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.526 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f4eb7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.526 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f4eb7fff640 10 monclient(hunting): my global_id is 4399 2026-02-24T19:17:28.526 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f48c915c640 1 -- start start 2026-02-24T19:17:28.526 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f48c915c640 10 monclient: init 2026-02-24T19:17:28.526 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f4eb7fff640 1 -- 10.20.193.14:0/1119703420 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ec4002c90 con 0x7f4ec80ba350 2026-02-24T19:17:28.526 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f777e7fc640 1 -- 10.20.193.14:0/3654713008 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 231728715 0 0) 0x7f77800b38f0 con 0x7f77800b3190 2026-02-24T19:17:28.526 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f777e7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.526 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f777e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.527 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f777e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.527 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f777e7fc640 10 monclient(hunting): my global_id is 4396 2026-02-24T19:17:28.527 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f777e7fc640 1 -- 10.20.193.14:0/3654713008 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7764003610 con 0x7f77800b3190 2026-02-24T19:17:28.527 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f4eb7fff640 1 -- 10.20.193.14:0/1119703420 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1721050619 0 0) 0x7f4eb0003610 con 0x7f4ec80b9f80 2026-02-24T19:17:28.527 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f4eb7fff640 1 -- 10.20.193.14:0/1119703420 >> v1:10.20.193.44:6789/0 conn(0x7f4ec80ba350 legacy=0x7f4ec8057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.527 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f4eb7fff640 1 -- 10.20.193.14:0/1119703420 >> v1:10.20.193.14:6789/0 conn(0x7f4ec80585e0 legacy=0x7f4ec8166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.527 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f4eb7fff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.527 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f4eb7fff640 1 monclient: found mon.noname-c 2026-02-24T19:17:28.527 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f4eb7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.527 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f4eb7fff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.527 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f4eb7fff640 1 -- 10.20.193.14:0/1119703420 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ec80573f0 con 0x7f4ec80b9f80 2026-02-24T19:17:28.527 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f4eb7fff640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.527 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f4eb7fff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.527 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f4eb7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.527 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f4ecf88b640 5 monclient: authenticate success, global_id 4409 2026-02-24T19:17:28.528 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f4ecf88b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.528 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f4eb7fff640 1 -- 10.20.193.14:0/1119703420 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4eb8002df0 con 0x7f4ec80b9f80 2026-02-24T19:17:28.528 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f4eb7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.528 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f4eb7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:28.528 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f4eb7fff640 10 monclient: dump: 2026-02-24T19:17:28.528 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.528 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.528 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.528 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.528 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.528 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.528 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.528 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.528 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.528 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.528 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f4ecf88b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.528 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f48c915c640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.528 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f48c915c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:28.528 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f48c915c640 10 monclient(hunting): picked mon.noname-b con 0x7f48c4059e70 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.529 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f48c915c640 10 monclient(hunting): picked mon.noname-c con 0x7f48c4058580 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.529 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f48c915c640 10 monclient(hunting): picked mon.noname-a con 0x7f48c405a240 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.529 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f48c915c640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48c4160560 con 0x7f48c405a240 2026-02-24T19:17:28.529 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f48c915c640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48c4160820 con 0x7f48c4059e70 2026-02-24T19:17:28.529 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f48c915c640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48c4160b00 con 0x7f48c4058580 2026-02-24T19:17:28.529 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f48c915c640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.529 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7f48c915c640 10 monclient(hunting): authenticate will time out at 3623.161642s 2026-02-24T19:17:28.529 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7fa29e012640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7fa2980ba3b0 0x7fa2980ad850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:34404/0 (socket says 10.20.193.14:34404) 2026-02-24T19:17:28.529 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.480+0000 7fa29e012640 1 -- 10.20.193.14:0/3628137673 learned_addr learned my addr 10.20.193.14:0/3628137673 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.529 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.481+0000 7f4dd6b39640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7f4dd00585e0 0x7f4dd0166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:34420/0 (socket says 10.20.193.14:34420) 2026-02-24T19:17:28.529 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.481+0000 7f4dd6b39640 1 -- 10.20.193.14:0/2289182226 learned_addr learned my addr 10.20.193.14:0/2289182226 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.529 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.481+0000 7f56e5d74640 1 -- 10.20.193.14:0/1644971506 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 278629794 0 0) 0x7f56d4003610 con 0x7f56e8164d00 2026-02-24T19:17:28.529 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.481+0000 7f56e5d74640 1 -- 10.20.193.14:0/1644971506 >> v1:10.20.193.170:6789/0 conn(0x7f56e8157780 legacy=0x7f56e8056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.529 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.481+0000 7f56e5d74640 1 -- 10.20.193.14:0/1644971506 >> v1:10.20.193.14:6789/0 conn(0x7f56e8157b50 legacy=0x7f56e81645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.529 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.481+0000 7f56e5d74640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.529 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.481+0000 7f56e5d74640 1 monclient: found mon.noname-b 2026-02-24T19:17:28.529 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.481+0000 7f56e5d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.530 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.481+0000 7f56e5d74640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.530 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.481+0000 7f56e5d74640 1 -- 10.20.193.14:0/1644971506 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e80560e0 con 0x7f56e8164d00 2026-02-24T19:17:28.530 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.481+0000 7f56e5d74640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.530 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.481+0000 7f56e5d74640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.530 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.481+0000 7f56e5d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.530 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.481+0000 7f56e5d74640 1 -- 10.20.193.14:0/1644971506 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f56d8003170 con 0x7f56e8164d00 2026-02-24T19:17:28.530 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.481+0000 7f56e5d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.530 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.481+0000 7f56e5d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:28.530 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.481+0000 7f56e5d74640 10 monclient: dump: 2026-02-24T19:17:28.530 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.530 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.530 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.530 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.530 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.530 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.530 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.530 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.530 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.530 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.530 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.481+0000 7f56ed25c640 5 monclient: authenticate success, global_id 4387 2026-02-24T19:17:28.530 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.481+0000 7f56ed25c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.530 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.481+0000 7ff13e7fc640 1 -- 10.20.193.14:0/3191870825 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2094656241 0 0) 0x7ff140163bb0 con 0x7ff1400ba350 2026-02-24T19:17:28.531 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.481+0000 7ff13e7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.531 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.481+0000 7ff13e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.531 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.481+0000 7ff13e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.531 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.481+0000 7ff13e7fc640 10 monclient(hunting): my global_id is 4402 2026-02-24T19:17:28.531 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.481+0000 7ff13e7fc640 1 -- 10.20.193.14:0/3191870825 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff140163e90 con 0x7ff1400ba350 2026-02-24T19:17:28.531 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.481+0000 7fdd15c4d640 10 monclient: get_monmap_and_config 2026-02-24T19:17:28.531 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.481+0000 7fdd15c4d640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.531 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.481+0000 7fdd15c4d640 10 monclient: monmap: 2026-02-24T19:17:28.531 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.531 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.531 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:28.482263+0000 2026-02-24T19:17:28.531 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:28.482263+0000 2026-02-24T19:17:28.531 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.531 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.531 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.531 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.531 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.531 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.531 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.482+0000 7fdd15c4d640 1 Processor -- start 2026-02-24T19:17:28.531 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.482+0000 7f5970ab8640 1 -- 10.20.193.14:0/2760581683 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1313549018 0 0) 0x7f596c163e90 con 0x7f596c0b9f80 2026-02-24T19:17:28.532 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.482+0000 7f5970ab8640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.532 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.482+0000 7f5970ab8640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.532 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.482+0000 7f5970ab8640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.532 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.482+0000 7f5970ab8640 10 monclient(hunting): my global_id is 4415 2026-02-24T19:17:28.532 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.482+0000 7f5970ab8640 1 -- 10.20.193.14:0/2760581683 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5968002c90 con 0x7f596c0b9f80 2026-02-24T19:17:28.532 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.482+0000 7fdd15c4d640 1 -- start start 2026-02-24T19:17:28.532 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.482+0000 7fdd15c4d640 10 monclient: init 2026-02-24T19:17:28.532 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.482+0000 7f28c67fc640 1 -- 10.20.193.14:0/505935506 <== mon.2 v1:10.20.193.170:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f28b4002fc0 con 0x7f28c815b0a0 2026-02-24T19:17:28.532 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.482+0000 7f28c67fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.532 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.482+0000 7f28c67fc640 1 -- 10.20.193.14:0/505935506 <== mon.2 v1:10.20.193.170:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f28b4003400 con 0x7f28c815b0a0 2026-02-24T19:17:28.533 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.482+0000 7f28cdbb3640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:28.533 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.482+0000 7f28c67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.533 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.482+0000 7f28c67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:28.533 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.482+0000 7f28c67fc640 10 monclient: dump: 2026-02-24T19:17:28.533 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.533 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.533 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.533 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.533 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.533 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.533 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.533 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.533 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.533 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.533 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.482+0000 7f28cdbb3640 4 set_mon_vals no callback set 2026-02-24T19:17:28.533 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.482+0000 7fc5a96c8640 1 -- 10.20.193.14:0/2043353022 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 229065820 0 0) 0x7fc5a4059410 con 0x7fc5a415b350 2026-02-24T19:17:28.533 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.482+0000 7fc5a96c8640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.533 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.482+0000 7fc5a96c8640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.533 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.482+0000 7fc5a96c8640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.533 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.482+0000 7fc5a96c8640 10 monclient(hunting): my global_id is 4405 2026-02-24T19:17:28.533 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.482+0000 7fc5a96c8640 1 -- 10.20.193.14:0/2043353022 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc594003610 con 0x7fc5a415b350 2026-02-24T19:17:28.534 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.482+0000 7fdd15c4d640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.534 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.482+0000 7fdd15c4d640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:28.534 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.482+0000 7fdd15c4d640 10 monclient(hunting): picked mon.noname-a con 0x7fdd10159a70 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.534 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.482+0000 7fdd15c4d640 10 monclient(hunting): picked mon.noname-b con 0x7fdd10159e40 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.534 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.482+0000 7fdd15c4d640 10 monclient(hunting): picked mon.noname-c con 0x7fdd10058070 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.534 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.482+0000 7fdd15c4d640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd10163930 con 0x7fdd10159a70 2026-02-24T19:17:28.534 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.482+0000 7fab44a4d640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7fab400b9f80 0x7fab40163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:34410/0 (socket says 10.20.193.14:34410) 2026-02-24T19:17:28.534 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.482+0000 7fab44a4d640 1 -- 10.20.193.14:0/2887742981 learned_addr learned my addr 10.20.193.14:0/2887742981 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.534 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.482+0000 7fdd15c4d640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd10163bf0 con 0x7fdd10159e40 2026-02-24T19:17:28.534 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.482+0000 7fdd15c4d640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd10163ed0 con 0x7fdd10058070 2026-02-24T19:17:28.534 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.482+0000 7fdd15c4d640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.534 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.482+0000 7fdd15c4d640 10 monclient(hunting): authenticate will time out at 3623.163887s 2026-02-24T19:17:28.535 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.483+0000 7f28cdbb3640 10 monclient: shutdown 2026-02-24T19:17:28.535 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.483+0000 7f28cdbb3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.535 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.483+0000 7f28cdbb3640 1 -- 10.20.193.14:0/505935506 >> v1:10.20.193.170:6789/0 conn(0x7f28c815b0a0 legacy=0x7f28c8162300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.535 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.483+0000 7f28cdbb3640 1 -- 10.20.193.14:0/505935506 shutdown_connections 2026-02-24T19:17:28.535 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.483+0000 7f28cdbb3640 1 -- 10.20.193.14:0/505935506 >> 10.20.193.14:0/505935506 conn(0x7f28c80b5290 msgr2=0x7f28c80b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.535 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.483+0000 7f28cdbb3640 1 -- 10.20.193.14:0/505935506 shutdown_connections 2026-02-24T19:17:28.535 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.483+0000 7f28cdbb3640 1 -- 10.20.193.14:0/505935506 wait complete. 2026-02-24T19:17:28.535 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.483+0000 7f28cdbb3640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.535 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.483+0000 7f28cdbb3640 10 monclient: monmap: 2026-02-24T19:17:28.535 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.535 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:28.535 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:28.535 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:28.535 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.535 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:28.535 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.535 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.535 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.535 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.535 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.483+0000 7f28cdbb3640 1 librados: starting msgr at 2026-02-24T19:17:28.535 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.483+0000 7f28cdbb3640 1 librados: starting objecter 2026-02-24T19:17:28.535 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.483+0000 7f28cdbb3640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:28.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.484+0000 7f28cdbb3640 1 Processor -- start 2026-02-24T19:17:28.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.484+0000 7f28cdbb3640 1 -- start start 2026-02-24T19:17:28.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.484+0000 7f28cdbb3640 1 librados: setting wanted keys 2026-02-24T19:17:28.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.484+0000 7f28cdbb3640 1 librados: calling monclient init 2026-02-24T19:17:28.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.484+0000 7f28cdbb3640 10 monclient: init 2026-02-24T19:17:28.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.484+0000 7f28cdbb3640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.484+0000 7f28cdbb3640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:28.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.484+0000 7f28cdbb3640 10 monclient(hunting): picked mon.noname-b con 0x7f28c80b5da0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.484+0000 7f28cdbb3640 10 monclient(hunting): picked mon.noname-c con 0x7f28c815b0a0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.484+0000 7f28cdbb3640 10 monclient(hunting): picked mon.noname-a con 0x7f28c81f97f0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.484+0000 7f28cdbb3640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28c8160e00 con 0x7f28c81f97f0 2026-02-24T19:17:28.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.484+0000 7f28cdbb3640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28c8155cc0 con 0x7f28c80b5da0 2026-02-24T19:17:28.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.484+0000 7f28cdbb3640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28c81610c0 con 0x7f28c815b0a0 2026-02-24T19:17:28.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.484+0000 7f28cdbb3640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.484+0000 7f28cdbb3640 10 monclient(hunting): authenticate will time out at 3623.165581s 2026-02-24T19:17:28.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.484+0000 7ff13e7fc640 1 -- 10.20.193.14:0/3191870825 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4222744405 0 0) 0x7ff124003610 con 0x7ff1400b9f80 2026-02-24T19:17:28.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.484+0000 7ff13e7fc640 1 -- 10.20.193.14:0/3191870825 >> v1:10.20.193.170:6789/0 conn(0x7ff1400585e0 legacy=0x7ff140166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.484+0000 7ff13e7fc640 1 -- 10.20.193.14:0/3191870825 >> v1:10.20.193.44:6789/0 conn(0x7ff1400ba350 legacy=0x7ff140057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.484+0000 7ff13e7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.484+0000 7ff13e7fc640 1 monclient: found mon.noname-a 2026-02-24T19:17:28.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.484+0000 7ff13e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.484+0000 7ff13e7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.484+0000 7ff13e7fc640 1 -- 10.20.193.14:0/3191870825 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1400573f0 con 0x7ff1400b9f80 2026-02-24T19:17:28.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.484+0000 7ff13e7fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.484+0000 7ff13e7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.484+0000 7ff13e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.484+0000 7ff13e7fc640 1 -- 10.20.193.14:0/3191870825 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ff12c002fc0 con 0x7ff1400b9f80 2026-02-24T19:17:28.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.484+0000 7ff13e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.484+0000 7ff13e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:28.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.484+0000 7ff13e7fc640 10 monclient: dump: 2026-02-24T19:17:28.537 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.537 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.537 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.537 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.537 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.537 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.537 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.537 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.537 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.537 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.484+0000 7ff14612c640 5 monclient: authenticate success, global_id 4398 2026-02-24T19:17:28.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.484+0000 7ff14612c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.485+0000 7f777e7fc640 1 -- 10.20.193.14:0/3654713008 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4067119262 0 0) 0x7f77800b3bd0 con 0x7f778015b0a0 2026-02-24T19:17:28.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.485+0000 7f777e7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.485+0000 7f777e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.485+0000 7f777e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.485+0000 7f777e7fc640 10 monclient(hunting): my global_id is 4412 2026-02-24T19:17:28.538 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.485+0000 7f777e7fc640 1 -- 10.20.193.14:0/3654713008 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77800b38f0 con 0x7f778015b0a0 2026-02-24T19:17:28.538 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.486+0000 7fc5a96c8640 1 -- 10.20.193.14:0/2043353022 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2291445956 0 0) 0x7fc5a40596f0 con 0x7fc5a40b5d80 2026-02-24T19:17:28.538 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.486+0000 7fc5a96c8640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.538 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.486+0000 7fc5a96c8640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.538 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.486+0000 7fc5a96c8640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.538 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.486+0000 7fc5a96c8640 10 monclient(hunting): my global_id is 4418 2026-02-24T19:17:28.538 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.486+0000 7fc5a96c8640 1 -- 10.20.193.14:0/2043353022 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5a4059410 con 0x7fc5a40b5d80 2026-02-24T19:17:28.538 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.486+0000 7f0e81573640 1 -- 10.20.193.14:0/2149769258 <== mon.2 v1:10.20.193.170:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0e78002fe0 con 0x7f0e84159a70 2026-02-24T19:17:28.538 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.486+0000 7f0e81573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.538 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.486+0000 7f0e81573640 1 -- 10.20.193.14:0/2149769258 <== mon.2 v1:10.20.193.170:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f0e780033e0 con 0x7f0e84159a70 2026-02-24T19:17:28.538 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.486+0000 7f0e88ded640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:28.538 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.486+0000 7f0e88ded640 4 set_mon_vals no callback set 2026-02-24T19:17:28.538 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.486+0000 7f0e81573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.538 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.486+0000 7f0e81573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:28.538 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.486+0000 7f0e81573640 10 monclient: dump: 2026-02-24T19:17:28.538 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.538 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.538 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.538 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.538 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.539 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.539 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.539 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.539 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.539 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.539 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.487+0000 7f830121a640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7f82fc0ba350 0x7f82fc057ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:44784/0 (socket says 10.20.193.14:44784) 2026-02-24T19:17:28.539 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.487+0000 7f830121a640 1 -- 10.20.193.14:0/2187888260 learned_addr learned my addr 10.20.193.14:0/2187888260 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.539 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.487+0000 7f0e88ded640 10 monclient: shutdown 2026-02-24T19:17:28.539 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.487+0000 7f0e88ded640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.539 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.487+0000 7f0e88ded640 1 -- 10.20.193.14:0/2149769258 >> v1:10.20.193.170:6789/0 conn(0x7f0e84159a70 legacy=0x7f0e840b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.539 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.487+0000 7f0e88ded640 1 -- 10.20.193.14:0/2149769258 shutdown_connections 2026-02-24T19:17:28.539 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.487+0000 7f0e88ded640 1 -- 10.20.193.14:0/2149769258 >> 10.20.193.14:0/2149769258 conn(0x7f0e840b7780 msgr2=0x7f0e840b7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.539 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.487+0000 7f0e88ded640 1 -- 10.20.193.14:0/2149769258 shutdown_connections 2026-02-24T19:17:28.539 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.487+0000 7f0e88ded640 1 -- 10.20.193.14:0/2149769258 wait complete. 2026-02-24T19:17:28.539 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.488+0000 7f4dd5336640 1 -- 10.20.193.14:0/2289182226 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1605115250 0 0) 0x7f4dd0163bb0 con 0x7f4dd00585e0 2026-02-24T19:17:28.540 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.488+0000 7f4dd5336640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.540 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.488+0000 7f4dd5336640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.540 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.488+0000 7f4dd5336640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.540 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.488+0000 7f4dd5336640 10 monclient(hunting): my global_id is 4411 2026-02-24T19:17:28.540 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.488+0000 7f4dd5336640 1 -- 10.20.193.14:0/2289182226 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4db8003610 con 0x7f4dd00585e0 2026-02-24T19:17:28.540 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.488+0000 7f0e88ded640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.540 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.488+0000 7f0e88ded640 10 monclient: monmap: 2026-02-24T19:17:28.540 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.540 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:28.540 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:28.540 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:28.540 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.540 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:28.540 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.540 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.541 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.541 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.541 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.488+0000 7f0e88ded640 1 librados: starting msgr at 2026-02-24T19:17:28.541 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.488+0000 7f0e88ded640 1 librados: starting objecter 2026-02-24T19:17:28.541 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.488+0000 7f0e88ded640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:28.541 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.488+0000 7f0e88ded640 1 Processor -- start 2026-02-24T19:17:28.541 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.488+0000 7f0e88ded640 1 -- start start 2026-02-24T19:17:28.541 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.488+0000 7f0e88ded640 1 librados: setting wanted keys 2026-02-24T19:17:28.541 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.488+0000 7f0e88ded640 1 librados: calling monclient init 2026-02-24T19:17:28.541 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.488+0000 7f0e88ded640 10 monclient: init 2026-02-24T19:17:28.541 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.489+0000 7f0e88ded640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.541 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.489+0000 7f0e88ded640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:28.541 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.489+0000 7f0e88ded640 10 monclient(hunting): picked mon.noname-b con 0x7f0e84058070 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.541 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.489+0000 7f0e88ded640 10 monclient(hunting): picked mon.noname-a con 0x7f0e84159a70 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.541 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.489+0000 7f0e88ded640 10 monclient(hunting): picked mon.noname-c con 0x7f0e84159e40 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.541 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.489+0000 7f0e88ded640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e841fb300 con 0x7f0e84159a70 2026-02-24T19:17:28.541 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.489+0000 7f0e88ded640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e8415fd20 con 0x7f0e84058070 2026-02-24T19:17:28.541 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.489+0000 7f0e88ded640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e84160000 con 0x7f0e84159e40 2026-02-24T19:17:28.541 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.489+0000 7f0e88ded640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.541 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.489+0000 7f0e88ded640 10 monclient(hunting): authenticate will time out at 3623.170266s 2026-02-24T19:17:28.541 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.489+0000 7f5f7a575640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7f5f7c159a70 0x7f5f7c0b6d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:34442/0 (socket says 10.20.193.14:34442) 2026-02-24T19:17:28.541 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.489+0000 7f5f7a575640 1 -- 10.20.193.14:0/1475427421 learned_addr learned my addr 10.20.193.14:0/1475427421 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.541 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.489+0000 7f5970ab8640 1 -- 10.20.193.14:0/2760581683 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1644365450 0 0) 0x7f596c163bb0 con 0x7f596c0ba350 2026-02-24T19:17:28.541 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.489+0000 7f5970ab8640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.541 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.489+0000 7f5970ab8640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.541 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.489+0000 7f5970ab8640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.541 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.489+0000 7f5970ab8640 10 monclient(hunting): my global_id is 4408 2026-02-24T19:17:28.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.489+0000 7f5970ab8640 1 -- 10.20.193.14:0/2760581683 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f596c163e90 con 0x7f596c0ba350 2026-02-24T19:17:28.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.490+0000 7feedbfff640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7feedc0b9f80 0x7feedc163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:54762/0 (socket says 10.20.193.14:54762) 2026-02-24T19:17:28.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.490+0000 7feedbfff640 1 -- 10.20.193.14:0/2449888433 learned_addr learned my addr 10.20.193.14:0/2449888433 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.491+0000 7f48c2575640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7f48c4058580 0x7f48c4056600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:44826/0 (socket says 10.20.193.14:44826) 2026-02-24T19:17:28.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.491+0000 7f48c2575640 1 -- 10.20.193.14:0/786497491 learned_addr learned my addr 10.20.193.14:0/786497491 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.492+0000 7fa29c80f640 1 -- 10.20.193.14:0/3628137673 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1254674047 0 0) 0x7fa2980b5b60 con 0x7fa2980ba3b0 2026-02-24T19:17:28.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.492+0000 7fa29c80f640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.492+0000 7fa29c80f640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.492+0000 7fa29c80f640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.492+0000 7fa29c80f640 10 monclient(hunting): my global_id is 4414 2026-02-24T19:17:28.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.492+0000 7fa29c80f640 1 -- 10.20.193.14:0/3628137673 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa280003610 con 0x7fa2980ba3b0 2026-02-24T19:17:28.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.493+0000 7fdd0effd640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7fdd10159e40 0x7fdd10163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:34478/0 (socket says 10.20.193.14:34478) 2026-02-24T19:17:28.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.493+0000 7fdd0effd640 1 -- 10.20.193.14:0/1020801030 learned_addr learned my addr 10.20.193.14:0/1020801030 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7f4eb7fff640 1 -- 10.20.193.14:0/1119703420 <== mon.2 v1:10.20.193.170:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4eb8003040 con 0x7f4ec80b9f80 2026-02-24T19:17:28.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7f4eb7fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7f4eb7fff640 1 -- 10.20.193.14:0/1119703420 <== mon.2 v1:10.20.193.170:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4eb8003440 con 0x7f4ec80b9f80 2026-02-24T19:17:28.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7f4eb7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7f4eb7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:28.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7f4eb7fff640 10 monclient: dump: 2026-02-24T19:17:28.543 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.543 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.543 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.543 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.543 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.543 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.543 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.543 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.543 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.543 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7f4ecf88b640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:28.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7f4ecf88b640 4 set_mon_vals no callback set 2026-02-24T19:17:28.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7fab377fe640 1 -- 10.20.193.14:0/2887742981 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1823431000 0 0) 0x7fab40163e90 con 0x7fab400585e0 2026-02-24T19:17:28.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7fab377fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7fab377fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7fab377fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7fab377fe640 10 monclient(hunting): my global_id is 4421 2026-02-24T19:17:28.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7fab377fe640 1 -- 10.20.193.14:0/2887742981 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab2c003610 con 0x7fab400585e0 2026-02-24T19:17:28.544 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7f5970ab8640 1 -- 10.20.193.14:0/2760581683 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 126650144 0 0) 0x7f5954003610 con 0x7f596c0585e0 2026-02-24T19:17:28.544 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7f5970ab8640 1 -- 10.20.193.14:0/2760581683 >> v1:10.20.193.170:6789/0 conn(0x7f596c0b9f80 legacy=0x7f596c163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.544 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7f5970ab8640 1 -- 10.20.193.14:0/2760581683 >> v1:10.20.193.44:6789/0 conn(0x7f596c0ba350 legacy=0x7f596c057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.544 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7f5970ab8640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.544 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7f5970ab8640 1 monclient: found mon.noname-a 2026-02-24T19:17:28.544 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7f5970ab8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.544 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7f5970ab8640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.544 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7f5970ab8640 1 -- 10.20.193.14:0/2760581683 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f596c0573f0 con 0x7f596c0585e0 2026-02-24T19:17:28.544 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7f5970ab8640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.544 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7f5970ab8640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.544 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7f5970ab8640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.544 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7f5970ab8640 1 -- 10.20.193.14:0/2760581683 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5968003340 con 0x7f596c0585e0 2026-02-24T19:17:28.544 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7f5970ab8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.544 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7f5970ab8640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:28.544 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7f5970ab8640 10 monclient: dump: 2026-02-24T19:17:28.544 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.544 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.544 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.544 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.544 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.544 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.544 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.544 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.544 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.544 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.544 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7f5973d45640 5 monclient: authenticate success, global_id 4404 2026-02-24T19:17:28.544 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7f5973d45640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.545 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7f4ecf88b640 10 monclient: shutdown 2026-02-24T19:17:28.545 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7f4ecf88b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.545 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7f4ecf88b640 1 -- 10.20.193.14:0/1119703420 >> v1:10.20.193.170:6789/0 conn(0x7f4ec80b9f80 legacy=0x7f4ec8163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.545 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7f4ecf88b640 1 -- 10.20.193.14:0/1119703420 shutdown_connections 2026-02-24T19:17:28.545 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7f4ecf88b640 1 -- 10.20.193.14:0/1119703420 >> 10.20.193.14:0/1119703420 conn(0x7f4ec80b7990 msgr2=0x7f4ec80b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.545 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7f4ecf88b640 1 -- 10.20.193.14:0/1119703420 shutdown_connections 2026-02-24T19:17:28.545 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.494+0000 7f4ecf88b640 1 -- 10.20.193.14:0/1119703420 wait complete. 2026-02-24T19:17:28.545 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.495+0000 7f4ecf88b640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.545 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.495+0000 7f4ecf88b640 10 monclient: monmap: 2026-02-24T19:17:28.545 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.545 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:28.545 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:28.545 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:28.545 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.545 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:28.545 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.545 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.545 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.545 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.545 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.495+0000 7f4ecf88b640 1 librados: starting msgr at 2026-02-24T19:17:28.545 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.495+0000 7f4ecf88b640 1 librados: starting objecter 2026-02-24T19:17:28.545 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7f4ecf88b640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:28.545 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7f4ecf88b640 1 Processor -- start 2026-02-24T19:17:28.545 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7f4ecf88b640 1 -- start start 2026-02-24T19:17:28.545 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7f4ecf88b640 1 librados: setting wanted keys 2026-02-24T19:17:28.545 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7f4ecf88b640 1 librados: calling monclient init 2026-02-24T19:17:28.545 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7f4ecf88b640 10 monclient: init 2026-02-24T19:17:28.546 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7f777e7fc640 1 -- 10.20.193.14:0/3654713008 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 509010200 0 0) 0x7f77800b3610 con 0x7f77800b5da0 2026-02-24T19:17:28.546 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7f777e7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.546 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7f777e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.546 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7f777e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.546 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7f777e7fc640 10 monclient(hunting): my global_id is 4410 2026-02-24T19:17:28.546 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7f777e7fc640 1 -- 10.20.193.14:0/3654713008 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77800b3bd0 con 0x7f77800b5da0 2026-02-24T19:17:28.546 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7f4ecf88b640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.546 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7f4ecf88b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:28.546 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7f4ecf88b640 10 monclient(hunting): picked mon.noname-a con 0x7f4ec80585e0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.546 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7f4ecf88b640 10 monclient(hunting): picked mon.noname-c con 0x7f4ec80b9f80 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.546 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7f777e7fc640 1 -- 10.20.193.14:0/3654713008 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1068160615 0 0) 0x7f7764003610 con 0x7f77800b3190 2026-02-24T19:17:28.546 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7f777e7fc640 1 -- 10.20.193.14:0/3654713008 >> v1:10.20.193.170:6789/0 conn(0x7f778015b0a0 legacy=0x7f7780162300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.546 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7f777e7fc640 1 -- 10.20.193.14:0/3654713008 >> v1:10.20.193.14:6789/0 conn(0x7f77800b5da0 legacy=0x7f77800b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.546 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7f4ecf88b640 10 monclient(hunting): picked mon.noname-b con 0x7f4ec80ba350 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.546 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7f4ecf88b640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ec8165530 con 0x7f4ec80585e0 2026-02-24T19:17:28.546 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7fa29c80f640 1 -- 10.20.193.14:0/3628137673 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 447523092 0 0) 0x7fa2980b5e40 con 0x7fa29815e280 2026-02-24T19:17:28.546 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7fa29c80f640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.547 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7f777e7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.547 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7f777e7fc640 1 monclient: found mon.noname-b 2026-02-24T19:17:28.547 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7fa29c80f640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.547 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7fa29c80f640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.547 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7f777e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.547 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7f777e7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.547 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7fa29c80f640 10 monclient(hunting): my global_id is 4424 2026-02-24T19:17:28.547 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7f777e7fc640 1 -- 10.20.193.14:0/3654713008 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77800b3eb0 con 0x7f77800b3190 2026-02-24T19:17:28.547 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7f777e7fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.547 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7f777e7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.547 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7f777e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.547 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7f777e7fc640 1 -- 10.20.193.14:0/3654713008 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7770002df0 con 0x7f77800b3190 2026-02-24T19:17:28.547 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7f777e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.547 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7f777e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:28.547 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.497+0000 7f4ecf88b640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ec813aab0 con 0x7f4ec80ba350 2026-02-24T19:17:28.547 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.497+0000 7fa29c80f640 1 -- 10.20.193.14:0/3628137673 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2980b5b60 con 0x7fa29815e280 2026-02-24T19:17:28.548 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7f777e7fc640 10 monclient: dump: 2026-02-24T19:17:28.548 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.548 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.548 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.548 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.548 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.548 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.548 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.548 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.548 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.548 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.548 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7f7785bd9640 5 monclient: authenticate success, global_id 4396 2026-02-24T19:17:28.548 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.496+0000 7f7785bd9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.548 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.497+0000 7f4ecf88b640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ec8164c90 con 0x7f4ec80b9f80 2026-02-24T19:17:28.548 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.497+0000 7f4ecf88b640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.548 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.497+0000 7f4ecf88b640 10 monclient(hunting): authenticate will time out at 3623.178061s 2026-02-24T19:17:28.548 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.497+0000 7fc5a96c8640 1 -- 10.20.193.14:0/2043353022 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3827997740 0 0) 0x7fc5a4059130 con 0x7fc5a415af80 2026-02-24T19:17:28.548 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.497+0000 7fc5a96c8640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.548 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.497+0000 7fc5a96c8640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.548 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.497+0000 7fc5a96c8640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.548 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.497+0000 7fc5a96c8640 10 monclient(hunting): my global_id is 4419 2026-02-24T19:17:28.548 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.497+0000 7fc5a96c8640 1 -- 10.20.193.14:0/2043353022 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5a40596f0 con 0x7fc5a415af80 2026-02-24T19:17:28.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.497+0000 7f8300a19640 1 -- 10.20.193.14:0/2187888260 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 905132765 0 0) 0x7f82fc163e90 con 0x7f82fc0ba350 2026-02-24T19:17:28.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.497+0000 7f8300a19640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.497+0000 7f8300a19640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.497+0000 7f8300a19640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.497+0000 7f8300a19640 10 monclient(hunting): my global_id is 4430 2026-02-24T19:17:28.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.497+0000 7f8300a19640 1 -- 10.20.193.14:0/2187888260 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82e4003610 con 0x7f82fc0ba350 2026-02-24T19:17:28.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.497+0000 7fa29c80f640 1 -- 10.20.193.14:0/3628137673 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1498054130 0 0) 0x7fa2980b5880 con 0x7fa29815deb0 2026-02-24T19:17:28.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.497+0000 7fa29c80f640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.497+0000 7fa29c80f640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.497+0000 7fa29c80f640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.497+0000 7fa29c80f640 10 monclient(hunting): my global_id is 4413 2026-02-24T19:17:28.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.497+0000 7fa29c80f640 1 -- 10.20.193.14:0/3628137673 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2980b5e40 con 0x7fa29815deb0 2026-02-24T19:17:28.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.497+0000 7fab377fe640 1 -- 10.20.193.14:0/2887742981 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2465749519 0 0) 0x7fab28002910 con 0x7fab400ba350 2026-02-24T19:17:28.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.497+0000 7fab377fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.497+0000 7fab377fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.497+0000 7fab377fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.497+0000 7fab377fe640 10 monclient(hunting): my global_id is 4416 2026-02-24T19:17:28.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.497+0000 7fab377fe640 1 -- 10.20.193.14:0/2887742981 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab40163e90 con 0x7fab400ba350 2026-02-24T19:17:28.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.498+0000 7f4dd5336640 1 -- 10.20.193.14:0/2289182226 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 669260612 0 0) 0x7f4dc4002910 con 0x7f4dd00ba350 2026-02-24T19:17:28.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.498+0000 7f4dd5336640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.498+0000 7f4dd5336640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.498+0000 7f4dd5336640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.498+0000 7f4dd5336640 10 monclient(hunting): my global_id is 4422 2026-02-24T19:17:28.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.498+0000 7f4dd5336640 1 -- 10.20.193.14:0/2289182226 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4dd0163bb0 con 0x7f4dd00ba350 2026-02-24T19:17:28.550 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.498+0000 7f5f79573640 1 -- 10.20.193.14:0/1475427421 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3136029871 0 0) 0x7f5f7c163930 con 0x7f5f7c159e40 2026-02-24T19:17:28.550 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.498+0000 7f5f79573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.550 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.498+0000 7f5f79573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.550 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.498+0000 7f5f79573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.550 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.498+0000 7f5f79573640 10 monclient(hunting): my global_id is 4425 2026-02-24T19:17:28.550 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.498+0000 7f5f79573640 1 -- 10.20.193.14:0/1475427421 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f68003610 con 0x7f5f7c159e40 2026-02-24T19:17:28.550 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.498+0000 7feedaffd640 1 -- 10.20.193.14:0/2449888433 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1072674343 0 0) 0x7feec8002910 con 0x7feedc0b9f80 2026-02-24T19:17:28.550 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.498+0000 7feedaffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.550 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.498+0000 7feedaffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.550 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.498+0000 7feedaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.550 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.498+0000 7feedaffd640 10 monclient(hunting): my global_id is 4428 2026-02-24T19:17:28.550 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.498+0000 7feedaffd640 1 -- 10.20.193.14:0/2449888433 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feec0003610 con 0x7feedc0b9f80 2026-02-24T19:17:28.550 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.499+0000 7ff13e7fc640 1 -- 10.20.193.14:0/3191870825 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff12c003190 con 0x7ff1400b9f80 2026-02-24T19:17:28.550 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.499+0000 7ff13e7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.550 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.499+0000 7ff13e7fc640 1 -- 10.20.193.14:0/3191870825 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ff12c004990 con 0x7ff1400b9f80 2026-02-24T19:17:28.550 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.499+0000 7ff13e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.550 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.499+0000 7ff13e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.550 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.499+0000 7ff13e7fc640 10 monclient: dump: 2026-02-24T19:17:28.550 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.550 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.550 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.550 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.550 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.550 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.551 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.551 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.551 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.551 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.551 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.499+0000 7ff14612c640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:28.551 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.499+0000 7ff14612c640 4 set_mon_vals no callback set 2026-02-24T19:17:28.551 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.499+0000 7ff14612c640 10 monclient: shutdown 2026-02-24T19:17:28.551 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.499+0000 7ff14612c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.551 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.499+0000 7ff14612c640 1 -- 10.20.193.14:0/3191870825 >> v1:10.20.193.14:6789/0 conn(0x7ff1400b9f80 legacy=0x7ff140163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.551 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.499+0000 7ff14612c640 1 -- 10.20.193.14:0/3191870825 shutdown_connections 2026-02-24T19:17:28.551 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.499+0000 7ff14612c640 1 -- 10.20.193.14:0/3191870825 >> 10.20.193.14:0/3191870825 conn(0x7ff1400b7990 msgr2=0x7ff1400b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.551 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.499+0000 7ff14612c640 1 -- 10.20.193.14:0/3191870825 shutdown_connections 2026-02-24T19:17:28.551 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.499+0000 7f48c1d74640 1 -- 10.20.193.14:0/786497491 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 472775321 0 0) 0x7f48c4160b00 con 0x7f48c4058580 2026-02-24T19:17:28.551 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.499+0000 7f48c1d74640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.551 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.499+0000 7f48c1d74640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.551 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.499+0000 7f48c1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.551 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.499+0000 7f48c1d74640 10 monclient(hunting): my global_id is 4436 2026-02-24T19:17:28.551 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.499+0000 7f48c1d74640 1 -- 10.20.193.14:0/786497491 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48b0003610 con 0x7f48c4058580 2026-02-24T19:17:28.551 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.499+0000 7ff14612c640 1 -- 10.20.193.14:0/3191870825 wait complete. 2026-02-24T19:17:28.551 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.500+0000 7ff14612c640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.551 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.500+0000 7ff14612c640 10 monclient: monmap: 2026-02-24T19:17:28.551 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.551 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:28.551 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:28.551 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:28.551 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.551 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:28.552 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.552 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.552 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.552 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.500+0000 7f8300a19640 1 -- 10.20.193.14:0/2187888260 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2082508533 0 0) 0x7f82f8002c90 con 0x7f82fc0585e0 2026-02-24T19:17:28.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.500+0000 7f8300a19640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.500+0000 7f8300a19640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.500+0000 7f8300a19640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.500+0000 7f8300a19640 10 monclient(hunting): my global_id is 4431 2026-02-24T19:17:28.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.500+0000 7f8300a19640 1 -- 10.20.193.14:0/2187888260 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82fc163e90 con 0x7f82fc0585e0 2026-02-24T19:17:28.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.500+0000 7ff14612c640 1 librados: starting msgr at 2026-02-24T19:17:28.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.500+0000 7ff14612c640 1 librados: starting objecter 2026-02-24T19:17:28.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.500+0000 7ff14612c640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:28.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.500+0000 7ff14612c640 1 Processor -- start 2026-02-24T19:17:28.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.500+0000 7ff14612c640 1 -- start start 2026-02-24T19:17:28.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.500+0000 7ff14612c640 1 librados: setting wanted keys 2026-02-24T19:17:28.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.500+0000 7ff14612c640 1 librados: calling monclient init 2026-02-24T19:17:28.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.500+0000 7ff14612c640 10 monclient: init 2026-02-24T19:17:28.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.501+0000 7f4dd5336640 1 -- 10.20.193.14:0/2289182226 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3888432722 0 0) 0x7f4dd0163e90 con 0x7f4dd00b9f80 2026-02-24T19:17:28.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.501+0000 7f4dd5336640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.501+0000 7f4dd5336640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.501+0000 7f4dd5336640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.501+0000 7f4dd5336640 10 monclient(hunting): my global_id is 4427 2026-02-24T19:17:28.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.501+0000 7f4dd5336640 1 -- 10.20.193.14:0/2289182226 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4dc4002910 con 0x7f4dd00b9f80 2026-02-24T19:17:28.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.501+0000 7ff14612c640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.501+0000 7ff14612c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:28.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.501+0000 7ff14612c640 10 monclient(hunting): picked mon.noname-b con 0x7ff1400585e0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.501+0000 7ff14612c640 10 monclient(hunting): picked mon.noname-c con 0x7ff1400b9f80 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.501+0000 7ff14612c640 10 monclient(hunting): picked mon.noname-a con 0x7ff1400ba350 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.501+0000 7ff14612c640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1400b4ea0 con 0x7ff1400ba350 2026-02-24T19:17:28.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.501+0000 7ff14612c640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1400b23b0 con 0x7ff1400585e0 2026-02-24T19:17:28.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.501+0000 7f5f79573640 1 -- 10.20.193.14:0/1475427421 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 14911476 0 0) 0x7f5f7c163ed0 con 0x7f5f7c058070 2026-02-24T19:17:28.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.501+0000 7f5f79573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.501+0000 7f5f79573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.501+0000 7f5f79573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.501+0000 7f5f79573640 10 monclient(hunting): my global_id is 4439 2026-02-24T19:17:28.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.501+0000 7f5f79573640 1 -- 10.20.193.14:0/1475427421 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f7c163930 con 0x7f5f7c058070 2026-02-24T19:17:28.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.501+0000 7ff14612c640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1400b2690 con 0x7ff1400b9f80 2026-02-24T19:17:28.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.501+0000 7ff14612c640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.501+0000 7ff14612c640 10 monclient(hunting): authenticate will time out at 3623.182546s 2026-02-24T19:17:28.554 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.501+0000 7feedaffd640 1 -- 10.20.193.14:0/2449888433 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 931748887 0 0) 0x7feedc163e90 con 0x7feedc0ba350 2026-02-24T19:17:28.554 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.501+0000 7feedaffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.554 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.501+0000 7feedaffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.554 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.501+0000 7feedaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.554 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.501+0000 7feedaffd640 10 monclient(hunting): my global_id is 4433 2026-02-24T19:17:28.554 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.501+0000 7feedaffd640 1 -- 10.20.193.14:0/2449888433 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feec8002910 con 0x7feedc0ba350 2026-02-24T19:17:28.554 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.501+0000 7f28c77fe640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7f28c80b5da0 0x7f28c81555b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:34490/0 (socket says 10.20.193.14:34490) 2026-02-24T19:17:28.554 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.501+0000 7f28c77fe640 1 -- 10.20.193.14:0/425562497 learned_addr learned my addr 10.20.193.14:0/425562497 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.554 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.502+0000 7f0e82d76640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7f0e84159e40 0x7f0e841fa420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:44840/0 (socket says 10.20.193.14:44840) 2026-02-24T19:17:28.554 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.502+0000 7f0e82d76640 1 -- 10.20.193.14:0/3369942034 learned_addr learned my addr 10.20.193.14:0/3369942034 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.554 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.502+0000 7f0e6affd640 10 client.?.objecter ms_handle_connect 0x7f0e84159e40 2026-02-24T19:17:28.554 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.502+0000 7f0e6affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.554 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.502+0000 7fc5a96c8640 1 -- 10.20.193.14:0/2043353022 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 945975253 0 0) 0x7fc594003610 con 0x7fc5a415b350 2026-02-24T19:17:28.554 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.502+0000 7fc5a96c8640 1 -- 10.20.193.14:0/2043353022 >> v1:10.20.193.170:6789/0 conn(0x7fc5a40b5d80 legacy=0x7fc5a40b7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.554 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.502+0000 7fc5a96c8640 1 -- 10.20.193.14:0/2043353022 >> v1:10.20.193.14:6789/0 conn(0x7fc5a415af80 legacy=0x7fc5a4161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.554 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.502+0000 7fc5a96c8640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.555 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.502+0000 7fc5a96c8640 1 monclient: found mon.noname-b 2026-02-24T19:17:28.555 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.502+0000 7fc5a96c8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.555 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.502+0000 7fc5a96c8640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.555 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.502+0000 7fc5a96c8640 1 -- 10.20.193.14:0/2043353022 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5a40599d0 con 0x7fc5a415b350 2026-02-24T19:17:28.555 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.502+0000 7fc5a96c8640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.555 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.502+0000 7fc5a96c8640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.555 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.502+0000 7fc5a96c8640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.555 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.502+0000 7fc5a96c8640 1 -- 10.20.193.14:0/2043353022 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc590002df0 con 0x7fc5a415b350 2026-02-24T19:17:28.555 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.502+0000 7fc5ac955640 5 monclient: authenticate success, global_id 4405 2026-02-24T19:17:28.555 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.502+0000 7fc5ac955640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.555 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.502+0000 7fc5a96c8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.555 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.502+0000 7fc5a96c8640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:28.555 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.502+0000 7fc5a96c8640 10 monclient: dump: 2026-02-24T19:17:28.555 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.555 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.555 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.555 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.555 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.555 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.555 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.555 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.555 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.555 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.555 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.502+0000 7fc5ac955640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.555 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.503+0000 7f28a3fff640 10 client.?.objecter ms_handle_connect 0x7f28c80b5da0 2026-02-24T19:17:28.555 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.503+0000 7f28a3fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.555 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.503+0000 7f5f79573640 1 -- 10.20.193.14:0/1475427421 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4222370471 0 0) 0x7f5f7c163bf0 con 0x7f5f7c159a70 2026-02-24T19:17:28.555 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.503+0000 7f5f79573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.555 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.503+0000 7f5f79573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.555 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.503+0000 7f5f79573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.555 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.503+0000 7f5f79573640 10 monclient(hunting): my global_id is 4420 2026-02-24T19:17:28.555 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.503+0000 7f5f79573640 1 -- 10.20.193.14:0/1475427421 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f7c163ed0 con 0x7f5f7c159a70 2026-02-24T19:17:28.556 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.503+0000 7fdd0e7fc640 1 -- 10.20.193.14:0/1020801030 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3398045692 0 0) 0x7fdd10163bf0 con 0x7fdd10159e40 2026-02-24T19:17:28.556 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.503+0000 7fdd0e7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.556 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.503+0000 7fdd0e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.556 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.503+0000 7fdd0e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.556 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.503+0000 7fdd0e7fc640 10 monclient(hunting): my global_id is 4426 2026-02-24T19:17:28.556 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.503+0000 7fdd0e7fc640 1 -- 10.20.193.14:0/1020801030 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdcf4003610 con 0x7fdd10159e40 2026-02-24T19:17:28.556 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.504+0000 7f4dd5336640 1 -- 10.20.193.14:0/2289182226 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2416370296 0 0) 0x7f4db8003610 con 0x7f4dd00585e0 2026-02-24T19:17:28.556 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.504+0000 7f4dd5336640 1 -- 10.20.193.14:0/2289182226 >> v1:10.20.193.170:6789/0 conn(0x7f4dd00b9f80 legacy=0x7f4dd0163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.556 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.504+0000 7f4dd5336640 1 -- 10.20.193.14:0/2289182226 >> v1:10.20.193.14:6789/0 conn(0x7f4dd00ba350 legacy=0x7f4dd0057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.556 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.504+0000 7f4dd5336640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.556 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.504+0000 7f4dd5336640 1 monclient: found mon.noname-b 2026-02-24T19:17:28.556 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.504+0000 7f4dd5336640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.556 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.504+0000 7f4dd5336640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.556 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.504+0000 7f4dd5336640 1 -- 10.20.193.14:0/2289182226 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd00573f0 con 0x7f4dd00585e0 2026-02-24T19:17:28.556 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.504+0000 7f4dd5336640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.556 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.504+0000 7f4dd5336640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.556 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.504+0000 7f4dd5336640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.556 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.504+0000 7f4dd5336640 1 -- 10.20.193.14:0/2289182226 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4dcc003170 con 0x7f4dd00585e0 2026-02-24T19:17:28.556 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.504+0000 7f4dd5336640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.556 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.504+0000 7f4dd5336640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:28.556 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.504+0000 7f4dd5336640 10 monclient: dump: 2026-02-24T19:17:28.556 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.556 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.556 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.556 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.556 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.556 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.556 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.556 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.556 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.556 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.556 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.504+0000 7f4dd85c3640 5 monclient: authenticate success, global_id 4411 2026-02-24T19:17:28.556 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.504+0000 7f4dd85c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.557 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.505+0000 7f777e7fc640 1 -- 10.20.193.14:0/3654713008 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7770002fc0 con 0x7f77800b3190 2026-02-24T19:17:28.557 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.505+0000 7f777e7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.557 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.505+0000 7f777e7fc640 1 -- 10.20.193.14:0/3654713008 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7770003400 con 0x7f77800b3190 2026-02-24T19:17:28.557 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.505+0000 7f777e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.557 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.505+0000 7f777e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:28.557 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.505+0000 7f777e7fc640 10 monclient: dump: 2026-02-24T19:17:28.557 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.557 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.557 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.557 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.557 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.557 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.557 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.557 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.557 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.557 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.557 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.505+0000 7f7785bd9640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:28.557 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.505+0000 7f7785bd9640 4 set_mon_vals no callback set 2026-02-24T19:17:28.557 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.505+0000 7f7785bd9640 10 monclient: shutdown 2026-02-24T19:17:28.557 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.505+0000 7f7785bd9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.557 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.505+0000 7f7785bd9640 1 -- 10.20.193.14:0/3654713008 >> v1:10.20.193.44:6789/0 conn(0x7f77800b3190 legacy=0x7f77800b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.557 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.505+0000 7f7785bd9640 1 -- 10.20.193.14:0/3654713008 shutdown_connections 2026-02-24T19:17:28.557 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.505+0000 7f7785bd9640 1 -- 10.20.193.14:0/3654713008 >> 10.20.193.14:0/3654713008 conn(0x7f77800b5290 msgr2=0x7f77800b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.557 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.505+0000 7f7785bd9640 1 -- 10.20.193.14:0/3654713008 shutdown_connections 2026-02-24T19:17:28.557 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.505+0000 7f7785bd9640 1 -- 10.20.193.14:0/3654713008 wait complete. 2026-02-24T19:17:28.557 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7f5970ab8640 1 -- 10.20.193.14:0/2760581683 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5968003510 con 0x7f596c0585e0 2026-02-24T19:17:28.557 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7f5970ab8640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.557 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7f5970ab8640 1 -- 10.20.193.14:0/2760581683 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5968004d10 con 0x7f596c0585e0 2026-02-24T19:17:28.558 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7f5970ab8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.558 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7f5970ab8640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.558 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7f5970ab8640 10 monclient: dump: 2026-02-24T19:17:28.558 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.558 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.558 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.558 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.558 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.558 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.558 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.558 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.558 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.558 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.558 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7f5973d45640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:28.558 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7f5973d45640 4 set_mon_vals no callback set 2026-02-24T19:17:28.558 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7fab377fe640 1 -- 10.20.193.14:0/2887742981 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1459341293 0 0) 0x7fab40163bb0 con 0x7fab400b9f80 2026-02-24T19:17:28.558 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7fab377fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.558 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7fab377fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.558 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7fab377fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.558 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7fab377fe640 10 monclient(hunting): my global_id is 4417 2026-02-24T19:17:28.558 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7fab377fe640 1 -- 10.20.193.14:0/2887742981 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab28002910 con 0x7fab400b9f80 2026-02-24T19:17:28.558 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7f7785bd9640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.558 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7f7785bd9640 10 monclient: monmap: 2026-02-24T19:17:28.558 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.558 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:28.558 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:28.558 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:28.558 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.558 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:28.558 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.558 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.558 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.558 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.558 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7f56e5d74640 1 -- 10.20.193.14:0/1644971506 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f56d8003380 con 0x7f56e8164d00 2026-02-24T19:17:28.559 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7f56e5d74640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.559 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7f56e5d74640 1 -- 10.20.193.14:0/1644971506 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f56d80037c0 con 0x7f56e8164d00 2026-02-24T19:17:28.559 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7f56e5d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.559 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7f56e5d74640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:28.559 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7f56e5d74640 10 monclient: dump: 2026-02-24T19:17:28.559 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.559 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.559 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.559 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.559 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.559 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.559 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.559 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.559 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.559 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.559 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7f7785bd9640 1 librados: starting msgr at 2026-02-24T19:17:28.559 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7f7785bd9640 1 librados: starting objecter 2026-02-24T19:17:28.559 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7f56ed25c640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:28.559 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7f56ed25c640 4 set_mon_vals no callback set 2026-02-24T19:17:28.559 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7f7785bd9640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:28.559 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7f7785bd9640 1 Processor -- start 2026-02-24T19:17:28.559 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7f7785bd9640 1 -- start start 2026-02-24T19:17:28.559 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7f7785bd9640 1 librados: setting wanted keys 2026-02-24T19:17:28.559 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7f7785bd9640 1 librados: calling monclient init 2026-02-24T19:17:28.559 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7f7785bd9640 10 monclient: init 2026-02-24T19:17:28.560 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7f5973d45640 10 monclient: shutdown 2026-02-24T19:17:28.560 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7f5973d45640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.560 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7f5973d45640 1 -- 10.20.193.14:0/2760581683 >> v1:10.20.193.14:6789/0 conn(0x7f596c0585e0 legacy=0x7f596c166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.560 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7f5973d45640 1 -- 10.20.193.14:0/2760581683 shutdown_connections 2026-02-24T19:17:28.560 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7f5973d45640 1 -- 10.20.193.14:0/2760581683 >> 10.20.193.14:0/2760581683 conn(0x7f596c0b7990 msgr2=0x7f596c0b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.560 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7f5973d45640 1 -- 10.20.193.14:0/2760581683 shutdown_connections 2026-02-24T19:17:28.560 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.506+0000 7f5973d45640 1 -- 10.20.193.14:0/2760581683 wait complete. 2026-02-24T19:17:28.560 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7f56ed25c640 10 monclient: shutdown 2026-02-24T19:17:28.560 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7f56ed25c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.560 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7f56ed25c640 1 -- 10.20.193.14:0/1644971506 >> v1:10.20.193.44:6789/0 conn(0x7f56e8164d00 legacy=0x7f56e81c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.560 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7f8300a19640 1 -- 10.20.193.14:0/2187888260 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3886351427 0 0) 0x7f82fc163bb0 con 0x7f82fc0b9f80 2026-02-24T19:17:28.560 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7f8300a19640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.560 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7f8300a19640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.560 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7f8300a19640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.560 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7f8300a19640 10 monclient(hunting): my global_id is 4423 2026-02-24T19:17:28.560 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7f8300a19640 1 -- 10.20.193.14:0/2187888260 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82f8002c90 con 0x7f82fc0b9f80 2026-02-24T19:17:28.560 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7fa29c80f640 1 -- 10.20.193.14:0/3628137673 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2207068287 0 0) 0x7fa2980b5e40 con 0x7fa29815deb0 2026-02-24T19:17:28.560 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7fa29c80f640 1 -- 10.20.193.14:0/3628137673 >> v1:10.20.193.170:6789/0 conn(0x7fa29815e280 legacy=0x7fa2980ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.560 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7fa29c80f640 1 -- 10.20.193.14:0/3628137673 >> v1:10.20.193.44:6789/0 conn(0x7fa2980ba3b0 legacy=0x7fa2980ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.560 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7fa29c80f640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.560 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7f7785bd9640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.560 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7f56ed25c640 1 -- 10.20.193.14:0/1644971506 shutdown_connections 2026-02-24T19:17:28.561 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7f56ed25c640 1 -- 10.20.193.14:0/1644971506 >> 10.20.193.14:0/1644971506 conn(0x7f56e80b2ef0 msgr2=0x7f56e80b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.561 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7fa29c80f640 1 monclient: found mon.noname-a 2026-02-24T19:17:28.561 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7fa29c80f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.561 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7fa29c80f640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.561 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7fa29c80f640 1 -- 10.20.193.14:0/3628137673 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2980b6120 con 0x7fa29815deb0 2026-02-24T19:17:28.561 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7fa29c80f640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.561 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7fa29c80f640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.561 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7fa29c80f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.561 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7fa29c80f640 1 -- 10.20.193.14:0/3628137673 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fa288002df0 con 0x7fa29815deb0 2026-02-24T19:17:28.561 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7fa29c80f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.561 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7fa29c80f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:28.561 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7fa29c80f640 10 monclient: dump: 2026-02-24T19:17:28.561 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.561 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.561 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.561 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.561 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.561 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.561 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.561 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.561 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.561 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.561 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7f56ed25c640 1 -- 10.20.193.14:0/1644971506 shutdown_connections 2026-02-24T19:17:28.561 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7fa29fa9c640 5 monclient: authenticate success, global_id 4413 2026-02-24T19:17:28.561 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7fa29fa9c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.561 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7f56ed25c640 1 -- 10.20.193.14:0/1644971506 wait complete. 2026-02-24T19:17:28.562 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7f7785bd9640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:28.562 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7f7785bd9640 10 monclient(hunting): picked mon.noname-b con 0x7f77800b5da0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.562 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7f7785bd9640 10 monclient(hunting): picked mon.noname-a con 0x7f778015b0a0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.562 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7f7785bd9640 10 monclient(hunting): picked mon.noname-c con 0x7f77801f88c0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.562 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7f7785bd9640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77800b1970 con 0x7f778015b0a0 2026-02-24T19:17:28.562 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7f7785bd9640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77800b1c50 con 0x7f77800b5da0 2026-02-24T19:17:28.562 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7f7785bd9640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77800b1f30 con 0x7f77801f88c0 2026-02-24T19:17:28.562 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7f7785bd9640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.562 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7f7785bd9640 10 monclient(hunting): authenticate will time out at 3623.188352s 2026-02-24T19:17:28.562 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7f28a3fff640 10 client.?.objecter ms_handle_connect 0x7f28c81f97f0 2026-02-24T19:17:28.562 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7f28a3fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.562 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7f5973d45640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.562 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7f5973d45640 10 monclient: monmap: 2026-02-24T19:17:28.562 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.562 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:28.562 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:28.562 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:28.562 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.562 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:28.562 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.562 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.562 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.562 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.562 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7f5973d45640 1 librados: starting msgr at 2026-02-24T19:17:28.562 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7f5973d45640 1 librados: starting objecter 2026-02-24T19:17:28.563 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7f5973d45640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:28.563 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7feedaffd640 1 -- 10.20.193.14:0/2449888433 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 915024599 0 0) 0x7feec0003610 con 0x7feedc0b9f80 2026-02-24T19:17:28.563 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7feedaffd640 1 -- 10.20.193.14:0/2449888433 >> v1:10.20.193.170:6789/0 conn(0x7feedc0ba350 legacy=0x7feedc057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.563 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7f5973d45640 1 Processor -- start 2026-02-24T19:17:28.563 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7feedaffd640 1 -- 10.20.193.14:0/2449888433 >> v1:10.20.193.44:6789/0 conn(0x7feedc0585e0 legacy=0x7feedc166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.563 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7feedaffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.563 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7feedaffd640 1 monclient: found mon.noname-a 2026-02-24T19:17:28.563 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7feedaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.563 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7f56ed25c640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.563 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7feedaffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.563 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7feedaffd640 1 -- 10.20.193.14:0/2449888433 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feedc0573f0 con 0x7feedc0b9f80 2026-02-24T19:17:28.563 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7feedaffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.563 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7feedaffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.563 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7feedaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.563 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7feedaffd640 1 -- 10.20.193.14:0/2449888433 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7feec8002fc0 con 0x7feedc0b9f80 2026-02-24T19:17:28.563 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7feedaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.563 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7feedaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:28.563 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7feedaffd640 10 monclient: dump: 2026-02-24T19:17:28.563 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.563 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.563 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.563 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.563 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.563 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.563 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.564 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.564 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.564 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.564 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7f56ed25c640 10 monclient: monmap: 2026-02-24T19:17:28.564 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.564 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:28.564 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:28.564 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:28.564 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.564 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:28.564 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.564 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.564 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.564 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.564 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7feee249f640 5 monclient: authenticate success, global_id 4428 2026-02-24T19:17:28.564 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7feee249f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.564 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7f5973d45640 1 -- start start 2026-02-24T19:17:28.564 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7f5973d45640 1 librados: setting wanted keys 2026-02-24T19:17:28.564 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7f5973d45640 1 librados: calling monclient init 2026-02-24T19:17:28.564 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.507+0000 7f5973d45640 10 monclient: init 2026-02-24T19:17:28.564 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.508+0000 7f56ed25c640 1 librados: starting msgr at 2026-02-24T19:17:28.564 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.508+0000 7f56ed25c640 1 librados: starting objecter 2026-02-24T19:17:28.564 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.508+0000 7f56ed25c640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:28.564 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.508+0000 7f56ed25c640 1 Processor -- start 2026-02-24T19:17:28.565 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.508+0000 7f0e6affd640 10 client.?.objecter ms_handle_connect 0x7f0e84159a70 2026-02-24T19:17:28.565 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.508+0000 7f0e6affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.565 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.508+0000 7f56ed25c640 1 -- start start 2026-02-24T19:17:28.565 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.508+0000 7f56ed25c640 1 librados: setting wanted keys 2026-02-24T19:17:28.565 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.508+0000 7f56ed25c640 1 librados: calling monclient init 2026-02-24T19:17:28.565 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.508+0000 7f56ed25c640 10 monclient: init 2026-02-24T19:17:28.565 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.508+0000 7f5973d45640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.565 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.508+0000 7f5973d45640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:28.565 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.508+0000 7f5973d45640 10 monclient(hunting): picked mon.noname-b con 0x7f596c0585e0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.565 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.508+0000 7f5973d45640 10 monclient(hunting): picked mon.noname-a con 0x7f596c0b9f80 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.565 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.508+0000 7f5973d45640 10 monclient(hunting): picked mon.noname-c con 0x7f596c0ba350 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.565 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.508+0000 7f5973d45640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f596c159ea0 con 0x7f596c0b9f80 2026-02-24T19:17:28.565 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.508+0000 7f5973d45640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f596c1fb450 con 0x7f596c0585e0 2026-02-24T19:17:28.565 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.508+0000 7f5973d45640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f596c1fb730 con 0x7f596c0ba350 2026-02-24T19:17:28.565 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.508+0000 7f5973d45640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.565 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.508+0000 7f5973d45640 10 monclient(hunting): authenticate will time out at 3623.189511s 2026-02-24T19:17:28.566 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.508+0000 7f56ed25c640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.566 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.508+0000 7f56ed25c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:28.566 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.508+0000 7f56ed25c640 10 monclient(hunting): picked mon.noname-a con 0x7f56e8157780 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.566 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.508+0000 7f56ed25c640 10 monclient(hunting): picked mon.noname-c con 0x7f56e8157b50 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.566 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.508+0000 7f56ed25c640 10 monclient(hunting): picked mon.noname-b con 0x7f56e8164d00 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.566 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.508+0000 7f56ed25c640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56e80a7de0 con 0x7f56e8157780 2026-02-24T19:17:28.566 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.508+0000 7f56ed25c640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56e80a80c0 con 0x7f56e8164d00 2026-02-24T19:17:28.566 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.508+0000 7f56ed25c640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56e80a83a0 con 0x7f56e8157b50 2026-02-24T19:17:28.566 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.508+0000 7f56ed25c640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.566 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.508+0000 7f56ed25c640 10 monclient(hunting): authenticate will time out at 3623.189990s 2026-02-24T19:17:28.566 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.509+0000 7f4ecd600640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f4ec80585e0 0x7f4ec813a3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:54800/0 (socket says 10.20.193.14:54800) 2026-02-24T19:17:28.566 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.509+0000 7f4ecd600640 1 -- 10.20.193.14:0/1929189111 learned_addr learned my addr 10.20.193.14:0/1929189111 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.566 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.510+0000 7f28a3fff640 10 client.?.objecter ms_handle_connect 0x7f28c815b0a0 2026-02-24T19:17:28.566 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.510+0000 7f28a3fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.566 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.510+0000 7f4eb5ffb640 10 client.?.objecter ms_handle_connect 0x7f4ec80585e0 2026-02-24T19:17:28.566 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.510+0000 7f4eb5ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.567 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.510+0000 7f8300a19640 1 -- 10.20.193.14:0/2187888260 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1517506627 0 0) 0x7f82e4003610 con 0x7f82fc0ba350 2026-02-24T19:17:28.567 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.510+0000 7f8300a19640 1 -- 10.20.193.14:0/2187888260 >> v1:10.20.193.44:6789/0 conn(0x7f82fc0b9f80 legacy=0x7f82fc163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.567 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.510+0000 7f8300a19640 1 -- 10.20.193.14:0/2187888260 >> v1:10.20.193.14:6789/0 conn(0x7f82fc0585e0 legacy=0x7f82fc166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.567 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.510+0000 7f8300a19640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.567 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.510+0000 7f8300a19640 1 monclient: found mon.noname-c 2026-02-24T19:17:28.567 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.510+0000 7f8300a19640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.567 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.510+0000 7f8300a19640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.567 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.510+0000 7f8300a19640 1 -- 10.20.193.14:0/2187888260 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82fc0573f0 con 0x7f82fc0ba350 2026-02-24T19:17:28.567 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.510+0000 7f8300a19640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.567 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.510+0000 7f8300a19640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.567 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.510+0000 7f8300a19640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.567 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.510+0000 7f8300a19640 1 -- 10.20.193.14:0/2187888260 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f82f0002df0 con 0x7f82fc0ba350 2026-02-24T19:17:28.567 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.510+0000 7f8303ca6640 5 monclient: authenticate success, global_id 4430 2026-02-24T19:17:28.567 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.510+0000 7f8303ca6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.567 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.510+0000 7f8300a19640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.567 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.510+0000 7f8300a19640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:28.567 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.510+0000 7f8300a19640 10 monclient: dump: 2026-02-24T19:17:28.567 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.567 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.567 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.567 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.567 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.567 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.567 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.567 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.567 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.567 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.567 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.510+0000 7f8303ca6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.567 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.511+0000 7fab377fe640 1 -- 10.20.193.14:0/2887742981 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 717846816 0 0) 0x7fab2c003610 con 0x7fab400585e0 2026-02-24T19:17:28.567 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.511+0000 7fab377fe640 1 -- 10.20.193.14:0/2887742981 >> v1:10.20.193.44:6789/0 conn(0x7fab400b9f80 legacy=0x7fab40163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.567 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.511+0000 7fab377fe640 1 -- 10.20.193.14:0/2887742981 >> v1:10.20.193.14:6789/0 conn(0x7fab400ba350 legacy=0x7fab40057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.567 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.511+0000 7fab377fe640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.567 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.511+0000 7fab377fe640 1 monclient: found mon.noname-c 2026-02-24T19:17:28.567 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.511+0000 7fab377fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.567 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.511+0000 7fab377fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.567 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.511+0000 7fab377fe640 1 -- 10.20.193.14:0/2887742981 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab400573f0 con 0x7fab400585e0 2026-02-24T19:17:28.568 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.511+0000 7fab377fe640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.568 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.511+0000 7fab377fe640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.568 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.511+0000 7fab377fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.568 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.511+0000 7fab377fe640 1 -- 10.20.193.14:0/2887742981 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fab3c003170 con 0x7fab400585e0 2026-02-24T19:17:28.568 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.511+0000 7fab377fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.568 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.511+0000 7fab377fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:28.568 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.511+0000 7fab377fe640 10 monclient: dump: 2026-02-24T19:17:28.568 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.568 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.568 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.568 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.568 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.568 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.568 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.568 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.568 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.568 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.568 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.511+0000 7fab46cd8640 5 monclient: authenticate success, global_id 4421 2026-02-24T19:17:28.568 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.511+0000 7fab46cd8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.568 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.511+0000 7fdd0e7fc640 1 -- 10.20.193.14:0/1020801030 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4069363374 0 0) 0x7fdd10163930 con 0x7fdd10159a70 2026-02-24T19:17:28.568 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.511+0000 7fdd0e7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.568 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.511+0000 7fdd0e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.568 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.511+0000 7fdd0e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.568 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.511+0000 7fdd0e7fc640 10 monclient(hunting): my global_id is 4437 2026-02-24T19:17:28.568 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.511+0000 7fdd0e7fc640 1 -- 10.20.193.14:0/1020801030 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd10163bf0 con 0x7fdd10159a70 2026-02-24T19:17:28.568 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.512+0000 7f28a3fff640 1 -- 10.20.193.14:0/425562497 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3614350995 0 0) 0x7f28c8155cc0 con 0x7f28c80b5da0 2026-02-24T19:17:28.568 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.512+0000 7f28a3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.568 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.512+0000 7f28a3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.568 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.512+0000 7f28a3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.568 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.512+0000 7f28a3fff640 10 monclient(hunting): my global_id is 4432 2026-02-24T19:17:28.568 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.512+0000 7f28a3fff640 1 -- 10.20.193.14:0/425562497 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2898003610 con 0x7f28c80b5da0 2026-02-24T19:17:28.569 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.513+0000 7ff13f7fe640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7ff1400585e0 0x7ff1400b4790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:34530/0 (socket says 10.20.193.14:34530) 2026-02-24T19:17:28.569 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.513+0000 7ff13f7fe640 1 -- 10.20.193.14:0/1755338058 learned_addr learned my addr 10.20.193.14:0/1755338058 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.569 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.513+0000 7f0e6affd640 1 -- 10.20.193.14:0/3369942034 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3580731457 0 0) 0x7f0e841fb300 con 0x7f0e84159a70 2026-02-24T19:17:28.569 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.513+0000 7f0e6affd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.569 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.513+0000 7f0e6affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.569 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.513+0000 7f0e6affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.569 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.513+0000 7f0e6affd640 10 monclient(hunting): my global_id is 4443 2026-02-24T19:17:28.569 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.513+0000 7f0e6affd640 1 -- 10.20.193.14:0/3369942034 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e50003610 con 0x7f0e84159a70 2026-02-24T19:17:28.569 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.513+0000 7fc5a96c8640 1 -- 10.20.193.14:0/2043353022 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc590003000 con 0x7fc5a415b350 2026-02-24T19:17:28.569 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.513+0000 7fc5a96c8640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.569 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.513+0000 7fc5a96c8640 1 -- 10.20.193.14:0/2043353022 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc590003400 con 0x7fc5a415b350 2026-02-24T19:17:28.569 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.513+0000 7fc5ac955640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:28.569 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.513+0000 7fc5ac955640 4 set_mon_vals no callback set 2026-02-24T19:17:28.569 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.513+0000 7fc5a96c8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.569 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.513+0000 7fc5a96c8640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:28.569 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.513+0000 7fc5a96c8640 10 monclient: dump: 2026-02-24T19:17:28.569 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.569 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.569 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.569 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.569 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.569 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.569 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.569 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.569 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.570 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.570 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.514+0000 7fc5ac955640 10 monclient: shutdown 2026-02-24T19:17:28.570 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.514+0000 7fc5ac955640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.570 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.514+0000 7fc5ac955640 1 -- 10.20.193.14:0/2043353022 >> v1:10.20.193.44:6789/0 conn(0x7fc5a415b350 legacy=0x7fc5a41623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.570 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.514+0000 7fc5ac955640 1 -- 10.20.193.14:0/2043353022 shutdown_connections 2026-02-24T19:17:28.570 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.514+0000 7fc5ac955640 1 -- 10.20.193.14:0/2043353022 >> 10.20.193.14:0/2043353022 conn(0x7fc5a40b5270 msgr2=0x7fc5a40b5670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.570 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.514+0000 7fc5ac955640 1 -- 10.20.193.14:0/2043353022 shutdown_connections 2026-02-24T19:17:28.570 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.514+0000 7fc5ac955640 1 -- 10.20.193.14:0/2043353022 wait complete. 2026-02-24T19:17:28.570 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.514+0000 7f48c1d74640 1 -- 10.20.193.14:0/786497491 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2510951312 0 0) 0x7f48b0003610 con 0x7f48c4058580 2026-02-24T19:17:28.570 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.514+0000 7f48c1d74640 1 -- 10.20.193.14:0/786497491 >> v1:10.20.193.44:6789/0 conn(0x7f48c4059e70 legacy=0x7f48c415fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.570 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.514+0000 7f48c1d74640 1 -- 10.20.193.14:0/786497491 >> v1:10.20.193.14:6789/0 conn(0x7f48c405a240 legacy=0x7f48c4156280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.570 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.514+0000 7f48c1d74640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.570 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.514+0000 7f48c1d74640 1 monclient: found mon.noname-c 2026-02-24T19:17:28.570 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.514+0000 7f48c1d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.570 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.514+0000 7f48c1d74640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.570 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.514+0000 7f48c1d74640 1 -- 10.20.193.14:0/786497491 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48c4055b20 con 0x7f48c4058580 2026-02-24T19:17:28.570 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.514+0000 7f48c1d74640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.570 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.514+0000 7f48c1d74640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.570 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.514+0000 7f48c1d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.570 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.514+0000 7f48c1d74640 1 -- 10.20.193.14:0/786497491 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f48ac002df0 con 0x7f48c4058580 2026-02-24T19:17:28.570 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.514+0000 7f48c1d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.570 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7f48c1d74640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:28.570 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7f48c1d74640 10 monclient: dump: 2026-02-24T19:17:28.570 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.570 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.570 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.570 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.570 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.570 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.570 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.570 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.570 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.570 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.570 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7f48c915c640 5 monclient: authenticate success, global_id 4436 2026-02-24T19:17:28.570 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7f48c915c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.571 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fc5ac955640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.571 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fc5ac955640 10 monclient: monmap: 2026-02-24T19:17:28.571 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.571 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:28.571 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:28.571 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:28.571 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.571 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:28.571 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.571 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.571 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.571 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.571 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fa29c80f640 1 -- 10.20.193.14:0/3628137673 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa288002fc0 con 0x7fa29815deb0 2026-02-24T19:17:28.571 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fa29c80f640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.571 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fa29c80f640 1 -- 10.20.193.14:0/3628137673 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fa288003400 con 0x7fa29815deb0 2026-02-24T19:17:28.571 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fa29c80f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.571 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fa29c80f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.571 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fa29c80f640 10 monclient: dump: 2026-02-24T19:17:28.571 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.571 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.571 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.571 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.571 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.571 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.571 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.571 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.571 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.571 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.571 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fa29fa9c640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:28.571 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fa29fa9c640 4 set_mon_vals no callback set 2026-02-24T19:17:28.572 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fc5ac955640 1 librados: starting msgr at 2026-02-24T19:17:28.572 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fc5ac955640 1 librados: starting objecter 2026-02-24T19:17:28.572 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fc5ac955640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:28.572 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fc5ac955640 1 Processor -- start 2026-02-24T19:17:28.572 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fc5ac955640 1 -- start start 2026-02-24T19:17:28.572 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fc5ac955640 1 librados: setting wanted keys 2026-02-24T19:17:28.572 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fc5ac955640 1 librados: calling monclient init 2026-02-24T19:17:28.572 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fc5ac955640 10 monclient: init 2026-02-24T19:17:28.572 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fdd0e7fc640 1 -- 10.20.193.14:0/1020801030 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2039982772 0 0) 0x7fdd10163ed0 con 0x7fdd10058070 2026-02-24T19:17:28.572 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fdd0e7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.572 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fdd0e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.572 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fdd0e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.572 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fdd0e7fc640 10 monclient(hunting): my global_id is 4445 2026-02-24T19:17:28.572 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7feedaffd640 1 -- 10.20.193.14:0/2449888433 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feec80031d0 con 0x7feedc0b9f80 2026-02-24T19:17:28.572 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7feedaffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.572 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7feedaffd640 1 -- 10.20.193.14:0/2449888433 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7feec8004990 con 0x7feedc0b9f80 2026-02-24T19:17:28.572 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7feedaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.572 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7feedaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.572 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7feedaffd640 10 monclient: dump: 2026-02-24T19:17:28.572 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.572 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.572 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.572 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.572 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.572 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.572 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.572 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.572 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.572 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.572 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7feee249f640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:28.572 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7feee249f640 4 set_mon_vals no callback set 2026-02-24T19:17:28.573 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7ff11bfff640 10 client.?.objecter ms_handle_connect 0x7ff1400585e0 2026-02-24T19:17:28.573 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7ff11bfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.573 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fdd0e7fc640 1 -- 10.20.193.14:0/1020801030 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd10163930 con 0x7fdd10058070 2026-02-24T19:17:28.573 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7f28a3fff640 1 -- 10.20.193.14:0/425562497 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3060249746 0 0) 0x7f28c81610c0 con 0x7f28c815b0a0 2026-02-24T19:17:28.573 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7f28a3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.573 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7f28a3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.573 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7f28a3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.573 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7f28a3fff640 10 monclient(hunting): my global_id is 4448 2026-02-24T19:17:28.573 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7f28a3fff640 1 -- 10.20.193.14:0/425562497 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28c8155cc0 con 0x7f28c815b0a0 2026-02-24T19:17:28.573 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fa29fa9c640 10 monclient: shutdown 2026-02-24T19:17:28.573 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fa29fa9c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.573 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fa29fa9c640 1 -- 10.20.193.14:0/3628137673 >> v1:10.20.193.14:6789/0 conn(0x7fa29815deb0 legacy=0x7fa2980b9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.573 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fc5ac955640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.573 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fc5ac955640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:28.573 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fc5ac955640 10 monclient(hunting): picked mon.noname-a con 0x7fc5a40b5d80 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.573 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fc5ac955640 10 monclient(hunting): picked mon.noname-c con 0x7fc5a415af80 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.573 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fc5ac955640 10 monclient(hunting): picked mon.noname-b con 0x7fc5a415b350 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.573 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fc5ac955640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5a40b0730 con 0x7fc5a40b5d80 2026-02-24T19:17:28.573 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fc5ac955640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5a4155fa0 con 0x7fc5a415b350 2026-02-24T19:17:28.573 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fc5ac955640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5a41fdbf0 con 0x7fc5a415af80 2026-02-24T19:17:28.573 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fc5ac955640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.573 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fc5ac955640 10 monclient(hunting): authenticate will time out at 3623.196754s 2026-02-24T19:17:28.574 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fa29fa9c640 1 -- 10.20.193.14:0/3628137673 shutdown_connections 2026-02-24T19:17:28.574 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fa29fa9c640 1 -- 10.20.193.14:0/3628137673 >> 10.20.193.14:0/3628137673 conn(0x7fa2980b7990 msgr2=0x7fa2980b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.574 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7f5f79573640 1 -- 10.20.193.14:0/1475427421 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1842123087 0 0) 0x7f5f7c163ed0 con 0x7f5f7c159a70 2026-02-24T19:17:28.574 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7f5f79573640 1 -- 10.20.193.14:0/1475427421 >> v1:10.20.193.170:6789/0 conn(0x7f5f7c058070 legacy=0x7f5f7c058460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.574 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7f5f79573640 1 -- 10.20.193.14:0/1475427421 >> v1:10.20.193.14:6789/0 conn(0x7f5f7c159e40 legacy=0x7f5f7c163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.574 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fa29fa9c640 1 -- 10.20.193.14:0/3628137673 shutdown_connections 2026-02-24T19:17:28.574 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7f5f79573640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.574 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7f5f79573640 1 monclient: found mon.noname-b 2026-02-24T19:17:28.574 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7f5f79573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.574 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7f5f79573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.574 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7f5f79573640 1 -- 10.20.193.14:0/1475427421 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f7c057590 con 0x7f5f7c159a70 2026-02-24T19:17:28.574 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7fa29fa9c640 1 -- 10.20.193.14:0/3628137673 wait complete. 2026-02-24T19:17:28.574 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7f5f79573640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.574 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7f5f79573640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.574 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7f5f79573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.574 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7f5f79573640 1 -- 10.20.193.14:0/1475427421 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5f70002dd0 con 0x7f5f7c159a70 2026-02-24T19:17:28.574 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7f5f79573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.574 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7f5f79573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:28.574 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7f5f79573640 10 monclient: dump: 2026-02-24T19:17:28.574 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.575 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.575 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.575 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.575 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.575 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.575 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.575 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.575 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.575 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.575 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7feee249f640 10 monclient: shutdown 2026-02-24T19:17:28.575 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7feee249f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.575 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7feee249f640 1 -- 10.20.193.14:0/2449888433 >> v1:10.20.193.14:6789/0 conn(0x7feedc0b9f80 legacy=0x7feedc163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.575 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7f5f80ee8640 5 monclient: authenticate success, global_id 4420 2026-02-24T19:17:28.575 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.515+0000 7f5f80ee8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.575 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7feee249f640 1 -- 10.20.193.14:0/2449888433 shutdown_connections 2026-02-24T19:17:28.575 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7feee249f640 1 -- 10.20.193.14:0/2449888433 >> 10.20.193.14:0/2449888433 conn(0x7feedc0b7990 msgr2=0x7feedc0b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.575 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7feee249f640 1 -- 10.20.193.14:0/2449888433 shutdown_connections 2026-02-24T19:17:28.575 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7feee249f640 1 -- 10.20.193.14:0/2449888433 wait complete. 2026-02-24T19:17:28.575 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7fa29fa9c640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.575 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7fa29fa9c640 10 monclient: monmap: 2026-02-24T19:17:28.575 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.575 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:28.575 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:28.575 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:28.575 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.575 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:28.575 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.575 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.575 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.576 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7fdd0e7fc640 1 -- 10.20.193.14:0/1020801030 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3717465048 0 0) 0x7fdcf4003610 con 0x7fdd10159e40 2026-02-24T19:17:28.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7fdd0e7fc640 1 -- 10.20.193.14:0/1020801030 >> v1:10.20.193.170:6789/0 conn(0x7fdd10058070 legacy=0x7fdd10058460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7fdd0e7fc640 1 -- 10.20.193.14:0/1020801030 >> v1:10.20.193.14:6789/0 conn(0x7fdd10159a70 legacy=0x7fdd100b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7fdd0e7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7fdd0e7fc640 1 monclient: found mon.noname-b 2026-02-24T19:17:28.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7fdd0e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7fdd0e7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7fdd0e7fc640 1 -- 10.20.193.14:0/1020801030 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd10057590 con 0x7fdd10159e40 2026-02-24T19:17:28.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7fdd0e7fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7fdd0e7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7fdd0e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7fdd0e7fc640 1 -- 10.20.193.14:0/1020801030 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fdd00002df0 con 0x7fdd10159e40 2026-02-24T19:17:28.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7fdd0e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7fdd0e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:28.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7fdd0e7fc640 10 monclient: dump: 2026-02-24T19:17:28.576 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.576 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.576 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.576 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.576 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.576 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.576 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.576 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.576 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.576 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7fa29fa9c640 1 librados: starting msgr at 2026-02-24T19:17:28.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7fa29fa9c640 1 librados: starting objecter 2026-02-24T19:17:28.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7feee249f640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7fa29fa9c640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:28.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7fa29fa9c640 1 Processor -- start 2026-02-24T19:17:28.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7feee249f640 10 monclient: monmap: 2026-02-24T19:17:28.577 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.577 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:28.577 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:28.577 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:28.577 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.577 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:28.577 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.577 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.577 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.577 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7fdd15c4d640 5 monclient: authenticate success, global_id 4426 2026-02-24T19:17:28.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7fdd15c4d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7fa29fa9c640 1 -- start start 2026-02-24T19:17:28.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7fa29fa9c640 1 librados: setting wanted keys 2026-02-24T19:17:28.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7fa29fa9c640 1 librados: calling monclient init 2026-02-24T19:17:28.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7fa29fa9c640 10 monclient: init 2026-02-24T19:17:28.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7f4dd5336640 1 -- 10.20.193.14:0/2289182226 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4dcc003340 con 0x7f4dd00585e0 2026-02-24T19:17:28.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7f4dd5336640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7f4dd5336640 1 -- 10.20.193.14:0/2289182226 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4dcc003780 con 0x7f4dd00585e0 2026-02-24T19:17:28.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7f4dd5336640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.578 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7f4dd5336640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:28.578 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7f4dd5336640 10 monclient: dump: 2026-02-24T19:17:28.578 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.578 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.578 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.578 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.578 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.578 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.578 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.578 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.578 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.578 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.578 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7f4dd85c3640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:28.578 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7f4dd85c3640 4 set_mon_vals no callback set 2026-02-24T19:17:28.578 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7ff11bfff640 10 client.?.objecter ms_handle_connect 0x7ff1400ba350 2026-02-24T19:17:28.578 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7ff11bfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.578 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7f0e6affd640 10 client.?.objecter ms_handle_connect 0x7f0e84058070 2026-02-24T19:17:28.578 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.516+0000 7f0e6affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.578 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7feee249f640 1 librados: starting msgr at 2026-02-24T19:17:28.578 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7feee249f640 1 librados: starting objecter 2026-02-24T19:17:28.578 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7fa29fa9c640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.578 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7fa29fa9c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:28.578 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7fa29fa9c640 10 monclient(hunting): picked mon.noname-b con 0x7fa2980ba3b0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.578 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7fa29fa9c640 10 monclient(hunting): picked mon.noname-a con 0x7fa29815deb0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.578 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7fa29fa9c640 10 monclient(hunting): picked mon.noname-c con 0x7fa29815e280 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.578 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7fa29fa9c640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa298136250 con 0x7fa29815deb0 2026-02-24T19:17:28.578 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7fa29fa9c640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2980afdd0 con 0x7fa2980ba3b0 2026-02-24T19:17:28.578 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7fa29fa9c640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2980b00b0 con 0x7fa29815e280 2026-02-24T19:17:28.579 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7fa29fa9c640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.579 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7fa29fa9c640 10 monclient(hunting): authenticate will time out at 3623.198158s 2026-02-24T19:17:28.579 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7feee249f640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:28.579 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7feee249f640 1 Processor -- start 2026-02-24T19:17:28.579 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7feee249f640 1 -- start start 2026-02-24T19:17:28.579 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7feee249f640 1 librados: setting wanted keys 2026-02-24T19:17:28.579 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7feee249f640 1 librados: calling monclient init 2026-02-24T19:17:28.579 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7feee249f640 10 monclient: init 2026-02-24T19:17:28.579 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7f4dd85c3640 10 monclient: shutdown 2026-02-24T19:17:28.579 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7f4dd85c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.579 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7f4dd85c3640 1 -- 10.20.193.14:0/2289182226 >> v1:10.20.193.44:6789/0 conn(0x7f4dd00585e0 legacy=0x7f4dd0166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.579 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7f4dd85c3640 1 -- 10.20.193.14:0/2289182226 shutdown_connections 2026-02-24T19:17:28.579 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7f4dd85c3640 1 -- 10.20.193.14:0/2289182226 >> 10.20.193.14:0/2289182226 conn(0x7f4dd00b7990 msgr2=0x7f4dd00b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.579 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7f4dd85c3640 1 -- 10.20.193.14:0/2289182226 shutdown_connections 2026-02-24T19:17:28.579 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7f4dd85c3640 1 -- 10.20.193.14:0/2289182226 wait complete. 2026-02-24T19:17:28.579 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7feee249f640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.579 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7f4eb5ffb640 10 client.?.objecter ms_handle_connect 0x7f4ec80b9f80 2026-02-24T19:17:28.579 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7f4eb5ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.580 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7feee249f640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:28.580 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7feee249f640 10 monclient(hunting): picked mon.noname-c con 0x7feedc0585e0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.580 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7feee249f640 10 monclient(hunting): picked mon.noname-b con 0x7feedc0b9f80 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.580 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7feee249f640 10 monclient(hunting): picked mon.noname-a con 0x7feedc0ba350 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.580 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7feee249f640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feedc165ee0 con 0x7feedc0ba350 2026-02-24T19:17:28.580 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7feee249f640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feedc156d30 con 0x7feedc0b9f80 2026-02-24T19:17:28.580 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7feee249f640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feedc166170 con 0x7feedc0585e0 2026-02-24T19:17:28.580 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7f777ffff640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7f77801f88c0 0x7f778015fb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:44884/0 (socket says 10.20.193.14:44884) 2026-02-24T19:17:28.580 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7f777ffff640 1 -- 10.20.193.14:0/3545456418 learned_addr learned my addr 10.20.193.14:0/3545456418 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.580 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7feee249f640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.580 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.517+0000 7feee249f640 10 monclient(hunting): authenticate will time out at 3623.198909s 2026-02-24T19:17:28.580 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.518+0000 7f4dd85c3640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.580 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.518+0000 7f4dd85c3640 10 monclient: monmap: 2026-02-24T19:17:28.581 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.581 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:28.581 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:28.581 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:28.581 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.581 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:28.581 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.581 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.581 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.581 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.581 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.518+0000 7f4dd85c3640 1 librados: starting msgr at 2026-02-24T19:17:28.581 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.518+0000 7f4dd85c3640 1 librados: starting objecter 2026-02-24T19:17:28.581 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.518+0000 7f4dd85c3640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:28.581 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.518+0000 7f4dd85c3640 1 Processor -- start 2026-02-24T19:17:28.581 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.518+0000 7f4dd85c3640 1 -- start start 2026-02-24T19:17:28.581 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.518+0000 7f4dd85c3640 1 librados: setting wanted keys 2026-02-24T19:17:28.581 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.518+0000 7f4dd85c3640 1 librados: calling monclient init 2026-02-24T19:17:28.581 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.518+0000 7f4dd85c3640 10 monclient: init 2026-02-24T19:17:28.581 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.518+0000 7f4dd85c3640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.581 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.518+0000 7f4dd85c3640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:28.581 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.518+0000 7f4dd85c3640 10 monclient(hunting): picked mon.noname-a con 0x7f4dd00585e0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.581 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.518+0000 7f4dd85c3640 10 monclient(hunting): picked mon.noname-c con 0x7f4dd00b9f80 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.581 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.518+0000 7f4dd85c3640 10 monclient(hunting): picked mon.noname-b con 0x7f4dd00ba350 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.581 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.518+0000 7f4dd85c3640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dd0159ea0 con 0x7f4dd00585e0 2026-02-24T19:17:28.581 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.518+0000 7f4dd85c3640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dd01fb450 con 0x7f4dd00ba350 2026-02-24T19:17:28.581 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.518+0000 7f4dd85c3640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dd01fb730 con 0x7f4dd00b9f80 2026-02-24T19:17:28.581 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.518+0000 7f4dd85c3640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.581 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.518+0000 7f4dd85c3640 10 monclient(hunting): authenticate will time out at 3623.199720s 2026-02-24T19:17:28.581 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.519+0000 7f775bfff640 10 client.?.objecter ms_handle_connect 0x7f77801f88c0 2026-02-24T19:17:28.581 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.519+0000 7f775bfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.582 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.520+0000 7f8300a19640 1 -- 10.20.193.14:0/2187888260 <== mon.2 v1:10.20.193.170:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f82f0002fc0 con 0x7f82fc0ba350 2026-02-24T19:17:28.582 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.520+0000 7f8300a19640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.582 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.520+0000 7f8300a19640 1 -- 10.20.193.14:0/2187888260 <== mon.2 v1:10.20.193.170:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f82f0003400 con 0x7f82fc0ba350 2026-02-24T19:17:28.582 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.520+0000 7f8300a19640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.582 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.520+0000 7f8300a19640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:28.582 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.520+0000 7f8300a19640 10 monclient: dump: 2026-02-24T19:17:28.582 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.582 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.582 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.582 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.582 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.582 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.582 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.582 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.582 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.582 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.582 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.520+0000 7f8303ca6640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:28.582 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.520+0000 7f8303ca6640 4 set_mon_vals no callback set 2026-02-24T19:17:28.582 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.521+0000 7f8303ca6640 10 monclient: shutdown 2026-02-24T19:17:28.582 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.521+0000 7f8303ca6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.582 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.521+0000 7f8303ca6640 1 -- 10.20.193.14:0/2187888260 >> v1:10.20.193.170:6789/0 conn(0x7f82fc0ba350 legacy=0x7f82fc057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.582 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.521+0000 7f8303ca6640 1 -- 10.20.193.14:0/2187888260 shutdown_connections 2026-02-24T19:17:28.582 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.521+0000 7f8303ca6640 1 -- 10.20.193.14:0/2187888260 >> 10.20.193.14:0/2187888260 conn(0x7f82fc0b7990 msgr2=0x7f82fc0b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.582 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.521+0000 7f8303ca6640 1 -- 10.20.193.14:0/2187888260 shutdown_connections 2026-02-24T19:17:28.582 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.521+0000 7f8303ca6640 1 -- 10.20.193.14:0/2187888260 wait complete. 2026-02-24T19:17:28.582 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.521+0000 7f8303ca6640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.582 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.521+0000 7f8303ca6640 10 monclient: monmap: 2026-02-24T19:17:28.582 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.582 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:28.582 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:28.582 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:28.582 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.582 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:28.582 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.582 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.582 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.583 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.583 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.522+0000 7f8303ca6640 1 librados: starting msgr at 2026-02-24T19:17:28.583 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.522+0000 7f8303ca6640 1 librados: starting objecter 2026-02-24T19:17:28.583 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.522+0000 7f8303ca6640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:28.583 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.522+0000 7f8303ca6640 1 Processor -- start 2026-02-24T19:17:28.583 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.522+0000 7f8303ca6640 1 -- start start 2026-02-24T19:17:28.583 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.522+0000 7f8303ca6640 1 librados: setting wanted keys 2026-02-24T19:17:28.583 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.522+0000 7f8303ca6640 1 librados: calling monclient init 2026-02-24T19:17:28.583 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.522+0000 7f8303ca6640 10 monclient: init 2026-02-24T19:17:28.583 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.522+0000 7ff11bfff640 10 client.?.objecter ms_handle_connect 0x7ff1400b9f80 2026-02-24T19:17:28.583 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.522+0000 7ff11bfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.583 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.522+0000 7f8303ca6640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.583 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.522+0000 7f8303ca6640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:28.583 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.522+0000 7f8303ca6640 10 monclient(hunting): picked mon.noname-c con 0x7f82fc0585e0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.583 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.522+0000 7f4eb5ffb640 10 client.?.objecter ms_handle_connect 0x7f4ec80ba350 2026-02-24T19:17:28.583 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.522+0000 7f4eb5ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.583 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.522+0000 7f8303ca6640 10 monclient(hunting): picked mon.noname-b con 0x7f82fc0b9f80 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.583 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.522+0000 7f8303ca6640 10 monclient(hunting): picked mon.noname-a con 0x7f82fc0ba350 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.583 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.522+0000 7f8303ca6640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82fc0b4ea0 con 0x7f82fc0ba350 2026-02-24T19:17:28.583 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.523+0000 7f8303ca6640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82fc0b23b0 con 0x7f82fc0b9f80 2026-02-24T19:17:28.583 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.523+0000 7f8303ca6640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82fc0b2690 con 0x7f82fc0585e0 2026-02-24T19:17:28.583 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.523+0000 7f8303ca6640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.584 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.523+0000 7f8303ca6640 10 monclient(hunting): authenticate will time out at 3623.204029s 2026-02-24T19:17:28.584 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.523+0000 7f59712b9640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f596c0b9f80 0x7f596c15daa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:54844/0 (socket says 10.20.193.14:54844) 2026-02-24T19:17:28.584 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.523+0000 7f59712b9640 1 -- 10.20.193.14:0/2765925491 learned_addr learned my addr 10.20.193.14:0/2765925491 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.584 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.524+0000 7f0e6affd640 1 -- 10.20.193.14:0/3369942034 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1395574742 0 0) 0x7f0e84160000 con 0x7f0e84159e40 2026-02-24T19:17:28.584 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.524+0000 7f0e6affd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.584 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.524+0000 7f0e6affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.584 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.524+0000 7f0e6affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.584 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.524+0000 7f0e6affd640 10 monclient(hunting): my global_id is 4442 2026-02-24T19:17:28.584 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.524+0000 7f5f79573640 1 -- 10.20.193.14:0/1475427421 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5f70002fa0 con 0x7f5f7c159a70 2026-02-24T19:17:28.584 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.524+0000 7f5f79573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.584 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.524+0000 7f5f79573640 1 -- 10.20.193.14:0/1475427421 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5f700033e0 con 0x7f5f7c159a70 2026-02-24T19:17:28.584 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.524+0000 7f5f79573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.584 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.524+0000 7f5f79573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:28.584 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.524+0000 7f5f79573640 10 monclient: dump: 2026-02-24T19:17:28.584 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.584 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.584 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.584 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.584 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.584 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.584 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.584 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.584 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.584 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.584 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.524+0000 7f5f80ee8640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:28.584 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.524+0000 7f5f80ee8640 4 set_mon_vals no callback set 2026-02-24T19:17:28.584 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.524+0000 7f0e6affd640 1 -- 10.20.193.14:0/3369942034 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e841fb300 con 0x7f0e84159e40 2026-02-24T19:17:28.584 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.524+0000 7f595a7fc640 10 client.?.objecter ms_handle_connect 0x7f596c0b9f80 2026-02-24T19:17:28.585 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.524+0000 7f595a7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.585 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.524+0000 7f5f80ee8640 10 monclient: shutdown 2026-02-24T19:17:28.585 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.524+0000 7f5f80ee8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.585 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.524+0000 7f5f80ee8640 1 -- 10.20.193.14:0/1475427421 >> v1:10.20.193.44:6789/0 conn(0x7f5f7c159a70 legacy=0x7f5f7c0b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.585 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.524+0000 7f5f80ee8640 1 -- 10.20.193.14:0/1475427421 shutdown_connections 2026-02-24T19:17:28.585 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.524+0000 7f5f80ee8640 1 -- 10.20.193.14:0/1475427421 >> 10.20.193.14:0/1475427421 conn(0x7f5f7c0b7780 msgr2=0x7f5f7c0b7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.585 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.525+0000 7f5f80ee8640 1 -- 10.20.193.14:0/1475427421 shutdown_connections 2026-02-24T19:17:28.585 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.525+0000 7f0e6affd640 1 -- 10.20.193.14:0/3369942034 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3704133800 0 0) 0x7f0e8415fd20 con 0x7f0e84058070 2026-02-24T19:17:28.585 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.525+0000 7f0e6affd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.585 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.525+0000 7f0e6affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.585 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.525+0000 7f0e6affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.585 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.525+0000 7f0e6affd640 10 monclient(hunting): my global_id is 4441 2026-02-24T19:17:28.585 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.525+0000 7f0e6affd640 1 -- 10.20.193.14:0/3369942034 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e84160000 con 0x7f0e84058070 2026-02-24T19:17:28.585 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.525+0000 7f5f80ee8640 1 -- 10.20.193.14:0/1475427421 wait complete. 2026-02-24T19:17:28.585 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.525+0000 7f775bfff640 10 client.?.objecter ms_handle_connect 0x7f778015b0a0 2026-02-24T19:17:28.585 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.525+0000 7f775bfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.586 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.525+0000 7f5f80ee8640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.586 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.525+0000 7f5f80ee8640 10 monclient: monmap: 2026-02-24T19:17:28.586 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.586 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:28.586 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:28.586 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:28.586 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.586 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:28.586 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.586 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.586 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.586 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.586 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.525+0000 7f5f80ee8640 1 librados: starting msgr at 2026-02-24T19:17:28.586 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.525+0000 7f5f80ee8640 1 librados: starting objecter 2026-02-24T19:17:28.586 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.525+0000 7f5f80ee8640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:28.586 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.525+0000 7f5f80ee8640 1 Processor -- start 2026-02-24T19:17:28.586 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.526+0000 7f5f80ee8640 1 -- start start 2026-02-24T19:17:28.586 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.526+0000 7f5f80ee8640 1 librados: setting wanted keys 2026-02-24T19:17:28.586 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.526+0000 7f5f80ee8640 1 librados: calling monclient init 2026-02-24T19:17:28.586 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.526+0000 7f5f80ee8640 10 monclient: init 2026-02-24T19:17:28.586 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.526+0000 7f56e6d76640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f56e8157780 0x7f56e8158c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:54846/0 (socket says 10.20.193.14:54846) 2026-02-24T19:17:28.586 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.526+0000 7f56e6d76640 1 -- 10.20.193.14:0/1171845697 learned_addr learned my addr 10.20.193.14:0/1171845697 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.586 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.526+0000 7f56c77fe640 10 client.?.objecter ms_handle_connect 0x7f56e8157780 2026-02-24T19:17:28.586 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.526+0000 7f56c77fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.586 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.526+0000 7f5f80ee8640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.526+0000 7f5f80ee8640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:28.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.526+0000 7f5f80ee8640 10 monclient(hunting): picked mon.noname-c con 0x7f5f7c058070 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.526+0000 7f5f80ee8640 10 monclient(hunting): picked mon.noname-a con 0x7f5f7c159a70 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.526+0000 7f5f80ee8640 10 monclient(hunting): picked mon.noname-b con 0x7f5f7c159e40 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.526+0000 7f5f80ee8640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f7c156940 con 0x7f5f7c159a70 2026-02-24T19:17:28.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.526+0000 7f5f80ee8640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f7c0b9380 con 0x7f5f7c159e40 2026-02-24T19:17:28.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.526+0000 7f5f80ee8640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f7c1faf30 con 0x7f5f7c058070 2026-02-24T19:17:28.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.526+0000 7f5f80ee8640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.526+0000 7f5f80ee8640 10 monclient(hunting): authenticate will time out at 3623.207718s 2026-02-24T19:17:28.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.527+0000 7f775bfff640 10 client.?.objecter ms_handle_connect 0x7f77800b5da0 2026-02-24T19:17:28.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.527+0000 7f775bfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.527+0000 7fc5aaecb640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7fc5a415b350 0x7fc5a40b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:34564/0 (socket says 10.20.193.14:34564) 2026-02-24T19:17:28.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.527+0000 7fc5aaecb640 1 -- 10.20.193.14:0/2603662831 learned_addr learned my addr 10.20.193.14:0/2603662831 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.527+0000 7fab377fe640 1 -- 10.20.193.14:0/2887742981 <== mon.2 v1:10.20.193.170:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fab3c003340 con 0x7fab400585e0 2026-02-24T19:17:28.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.527+0000 7fab377fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.527+0000 7fab377fe640 1 -- 10.20.193.14:0/2887742981 <== mon.2 v1:10.20.193.170:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fab3c003780 con 0x7fab400585e0 2026-02-24T19:17:28.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.527+0000 7fab377fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.527+0000 7fab377fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:28.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.527+0000 7fab377fe640 10 monclient: dump: 2026-02-24T19:17:28.587 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.587 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.587 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.587 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.587 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.587 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.587 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.587 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.587 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.587 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.527+0000 7fab46cd8640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:28.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.527+0000 7fab46cd8640 4 set_mon_vals no callback set 2026-02-24T19:17:28.588 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.528+0000 7ff11bfff640 1 -- 10.20.193.14:0/1755338058 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 667836934 0 0) 0x7ff1400b23b0 con 0x7ff1400585e0 2026-02-24T19:17:28.588 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.528+0000 7ff11bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.588 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.528+0000 7ff11bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.588 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.528+0000 7ff11bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.588 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.528+0000 7ff11bfff640 10 monclient(hunting): my global_id is 4438 2026-02-24T19:17:28.588 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.528+0000 7ff11bfff640 1 -- 10.20.193.14:0/1755338058 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff110003610 con 0x7ff1400585e0 2026-02-24T19:17:28.588 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.528+0000 7f775bfff640 1 -- 10.20.193.14:0/3545456418 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3365486181 0 0) 0x7f77800b1f30 con 0x7f77801f88c0 2026-02-24T19:17:28.588 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.528+0000 7f775bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.588 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.528+0000 7f775bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.588 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.528+0000 7f775bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.588 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.528+0000 7f775bfff640 10 monclient(hunting): my global_id is 4454 2026-02-24T19:17:28.588 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.528+0000 7f775bfff640 1 -- 10.20.193.14:0/3545456418 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7750003610 con 0x7f77801f88c0 2026-02-24T19:17:28.588 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.528+0000 7fc58effd640 10 client.?.objecter ms_handle_connect 0x7fc5a415b350 2026-02-24T19:17:28.588 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.528+0000 7fc58effd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.588 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.528+0000 7fab46cd8640 10 monclient: shutdown 2026-02-24T19:17:28.588 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.528+0000 7fab46cd8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.588 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.528+0000 7fab46cd8640 1 -- 10.20.193.14:0/2887742981 >> v1:10.20.193.170:6789/0 conn(0x7fab400585e0 legacy=0x7fab40166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.588 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.528+0000 7fab46cd8640 1 -- 10.20.193.14:0/2887742981 shutdown_connections 2026-02-24T19:17:28.588 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.528+0000 7fab46cd8640 1 -- 10.20.193.14:0/2887742981 >> 10.20.193.14:0/2887742981 conn(0x7fab400b7990 msgr2=0x7fab400b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.588 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.528+0000 7fab46cd8640 1 -- 10.20.193.14:0/2887742981 shutdown_connections 2026-02-24T19:17:28.588 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.528+0000 7fab46cd8640 1 -- 10.20.193.14:0/2887742981 wait complete. 2026-02-24T19:17:28.588 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.528+0000 7f595a7fc640 10 client.?.objecter ms_handle_connect 0x7f596c0ba350 2026-02-24T19:17:28.589 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.528+0000 7f595a7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.589 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.529+0000 7fc58effd640 10 client.?.objecter ms_handle_connect 0x7fc5a40b5d80 2026-02-24T19:17:28.589 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.529+0000 7fc58effd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.589 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.529+0000 7fab46cd8640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.589 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.529+0000 7fab46cd8640 10 monclient: monmap: 2026-02-24T19:17:28.589 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.589 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:28.589 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:28.589 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:28.589 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.589 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:28.589 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.589 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.589 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.589 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.589 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.529+0000 7f28a3fff640 1 -- 10.20.193.14:0/425562497 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2043257927 0 0) 0x7f28c8155cc0 con 0x7f28c815b0a0 2026-02-24T19:17:28.589 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.529+0000 7f28a3fff640 1 -- 10.20.193.14:0/425562497 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f28c81610c0 con 0x7f28c815b0a0 2026-02-24T19:17:28.589 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.529+0000 7f28a3fff640 1 -- 10.20.193.14:0/425562497 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f28b8003060 con 0x7f28c815b0a0 2026-02-24T19:17:28.589 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.529+0000 7f28a3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.589 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.529+0000 7fab46cd8640 1 librados: starting msgr at 2026-02-24T19:17:28.589 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.529+0000 7fab46cd8640 1 librados: starting objecter 2026-02-24T19:17:28.589 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.529+0000 7f28a3fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:28.589 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.529+0000 7f28a3fff640 10 monclient(hunting): dump: 2026-02-24T19:17:28.589 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.590 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.590 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.590 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.590 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.590 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.590 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.590 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.590 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.590 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.590 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.529+0000 7f28a3fff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:28.590 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.529+0000 7fab46cd8640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:28.590 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.529+0000 7fab46cd8640 1 Processor -- start 2026-02-24T19:17:28.590 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.529+0000 7fab46cd8640 1 -- start start 2026-02-24T19:17:28.590 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.529+0000 7fab46cd8640 1 librados: setting wanted keys 2026-02-24T19:17:28.590 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.529+0000 7fab46cd8640 1 librados: calling monclient init 2026-02-24T19:17:28.590 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.529+0000 7fab46cd8640 10 monclient: init 2026-02-24T19:17:28.590 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.530+0000 7fa29d010640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7fa29815deb0 0x7fa2980b1150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:54864/0 (socket says 10.20.193.14:54864) 2026-02-24T19:17:28.590 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.530+0000 7fa29d010640 1 -- 10.20.193.14:0/852388800 learned_addr learned my addr 10.20.193.14:0/852388800 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.590 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.530+0000 7fab46cd8640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.590 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.530+0000 7fab46cd8640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:28.590 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.530+0000 7fab46cd8640 10 monclient(hunting): picked mon.noname-c con 0x7fab400585e0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.530+0000 7fab46cd8640 10 monclient(hunting): picked mon.noname-a con 0x7fab400b9f80 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.530+0000 7fab46cd8640 10 monclient(hunting): picked mon.noname-b con 0x7fab400ba350 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.530+0000 7fab46cd8640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab40159ea0 con 0x7fab400b9f80 2026-02-24T19:17:28.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.530+0000 7fab46cd8640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab401fb450 con 0x7fab400ba350 2026-02-24T19:17:28.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.530+0000 7fab46cd8640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab401fb730 con 0x7fab400585e0 2026-02-24T19:17:28.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.530+0000 7fab46cd8640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.530+0000 7fab46cd8640 10 monclient(hunting): authenticate will time out at 3623.211162s 2026-02-24T19:17:28.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.530+0000 7f56c77fe640 10 client.?.objecter ms_handle_connect 0x7f56e8157b50 2026-02-24T19:17:28.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.530+0000 7f56c77fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.530+0000 7f595a7fc640 10 client.?.objecter ms_handle_connect 0x7f596c0585e0 2026-02-24T19:17:28.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.530+0000 7f595a7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.531+0000 7f56c77fe640 10 client.?.objecter ms_handle_connect 0x7f56e8164d00 2026-02-24T19:17:28.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.531+0000 7f56c77fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.531+0000 7fa2867fc640 10 client.?.objecter ms_handle_connect 0x7fa29815deb0 2026-02-24T19:17:28.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.531+0000 7fa2867fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.531+0000 7ff11bfff640 1 -- 10.20.193.14:0/1755338058 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2921741161 0 0) 0x7ff1400b4ea0 con 0x7ff1400ba350 2026-02-24T19:17:28.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.531+0000 7ff11bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.531+0000 7ff11bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.531+0000 7ff11bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.531+0000 7ff11bfff640 10 monclient(hunting): my global_id is 4449 2026-02-24T19:17:28.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.531+0000 7ff11bfff640 1 -- 10.20.193.14:0/1755338058 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1400b23b0 con 0x7ff1400ba350 2026-02-24T19:17:28.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.532+0000 7fdd0e7fc640 1 -- 10.20.193.14:0/1020801030 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdd00002fc0 con 0x7fdd10159e40 2026-02-24T19:17:28.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.532+0000 7fdd0e7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.532+0000 7fdd0e7fc640 1 -- 10.20.193.14:0/1020801030 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fdd00003400 con 0x7fdd10159e40 2026-02-24T19:17:28.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.532+0000 7fdd0e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.532+0000 7fdd0e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:28.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.532+0000 7fdd0e7fc640 10 monclient: dump: 2026-02-24T19:17:28.592 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.592 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.592 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.592 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.592 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.592 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.592 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.592 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.592 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.592 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.532+0000 7fdd15c4d640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:28.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.532+0000 7fdd15c4d640 4 set_mon_vals no callback set 2026-02-24T19:17:28.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.532+0000 7f4eb5ffb640 1 -- 10.20.193.14:0/1929189111 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 403201465 0 0) 0x7f4ec813aab0 con 0x7f4ec80ba350 2026-02-24T19:17:28.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.532+0000 7f4eb5ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.532+0000 7f4eb5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.532+0000 7f4eb5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.532+0000 7f4eb5ffb640 10 monclient(hunting): my global_id is 4444 2026-02-24T19:17:28.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.532+0000 7f4eb5ffb640 1 -- 10.20.193.14:0/1929189111 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e98003610 con 0x7f4ec80ba350 2026-02-24T19:17:28.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.532+0000 7fdd15c4d640 10 monclient: shutdown 2026-02-24T19:17:28.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.532+0000 7fdd15c4d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.532+0000 7fdd15c4d640 1 -- 10.20.193.14:0/1020801030 >> v1:10.20.193.44:6789/0 conn(0x7fdd10159e40 legacy=0x7fdd10163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.532+0000 7f4dd6338640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f4dd00585e0 0x7f4dd0159790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:54888/0 (socket says 10.20.193.14:54888) 2026-02-24T19:17:28.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.532+0000 7f4dd6338640 1 -- 10.20.193.14:0/4093622326 learned_addr learned my addr 10.20.193.14:0/4093622326 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.593 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.532+0000 7fdd15c4d640 1 -- 10.20.193.14:0/1020801030 shutdown_connections 2026-02-24T19:17:28.593 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.532+0000 7fdd15c4d640 1 -- 10.20.193.14:0/1020801030 >> 10.20.193.14:0/1020801030 conn(0x7fdd100b7780 msgr2=0x7fdd100b7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.593 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.532+0000 7fdd15c4d640 1 -- 10.20.193.14:0/1020801030 shutdown_connections 2026-02-24T19:17:28.593 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.532+0000 7fdd15c4d640 1 -- 10.20.193.14:0/1020801030 wait complete. 2026-02-24T19:17:28.593 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.532+0000 7feee0a15640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7feedc0ba350 0x7feedc1645a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:54880/0 (socket says 10.20.193.14:54880) 2026-02-24T19:17:28.593 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.532+0000 7feee0a15640 1 -- 10.20.193.14:0/912187155 learned_addr learned my addr 10.20.193.14:0/912187155 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.593 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.532+0000 7f28a3fff640 1 -- 10.20.193.14:0/425562497 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1947714264 0 0) 0x7f28c8160e00 con 0x7f28c81f97f0 2026-02-24T19:17:28.593 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.532+0000 7f28a3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.593 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.532+0000 7f28a3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.593 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.532+0000 7f28a3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.593 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.532+0000 7f28a3fff640 10 monclient(hunting): my global_id is 4440 2026-02-24T19:17:28.593 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.532+0000 7f28a3fff640 1 -- 10.20.193.14:0/425562497 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28c8155cc0 con 0x7f28c81f97f0 2026-02-24T19:17:28.593 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.533+0000 7fdd15c4d640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.593 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.533+0000 7fdd15c4d640 10 monclient: monmap: 2026-02-24T19:17:28.594 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.594 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:28.594 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:28.594 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:28.594 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.594 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:28.594 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.594 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.594 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.594 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.594 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.533+0000 7fdd15c4d640 1 librados: starting msgr at 2026-02-24T19:17:28.594 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.533+0000 7fdd15c4d640 1 librados: starting objecter 2026-02-24T19:17:28.594 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.533+0000 7fdd15c4d640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:28.594 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.533+0000 7fdd15c4d640 1 Processor -- start 2026-02-24T19:17:28.594 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.533+0000 7fdd15c4d640 1 -- start start 2026-02-24T19:17:28.594 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.533+0000 7fdd15c4d640 1 librados: setting wanted keys 2026-02-24T19:17:28.594 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.533+0000 7fdd15c4d640 1 librados: calling monclient init 2026-02-24T19:17:28.594 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.533+0000 7fdd15c4d640 10 monclient: init 2026-02-24T19:17:28.594 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.534+0000 7f4db6ffd640 10 client.?.objecter ms_handle_connect 0x7f4dd00ba350 2026-02-24T19:17:28.594 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.534+0000 7f4db6ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.594 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.534+0000 7feed8ff9640 10 client.?.objecter ms_handle_connect 0x7feedc0b9f80 2026-02-24T19:17:28.594 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.534+0000 7feed8ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.594 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.534+0000 7fa2867fc640 10 client.?.objecter ms_handle_connect 0x7fa2980ba3b0 2026-02-24T19:17:28.594 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.534+0000 7fa2867fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.534+0000 7fdd15c4d640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.534+0000 7fdd15c4d640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:28.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.534+0000 7fdd15c4d640 10 monclient(hunting): picked mon.noname-a con 0x7fdd10058070 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.534+0000 7fdd15c4d640 10 monclient(hunting): picked mon.noname-c con 0x7fdd10159a70 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.534+0000 7fdd15c4d640 10 monclient(hunting): picked mon.noname-b con 0x7fdd10159e40 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.534+0000 7fdd15c4d640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd101535c0 con 0x7fdd10058070 2026-02-24T19:17:28.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.534+0000 7fdd15c4d640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd101fe890 con 0x7fdd10159e40 2026-02-24T19:17:28.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.534+0000 7fdd15c4d640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd101feb70 con 0x7fdd10159a70 2026-02-24T19:17:28.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.534+0000 7fdd15c4d640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.534+0000 7fdd15c4d640 10 monclient(hunting): authenticate will time out at 3623.215399s 2026-02-24T19:17:28.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.534+0000 7f4eb5ffb640 1 -- 10.20.193.14:0/1929189111 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2604452068 0 0) 0x7f4ec8165530 con 0x7f4ec80585e0 2026-02-24T19:17:28.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.534+0000 7f4eb5ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.534+0000 7f4eb5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.534+0000 7f4eb5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.534+0000 7f4eb5ffb640 10 monclient(hunting): my global_id is 4446 2026-02-24T19:17:28.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.534+0000 7f4eb5ffb640 1 -- 10.20.193.14:0/1929189111 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ec813aab0 con 0x7f4ec80585e0 2026-02-24T19:17:28.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.535+0000 7feed8ff9640 10 client.?.objecter ms_handle_connect 0x7feedc0ba350 2026-02-24T19:17:28.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.535+0000 7feed8ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.535+0000 7f4db6ffd640 10 client.?.objecter ms_handle_connect 0x7f4dd00585e0 2026-02-24T19:17:28.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.535+0000 7f4db6ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.536+0000 7f830121a640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7f82fc0b9f80 0x7f82fc1fc380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:34584/0 (socket says 10.20.193.14:34584) 2026-02-24T19:17:28.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.536+0000 7f830121a640 1 -- 10.20.193.14:0/897198496 learned_addr learned my addr 10.20.193.14:0/897198496 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.537+0000 7f775bfff640 1 -- 10.20.193.14:0/3545456418 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1887714785 0 0) 0x7f7750003610 con 0x7f77801f88c0 2026-02-24T19:17:28.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.537+0000 7f775bfff640 1 -- 10.20.193.14:0/3545456418 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f77800b1f30 con 0x7f77801f88c0 2026-02-24T19:17:28.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.537+0000 7f775bfff640 1 -- 10.20.193.14:0/3545456418 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7774003470 con 0x7f77801f88c0 2026-02-24T19:17:28.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.537+0000 7f775bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.537+0000 7f775bfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:28.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.537+0000 7f775bfff640 10 monclient(hunting): dump: 2026-02-24T19:17:28.596 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.596 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.596 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.596 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.596 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.596 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.596 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.596 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.596 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.596 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.537+0000 7f775bfff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:28.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.537+0000 7f4eb5ffb640 1 -- 10.20.193.14:0/1929189111 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1523995468 0 0) 0x7f4ec8164c90 con 0x7f4ec80b9f80 2026-02-24T19:17:28.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.537+0000 7f4eb5ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.537+0000 7f4eb5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.537+0000 7f4eb5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.537+0000 7f4eb5ffb640 10 monclient(hunting): my global_id is 4451 2026-02-24T19:17:28.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.537+0000 7f4eb5ffb640 1 -- 10.20.193.14:0/1929189111 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ec8165530 con 0x7f4ec80b9f80 2026-02-24T19:17:28.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.538+0000 7ff11bfff640 1 -- 10.20.193.14:0/1755338058 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 522027430 0 0) 0x7ff1400b2690 con 0x7ff1400b9f80 2026-02-24T19:17:28.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.538+0000 7ff11bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.538+0000 7ff11bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.538+0000 7ff11bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.538+0000 7ff11bfff640 10 monclient(hunting): my global_id is 4457 2026-02-24T19:17:28.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.538+0000 7ff11bfff640 1 -- 10.20.193.14:0/1755338058 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1400b4ea0 con 0x7ff1400b9f80 2026-02-24T19:17:28.597 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.538+0000 7f48c1d74640 1 -- 10.20.193.14:0/786497491 <== mon.2 v1:10.20.193.170:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f48ac003000 con 0x7f48c4058580 2026-02-24T19:17:28.597 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.538+0000 7f48c1d74640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.597 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.538+0000 7f48c1d74640 1 -- 10.20.193.14:0/786497491 <== mon.2 v1:10.20.193.170:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f48ac003440 con 0x7f48c4058580 2026-02-24T19:17:28.597 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.538+0000 7f48c1d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.597 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.538+0000 7f48c1d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:28.597 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.538+0000 7f48c1d74640 10 monclient: dump: 2026-02-24T19:17:28.597 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.597 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.597 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.597 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.597 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.597 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.597 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.597 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.597 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.597 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.597 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.538+0000 7f48c915c640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:28.597 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.538+0000 7f48c915c640 4 set_mon_vals no callback set 2026-02-24T19:17:28.597 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.538+0000 7fc58effd640 10 client.?.objecter ms_handle_connect 0x7fc5a415af80 2026-02-24T19:17:28.597 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.538+0000 7fc58effd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.597 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.538+0000 7f48c915c640 10 monclient: shutdown 2026-02-24T19:17:28.597 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.538+0000 7f48c915c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.597 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.538+0000 7f48c915c640 1 -- 10.20.193.14:0/786497491 >> v1:10.20.193.170:6789/0 conn(0x7f48c4058580 legacy=0x7f48c4056600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.597 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.538+0000 7f82ea7fc640 10 client.?.objecter ms_handle_connect 0x7f82fc0b9f80 2026-02-24T19:17:28.597 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.539+0000 7f82ea7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.597 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.539+0000 7f48c915c640 1 -- 10.20.193.14:0/786497491 shutdown_connections 2026-02-24T19:17:28.598 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.539+0000 7f48c915c640 1 -- 10.20.193.14:0/786497491 >> 10.20.193.14:0/786497491 conn(0x7f48c40590f0 msgr2=0x7f48c40594f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.598 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.539+0000 7f48c915c640 1 -- 10.20.193.14:0/786497491 shutdown_connections 2026-02-24T19:17:28.598 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.539+0000 7f48c915c640 1 -- 10.20.193.14:0/786497491 wait complete. 2026-02-24T19:17:28.598 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.539+0000 7f0e6affd640 1 -- 10.20.193.14:0/3369942034 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4239649014 0 0) 0x7f0e50003610 con 0x7f0e84159a70 2026-02-24T19:17:28.598 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.539+0000 7f0e6affd640 1 -- 10.20.193.14:0/3369942034 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0e8415fd20 con 0x7f0e84159a70 2026-02-24T19:17:28.598 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.539+0000 7f0e6affd640 1 -- 10.20.193.14:0/3369942034 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f0e6c0030b0 con 0x7f0e84159a70 2026-02-24T19:17:28.598 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.539+0000 7f0e6affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.598 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.539+0000 7f0e6affd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:28.598 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.539+0000 7f0e6affd640 10 monclient(hunting): dump: 2026-02-24T19:17:28.598 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.598 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.598 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.598 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.598 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.598 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.598 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.598 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.598 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.598 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.598 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.539+0000 7f0e6affd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:28.598 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.539+0000 7f48c915c640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.598 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.539+0000 7f48c915c640 10 monclient: monmap: 2026-02-24T19:17:28.598 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.598 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:28.598 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:28.598 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:28.599 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.599 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:28.599 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.599 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.599 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.599 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.599 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.539+0000 7f48c915c640 1 librados: starting msgr at 2026-02-24T19:17:28.599 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.539+0000 7f48c915c640 1 librados: starting objecter 2026-02-24T19:17:28.599 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.539+0000 7f48c915c640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:28.599 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.539+0000 7f48c915c640 1 Processor -- start 2026-02-24T19:17:28.599 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.539+0000 7f48c915c640 1 -- start start 2026-02-24T19:17:28.599 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.539+0000 7f48c915c640 1 librados: setting wanted keys 2026-02-24T19:17:28.599 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.539+0000 7f48c915c640 1 librados: calling monclient init 2026-02-24T19:17:28.599 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.539+0000 7f48c915c640 10 monclient: init 2026-02-24T19:17:28.599 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.540+0000 7fc58effd640 1 -- 10.20.193.14:0/2603662831 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3902486271 0 0) 0x7fc5a4155fa0 con 0x7fc5a415b350 2026-02-24T19:17:28.599 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.540+0000 7fc58effd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.599 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.540+0000 7fc58effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.599 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.540+0000 7fc58effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.599 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.540+0000 7fc58effd640 10 monclient(hunting): my global_id is 4450 2026-02-24T19:17:28.599 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.540+0000 7fc58effd640 1 -- 10.20.193.14:0/2603662831 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc574003610 con 0x7fc5a415b350 2026-02-24T19:17:28.599 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.540+0000 7f48c915c640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.599 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.540+0000 7f48c915c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:28.599 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.540+0000 7f48c915c640 10 monclient(hunting): picked mon.noname-b con 0x7f48c4058580 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.599 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.540+0000 7f48c915c640 10 monclient(hunting): picked mon.noname-c con 0x7f48c4059e70 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.599 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.540+0000 7f48c915c640 10 monclient(hunting): picked mon.noname-a con 0x7f48c405a240 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.599 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.540+0000 7f48c915c640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48c40b30c0 con 0x7f48c405a240 2026-02-24T19:17:28.599 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.540+0000 7f48c915c640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48c41f9260 con 0x7f48c4058580 2026-02-24T19:17:28.599 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.540+0000 7f48c915c640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48c41f9540 con 0x7f48c4059e70 2026-02-24T19:17:28.600 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.540+0000 7f48c915c640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.600 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.540+0000 7f48c915c640 10 monclient(hunting): authenticate will time out at 3623.221446s 2026-02-24T19:17:28.600 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.540+0000 7f595a7fc640 1 -- 10.20.193.14:0/2765925491 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 691259627 0 0) 0x7f596c159ea0 con 0x7f596c0b9f80 2026-02-24T19:17:28.600 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.540+0000 7f595a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.600 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.540+0000 7f595a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.600 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.540+0000 7f595a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.600 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.540+0000 7f595a7fc640 10 monclient(hunting): my global_id is 4452 2026-02-24T19:17:28.600 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.540+0000 7f595a7fc640 1 -- 10.20.193.14:0/2765925491 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f593c003610 con 0x7f596c0b9f80 2026-02-24T19:17:28.600 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.542+0000 7f56c77fe640 1 -- 10.20.193.14:0/1171845697 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 555886358 0 0) 0x7f56e80a7de0 con 0x7f56e8157780 2026-02-24T19:17:28.600 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.542+0000 7f56c77fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.600 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.542+0000 7f56c77fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.600 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.542+0000 7f56c77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.600 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.542+0000 7f56c77fe640 10 monclient(hunting): my global_id is 4458 2026-02-24T19:17:28.600 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.542+0000 7f56c77fe640 1 -- 10.20.193.14:0/1171845697 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56b4003610 con 0x7f56e8157780 2026-02-24T19:17:28.600 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.542+0000 7f4db6ffd640 1 -- 10.20.193.14:0/4093622326 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 161751555 0 0) 0x7f4dd01fb450 con 0x7f4dd00ba350 2026-02-24T19:17:28.600 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.542+0000 7f4db6ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.600 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.542+0000 7f4db6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.600 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.542+0000 7f4db6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.600 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.542+0000 7f4db6ffd640 10 monclient(hunting): my global_id is 4462 2026-02-24T19:17:28.600 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.542+0000 7f775bfff640 1 -- 10.20.193.14:0/3545456418 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1029596837 0 0) 0x7f77800b1c50 con 0x7f77800b5da0 2026-02-24T19:17:28.600 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.542+0000 7f775bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.600 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.542+0000 7f775bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.601 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.542+0000 7f4db6ffd640 1 -- 10.20.193.14:0/4093622326 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4da0003610 con 0x7f4dd00ba350 2026-02-24T19:17:28.601 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.542+0000 7f775bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.601 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.542+0000 7f775bfff640 10 monclient(hunting): my global_id is 4447 2026-02-24T19:17:28.601 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.542+0000 7f775bfff640 1 -- 10.20.193.14:0/3545456418 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7750003610 con 0x7f77800b5da0 2026-02-24T19:17:28.601 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.542+0000 7f56c77fe640 1 -- 10.20.193.14:0/1171845697 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4140184706 0 0) 0x7f56e80a80c0 con 0x7f56e8164d00 2026-02-24T19:17:28.601 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.542+0000 7f56c77fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.601 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.542+0000 7f56c77fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.601 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.542+0000 7f56c77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.601 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.542+0000 7f56c77fe640 10 monclient(hunting): my global_id is 4453 2026-02-24T19:17:28.601 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.542+0000 7f56c77fe640 1 -- 10.20.193.14:0/1171845697 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56e80a7de0 con 0x7f56e8164d00 2026-02-24T19:17:28.601 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.543+0000 7f28a3fff640 1 -- 10.20.193.14:0/425562497 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1304024399 0 0) 0x7f2898003610 con 0x7f28c80b5da0 2026-02-24T19:17:28.601 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.543+0000 7f28a3fff640 1 -- 10.20.193.14:0/425562497 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f28c8160e00 con 0x7f28c80b5da0 2026-02-24T19:17:28.601 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.543+0000 7f28a3fff640 1 -- 10.20.193.14:0/425562497 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f28b4003310 con 0x7f28c80b5da0 2026-02-24T19:17:28.601 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.543+0000 7f28a3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.601 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.543+0000 7f28a3fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:28.601 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.543+0000 7f28a3fff640 10 monclient(hunting): dump: 2026-02-24T19:17:28.601 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.601 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.601 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.601 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.601 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.601 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.601 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.601 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.601 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.601 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.602 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.543+0000 7feed8ff9640 1 -- 10.20.193.14:0/912187155 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2317788496 0 0) 0x7feedc156d30 con 0x7feedc0b9f80 2026-02-24T19:17:28.602 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.543+0000 7feed8ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.602 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.543+0000 7feed8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.602 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.543+0000 7feed8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.602 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.543+0000 7feed8ff9640 10 monclient(hunting): my global_id is 4459 2026-02-24T19:17:28.602 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.543+0000 7feed8ff9640 1 -- 10.20.193.14:0/912187155 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feeac003610 con 0x7feedc0b9f80 2026-02-24T19:17:28.602 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.544+0000 7f56c77fe640 1 -- 10.20.193.14:0/1171845697 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1428147320 0 0) 0x7f56e80a83a0 con 0x7f56e8157b50 2026-02-24T19:17:28.602 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.544+0000 7f56c77fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.602 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.544+0000 7f56c77fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.602 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.544+0000 7f56c77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.602 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.544+0000 7f56c77fe640 10 monclient(hunting): my global_id is 4463 2026-02-24T19:17:28.602 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.544+0000 7f56c77fe640 1 -- 10.20.193.14:0/1171845697 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56e80a80c0 con 0x7f56e8157b50 2026-02-24T19:17:28.602 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.544+0000 7fab44a4d640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7fab400585e0 0x7fab40159790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:44964/0 (socket says 10.20.193.14:44964) 2026-02-24T19:17:28.602 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.544+0000 7fab44a4d640 1 -- 10.20.193.14:0/2139916363 learned_addr learned my addr 10.20.193.14:0/2139916363 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.602 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.544+0000 7f0e6affd640 1 -- 10.20.193.14:0/3369942034 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3422552373 0 0) 0x7f0e84160000 con 0x7f0e84058070 2026-02-24T19:17:28.602 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.544+0000 7f0e6affd640 1 -- 10.20.193.14:0/3369942034 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0e50003610 con 0x7f0e84058070 2026-02-24T19:17:28.602 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.544+0000 7f0e6affd640 1 -- 10.20.193.14:0/3369942034 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f0e78003330 con 0x7f0e84058070 2026-02-24T19:17:28.602 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.544+0000 7f0e6affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.602 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.544+0000 7f0e6affd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:28.602 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.544+0000 7f0e6affd640 10 monclient(hunting): dump: 2026-02-24T19:17:28.602 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.602 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.602 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.602 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.602 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.602 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.602 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.603 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.603 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.603 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.603 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.544+0000 7f4eb5ffb640 1 -- 10.20.193.14:0/1929189111 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1432271337 0 0) 0x7f4e98003610 con 0x7f4ec80ba350 2026-02-24T19:17:28.603 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.544+0000 7f4eb5ffb640 1 -- 10.20.193.14:0/1929189111 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4ec8164c90 con 0x7f4ec80ba350 2026-02-24T19:17:28.603 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.544+0000 7f4eb5ffb640 1 -- 10.20.193.14:0/1929189111 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4ec40035c0 con 0x7f4ec80ba350 2026-02-24T19:17:28.603 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.544+0000 7f4eb5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.603 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.544+0000 7f4eb5ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:28.603 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.544+0000 7f4eb5ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:28.603 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.603 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.603 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.603 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.603 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.603 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.603 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.603 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.603 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.603 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.603 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.545+0000 7f4eb5ffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:28.603 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.545+0000 7f775bfff640 1 -- 10.20.193.14:0/3545456418 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3738122983 0 0) 0x7f77800b1970 con 0x7f778015b0a0 2026-02-24T19:17:28.603 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.545+0000 7f775bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.603 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.545+0000 7f775bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.603 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.545+0000 7f775bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.603 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.545+0000 7f775bfff640 10 monclient(hunting): my global_id is 4455 2026-02-24T19:17:28.603 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.545+0000 7f775bfff640 1 -- 10.20.193.14:0/3545456418 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77800b1c50 con 0x7f778015b0a0 2026-02-24T19:17:28.603 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.545+0000 7fa2867fc640 1 -- 10.20.193.14:0/852388800 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4174029605 0 0) 0x7fa298136250 con 0x7fa29815deb0 2026-02-24T19:17:28.603 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.545+0000 7fa2867fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.603 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.545+0000 7fa2867fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.603 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.545+0000 7fa2867fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.603 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.545+0000 7fa2867fc640 10 monclient(hunting): my global_id is 4464 2026-02-24T19:17:28.603 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.545+0000 7fa2867fc640 1 -- 10.20.193.14:0/852388800 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa268003610 con 0x7fa29815deb0 2026-02-24T19:17:28.604 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.545+0000 7f82ea7fc640 10 client.?.objecter ms_handle_connect 0x7f82fc0ba350 2026-02-24T19:17:28.604 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.545+0000 7f82ea7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.604 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.545+0000 7fc58effd640 1 -- 10.20.193.14:0/2603662831 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4262809625 0 0) 0x7fc5a40b0730 con 0x7fc5a40b5d80 2026-02-24T19:17:28.604 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.545+0000 7fc58effd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.604 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.545+0000 7fc58effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.604 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.545+0000 7feed8ff9640 1 -- 10.20.193.14:0/912187155 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3549881624 0 0) 0x7feedc165ee0 con 0x7feedc0ba350 2026-02-24T19:17:28.604 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.545+0000 7feed8ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.604 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.545+0000 7feed8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.604 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.545+0000 7feed8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.604 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.545+0000 7feed8ff9640 10 monclient(hunting): my global_id is 4467 2026-02-24T19:17:28.604 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.545+0000 7feed8ff9640 1 -- 10.20.193.14:0/912187155 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feedc156d30 con 0x7feedc0ba350 2026-02-24T19:17:28.604 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.545+0000 7fc58effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.604 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.545+0000 7fc58effd640 10 monclient(hunting): my global_id is 4461 2026-02-24T19:17:28.604 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.545+0000 7fc58effd640 1 -- 10.20.193.14:0/2603662831 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5a4155fa0 con 0x7fc5a40b5d80 2026-02-24T19:17:28.604 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.546+0000 7f4db6ffd640 1 -- 10.20.193.14:0/4093622326 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2217569558 0 0) 0x7f4dd0159ea0 con 0x7f4dd00585e0 2026-02-24T19:17:28.604 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.546+0000 7f4db6ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.604 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.546+0000 7f4db6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.604 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.546+0000 7f4db6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.604 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.546+0000 7f4db6ffd640 10 monclient(hunting): my global_id is 4470 2026-02-24T19:17:28.605 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.546+0000 7f4db6ffd640 1 -- 10.20.193.14:0/4093622326 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4dd01fb450 con 0x7f4dd00585e0 2026-02-24T19:17:28.605 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.546+0000 7f595a7fc640 1 -- 10.20.193.14:0/2765925491 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3101915394 0 0) 0x7f596c1fb730 con 0x7f596c0ba350 2026-02-24T19:17:28.605 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.546+0000 7f595a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.605 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.546+0000 7f595a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.605 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.546+0000 7f595a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.605 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.546+0000 7f595a7fc640 10 monclient(hunting): my global_id is 4460 2026-02-24T19:17:28.605 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.546+0000 7f595a7fc640 1 -- 10.20.193.14:0/2765925491 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f596c159ea0 con 0x7f596c0ba350 2026-02-24T19:17:28.605 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.546+0000 7fab357fa640 10 client.?.objecter ms_handle_connect 0x7fab400585e0 2026-02-24T19:17:28.605 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.546+0000 7fab357fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.605 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.547+0000 7f28a3fff640 1 -- 10.20.193.14:0/425562497 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 348698350 0 0) 0x7f28c81610c0 con 0x7f28c815b0a0 2026-02-24T19:17:28.605 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.547+0000 7f28a3fff640 1 -- 10.20.193.14:0/425562497 >> v1:10.20.193.44:6789/0 conn(0x7f28c80b5da0 legacy=0x7f28c81555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.605 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.547+0000 7f28a3fff640 1 -- 10.20.193.14:0/425562497 >> v1:10.20.193.14:6789/0 conn(0x7f28c81f97f0 legacy=0x7f28c8150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.605 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.547+0000 7f28a3fff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.605 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.547+0000 7f28a3fff640 1 monclient: found mon.c 2026-02-24T19:17:28.605 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.547+0000 7f28a3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.605 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.547+0000 7f28a3fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.605 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.547+0000 7f28a3fff640 1 -- 10.20.193.14:0/425562497 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28c81f8320 con 0x7f28c815b0a0 2026-02-24T19:17:28.605 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.547+0000 7f28a3fff640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.605 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.547+0000 7f28a3fff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.605 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.547+0000 7f28a3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.547+0000 7f28cdbb3640 5 monclient: authenticate success, global_id 4448 2026-02-24T19:17:28.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.547+0000 7f28cdbb3640 10 monclient: _renew_subs 2026-02-24T19:17:28.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.547+0000 7f28cdbb3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.547+0000 7f28cdbb3640 1 -- 10.20.193.14:0/425562497 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f28c81f8600 con 0x7f28c815b0a0 2026-02-24T19:17:28.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.547+0000 7f28cdbb3640 10 client.4448.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.547+0000 7f28cdbb3640 10 monclient: _renew_subs 2026-02-24T19:17:28.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.547+0000 7f28cdbb3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.547+0000 7f28cdbb3640 1 -- 10.20.193.14:0/425562497 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f28c815fb10 con 0x7f28c815b0a0 2026-02-24T19:17:28.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.547+0000 7f28cdbb3640 1 librados: init done 2026-02-24T19:17:28.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.547+0000 7f28cdbb3640 10 client.4448.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.547+0000 7f28cdbb3640 15 client.4448.objecter _session_command_op_assign -1 1 2026-02-24T19:17:28.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.547+0000 7f28cdbb3640 20 client.4448.objecter _get_session osd=-1 returning homeless 2026-02-24T19:17:28.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.547+0000 7f28cdbb3640 10 client.4448.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.547+0000 7f28cdbb3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.547+0000 7f28cdbb3640 1 -- 10.20.193.14:0/425562497 --> v1:10.20.193.170:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f28c80525e0 con 0x7f28c815b0a0 2026-02-24T19:17:28.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.548+0000 7f5f7ad76640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7f5f7c159e40 0x7f5f7c1fe1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:34596/0 (socket says 10.20.193.14:34596) 2026-02-24T19:17:28.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.548+0000 7f5f7ad76640 1 -- 10.20.193.14:0/2714502469 learned_addr learned my addr 10.20.193.14:0/2714502469 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.549+0000 7fa2867fc640 10 client.?.objecter ms_handle_connect 0x7fa29815e280 2026-02-24T19:17:28.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.549+0000 7fa2867fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.549+0000 7f5f62ffd640 10 client.?.objecter ms_handle_connect 0x7f5f7c159e40 2026-02-24T19:17:28.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.549+0000 7f5f62ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.549+0000 7f4eb5ffb640 1 -- 10.20.193.14:0/1929189111 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 22786265 0 0) 0x7f4ec8165530 con 0x7f4ec80b9f80 2026-02-24T19:17:28.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.549+0000 7f4eb5ffb640 1 -- 10.20.193.14:0/1929189111 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4e98003610 con 0x7f4ec80b9f80 2026-02-24T19:17:28.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.549+0000 7f4eb5ffb640 1 -- 10.20.193.14:0/1929189111 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4ebc002fb0 con 0x7f4ec80b9f80 2026-02-24T19:17:28.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.549+0000 7f4eb5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.549+0000 7f4eb5ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:28.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.549+0000 7f4eb5ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:28.607 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.607 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.607 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.607 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.607 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.607 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.607 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.607 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.607 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.607 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.607 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.549+0000 7feed8ff9640 10 client.?.objecter ms_handle_connect 0x7feedc0585e0 2026-02-24T19:17:28.607 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.549+0000 7feed8ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.607 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.551+0000 7fab357fa640 10 client.?.objecter ms_handle_connect 0x7fab400b9f80 2026-02-24T19:17:28.607 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.551+0000 7fab357fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.607 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.551+0000 7f5f62ffd640 10 client.?.objecter ms_handle_connect 0x7f5f7c159a70 2026-02-24T19:17:28.607 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.551+0000 7f5f62ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.607 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.551+0000 7f4db6ffd640 10 client.?.objecter ms_handle_connect 0x7f4dd00b9f80 2026-02-24T19:17:28.607 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.551+0000 7f4db6ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.607 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.554+0000 7f595a7fc640 1 -- 10.20.193.14:0/2765925491 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4285290257 0 0) 0x7f596c1fb450 con 0x7f596c0585e0 2026-02-24T19:17:28.607 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.554+0000 7f595a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.607 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.554+0000 7f595a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.607 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.554+0000 7f595a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.607 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.554+0000 7f595a7fc640 10 monclient(hunting): my global_id is 4456 2026-02-24T19:17:28.607 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.554+0000 7f595a7fc640 1 -- 10.20.193.14:0/2765925491 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f596c1fb730 con 0x7f596c0585e0 2026-02-24T19:17:28.607 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.555+0000 7f82ea7fc640 10 client.?.objecter ms_handle_connect 0x7f82fc0585e0 2026-02-24T19:17:28.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.555+0000 7f82ea7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.555+0000 7f5f62ffd640 10 client.?.objecter ms_handle_connect 0x7f5f7c058070 2026-02-24T19:17:28.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.555+0000 7f5f62ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.556+0000 7fdd0f7fe640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7fdd10058070 0x7fdd100b4bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:54916/0 (socket says 10.20.193.14:54916) 2026-02-24T19:17:28.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.556+0000 7fdd0f7fe640 1 -- 10.20.193.14:0/1366958924 learned_addr learned my addr 10.20.193.14:0/1366958924 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.557+0000 7fa2867fc640 1 -- 10.20.193.14:0/852388800 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4156058603 0 0) 0x7fa2980afdd0 con 0x7fa2980ba3b0 2026-02-24T19:17:28.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.557+0000 7fa2867fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.557+0000 7fa2867fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.557+0000 7fa2867fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.557+0000 7fa2867fc640 10 monclient(hunting): my global_id is 4465 2026-02-24T19:17:28.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.557+0000 7fa2867fc640 1 -- 10.20.193.14:0/852388800 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa298136250 con 0x7fa2980ba3b0 2026-02-24T19:17:28.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.557+0000 7ff11bfff640 1 -- 10.20.193.14:0/1755338058 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2420485309 0 0) 0x7ff1400b4ea0 con 0x7ff1400b9f80 2026-02-24T19:17:28.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.557+0000 7ff11bfff640 1 -- 10.20.193.14:0/1755338058 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff1400b2690 con 0x7ff1400b9f80 2026-02-24T19:17:28.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.557+0000 7ff11bfff640 1 -- 10.20.193.14:0/1755338058 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ff130002fb0 con 0x7ff1400b9f80 2026-02-24T19:17:28.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.557+0000 7ff11bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.557+0000 7ff11bfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:28.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.557+0000 7ff11bfff640 10 monclient(hunting): dump: 2026-02-24T19:17:28.608 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.608 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.608 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.608 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.608 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.608 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.608 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.608 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.609 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.609 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.557+0000 7ff11bfff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:28.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.557+0000 7f0e6affd640 1 -- 10.20.193.14:0/3369942034 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3299166710 0 0) 0x7f0e8415fd20 con 0x7f0e84159a70 2026-02-24T19:17:28.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.557+0000 7f0e6affd640 1 -- 10.20.193.14:0/3369942034 >> v1:10.20.193.170:6789/0 conn(0x7f0e84159e40 legacy=0x7f0e841fa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.557+0000 7f0e6affd640 1 -- 10.20.193.14:0/3369942034 >> v1:10.20.193.44:6789/0 conn(0x7f0e84058070 legacy=0x7f0e841553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.557+0000 7f0e6affd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.557+0000 7f0e6affd640 1 monclient: found mon.a 2026-02-24T19:17:28.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.557+0000 7f0e6affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.557+0000 7f0e6affd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.557+0000 7f0e6affd640 1 -- 10.20.193.14:0/3369942034 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e841602e0 con 0x7f0e84159a70 2026-02-24T19:17:28.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.557+0000 7f0e6affd640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.557+0000 7f0e6affd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.557+0000 7f0e6affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.557+0000 7f0e88ded640 5 monclient: authenticate success, global_id 4443 2026-02-24T19:17:28.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.557+0000 7f0e88ded640 10 monclient: _renew_subs 2026-02-24T19:17:28.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.557+0000 7f0e88ded640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.557+0000 7f0e88ded640 1 -- 10.20.193.14:0/3369942034 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0e841605c0 con 0x7f0e84159a70 2026-02-24T19:17:28.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.557+0000 7f0e88ded640 10 client.4443.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.557+0000 7f0e88ded640 10 monclient: _renew_subs 2026-02-24T19:17:28.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.557+0000 7f0e88ded640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.557+0000 7f0e88ded640 1 -- 10.20.193.14:0/3369942034 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0e841f92d0 con 0x7f0e84159a70 2026-02-24T19:17:28.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.557+0000 7f0e88ded640 1 librados: init done 2026-02-24T19:17:28.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.557+0000 7fab357fa640 1 -- 10.20.193.14:0/2139916363 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 245202119 0 0) 0x7fab401fb730 con 0x7fab400585e0 2026-02-24T19:17:28.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.558+0000 7fab357fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.558+0000 7fab357fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.558+0000 7fab357fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.558+0000 7fab357fa640 10 monclient(hunting): my global_id is 4469 2026-02-24T19:17:28.610 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.558+0000 7fab357fa640 1 -- 10.20.193.14:0/2139916363 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab10003610 con 0x7fab400585e0 2026-02-24T19:17:28.610 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.558+0000 7f595a7fc640 1 -- 10.20.193.14:0/2765925491 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3566319590 0 0) 0x7f593c003610 con 0x7f596c0b9f80 2026-02-24T19:17:28.610 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.558+0000 7f595a7fc640 1 -- 10.20.193.14:0/2765925491 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f596c1fb450 con 0x7f596c0b9f80 2026-02-24T19:17:28.610 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.558+0000 7f595a7fc640 1 -- 10.20.193.14:0/2765925491 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f59600030c0 con 0x7f596c0b9f80 2026-02-24T19:17:28.610 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.558+0000 7f595a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.610 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.558+0000 7f595a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:28.610 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.558+0000 7f595a7fc640 10 monclient(hunting): dump: 2026-02-24T19:17:28.610 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.610 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.610 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.610 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.610 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.610 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.610 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.610 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.610 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.610 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.610 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.558+0000 7f595a7fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:28.610 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.558+0000 7f0e88ded640 10 client.4443.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.610 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.558+0000 7f0e88ded640 15 client.4443.objecter _session_command_op_assign -1 1 2026-02-24T19:17:28.610 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.558+0000 7f0e88ded640 20 client.4443.objecter _get_session osd=-1 returning homeless 2026-02-24T19:17:28.610 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.558+0000 7f0e88ded640 10 client.4443.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.610 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.558+0000 7f0e88ded640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.610 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.558+0000 7f0e88ded640 1 -- 10.20.193.14:0/3369942034 --> v1:10.20.193.14:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f0e84155ad0 con 0x7f0e84159a70 2026-02-24T19:17:28.610 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.558+0000 7f56c77fe640 1 -- 10.20.193.14:0/1171845697 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 882461342 0 0) 0x7f56b4003610 con 0x7f56e8157780 2026-02-24T19:17:28.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.558+0000 7f56c77fe640 1 -- 10.20.193.14:0/1171845697 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f56e80a83a0 con 0x7f56e8157780 2026-02-24T19:17:28.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.558+0000 7f56c77fe640 1 -- 10.20.193.14:0/1171845697 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f56dc003170 con 0x7f56e8157780 2026-02-24T19:17:28.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.558+0000 7f56c77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.558+0000 7f56c77fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:28.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.558+0000 7f56c77fe640 10 monclient(hunting): dump: 2026-02-24T19:17:28.611 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.611 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.611 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.611 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.611 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.611 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.611 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.611 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.611 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.611 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.558+0000 7f56c77fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:28.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.558+0000 7fdcebfff640 10 client.?.objecter ms_handle_connect 0x7fdd10058070 2026-02-24T19:17:28.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.558+0000 7fdcebfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.558+0000 7fdcebfff640 10 client.?.objecter ms_handle_connect 0x7fdd10159a70 2026-02-24T19:17:28.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.558+0000 7fdcebfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.559+0000 7fa2867fc640 1 -- 10.20.193.14:0/852388800 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4269853717 0 0) 0x7fa268003610 con 0x7fa29815deb0 2026-02-24T19:17:28.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.559+0000 7fa2867fc640 1 -- 10.20.193.14:0/852388800 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa2980afdd0 con 0x7fa29815deb0 2026-02-24T19:17:28.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.559+0000 7fa2867fc640 1 -- 10.20.193.14:0/852388800 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fa28c0030b0 con 0x7fa29815deb0 2026-02-24T19:17:28.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.559+0000 7fa2867fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.559+0000 7fa2867fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:28.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.559+0000 7fa2867fc640 10 monclient(hunting): dump: 2026-02-24T19:17:28.611 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.611 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.611 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.611 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.611 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.611 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.611 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.612 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.612 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.612 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.612 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.559+0000 7fa2867fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:28.612 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.559+0000 7f56c77fe640 1 -- 10.20.193.14:0/1171845697 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 414209007 0 0) 0x7f56e80a80c0 con 0x7f56e8157b50 2026-02-24T19:17:28.612 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.559+0000 7f56c77fe640 1 -- 10.20.193.14:0/1171845697 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f56b4003610 con 0x7f56e8157b50 2026-02-24T19:17:28.612 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.559+0000 7f56c77fe640 1 -- 10.20.193.14:0/1171845697 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f56d0003090 con 0x7f56e8157b50 2026-02-24T19:17:28.612 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.559+0000 7f56c77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.612 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.559+0000 7f56c77fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:28.612 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.559+0000 7f56c77fe640 10 monclient(hunting): dump: 2026-02-24T19:17:28.612 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.612 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.612 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.612 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.612 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.612 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.612 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.612 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.612 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.612 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.612 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.559+0000 7fab357fa640 10 client.?.objecter ms_handle_connect 0x7fab400ba350 2026-02-24T19:17:28.612 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.559+0000 7fab357fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.612 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.559+0000 7f82ea7fc640 1 -- 10.20.193.14:0/897198496 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2189766414 0 0) 0x7f82fc0b23b0 con 0x7f82fc0b9f80 2026-02-24T19:17:28.612 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.559+0000 7f82ea7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.612 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.559+0000 7f82ea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.612 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.559+0000 7f82ea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.612 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.559+0000 7f82ea7fc640 10 monclient(hunting): my global_id is 4468 2026-02-24T19:17:28.612 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.559+0000 7f82ea7fc640 1 -- 10.20.193.14:0/897198496 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82cc003610 con 0x7f82fc0b9f80 2026-02-24T19:17:28.613 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.560+0000 7fc58effd640 1 -- 10.20.193.14:0/2603662831 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1859465908 0 0) 0x7fc5a41fdbf0 con 0x7fc5a415af80 2026-02-24T19:17:28.613 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.560+0000 7fc58effd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.613 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.560+0000 7fc58effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.613 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.560+0000 7fc58effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.613 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.560+0000 7fc58effd640 10 monclient(hunting): my global_id is 4466 2026-02-24T19:17:28.613 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.560+0000 7fc58effd640 1 -- 10.20.193.14:0/2603662831 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5a40b0730 con 0x7fc5a415af80 2026-02-24T19:17:28.613 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.564+0000 7fc58effd640 1 -- 10.20.193.14:0/2603662831 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1686959655 0 0) 0x7fc574003610 con 0x7fc5a415b350 2026-02-24T19:17:28.613 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.564+0000 7fc58effd640 1 -- 10.20.193.14:0/2603662831 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc5a41fdbf0 con 0x7fc5a415b350 2026-02-24T19:17:28.613 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.564+0000 7fc58effd640 1 -- 10.20.193.14:0/2603662831 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc598003400 con 0x7fc5a415b350 2026-02-24T19:17:28.613 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.564+0000 7fc58effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.613 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.564+0000 7fc58effd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:28.613 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.564+0000 7fc58effd640 10 monclient(hunting): dump: 2026-02-24T19:17:28.613 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.613 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.613 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.613 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.613 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.613 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.613 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.613 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.613 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.613 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.613 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.564+0000 7fc58effd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:28.613 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.565+0000 7f4db6ffd640 1 -- 10.20.193.14:0/4093622326 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1851118606 0 0) 0x7f4da0003610 con 0x7f4dd00ba350 2026-02-24T19:17:28.613 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.565+0000 7f4db6ffd640 1 -- 10.20.193.14:0/4093622326 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4dd0159ea0 con 0x7f4dd00ba350 2026-02-24T19:17:28.613 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.565+0000 7f4db6ffd640 1 -- 10.20.193.14:0/4093622326 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4dcc0034f0 con 0x7f4dd00ba350 2026-02-24T19:17:28.613 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.565+0000 7f4db6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.613 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.565+0000 7f4db6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:28.613 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.565+0000 7f4db6ffd640 10 monclient(hunting): dump: 2026-02-24T19:17:28.613 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.613 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.613 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.613 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.613 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.614 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.614 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.614 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.614 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.614 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.614 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.565+0000 7f4db6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:28.614 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.566+0000 7f48c2d76640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7f48c4058580 0x7f48c41f8a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:34626/0 (socket says 10.20.193.14:34626) 2026-02-24T19:17:28.614 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.566+0000 7f48c2d76640 1 -- 10.20.193.14:0/3396094211 learned_addr learned my addr 10.20.193.14:0/3396094211 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.614 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.567+0000 7f48a37fe640 10 client.?.objecter ms_handle_connect 0x7f48c4058580 2026-02-24T19:17:28.614 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.567+0000 7f48a37fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.614 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.571+0000 7fdcebfff640 10 client.?.objecter ms_handle_connect 0x7fdd10159e40 2026-02-24T19:17:28.614 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.571+0000 7fdcebfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.614 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.571+0000 7fa2867fc640 1 -- 10.20.193.14:0/852388800 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1531963640 0 0) 0x7fa2980b00b0 con 0x7fa29815e280 2026-02-24T19:17:28.614 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.571+0000 7fa2867fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.614 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.571+0000 7fa2867fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.614 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.571+0000 7fa2867fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.614 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.571+0000 7fa2867fc640 10 monclient(hunting): my global_id is 4472 2026-02-24T19:17:28.614 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.571+0000 7fa2867fc640 1 -- 10.20.193.14:0/852388800 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa268003610 con 0x7fa29815e280 2026-02-24T19:17:28.614 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.571+0000 7f4db6ffd640 1 -- 10.20.193.14:0/4093622326 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 559475343 0 0) 0x7f4dd01fb730 con 0x7f4dd00b9f80 2026-02-24T19:17:28.614 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.571+0000 7f4db6ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.614 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.571+0000 7f4db6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.614 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.571+0000 7f4db6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.614 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.571+0000 7f4db6ffd640 10 monclient(hunting): my global_id is 4478 2026-02-24T19:17:28.614 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.571+0000 7f4db6ffd640 1 -- 10.20.193.14:0/4093622326 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4da0003610 con 0x7f4dd00b9f80 2026-02-24T19:17:28.615 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.573+0000 7ff11bfff640 1 -- 10.20.193.14:0/1755338058 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1814062326 0 0) 0x7ff1400b23b0 con 0x7ff1400ba350 2026-02-24T19:17:28.615 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.573+0000 7ff11bfff640 1 -- 10.20.193.14:0/1755338058 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff1400b4ea0 con 0x7ff1400ba350 2026-02-24T19:17:28.615 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.573+0000 7ff11bfff640 1 -- 10.20.193.14:0/1755338058 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ff134003400 con 0x7ff1400ba350 2026-02-24T19:17:28.615 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.573+0000 7ff11bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.615 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.573+0000 7ff11bfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.615 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.573+0000 7ff11bfff640 10 monclient(hunting): dump: 2026-02-24T19:17:28.615 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.615 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.615 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.615 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.615 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.615 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.615 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.615 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.615 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.615 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.615 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.573+0000 7fab357fa640 1 -- 10.20.193.14:0/2139916363 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1565907980 0 0) 0x7fab40159ea0 con 0x7fab400b9f80 2026-02-24T19:17:28.615 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.573+0000 7fab357fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.615 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.573+0000 7fab357fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.615 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.573+0000 7fab357fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.615 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.573+0000 7fab357fa640 10 monclient(hunting): my global_id is 4479 2026-02-24T19:17:28.615 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.573+0000 7fab357fa640 1 -- 10.20.193.14:0/2139916363 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab401fb730 con 0x7fab400b9f80 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f775bfff640 1 -- 10.20.193.14:0/3545456418 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3355684071 0 0) 0x7f77800b1c50 con 0x7f778015b0a0 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f775bfff640 1 -- 10.20.193.14:0/3545456418 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f77800b1970 con 0x7f778015b0a0 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f775bfff640 1 -- 10.20.193.14:0/3545456418 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7770003310 con 0x7f778015b0a0 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f775bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f775bfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f775bfff640 10 monclient(hunting): dump: 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f775bfff640 1 -- 10.20.193.14:0/3545456418 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 394137122 0 0) 0x7f7750003610 con 0x7f77800b5da0 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f775bfff640 1 -- 10.20.193.14:0/3545456418 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f77800b1c50 con 0x7f77800b5da0 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f775bfff640 1 -- 10.20.193.14:0/3545456418 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f776c002fc0 con 0x7f77800b5da0 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f775bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f775bfff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f775bfff640 10 monclient(hunting): dump: 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f775bfff640 1 -- 10.20.193.14:0/3545456418 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1617842598 0 0) 0x7f77800b1f30 con 0x7f77801f88c0 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f775bfff640 1 -- 10.20.193.14:0/3545456418 >> v1:10.20.193.44:6789/0 conn(0x7f77800b5da0 legacy=0x7f7780151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f775bfff640 1 -- 10.20.193.14:0/3545456418 >> v1:10.20.193.14:6789/0 conn(0x7f778015b0a0 legacy=0x7f77801f81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f775bfff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f775bfff640 1 monclient: found mon.c 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f775bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f775bfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f775bfff640 1 -- 10.20.193.14:0/3545456418 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77800b2210 con 0x7f77801f88c0 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f775bfff640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.616 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f775bfff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f775bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f7785bd9640 5 monclient: authenticate success, global_id 4454 2026-02-24T19:17:28.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f7785bd9640 10 monclient: _renew_subs 2026-02-24T19:17:28.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f7785bd9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f7785bd9640 1 -- 10.20.193.14:0/3545456418 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f77800b24f0 con 0x7f77801f88c0 2026-02-24T19:17:28.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7ff11bfff640 1 -- 10.20.193.14:0/1755338058 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2715015165 0 0) 0x7ff110003610 con 0x7ff1400585e0 2026-02-24T19:17:28.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7ff11bfff640 1 -- 10.20.193.14:0/1755338058 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff1400b23b0 con 0x7ff1400585e0 2026-02-24T19:17:28.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7ff11bfff640 1 -- 10.20.193.14:0/1755338058 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ff12c002d30 con 0x7ff1400585e0 2026-02-24T19:17:28.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7ff11bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7ff11bfff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:28.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7ff11bfff640 10 monclient(hunting): dump: 2026-02-24T19:17:28.617 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.617 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.617 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.617 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.617 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.617 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.617 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.617 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.617 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.617 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f7785bd9640 10 client.4454.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f7785bd9640 10 monclient: _renew_subs 2026-02-24T19:17:28.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f7785bd9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f7785bd9640 1 -- 10.20.193.14:0/3545456418 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f77801fb070 con 0x7f77801f88c0 2026-02-24T19:17:28.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f7785bd9640 1 librados: init done 2026-02-24T19:17:28.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f7785bd9640 10 client.4454.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f7785bd9640 15 client.4454.objecter _session_command_op_assign -1 1 2026-02-24T19:17:28.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f7785bd9640 20 client.4454.objecter _get_session osd=-1 returning homeless 2026-02-24T19:17:28.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f7785bd9640 10 client.4454.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f7785bd9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.574+0000 7f7785bd9640 1 -- 10.20.193.14:0/3545456418 --> v1:10.20.193.170:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f77800525e0 con 0x7f77801f88c0 2026-02-24T19:17:28.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f4eb5ffb640 1 -- 10.20.193.14:0/1929189111 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1198540062 0 0) 0x7f4e98003610 con 0x7f4ec80b9f80 2026-02-24T19:17:28.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f4eb5ffb640 1 -- 10.20.193.14:0/1929189111 >> v1:10.20.193.44:6789/0 conn(0x7f4ec80ba350 legacy=0x7f4ec81563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f4eb5ffb640 1 -- 10.20.193.14:0/1929189111 >> v1:10.20.193.14:6789/0 conn(0x7f4ec80585e0 legacy=0x7f4ec813a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f4eb5ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f4eb5ffb640 1 monclient: found mon.c 2026-02-24T19:17:28.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f4eb5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f4eb5ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f4eb5ffb640 1 -- 10.20.193.14:0/1929189111 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ec8164f70 con 0x7f4ec80b9f80 2026-02-24T19:17:28.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f4eb5ffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f4eb5ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f4eb5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f4ecf88b640 5 monclient: authenticate success, global_id 4451 2026-02-24T19:17:28.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f4ecf88b640 10 monclient: _renew_subs 2026-02-24T19:17:28.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f4ecf88b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f4ecf88b640 1 -- 10.20.193.14:0/1929189111 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4ec8165250 con 0x7f4ec80b9f80 2026-02-24T19:17:28.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f5f62ffd640 1 -- 10.20.193.14:0/2714502469 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 577604307 0 0) 0x7f5f7c1faf30 con 0x7f5f7c058070 2026-02-24T19:17:28.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f5f62ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f5f62ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f5f62ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f5f62ffd640 10 monclient(hunting): my global_id is 4484 2026-02-24T19:17:28.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f4ecf88b640 10 client.4451.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f4ecf88b640 10 monclient: _renew_subs 2026-02-24T19:17:28.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f4ecf88b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f4ecf88b640 1 -- 10.20.193.14:0/1929189111 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4ec80b3d60 con 0x7f4ec80b9f80 2026-02-24T19:17:28.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f4ecf88b640 1 librados: init done 2026-02-24T19:17:28.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f5f62ffd640 1 -- 10.20.193.14:0/2714502469 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f48003610 con 0x7f5f7c058070 2026-02-24T19:17:28.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f56c77fe640 1 -- 10.20.193.14:0/1171845697 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 195763903 0 0) 0x7f56e80a7de0 con 0x7f56e8164d00 2026-02-24T19:17:28.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f56c77fe640 1 -- 10.20.193.14:0/1171845697 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f56e80a80c0 con 0x7f56e8164d00 2026-02-24T19:17:28.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f56c77fe640 1 -- 10.20.193.14:0/1171845697 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f56d80036d0 con 0x7f56e8164d00 2026-02-24T19:17:28.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f56c77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f56c77fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:28.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f56c77fe640 10 monclient(hunting): dump: 2026-02-24T19:17:28.619 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.619 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.619 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.619 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.619 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.619 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.619 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.619 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.619 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.619 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7feed8ff9640 1 -- 10.20.193.14:0/912187155 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4084010775 0 0) 0x7feedc166170 con 0x7feedc0585e0 2026-02-24T19:17:28.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7feed8ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7feed8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7feed8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7feed8ff9640 10 monclient(hunting): my global_id is 4475 2026-02-24T19:17:28.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7feed8ff9640 1 -- 10.20.193.14:0/912187155 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feedc165ee0 con 0x7feedc0585e0 2026-02-24T19:17:28.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f595a7fc640 1 -- 10.20.193.14:0/2765925491 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 950388945 0 0) 0x7f596c1fb730 con 0x7f596c0585e0 2026-02-24T19:17:28.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f595a7fc640 1 -- 10.20.193.14:0/2765925491 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f593c003610 con 0x7f596c0585e0 2026-02-24T19:17:28.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f595a7fc640 1 -- 10.20.193.14:0/2765925491 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f595c0030b0 con 0x7f596c0585e0 2026-02-24T19:17:28.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f595a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f595a7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:28.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f595a7fc640 10 monclient(hunting): dump: 2026-02-24T19:17:28.620 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.620 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.620 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.620 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.620 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.620 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.620 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.620 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.620 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.620 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.620 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f595a7fc640 1 -- 10.20.193.14:0/2765925491 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1940932083 0 0) 0x7f596c159ea0 con 0x7f596c0ba350 2026-02-24T19:17:28.620 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f595a7fc640 1 -- 10.20.193.14:0/2765925491 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f596c1fb730 con 0x7f596c0ba350 2026-02-24T19:17:28.620 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f595a7fc640 1 -- 10.20.193.14:0/2765925491 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f59680030b0 con 0x7f596c0ba350 2026-02-24T19:17:28.620 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7feed8ff9640 1 -- 10.20.193.14:0/912187155 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2788150013 0 0) 0x7feeac003610 con 0x7feedc0b9f80 2026-02-24T19:17:28.620 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f595a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.620 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f595a7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:28.620 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7f595a7fc640 10 monclient(hunting): dump: 2026-02-24T19:17:28.620 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.620 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.620 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.620 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.620 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.620 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.620 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.620 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.620 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.620 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.620 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.575+0000 7feed8ff9640 1 -- 10.20.193.14:0/912187155 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feedc166170 con 0x7feedc0b9f80 2026-02-24T19:17:28.620 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.576+0000 7feed8ff9640 1 -- 10.20.193.14:0/912187155 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7feecc002fb0 con 0x7feedc0b9f80 2026-02-24T19:17:28.620 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.576+0000 7feed8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.620 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.576+0000 7feed8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:28.620 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.576+0000 7feed8ff9640 10 monclient(hunting): dump: 2026-02-24T19:17:28.621 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.621 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.621 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.621 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.621 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.621 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.621 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.621 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.621 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.621 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.576+0000 7feed8ff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:28.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.576+0000 7f4ecf88b640 10 client.4451.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.576+0000 7f4ecf88b640 15 client.4451.objecter _session_command_op_assign -1 1 2026-02-24T19:17:28.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.576+0000 7f4ecf88b640 20 client.4451.objecter _get_session osd=-1 returning homeless 2026-02-24T19:17:28.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.576+0000 7f4ecf88b640 10 client.4451.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.576+0000 7f4ecf88b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.576+0000 7f4ecf88b640 1 -- 10.20.193.14:0/1929189111 --> v1:10.20.193.170:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f4ec80b64c0 con 0x7f4ec80b9f80 2026-02-24T19:17:28.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.576+0000 7f82ea7fc640 1 -- 10.20.193.14:0/897198496 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2866724611 0 0) 0x7f82fc0b2690 con 0x7f82fc0585e0 2026-02-24T19:17:28.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.576+0000 7f82ea7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.576+0000 7f82ea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.576+0000 7f82ea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.576+0000 7f82ea7fc640 10 monclient(hunting): my global_id is 4481 2026-02-24T19:17:28.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.576+0000 7f82ea7fc640 1 -- 10.20.193.14:0/897198496 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82fc0b23b0 con 0x7f82fc0585e0 2026-02-24T19:17:28.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.576+0000 7fa2867fc640 1 -- 10.20.193.14:0/852388800 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3132710788 0 0) 0x7fa298136250 con 0x7fa2980ba3b0 2026-02-24T19:17:28.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.576+0000 7fa2867fc640 1 -- 10.20.193.14:0/852388800 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa2980b00b0 con 0x7fa2980ba3b0 2026-02-24T19:17:28.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.576+0000 7fa2867fc640 1 -- 10.20.193.14:0/852388800 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fa288003310 con 0x7fa2980ba3b0 2026-02-24T19:17:28.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.576+0000 7fa2867fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.576+0000 7fa2867fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:28.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.576+0000 7fa2867fc640 10 monclient(hunting): dump: 2026-02-24T19:17:28.621 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.621 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.621 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.621 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.622 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.622 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.622 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.622 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.622 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.622 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.576+0000 7fdcebfff640 1 -- 10.20.193.14:0/1366958924 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 106587617 0 0) 0x7fdd101feb70 con 0x7fdd10159a70 2026-02-24T19:17:28.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.576+0000 7fdcebfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.576+0000 7fdcebfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.576+0000 7fdcebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.576+0000 7fdcebfff640 10 monclient(hunting): my global_id is 4487 2026-02-24T19:17:28.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.576+0000 7fdcebfff640 1 -- 10.20.193.14:0/1366958924 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdce0003610 con 0x7fdd10159a70 2026-02-24T19:17:28.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.576+0000 7f48a37fe640 10 client.?.objecter ms_handle_connect 0x7f48c4059e70 2026-02-24T19:17:28.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.576+0000 7f48a37fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.578+0000 7fc58effd640 1 -- 10.20.193.14:0/2603662831 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2934876645 0 0) 0x7fc5a4155fa0 con 0x7fc5a40b5d80 2026-02-24T19:17:28.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.578+0000 7fc58effd640 1 -- 10.20.193.14:0/2603662831 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc574003610 con 0x7fc5a40b5d80 2026-02-24T19:17:28.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.578+0000 7fc58effd640 1 -- 10.20.193.14:0/2603662831 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc59c0030d0 con 0x7fc5a40b5d80 2026-02-24T19:17:28.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.578+0000 7fc58effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.578+0000 7fc58effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.578+0000 7fc58effd640 10 monclient(hunting): dump: 2026-02-24T19:17:28.622 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.622 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.622 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.622 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.622 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.622 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.622 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.622 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.622 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.622 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.578+0000 7f82ea7fc640 1 -- 10.20.193.14:0/897198496 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 994197423 0 0) 0x7f82cc003610 con 0x7f82fc0b9f80 2026-02-24T19:17:28.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.578+0000 7f82ea7fc640 1 -- 10.20.193.14:0/897198496 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f82fc0b2690 con 0x7f82fc0b9f80 2026-02-24T19:17:28.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.578+0000 7f82ea7fc640 1 -- 10.20.193.14:0/897198496 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f82f0003310 con 0x7f82fc0b9f80 2026-02-24T19:17:28.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.578+0000 7f82ea7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.578+0000 7f82ea7fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:28.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.578+0000 7f82ea7fc640 10 monclient(hunting): dump: 2026-02-24T19:17:28.623 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.623 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.623 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.623 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.623 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.623 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.623 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.623 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.623 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.623 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.578+0000 7f82ea7fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:28.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.579+0000 7f5f62ffd640 1 -- 10.20.193.14:0/2714502469 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1273828703 0 0) 0x7f5f7c0b9380 con 0x7f5f7c159e40 2026-02-24T19:17:28.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.579+0000 7f5f62ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.579+0000 7f5f62ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.579+0000 7f5f62ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.579+0000 7f5f62ffd640 10 monclient(hunting): my global_id is 4471 2026-02-24T19:17:28.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.579+0000 7f5f62ffd640 1 -- 10.20.193.14:0/2714502469 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f7c1faf30 con 0x7f5f7c159e40 2026-02-24T19:17:28.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.579+0000 7feed8ff9640 1 -- 10.20.193.14:0/912187155 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1671877065 0 0) 0x7feedc156d30 con 0x7feedc0ba350 2026-02-24T19:17:28.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.579+0000 7feed8ff9640 1 -- 10.20.193.14:0/912187155 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feeac003610 con 0x7feedc0ba350 2026-02-24T19:17:28.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.579+0000 7feed8ff9640 1 -- 10.20.193.14:0/912187155 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7feed00033d0 con 0x7feedc0ba350 2026-02-24T19:17:28.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.579+0000 7feed8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.579+0000 7feed8ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.579+0000 7feed8ff9640 10 monclient(hunting): dump: 2026-02-24T19:17:28.623 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.624 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.624 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.624 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.624 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.624 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.624 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.624 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.624 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.624 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.579+0000 7fab357fa640 1 -- 10.20.193.14:0/2139916363 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3154540371 0 0) 0x7fab401fb450 con 0x7fab400ba350 2026-02-24T19:17:28.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.579+0000 7fab357fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.579+0000 7fab357fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.579+0000 7fab357fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.579+0000 7fab357fa640 10 monclient(hunting): my global_id is 4474 2026-02-24T19:17:28.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.579+0000 7fab357fa640 1 -- 10.20.193.14:0/2139916363 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab40159ea0 con 0x7fab400ba350 2026-02-24T19:17:28.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.580+0000 7f4db6ffd640 1 -- 10.20.193.14:0/4093622326 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2700124696 0 0) 0x7f4dd01fb450 con 0x7f4dd00585e0 2026-02-24T19:17:28.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.580+0000 7f4db6ffd640 1 -- 10.20.193.14:0/4093622326 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4dd01fb730 con 0x7f4dd00585e0 2026-02-24T19:17:28.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.580+0000 7f4db6ffd640 1 -- 10.20.193.14:0/4093622326 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4dc0003170 con 0x7f4dd00585e0 2026-02-24T19:17:28.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.580+0000 7f4db6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.580+0000 7f4db6ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.580+0000 7f4db6ffd640 10 monclient(hunting): dump: 2026-02-24T19:17:28.624 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.624 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.624 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.624 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.624 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.624 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.624 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.624 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.624 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.624 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.580+0000 7fdcebfff640 1 -- 10.20.193.14:0/1366958924 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2297497766 0 0) 0x7fdd101fe890 con 0x7fdd10159e40 2026-02-24T19:17:28.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.580+0000 7fdcebfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.580+0000 7fdcebfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.580+0000 7fdcebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.580+0000 7fdcebfff640 10 monclient(hunting): my global_id is 4477 2026-02-24T19:17:28.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.580+0000 7fdcebfff640 1 -- 10.20.193.14:0/1366958924 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd101feb70 con 0x7fdd10159e40 2026-02-24T19:17:28.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.581+0000 7fc58effd640 1 -- 10.20.193.14:0/2603662831 <== mon.1 v1:10.20.193.44:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 965730373 0 0) 0x7fc5a41fdbf0 con 0x7fc5a415b350 2026-02-24T19:17:28.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.581+0000 7fc58effd640 1 -- 10.20.193.14:0/2603662831 >> v1:10.20.193.170:6789/0 conn(0x7fc5a415af80 legacy=0x7fc5a40b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.581+0000 7fc58effd640 1 -- 10.20.193.14:0/2603662831 >> v1:10.20.193.14:6789/0 conn(0x7fc5a40b5d80 legacy=0x7fc5a4155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.581+0000 7fc58effd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.581+0000 7fc58effd640 1 monclient: found mon.b 2026-02-24T19:17:28.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.581+0000 7fc58effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.581+0000 7fc58effd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.581+0000 7fc58effd640 1 -- 10.20.193.14:0/2603662831 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5a41fded0 con 0x7fc5a415b350 2026-02-24T19:17:28.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.581+0000 7fc58effd640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.581+0000 7fc58effd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.581+0000 7fc58effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.581+0000 7fc5ac955640 5 monclient: authenticate success, global_id 4450 2026-02-24T19:17:28.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.581+0000 7fc5ac955640 10 monclient: _renew_subs 2026-02-24T19:17:28.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.581+0000 7fc5ac955640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.581+0000 7fc5ac955640 1 -- 10.20.193.14:0/2603662831 --> v1:10.20.193.44:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc5a41fe1b0 con 0x7fc5a415b350 2026-02-24T19:17:28.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.581+0000 7fc5ac955640 10 client.4450.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.581+0000 7fc5ac955640 10 monclient: _renew_subs 2026-02-24T19:17:28.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.581+0000 7fc5ac955640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.581+0000 7fc5ac955640 1 -- 10.20.193.14:0/2603662831 --> v1:10.20.193.44:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc5a40b09d0 con 0x7fc5a415b350 2026-02-24T19:17:28.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.581+0000 7fc5ac955640 1 librados: init done 2026-02-24T19:17:28.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.581+0000 7fc5ac955640 10 client.4450.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.581+0000 7fc5ac955640 15 client.4450.objecter _session_command_op_assign -1 1 2026-02-24T19:17:28.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.581+0000 7fc5ac955640 20 client.4450.objecter _get_session osd=-1 returning homeless 2026-02-24T19:17:28.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.581+0000 7fc5ac955640 10 client.4450.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.581+0000 7fc5ac955640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.581+0000 7fc5ac955640 1 -- 10.20.193.14:0/2603662831 --> v1:10.20.193.44:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fc5a405bbc0 con 0x7fc5a415b350 2026-02-24T19:17:28.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.582+0000 7f28a3fff640 1 -- 10.20.193.14:0/425562497 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f28c80525e0 con 0x7f28c815b0a0 2026-02-24T19:17:28.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.582+0000 7f28a3fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.582+0000 7f28a3fff640 1 -- 10.20.193.14:0/425562497 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f28b80038a0 con 0x7f28c815b0a0 2026-02-24T19:17:28.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.582+0000 7f28a3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.582+0000 7f28a3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:28.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.582+0000 7f28a3fff640 10 monclient: dump: 2026-02-24T19:17:28.626 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.626 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.626 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.626 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.626 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.626 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.626 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.626 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.626 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.626 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.582+0000 7f28c5ffb640 4 set_mon_vals no callback set 2026-02-24T19:17:28.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.582+0000 7f4db6ffd640 1 -- 10.20.193.14:0/4093622326 <== mon.1 v1:10.20.193.44:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 152597847 0 0) 0x7f4dd0159ea0 con 0x7f4dd00ba350 2026-02-24T19:17:28.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.582+0000 7f4db6ffd640 1 -- 10.20.193.14:0/4093622326 >> v1:10.20.193.170:6789/0 conn(0x7f4dd00b9f80 legacy=0x7f4dd015daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.582+0000 7f4db6ffd640 1 -- 10.20.193.14:0/4093622326 >> v1:10.20.193.14:6789/0 conn(0x7f4dd00585e0 legacy=0x7f4dd0159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.582+0000 7f4db6ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.582+0000 7f4db6ffd640 1 monclient: found mon.b 2026-02-24T19:17:28.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.582+0000 7f4db6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.582+0000 7f4db6ffd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.582+0000 7f4db6ffd640 1 -- 10.20.193.14:0/4093622326 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd01fba10 con 0x7f4dd00ba350 2026-02-24T19:17:28.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.582+0000 7f4db6ffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.582+0000 7f4db6ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.582+0000 7f4db6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.582+0000 7f4dd85c3640 5 monclient: authenticate success, global_id 4462 2026-02-24T19:17:28.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.582+0000 7f4dd85c3640 10 monclient: _renew_subs 2026-02-24T19:17:28.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.582+0000 7f4dd85c3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.582+0000 7f4dd85c3640 1 -- 10.20.193.14:0/4093622326 --> v1:10.20.193.44:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4dd01fbcf0 con 0x7f4dd00ba350 2026-02-24T19:17:28.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.582+0000 7f4dd85c3640 10 client.4462.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.582+0000 7f4dd85c3640 10 monclient: _renew_subs 2026-02-24T19:17:28.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.582+0000 7f4dd85c3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.582+0000 7f4dd85c3640 1 -- 10.20.193.14:0/4093622326 --> v1:10.20.193.44:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4dd015faf0 con 0x7f4dd00ba350 2026-02-24T19:17:28.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.582+0000 7f4dd85c3640 1 librados: init done 2026-02-24T19:17:28.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.582+0000 7f4dd85c3640 10 client.4462.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.582+0000 7f4dd85c3640 15 client.4462.objecter _session_command_op_assign -1 1 2026-02-24T19:17:28.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.582+0000 7f4dd85c3640 20 client.4462.objecter _get_session osd=-1 returning homeless 2026-02-24T19:17:28.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.582+0000 7f4dd85c3640 10 client.4462.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.582+0000 7f4dd85c3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.582+0000 7f4dd85c3640 1 -- 10.20.193.14:0/4093622326 --> v1:10.20.193.44:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f4dd015e210 con 0x7f4dd00ba350 2026-02-24T19:17:28.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.583+0000 7f28a3fff640 1 -- 10.20.193.14:0/425562497 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f28b8003ab0 con 0x7f28c815b0a0 2026-02-24T19:17:28.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.583+0000 7f28c77fe640 10 monclient: get_auth_request con 0x7f2898077cc0 auth_method 0 2026-02-24T19:17:28.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.583+0000 7f28a3fff640 10 client.4448.objecter ms_handle_connect 0x7f2898077cc0 2026-02-24T19:17:28.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.584+0000 7f0e6affd640 1 -- 10.20.193.14:0/3369942034 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0e84155ad0 con 0x7f0e84159a70 2026-02-24T19:17:28.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.584+0000 7f0e6affd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.584+0000 7f0e6affd640 1 -- 10.20.193.14:0/3369942034 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f0e6c004a70 con 0x7f0e84159a70 2026-02-24T19:17:28.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.584+0000 7f0e6affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.584+0000 7f0e6affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.584+0000 7f0e80d72640 4 set_mon_vals no callback set 2026-02-24T19:17:28.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.584+0000 7f0e6affd640 10 monclient: dump: 2026-02-24T19:17:28.628 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.628 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.628 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.628 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.628 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.628 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.628 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.628 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.628 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.628 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.584+0000 7f0e6affd640 1 -- 10.20.193.14:0/3369942034 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f0e6c01d8e0 con 0x7f0e84159a70 2026-02-24T19:17:28.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.584+0000 7ff11bfff640 1 -- 10.20.193.14:0/1755338058 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3561056638 0 0) 0x7ff1400b2690 con 0x7ff1400b9f80 2026-02-24T19:17:28.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.584+0000 7ff11bfff640 1 -- 10.20.193.14:0/1755338058 >> v1:10.20.193.44:6789/0 conn(0x7ff1400585e0 legacy=0x7ff1400b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.584+0000 7ff11bfff640 1 -- 10.20.193.14:0/1755338058 >> v1:10.20.193.14:6789/0 conn(0x7ff1400ba350 legacy=0x7ff1401fe480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.584+0000 7ff11bfff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.584+0000 7ff11bfff640 1 monclient: found mon.c 2026-02-24T19:17:28.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.584+0000 7ff11bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.584+0000 7ff11bfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.584+0000 7ff11bfff640 1 -- 10.20.193.14:0/1755338058 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1400b2970 con 0x7ff1400b9f80 2026-02-24T19:17:28.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.584+0000 7ff11bfff640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.584+0000 7ff11bfff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.584+0000 7ff11bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.584+0000 7ff14612c640 5 monclient: authenticate success, global_id 4457 2026-02-24T19:17:28.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.584+0000 7ff14612c640 10 monclient: _renew_subs 2026-02-24T19:17:28.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.584+0000 7ff14612c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.584+0000 7ff14612c640 1 -- 10.20.193.14:0/1755338058 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff1400b2c50 con 0x7ff1400b9f80 2026-02-24T19:17:28.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.584+0000 7ff14612c640 10 client.4457.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.584+0000 7ff14612c640 10 monclient: _renew_subs 2026-02-24T19:17:28.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.584+0000 7ff14612c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.584+0000 7ff14612c640 1 -- 10.20.193.14:0/1755338058 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff1400b3210 con 0x7ff1400b9f80 2026-02-24T19:17:28.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.584+0000 7ff14612c640 1 librados: init done 2026-02-24T19:17:28.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.585+0000 7f0e82575640 10 monclient: get_auth_request con 0x7f0e50077d20 auth_method 0 2026-02-24T19:17:28.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.585+0000 7f0e6affd640 10 client.4443.objecter ms_handle_connect 0x7f0e50077d20 2026-02-24T19:17:28.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.585+0000 7ff14612c640 10 client.4457.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.585+0000 7ff14612c640 15 client.4457.objecter _session_command_op_assign -1 1 2026-02-24T19:17:28.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.585+0000 7ff14612c640 20 client.4457.objecter _get_session osd=-1 returning homeless 2026-02-24T19:17:28.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.585+0000 7ff14612c640 10 client.4457.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.585+0000 7ff14612c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.585+0000 7ff14612c640 1 -- 10.20.193.14:0/1755338058 --> v1:10.20.193.170:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7ff1400b64c0 con 0x7ff1400b9f80 2026-02-24T19:17:28.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.586+0000 7f28a3fff640 1 -- 10.20.193.14:0/425562497 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7f28b8091f90 con 0x7f28c815b0a0 2026-02-24T19:17:28.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.586+0000 7f28a3fff640 10 client.4448.objecter ms_dispatch2 0x7f28c8000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:28.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.586+0000 7f28a3fff640 3 client.4448.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:28.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.586+0000 7f28a3fff640 3 client.4448.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:28.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f28a3fff640 10 client.4448.objecter checking command 1 2026-02-24T19:17:28.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f28a3fff640 20 client.4448.objecter _get_session s=0x7f28980a0b40 osd=4 3 2026-02-24T19:17:28.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f28a3fff640 20 client.4448.objecter put_session s=0x7f28980a0b40 osd=4 3 2026-02-24T19:17:28.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f28a3fff640 15 client.4448.objecter _session_command_op_remove -1 1 2026-02-24T19:17:28.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f28a3fff640 20 client.4448.objecter _get_session s=0x7f28980a0b40 osd=4 3 2026-02-24T19:17:28.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f28a3fff640 20 client.4448.objecter get_session s=0x7f28980a0b40 osd=4 3 2026-02-24T19:17:28.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f28a3fff640 15 client.4448.objecter _session_command_op_assign 4 1 2026-02-24T19:17:28.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f28a3fff640 20 client.4448.objecter put_session s=0x7f28980a0b40 osd=4 4 2026-02-24T19:17:28.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f28a3fff640 10 client.4448.objecter _send_command 1 2026-02-24T19:17:28.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f28a3fff640 1 -- 10.20.193.14:0/425562497 --> v1:10.20.193.14:6805/4020872388 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f28980c2df0 con 0x7f28980a11f0 2026-02-24T19:17:28.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f28a3fff640 20 client.4448.objecter dump_active .. 0 homeless 2026-02-24T19:17:28.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f0e6affd640 1 -- 10.20.193.14:0/3369942034 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7f0e6c0930d0 con 0x7f0e84159a70 2026-02-24T19:17:28.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f0e6affd640 10 client.4443.objecter ms_dispatch2 0x7f0e84000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:28.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f0e6affd640 3 client.4443.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:28.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f0e6affd640 3 client.4443.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:28.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f0e6affd640 10 client.4443.objecter checking command 1 2026-02-24T19:17:28.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f595a7fc640 1 -- 10.20.193.14:0/2765925491 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 628673836 0 0) 0x7f596c1fb450 con 0x7f596c0b9f80 2026-02-24T19:17:28.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f595a7fc640 1 -- 10.20.193.14:0/2765925491 >> v1:10.20.193.170:6789/0 conn(0x7f596c0ba350 legacy=0x7f596c160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f595a7fc640 1 -- 10.20.193.14:0/2765925491 >> v1:10.20.193.44:6789/0 conn(0x7f596c0585e0 legacy=0x7f596c159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f595a7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f0e6affd640 20 client.4443.objecter _get_session s=0x7f0e500a0ba0 osd=6 3 2026-02-24T19:17:28.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f0e6affd640 20 client.4443.objecter put_session s=0x7f0e500a0ba0 osd=6 3 2026-02-24T19:17:28.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f0e6affd640 15 client.4443.objecter _session_command_op_remove -1 1 2026-02-24T19:17:28.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f0e6affd640 20 client.4443.objecter _get_session s=0x7f0e500a0ba0 osd=6 3 2026-02-24T19:17:28.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f0e6affd640 20 client.4443.objecter get_session s=0x7f0e500a0ba0 osd=6 3 2026-02-24T19:17:28.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f595a7fc640 1 monclient: found mon.a 2026-02-24T19:17:28.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f595a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f595a7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f595a7fc640 1 -- 10.20.193.14:0/2765925491 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f596c1fba10 con 0x7f596c0b9f80 2026-02-24T19:17:28.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f0e6affd640 15 client.4443.objecter _session_command_op_assign 6 1 2026-02-24T19:17:28.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f0e6affd640 20 client.4443.objecter put_session s=0x7f0e500a0ba0 osd=6 4 2026-02-24T19:17:28.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f0e6affd640 10 client.4443.objecter _send_command 1 2026-02-24T19:17:28.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f0e6affd640 1 -- 10.20.193.14:0/3369942034 --> v1:10.20.193.170:6800/3031579126 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0e500c2ef0 con 0x7f0e500a1250 2026-02-24T19:17:28.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f0e6affd640 20 client.4443.objecter dump_active .. 0 homeless 2026-02-24T19:17:28.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f595a7fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f595a7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f595a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f0e6affd640 1 -- 10.20.193.14:0/3369942034 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (unknown 3108795433 0 0) 0x7f0e6c059770 con 0x7f0e84159a70 2026-02-24T19:17:28.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f0e6affd640 10 monclient: handle_get_version_reply finishing 1 version 31 2026-02-24T19:17:28.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f5973d45640 5 monclient: authenticate success, global_id 4452 2026-02-24T19:17:28.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f5973d45640 10 monclient: _renew_subs 2026-02-24T19:17:28.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f5973d45640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f5973d45640 1 -- 10.20.193.14:0/2765925491 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f596c1fbcf0 con 0x7f596c0b9f80 2026-02-24T19:17:28.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f5973d45640 10 client.4452.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f5973d45640 10 monclient: _renew_subs 2026-02-24T19:17:28.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f5973d45640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f5973d45640 1 -- 10.20.193.14:0/2765925491 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f596c15faf0 con 0x7f596c0b9f80 2026-02-24T19:17:28.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f5973d45640 1 librados: init done 2026-02-24T19:17:28.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f82ea7fc640 1 -- 10.20.193.14:0/897198496 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 652620863 0 0) 0x7f82fc0b4ea0 con 0x7f82fc0ba350 2026-02-24T19:17:28.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f82ea7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f82ea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f82ea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f82ea7fc640 10 monclient(hunting): my global_id is 4473 2026-02-24T19:17:28.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f82ea7fc640 1 -- 10.20.193.14:0/897198496 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82cc003610 con 0x7f82fc0ba350 2026-02-24T19:17:28.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f28c7fff640 10 monclient: get_auth_request con 0x7f28980a11f0 auth_method 0 2026-02-24T19:17:28.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f56c77fe640 1 -- 10.20.193.14:0/1171845697 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2174610352 0 0) 0x7f56e80a83a0 con 0x7f56e8157780 2026-02-24T19:17:28.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f56c77fe640 1 -- 10.20.193.14:0/1171845697 >> v1:10.20.193.170:6789/0 conn(0x7f56e8157b50 legacy=0x7f56e80a8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f56c77fe640 1 -- 10.20.193.14:0/1171845697 >> v1:10.20.193.44:6789/0 conn(0x7f56e8164d00 legacy=0x7f56e812cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f56c77fe640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f56c77fe640 1 monclient: found mon.a 2026-02-24T19:17:28.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f56c77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f56c77fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f56c77fe640 1 -- 10.20.193.14:0/1171845697 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e80a8680 con 0x7f56e8157780 2026-02-24T19:17:28.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f56c77fe640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f56c77fe640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f56c77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f56ed25c640 5 monclient: authenticate success, global_id 4458 2026-02-24T19:17:28.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f56ed25c640 10 monclient: _renew_subs 2026-02-24T19:17:28.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f56ed25c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f56ed25c640 1 -- 10.20.193.14:0/1171845697 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f56e8159770 con 0x7f56e8157780 2026-02-24T19:17:28.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f56ed25c640 10 client.4458.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f56ed25c640 10 monclient: _renew_subs 2026-02-24T19:17:28.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f56ed25c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f56ed25c640 1 -- 10.20.193.14:0/1171845697 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f56e80a9590 con 0x7f56e8157780 2026-02-24T19:17:28.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f56ed25c640 1 librados: init done 2026-02-24T19:17:28.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7fa2867fc640 1 -- 10.20.193.14:0/852388800 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1845799143 0 0) 0x7fa2980afdd0 con 0x7fa29815deb0 2026-02-24T19:17:28.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7fa2867fc640 1 -- 10.20.193.14:0/852388800 >> v1:10.20.193.170:6789/0 conn(0x7fa29815e280 legacy=0x7fa298122c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7fa2867fc640 1 -- 10.20.193.14:0/852388800 >> v1:10.20.193.44:6789/0 conn(0x7fa2980ba3b0 legacy=0x7fa298135b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7fa2867fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7fa2867fc640 1 monclient: found mon.a 2026-02-24T19:17:28.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7fa2867fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7fa2867fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7fa2867fc640 1 -- 10.20.193.14:0/852388800 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2980b0390 con 0x7fa29815deb0 2026-02-24T19:17:28.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7fa2867fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7fa2867fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7fa2867fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f0e82d76640 10 monclient: get_auth_request con 0x7f0e500a1250 auth_method 0 2026-02-24T19:17:28.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7fa29fa9c640 5 monclient: authenticate success, global_id 4464 2026-02-24T19:17:28.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7fa29fa9c640 10 monclient: _renew_subs 2026-02-24T19:17:28.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7fa29fa9c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7fa29fa9c640 1 -- 10.20.193.14:0/852388800 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa2980b0670 con 0x7fa29815deb0 2026-02-24T19:17:28.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f5973d45640 10 client.4452.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f5973d45640 15 client.4452.objecter _session_command_op_assign -1 1 2026-02-24T19:17:28.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f5973d45640 20 client.4452.objecter _get_session osd=-1 returning homeless 2026-02-24T19:17:28.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7fa29fa9c640 10 client.4464.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7fa29fa9c640 10 monclient: _renew_subs 2026-02-24T19:17:28.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7fa29fa9c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7fa29fa9c640 1 -- 10.20.193.14:0/852388800 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa2981676f0 con 0x7fa29815deb0 2026-02-24T19:17:28.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7fa29fa9c640 1 librados: init done 2026-02-24T19:17:28.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f5973d45640 10 client.4452.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f5973d45640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.587+0000 7f5973d45640 1 -- 10.20.193.14:0/2765925491 --> v1:10.20.193.14:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f596c15e210 con 0x7f596c0b9f80 2026-02-24T19:17:28.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.588+0000 7f48a37fe640 10 client.?.objecter ms_handle_connect 0x7f48c405a240 2026-02-24T19:17:28.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.588+0000 7f48a37fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.588+0000 7f5f62ffd640 1 -- 10.20.193.14:0/2714502469 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3763923664 0 0) 0x7f5f7c156940 con 0x7f5f7c159a70 2026-02-24T19:17:28.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.588+0000 7f5f62ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.588+0000 7f5f62ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.588+0000 7f5f62ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.588+0000 7f5f62ffd640 10 monclient(hunting): my global_id is 4476 2026-02-24T19:17:28.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.588+0000 7f5f62ffd640 1 -- 10.20.193.14:0/2714502469 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f7c0b9380 con 0x7f5f7c159a70 2026-02-24T19:17:28.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.588+0000 7fab357fa640 1 -- 10.20.193.14:0/2139916363 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3716396262 0 0) 0x7fab10003610 con 0x7fab400585e0 2026-02-24T19:17:28.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.588+0000 7fab357fa640 1 -- 10.20.193.14:0/2139916363 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fab401fb450 con 0x7fab400585e0 2026-02-24T19:17:28.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.588+0000 7fab357fa640 1 -- 10.20.193.14:0/2139916363 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fab30003060 con 0x7fab400585e0 2026-02-24T19:17:28.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.588+0000 7fab357fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.588+0000 7fab357fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:28.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.588+0000 7fab357fa640 10 monclient(hunting): dump: 2026-02-24T19:17:28.634 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.634 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.634 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.634 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.634 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.634 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.634 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.634 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.634 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.634 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.588+0000 7fab357fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:28.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.588+0000 7f28a3fff640 1 -- 10.20.193.14:0/425562497 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (unknown 3108795433 0 0) 0x7f28b8058630 con 0x7f28c815b0a0 2026-02-24T19:17:28.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.588+0000 7f28a3fff640 10 monclient: handle_get_version_reply finishing 1 version 31 2026-02-24T19:17:28.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.588+0000 7f56ed25c640 10 client.4458.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.588+0000 7f56ed25c640 15 client.4458.objecter _session_command_op_assign -1 1 2026-02-24T19:17:28.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.588+0000 7f56ed25c640 20 client.4458.objecter _get_session osd=-1 returning homeless 2026-02-24T19:17:28.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.588+0000 7f56ed25c640 10 client.4458.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.588+0000 7f56ed25c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.588+0000 7f56ed25c640 1 -- 10.20.193.14:0/1171845697 --> v1:10.20.193.14:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f56e8164970 con 0x7f56e8157780 2026-02-24T19:17:28.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.588+0000 7fa29fa9c640 10 client.4464.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.588+0000 7fa29fa9c640 15 client.4464.objecter _session_command_op_assign -1 1 2026-02-24T19:17:28.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.588+0000 7fa29fa9c640 20 client.4464.objecter _get_session osd=-1 returning homeless 2026-02-24T19:17:28.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.588+0000 7fa29fa9c640 10 client.4464.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.588+0000 7fa29fa9c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.588+0000 7fa29fa9c640 1 -- 10.20.193.14:0/852388800 --> v1:10.20.193.14:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fa29813a9d0 con 0x7fa29815deb0 2026-02-24T19:17:28.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.588+0000 7fdcebfff640 1 -- 10.20.193.14:0/1366958924 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3155903188 0 0) 0x7fdd101535c0 con 0x7fdd10058070 2026-02-24T19:17:28.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.588+0000 7fdcebfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.588+0000 7fdcebfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.588+0000 7fdcebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.588+0000 7fdcebfff640 10 monclient(hunting): my global_id is 4482 2026-02-24T19:17:28.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.588+0000 7fdcebfff640 1 -- 10.20.193.14:0/1366958924 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd101fe890 con 0x7fdd10058070 2026-02-24T19:17:28.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.589+0000 7f28a3fff640 10 client.4448.objecter ms_handle_connect 0x7f28980a11f0 2026-02-24T19:17:28.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.589+0000 7f0e6affd640 10 client.4443.objecter ms_handle_connect 0x7f0e500a1250 2026-02-24T19:17:28.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.592+0000 7f48a37fe640 1 -- 10.20.193.14:0/3396094211 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3077375078 0 0) 0x7f48c41f9260 con 0x7f48c4058580 2026-02-24T19:17:28.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.592+0000 7f48a37fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.592+0000 7f48a37fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.592+0000 7f48a37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.592+0000 7f48a37fe640 10 monclient(hunting): my global_id is 4480 2026-02-24T19:17:28.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.592+0000 7f48a37fe640 1 -- 10.20.193.14:0/3396094211 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4890003610 con 0x7f48c4058580 2026-02-24T19:17:28.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.595+0000 7f82ea7fc640 1 -- 10.20.193.14:0/897198496 <== mon.1 v1:10.20.193.44:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3699073005 0 0) 0x7f82fc0b2690 con 0x7f82fc0b9f80 2026-02-24T19:17:28.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.595+0000 7f82ea7fc640 1 -- 10.20.193.14:0/897198496 >> v1:10.20.193.170:6789/0 conn(0x7f82fc0585e0 legacy=0x7f82fc0b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.595+0000 7f82ea7fc640 1 -- 10.20.193.14:0/897198496 >> v1:10.20.193.14:6789/0 conn(0x7f82fc0ba350 legacy=0x7f82fc1fe480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.595+0000 7f82ea7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.595+0000 7f82ea7fc640 1 monclient: found mon.b 2026-02-24T19:17:28.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.595+0000 7f82ea7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.595+0000 7f82ea7fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.595+0000 7f82ea7fc640 1 -- 10.20.193.14:0/897198496 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82fc0b2970 con 0x7f82fc0b9f80 2026-02-24T19:17:28.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.595+0000 7f82ea7fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.595+0000 7f82ea7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.595+0000 7f82ea7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.595+0000 7f8303ca6640 5 monclient: authenticate success, global_id 4468 2026-02-24T19:17:28.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.595+0000 7f8303ca6640 10 monclient: _renew_subs 2026-02-24T19:17:28.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.595+0000 7f8303ca6640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.595+0000 7f8303ca6640 1 -- 10.20.193.14:0/897198496 --> v1:10.20.193.44:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f82fc0b2c50 con 0x7f82fc0b9f80 2026-02-24T19:17:28.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.595+0000 7f8303ca6640 10 client.4468.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.595+0000 7f8303ca6640 10 monclient: _renew_subs 2026-02-24T19:17:28.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.595+0000 7f8303ca6640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.595+0000 7f8303ca6640 1 -- 10.20.193.14:0/897198496 --> v1:10.20.193.44:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f82fc0b3210 con 0x7f82fc0b9f80 2026-02-24T19:17:28.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.595+0000 7f8303ca6640 1 librados: init done 2026-02-24T19:17:28.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.595+0000 7feed8ff9640 1 -- 10.20.193.14:0/912187155 <== mon.1 v1:10.20.193.44:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1102146587 0 0) 0x7feedc166170 con 0x7feedc0b9f80 2026-02-24T19:17:28.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.595+0000 7feed8ff9640 1 -- 10.20.193.14:0/912187155 >> v1:10.20.193.170:6789/0 conn(0x7feedc0585e0 legacy=0x7feedc1657d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.595+0000 7feed8ff9640 1 -- 10.20.193.14:0/912187155 >> v1:10.20.193.14:6789/0 conn(0x7feedc0ba350 legacy=0x7feedc1645a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.595+0000 7feed8ff9640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.595+0000 7feed8ff9640 1 monclient: found mon.b 2026-02-24T19:17:28.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.595+0000 7feed8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.595+0000 7feed8ff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.595+0000 7feed8ff9640 1 -- 10.20.193.14:0/912187155 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feedc166450 con 0x7feedc0b9f80 2026-02-24T19:17:28.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.596+0000 7feed8ff9640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.596+0000 7feed8ff9640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.596+0000 7feed8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.596+0000 7feee249f640 5 monclient: authenticate success, global_id 4459 2026-02-24T19:17:28.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.596+0000 7feee249f640 10 monclient: _renew_subs 2026-02-24T19:17:28.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.596+0000 7feee249f640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.596+0000 7feee249f640 1 -- 10.20.193.14:0/912187155 --> v1:10.20.193.44:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7feedc1fb2e0 con 0x7feedc0b9f80 2026-02-24T19:17:28.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.596+0000 7feee249f640 10 client.4459.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.596+0000 7feee249f640 10 monclient: _renew_subs 2026-02-24T19:17:28.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.596+0000 7feee249f640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.596+0000 7feee249f640 1 -- 10.20.193.14:0/912187155 --> v1:10.20.193.44:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7feedc1fb8a0 con 0x7feedc0b9f80 2026-02-24T19:17:28.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.596+0000 7feee249f640 1 librados: init done 2026-02-24T19:17:28.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.596+0000 7f8303ca6640 10 client.4468.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.596+0000 7f8303ca6640 15 client.4468.objecter _session_command_op_assign -1 1 2026-02-24T19:17:28.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.596+0000 7f8303ca6640 20 client.4468.objecter _get_session osd=-1 returning homeless 2026-02-24T19:17:28.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.596+0000 7f8303ca6640 10 client.4468.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.596+0000 7f8303ca6640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.596+0000 7f8303ca6640 1 -- 10.20.193.14:0/897198496 --> v1:10.20.193.44:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f82fc0b64c0 con 0x7f82fc0b9f80 2026-02-24T19:17:28.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.596+0000 7feee249f640 10 client.4459.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.596+0000 7feee249f640 15 client.4459.objecter _session_command_op_assign -1 1 2026-02-24T19:17:28.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.596+0000 7feee249f640 20 client.4459.objecter _get_session osd=-1 returning homeless 2026-02-24T19:17:28.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.596+0000 7feee249f640 10 client.4459.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.596+0000 7feee249f640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.596+0000 7feee249f640 1 -- 10.20.193.14:0/912187155 --> v1:10.20.193.44:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7feedc0b96a0 con 0x7feedc0b9f80 2026-02-24T19:17:28.638 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.605+0000 7f5f62ffd640 1 -- 10.20.193.14:0/2714502469 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 618735124 0 0) 0x7f5f7c1faf30 con 0x7f5f7c159e40 2026-02-24T19:17:28.638 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.605+0000 7f5f62ffd640 1 -- 10.20.193.14:0/2714502469 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5f7c156940 con 0x7f5f7c159e40 2026-02-24T19:17:28.638 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.605+0000 7f5f62ffd640 1 -- 10.20.193.14:0/2714502469 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5f6c0033d0 con 0x7f5f7c159e40 2026-02-24T19:17:28.638 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.605+0000 7f5f62ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.638 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.605+0000 7f5f62ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:28.638 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.605+0000 7f5f62ffd640 10 monclient(hunting): dump: 2026-02-24T19:17:28.638 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.638 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.638 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.638 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.638 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.638 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.638 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.638 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.638 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.638 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.638 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.605+0000 7f5f62ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:28.638 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.605+0000 7f5f62ffd640 1 -- 10.20.193.14:0/2714502469 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2686760986 0 0) 0x7f5f48003610 con 0x7f5f7c058070 2026-02-24T19:17:28.638 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.605+0000 7f5f62ffd640 1 -- 10.20.193.14:0/2714502469 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5f7c1faf30 con 0x7f5f7c058070 2026-02-24T19:17:28.638 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.605+0000 7fab357fa640 1 -- 10.20.193.14:0/2139916363 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1118127115 0 0) 0x7fab40159ea0 con 0x7fab400ba350 2026-02-24T19:17:28.638 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.605+0000 7f5f62ffd640 1 -- 10.20.193.14:0/2714502469 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5f700032f0 con 0x7f5f7c058070 2026-02-24T19:17:28.638 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.605+0000 7f5f62ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.638 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.605+0000 7f5f62ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:28.638 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.605+0000 7fab357fa640 1 -- 10.20.193.14:0/2139916363 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fab10003610 con 0x7fab400ba350 2026-02-24T19:17:28.638 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.605+0000 7fab357fa640 1 -- 10.20.193.14:0/2139916363 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fab3c0034f0 con 0x7fab400ba350 2026-02-24T19:17:28.638 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.605+0000 7fab357fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.638 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.605+0000 7fab357fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:28.638 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.605+0000 7f5f62ffd640 10 monclient(hunting): dump: 2026-02-24T19:17:28.638 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.639 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.639 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.639 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.639 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.639 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.639 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.639 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.639 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.639 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.639 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.605+0000 7fab357fa640 10 monclient(hunting): dump: 2026-02-24T19:17:28.639 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.639 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.639 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.639 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.639 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.639 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.639 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.639 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.639 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.639 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.639 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.606+0000 7fdcebfff640 1 -- 10.20.193.14:0/1366958924 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2426961243 0 0) 0x7fdd101feb70 con 0x7fdd10159e40 2026-02-24T19:17:28.639 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.606+0000 7fdcebfff640 1 -- 10.20.193.14:0/1366958924 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdd101535c0 con 0x7fdd10159e40 2026-02-24T19:17:28.639 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.606+0000 7fdcebfff640 1 -- 10.20.193.14:0/1366958924 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fdd04003330 con 0x7fdd10159e40 2026-02-24T19:17:28.639 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.606+0000 7fdcebfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.639 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.606+0000 7fdcebfff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:28.639 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.606+0000 7fdcebfff640 10 monclient(hunting): dump: 2026-02-24T19:17:28.639 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.639 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.639 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.639 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.639 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.639 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.640 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.640 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.640 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.640 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.606+0000 7fdcebfff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:28.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.608+0000 7f0e6affd640 1 -- 10.20.193.14:0/3369942034 <== osd.6 v1:10.20.193.170:6800/3031579126 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f0e500c2ef0 con 0x7f0e500a1250 2026-02-24T19:17:28.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.608+0000 7f0e6affd640 10 client.4443.objecter ms_dispatch2 0x7f0e84000b90 command_reply(tid 1: 0 ) 2026-02-24T19:17:28.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.608+0000 7f0e6affd640 10 client.4443.objecter _finish_command 1 = system:0 2026-02-24T19:17:28.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.608+0000 7f0e6affd640 20 client.4443.objecter put_session s=0x7f0e500a0ba0 osd=6 4 2026-02-24T19:17:28.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.608+0000 7f0e6affd640 15 client.4443.objecter _session_command_op_remove 6 1 2026-02-24T19:17:28.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.609+0000 7f28a3fff640 1 -- 10.20.193.14:0/425562497 <== osd.4 v1:10.20.193.14:6805/4020872388 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f28980c2df0 con 0x7f28980a11f0 2026-02-24T19:17:28.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.609+0000 7f28a3fff640 10 client.4448.objecter ms_dispatch2 0x7f28c8000b90 command_reply(tid 1: 0 ) 2026-02-24T19:17:28.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.609+0000 7f28a3fff640 10 client.4448.objecter _finish_command 1 = system:0 2026-02-24T19:17:28.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.609+0000 7f28a3fff640 20 client.4448.objecter put_session s=0x7f28980a0b40 osd=4 4 2026-02-24T19:17:28.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.609+0000 7f28a3fff640 15 client.4448.objecter _session_command_op_remove 4 1 2026-02-24T19:17:28.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.609+0000 7fc58effd640 1 -- 10.20.193.14:0/2603662831 <== mon.1 v1:10.20.193.44:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc5a405bbc0 con 0x7fc5a415b350 2026-02-24T19:17:28.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.609+0000 7fc58effd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.609+0000 7fc58effd640 1 -- 10.20.193.14:0/2603662831 <== mon.1 v1:10.20.193.44:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc598003c20 con 0x7fc5a415b350 2026-02-24T19:17:28.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.609+0000 7fc58effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.609+0000 7fc58effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:28.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.609+0000 7fc58effd640 10 monclient: dump: 2026-02-24T19:17:28.640 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.640 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.640 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.640 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.640 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.640 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.640 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.640 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.640 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.640 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.609+0000 7fc5a8ec7640 4 set_mon_vals no callback set 2026-02-24T19:17:28.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.610+0000 7f48a37fe640 1 -- 10.20.193.14:0/3396094211 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1283105236 0 0) 0x7f48c41f9540 con 0x7f48c4059e70 2026-02-24T19:17:28.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.610+0000 7f48a37fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.610+0000 7f48a37fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.610+0000 7f48a37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.610+0000 7f48a37fe640 10 monclient(hunting): my global_id is 4490 2026-02-24T19:17:28.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.610+0000 7f48a37fe640 1 -- 10.20.193.14:0/3396094211 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48c41f9260 con 0x7f48c4059e70 2026-02-24T19:17:28.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.611+0000 7fc58effd640 1 -- 10.20.193.14:0/2603662831 <== mon.1 v1:10.20.193.44:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7fc598003e30 con 0x7fc5a415b350 2026-02-24T19:17:28.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.611+0000 7fc5aa6ca640 10 monclient: get_auth_request con 0x7fc574077ce0 auth_method 0 2026-02-24T19:17:28.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.611+0000 7fc58effd640 10 client.4450.objecter ms_handle_connect 0x7fc574077ce0 2026-02-24T19:17:28.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.614+0000 7f595a7fc640 1 -- 10.20.193.14:0/2765925491 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f596c15e210 con 0x7f596c0b9f80 2026-02-24T19:17:28.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.614+0000 7f595a7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.614+0000 7f595a7fc640 1 -- 10.20.193.14:0/2765925491 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f59600038a0 con 0x7f596c0b9f80 2026-02-24T19:17:28.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.614+0000 7f595a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.614+0000 7f595a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.614+0000 7f595a7fc640 10 monclient: dump: 2026-02-24T19:17:28.641 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.641 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.641 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.641 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.641 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.641 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.641 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.641 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.641 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.641 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.614+0000 7f595bfff640 4 set_mon_vals no callback set 2026-02-24T19:17:28.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.615+0000 7fc58effd640 1 -- 10.20.193.14:0/2603662831 <== mon.1 v1:10.20.193.44:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7fc598093420 con 0x7fc5a415b350 2026-02-24T19:17:28.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.615+0000 7fc58effd640 10 client.4450.objecter ms_dispatch2 0x7fc5a4000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:28.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.615+0000 7fc58effd640 3 client.4450.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:28.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.615+0000 7fc58effd640 3 client.4450.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:28.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.615+0000 7fc58effd640 10 client.4450.objecter checking command 1 2026-02-24T19:17:28.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.615+0000 7fc58effd640 20 client.4450.objecter _get_session s=0x7fc5740a0b60 osd=8 3 2026-02-24T19:17:28.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.615+0000 7fc58effd640 20 client.4450.objecter put_session s=0x7fc5740a0b60 osd=8 3 2026-02-24T19:17:28.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.615+0000 7fc58effd640 15 client.4450.objecter _session_command_op_remove -1 1 2026-02-24T19:17:28.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.615+0000 7fc58effd640 20 client.4450.objecter _get_session s=0x7fc5740a0b60 osd=8 3 2026-02-24T19:17:28.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.615+0000 7fc58effd640 20 client.4450.objecter get_session s=0x7fc5740a0b60 osd=8 3 2026-02-24T19:17:28.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.615+0000 7fc58effd640 15 client.4450.objecter _session_command_op_assign 8 1 2026-02-24T19:17:28.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.615+0000 7fc58effd640 20 client.4450.objecter put_session s=0x7fc5740a0b60 osd=8 4 2026-02-24T19:17:28.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.615+0000 7fc58effd640 10 client.4450.objecter _send_command 1 2026-02-24T19:17:28.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.615+0000 7fc58effd640 1 -- 10.20.193.14:0/2603662831 --> v1:10.20.193.14:6809/1223168292 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc5740c2e10 con 0x7fc5740a1210 2026-02-24T19:17:28.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.615+0000 7fc58effd640 20 client.4450.objecter dump_active .. 0 homeless 2026-02-24T19:17:28.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.615+0000 7fc58effd640 1 -- 10.20.193.14:0/2603662831 <== mon.1 v1:10.20.193.44:6789/0 9 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (unknown 3108795433 0 0) 0x7fc598059ac0 con 0x7fc5a415b350 2026-02-24T19:17:28.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.615+0000 7fc58effd640 10 monclient: handle_get_version_reply finishing 1 version 31 2026-02-24T19:17:28.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.615+0000 7f595a7fc640 1 -- 10.20.193.14:0/2765925491 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f5960003ab0 con 0x7f596c0b9f80 2026-02-24T19:17:28.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.615+0000 7f4eb5ffb640 1 -- 10.20.193.14:0/1929189111 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4ec80b64c0 con 0x7f4ec80b9f80 2026-02-24T19:17:28.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.615+0000 7f4eb5ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.615+0000 7f4eb5ffb640 1 -- 10.20.193.14:0/1929189111 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4ebc004a70 con 0x7f4ec80b9f80 2026-02-24T19:17:28.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.615+0000 7f4eb5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.615+0000 7f4eb5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:28.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.615+0000 7f4eb77fe640 4 set_mon_vals no callback set 2026-02-24T19:17:28.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.615+0000 7f4eb5ffb640 10 monclient: dump: 2026-02-24T19:17:28.642 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.642 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.642 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.642 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.642 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.642 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.643 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.643 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.643 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.643 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.615+0000 7fc5a9ec9640 10 monclient: get_auth_request con 0x7fc5740a1210 auth_method 0 2026-02-24T19:17:28.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.615+0000 7f5971aba640 10 monclient: get_auth_request con 0x7f593c077ed0 auth_method 0 2026-02-24T19:17:28.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.616+0000 7f595a7fc640 10 client.4452.objecter ms_handle_connect 0x7f593c077ed0 2026-02-24T19:17:28.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.616+0000 7f48a37fe640 1 -- 10.20.193.14:0/3396094211 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2049164547 0 0) 0x7f4890003610 con 0x7f48c4058580 2026-02-24T19:17:28.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.616+0000 7f48a37fe640 1 -- 10.20.193.14:0/3396094211 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f48c41f9540 con 0x7f48c4058580 2026-02-24T19:17:28.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.616+0000 7f48a37fe640 1 -- 10.20.193.14:0/3396094211 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f48b8003190 con 0x7f48c4058580 2026-02-24T19:17:28.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.616+0000 7f48a37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.616+0000 7f48a37fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:28.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.616+0000 7f48a37fe640 10 monclient(hunting): dump: 2026-02-24T19:17:28.643 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.643 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.643 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.643 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.643 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.643 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.643 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.643 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.643 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.643 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.616+0000 7f48a37fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:28.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.616+0000 7f4eb5ffb640 1 -- 10.20.193.14:0/1929189111 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f4ebc01d8e0 con 0x7f4ec80b9f80 2026-02-24T19:17:28.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.616+0000 7f0e88ded640 10 client.4443.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:17:28.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.616+0000 7f0e88ded640 15 client.4443.objecter _session_command_op_assign -1 2 2026-02-24T19:17:28.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.616+0000 7f0e88ded640 20 client.4443.objecter _get_session s=0x7f0e500a0ba0 osd=6 3 2026-02-24T19:17:28.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.616+0000 7f0e88ded640 20 client.4443.objecter put_session s=0x7f0e500a0ba0 osd=6 3 2026-02-24T19:17:28.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.616+0000 7f0e88ded640 20 client.4443.objecter _get_session s=0x7f0e500a0ba0 osd=6 3 2026-02-24T19:17:28.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.616+0000 7f0e88ded640 15 client.4443.objecter _session_command_op_remove -1 2 2026-02-24T19:17:28.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.616+0000 7f0e88ded640 20 client.4443.objecter get_session s=0x7f0e500a0ba0 osd=6 3 2026-02-24T19:17:28.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.616+0000 7f0e88ded640 15 client.4443.objecter _session_command_op_assign 6 2 2026-02-24T19:17:28.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.616+0000 7f0e88ded640 20 client.4443.objecter put_session s=0x7f0e500a0ba0 osd=6 4 2026-02-24T19:17:28.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.616+0000 7f0e88ded640 10 client.4443.objecter _send_command 2 2026-02-24T19:17:28.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.616+0000 7f0e88ded640 1 -- 10.20.193.14:0/3369942034 --> v1:10.20.193.170:6800/3031579126 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0e841f95b0 con 0x7f0e500a1250 2026-02-24T19:17:28.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.616+0000 7f4ecd600640 10 monclient: get_auth_request con 0x7f4e98077dc0 auth_method 0 2026-02-24T19:17:28.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.616+0000 7f4eb5ffb640 10 client.4451.objecter ms_handle_connect 0x7f4e98077dc0 2026-02-24T19:17:28.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.617+0000 7fc58effd640 10 client.4450.objecter ms_handle_connect 0x7fc5740a1210 2026-02-24T19:17:28.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.617+0000 7f4eb5ffb640 1 -- 10.20.193.14:0/1929189111 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7f4ebc093060 con 0x7f4ec80b9f80 2026-02-24T19:17:28.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.617+0000 7f4eb5ffb640 10 client.4451.objecter ms_dispatch2 0x7f4ec8000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:28.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.617+0000 7f4eb5ffb640 3 client.4451.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:28.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.617+0000 7f4eb5ffb640 3 client.4451.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:28.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.617+0000 7f595a7fc640 1 -- 10.20.193.14:0/2765925491 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7f59600038a0 con 0x7f596c0b9f80 2026-02-24T19:17:28.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.617+0000 7f595a7fc640 10 client.4452.objecter ms_dispatch2 0x7f596c000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:28.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.617+0000 7f595a7fc640 3 client.4452.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:28.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.617+0000 7f595a7fc640 3 client.4452.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:28.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.617+0000 7f4eb5ffb640 10 client.4451.objecter checking command 1 2026-02-24T19:17:28.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.617+0000 7f4eb5ffb640 20 client.4451.objecter _get_session s=0x7f4e980a0c40 osd=11 3 2026-02-24T19:17:28.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.617+0000 7f4eb5ffb640 20 client.4451.objecter put_session s=0x7f4e980a0c40 osd=11 3 2026-02-24T19:17:28.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.617+0000 7f4eb5ffb640 15 client.4451.objecter _session_command_op_remove -1 1 2026-02-24T19:17:28.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.617+0000 7f4eb5ffb640 20 client.4451.objecter _get_session s=0x7f4e980a0c40 osd=11 3 2026-02-24T19:17:28.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.617+0000 7f4eb5ffb640 20 client.4451.objecter get_session s=0x7f4e980a0c40 osd=11 3 2026-02-24T19:17:28.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.617+0000 7f4eb5ffb640 15 client.4451.objecter _session_command_op_assign 11 1 2026-02-24T19:17:28.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.617+0000 7f4eb5ffb640 20 client.4451.objecter put_session s=0x7f4e980a0c40 osd=11 4 2026-02-24T19:17:28.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.617+0000 7f4eb5ffb640 10 client.4451.objecter _send_command 1 2026-02-24T19:17:28.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.617+0000 7f4eb5ffb640 1 -- 10.20.193.14:0/1929189111 --> v1:10.20.193.195:6804/2798179318 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4e980c2ef0 con 0x7f4e980a12f0 2026-02-24T19:17:28.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.617+0000 7f4eb5ffb640 20 client.4451.objecter dump_active .. 0 homeless 2026-02-24T19:17:28.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.617+0000 7f595a7fc640 10 client.4452.objecter checking command 1 2026-02-24T19:17:28.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.618+0000 7f595a7fc640 20 client.4452.objecter _get_session s=0x7f593c0a0db0 osd=15 3 2026-02-24T19:17:28.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.618+0000 7f595a7fc640 20 client.4452.objecter put_session s=0x7f593c0a0db0 osd=15 3 2026-02-24T19:17:28.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.618+0000 7f595a7fc640 15 client.4452.objecter _session_command_op_remove -1 1 2026-02-24T19:17:28.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.618+0000 7f595a7fc640 20 client.4452.objecter _get_session s=0x7f593c0a0db0 osd=15 3 2026-02-24T19:17:28.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.618+0000 7f595a7fc640 20 client.4452.objecter get_session s=0x7f593c0a0db0 osd=15 3 2026-02-24T19:17:28.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.618+0000 7f595a7fc640 15 client.4452.objecter _session_command_op_assign 15 1 2026-02-24T19:17:28.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.618+0000 7f595a7fc640 20 client.4452.objecter put_session s=0x7f593c0a0db0 osd=15 4 2026-02-24T19:17:28.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.618+0000 7f595a7fc640 10 client.4452.objecter _send_command 1 2026-02-24T19:17:28.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.618+0000 7f595a7fc640 1 -- 10.20.193.14:0/2765925491 --> v1:10.20.193.195:6809/3316970219 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f593c0c3060 con 0x7f593c0a1460 2026-02-24T19:17:28.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.618+0000 7f595a7fc640 20 client.4452.objecter dump_active .. 0 homeless 2026-02-24T19:17:28.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.618+0000 7f595a7fc640 1 -- 10.20.193.14:0/2765925491 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (unknown 3108795433 0 0) 0x7f596005cfd0 con 0x7f596c0b9f80 2026-02-24T19:17:28.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.618+0000 7f595a7fc640 10 monclient: handle_get_version_reply finishing 1 version 31 2026-02-24T19:17:28.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.618+0000 7f4ecde01640 10 monclient: get_auth_request con 0x7f4e980a12f0 auth_method 0 2026-02-24T19:17:28.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.618+0000 7f59722bb640 10 monclient: get_auth_request con 0x7f593c0a1460 auth_method 0 2026-02-24T19:17:28.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.618+0000 7f28cdbb3640 10 client.4448.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:17:28.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.618+0000 7f28cdbb3640 15 client.4448.objecter _session_command_op_assign -1 2 2026-02-24T19:17:28.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.618+0000 7f28cdbb3640 20 client.4448.objecter _get_session s=0x7f28980a0b40 osd=4 3 2026-02-24T19:17:28.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.618+0000 7f28cdbb3640 20 client.4448.objecter put_session s=0x7f28980a0b40 osd=4 3 2026-02-24T19:17:28.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.618+0000 7f28cdbb3640 20 client.4448.objecter _get_session s=0x7f28980a0b40 osd=4 3 2026-02-24T19:17:28.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.618+0000 7f28cdbb3640 15 client.4448.objecter _session_command_op_remove -1 2 2026-02-24T19:17:28.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.618+0000 7f28cdbb3640 20 client.4448.objecter get_session s=0x7f28980a0b40 osd=4 3 2026-02-24T19:17:28.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.618+0000 7f28cdbb3640 15 client.4448.objecter _session_command_op_assign 4 2 2026-02-24T19:17:28.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.618+0000 7f28cdbb3640 20 client.4448.objecter put_session s=0x7f28980a0b40 osd=4 4 2026-02-24T19:17:28.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.618+0000 7f28cdbb3640 10 client.4448.objecter _send_command 2 2026-02-24T19:17:28.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.618+0000 7f28cdbb3640 1 -- 10.20.193.14:0/425562497 --> v1:10.20.193.14:6805/4020872388 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f28c805bbc0 con 0x7f28980a11f0 2026-02-24T19:17:28.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.619+0000 7f4eb5ffb640 1 -- 10.20.193.14:0/1929189111 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (unknown 3108795433 0 0) 0x7f4ebc059700 con 0x7f4ec80b9f80 2026-02-24T19:17:28.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.619+0000 7f4eb5ffb640 10 monclient: handle_get_version_reply finishing 1 version 31 2026-02-24T19:17:28.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.620+0000 7f4eb5ffb640 10 client.4451.objecter ms_handle_connect 0x7f4e980a12f0 2026-02-24T19:17:28.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.620+0000 7f595a7fc640 10 client.4452.objecter ms_handle_connect 0x7f593c0a1460 2026-02-24T19:17:28.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.621+0000 7f28a3fff640 1 -- 10.20.193.14:0/425562497 <== osd.4 v1:10.20.193.14:6805/4020872388 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7f28c805bbc0 con 0x7f28980a11f0 2026-02-24T19:17:28.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.621+0000 7f28a3fff640 10 client.4448.objecter ms_dispatch2 0x7f28c8000b90 command_reply(tid 2: 0 ) 2026-02-24T19:17:28.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.621+0000 7f28a3fff640 10 client.4448.objecter _finish_command 2 = system:0 2026-02-24T19:17:28.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.621+0000 7f28a3fff640 20 client.4448.objecter put_session s=0x7f28980a0b40 osd=4 4 2026-02-24T19:17:28.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.621+0000 7f28a3fff640 15 client.4448.objecter _session_command_op_remove 4 2 2026-02-24T19:17:28.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.621+0000 7f28cdbb3640 10 librados: watch_flush enter 2026-02-24T19:17:28.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.621+0000 7f28cdbb3640 10 librados: watch_flush exit 2026-02-24T19:17:28.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.621+0000 7f28cdbb3640 10 client.4448.objecter close_session for osd.4 2026-02-24T19:17:28.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.621+0000 7f28cdbb3640 1 -- 10.20.193.14:0/425562497 >> v1:10.20.193.14:6805/4020872388 conn(0x7f28980a11f0 legacy=0x7f28980c1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.621+0000 7f28cdbb3640 20 client.4448.objecter put_session s=0x7f28980a0b40 osd=4 1 2026-02-24T19:17:28.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.621+0000 7f28cdbb3640 20 client.4448.objecter shutdown clearing up homeless session... 2026-02-24T19:17:28.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.621+0000 7f28cdbb3640 10 client.4448.objecter successfully canceled tick 2026-02-24T19:17:28.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.621+0000 7f28cdbb3640 1 -- 10.20.193.14:0/425562497 >> v1:10.20.193.14:6800/4014096310 conn(0x7f2898077cc0 legacy=0x7f2898098170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.621+0000 7f28cdbb3640 10 monclient: shutdown 2026-02-24T19:17:28.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.621+0000 7f28cdbb3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.621+0000 7f28cdbb3640 1 -- 10.20.193.14:0/425562497 >> v1:10.20.193.170:6789/0 conn(0x7f28c815b0a0 legacy=0x7f28c81f90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.621+0000 7f28c7fff640 1 -- 10.20.193.14:0/425562497 reap_dead start 2026-02-24T19:17:28.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.621+0000 7f28cdbb3640 1 -- 10.20.193.14:0/425562497 shutdown_connections 2026-02-24T19:17:28.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.621+0000 7f28cdbb3640 1 -- 10.20.193.14:0/425562497 >> 10.20.193.14:0/425562497 conn(0x7f28c80b5290 msgr2=0x7f28c80b5660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.621+0000 7f28cdbb3640 1 -- 10.20.193.14:0/425562497 shutdown_connections 2026-02-24T19:17:28.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.621+0000 7f28cdbb3640 1 -- 10.20.193.14:0/425562497 wait complete. 2026-02-24T19:17:28.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.621+0000 7f28cdbb3640 1 librados: shutdown 2026-02-24T19:17:28.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.622+0000 7f5f62ffd640 1 -- 10.20.193.14:0/2714502469 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1621018731 0 0) 0x7f5f7c0b9380 con 0x7f5f7c159a70 2026-02-24T19:17:28.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.622+0000 7f5f62ffd640 1 -- 10.20.193.14:0/2714502469 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5f48003610 con 0x7f5f7c159a70 2026-02-24T19:17:28.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.622+0000 7f5f62ffd640 1 -- 10.20.193.14:0/2714502469 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5f640030b0 con 0x7f5f7c159a70 2026-02-24T19:17:28.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.622+0000 7f5f62ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.622+0000 7f5f62ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.622+0000 7f5f62ffd640 10 monclient(hunting): dump: 2026-02-24T19:17:28.647 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.647 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.647 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.647 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.647 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.647 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.648 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.648 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.648 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.648 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.622+0000 7f0e6affd640 1 -- 10.20.193.14:0/3369942034 <== osd.6 v1:10.20.193.170:6800/3031579126 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1506399442) 0x7f0e841f95b0 con 0x7f0e500a1250 2026-02-24T19:17:28.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.622+0000 7f0e6affd640 10 client.4443.objecter ms_dispatch2 0x7f0e84000b90 command_reply(tid 2: 0 ) 2026-02-24T19:17:28.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.622+0000 7f0e6affd640 10 client.4443.objecter _finish_command 2 = system:0 2026-02-24T19:17:28.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.622+0000 7f0e6affd640 20 client.4443.objecter put_session s=0x7f0e500a0ba0 osd=6 4 2026-02-24T19:17:28.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.622+0000 7f0e6affd640 15 client.4443.objecter _session_command_op_remove 6 2 2026-02-24T19:17:28.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.622+0000 7f0e88ded640 10 librados: watch_flush enter 2026-02-24T19:17:28.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.622+0000 7f0e88ded640 10 librados: watch_flush exit 2026-02-24T19:17:28.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.622+0000 7f0e88ded640 10 client.4443.objecter close_session for osd.6 2026-02-24T19:17:28.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.622+0000 7f0e88ded640 1 -- 10.20.193.14:0/3369942034 >> v1:10.20.193.170:6800/3031579126 conn(0x7f0e500a1250 legacy=0x7f0e500c1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.622+0000 7f0e88ded640 20 client.4443.objecter put_session s=0x7f0e500a0ba0 osd=6 1 2026-02-24T19:17:28.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.622+0000 7f0e88ded640 20 client.4443.objecter shutdown clearing up homeless session... 2026-02-24T19:17:28.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.622+0000 7f0e88ded640 10 client.4443.objecter successfully canceled tick 2026-02-24T19:17:28.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.622+0000 7f0e88ded640 1 -- 10.20.193.14:0/3369942034 >> v1:10.20.193.14:6800/4014096310 conn(0x7f0e50077d20 legacy=0x7f0e500981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.622+0000 7f0e88ded640 10 monclient: shutdown 2026-02-24T19:17:28.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.622+0000 7f0e88ded640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.622+0000 7f0e88ded640 1 -- 10.20.193.14:0/3369942034 >> v1:10.20.193.14:6789/0 conn(0x7f0e84159a70 legacy=0x7f0e841f8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.622+0000 7f0e82d76640 1 -- 10.20.193.14:0/3369942034 reap_dead start 2026-02-24T19:17:28.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.622+0000 7f0e88ded640 1 -- 10.20.193.14:0/3369942034 shutdown_connections 2026-02-24T19:17:28.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.622+0000 7f0e88ded640 1 -- 10.20.193.14:0/3369942034 >> 10.20.193.14:0/3369942034 conn(0x7f0e840b7780 msgr2=0x7f0e84165d70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.622+0000 7f0e88ded640 1 -- 10.20.193.14:0/3369942034 shutdown_connections 2026-02-24T19:17:28.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.622+0000 7f0e88ded640 1 -- 10.20.193.14:0/3369942034 wait complete. 2026-02-24T19:17:28.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.622+0000 7f0e88ded640 1 librados: shutdown 2026-02-24T19:17:28.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.623+0000 7f4db6ffd640 1 -- 10.20.193.14:0/4093622326 <== mon.1 v1:10.20.193.44:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4dd015e210 con 0x7f4dd00ba350 2026-02-24T19:17:28.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.623+0000 7f4db6ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.623+0000 7f4db6ffd640 1 -- 10.20.193.14:0/4093622326 <== mon.1 v1:10.20.193.44:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4dcc0032f0 con 0x7f4dd00ba350 2026-02-24T19:17:28.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.623+0000 7f4db6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.623+0000 7f4db6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:28.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.623+0000 7f4db6ffd640 10 monclient: dump: 2026-02-24T19:17:28.649 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.649 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.649 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.649 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.649 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.649 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.649 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.649 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.649 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.649 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.623+0000 7f4dd4b35640 4 set_mon_vals no callback set 2026-02-24T19:17:28.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.624+0000 7f4db6ffd640 1 -- 10.20.193.14:0/4093622326 <== mon.1 v1:10.20.193.44:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f4dcc01dbd0 con 0x7f4dd00ba350 2026-02-24T19:17:28.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.624+0000 7f4dd6338640 10 monclient: get_auth_request con 0x7f4da0077d70 auth_method 0 2026-02-24T19:17:28.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.624+0000 7f4db6ffd640 10 client.4462.objecter ms_handle_connect 0x7f4da0077d70 2026-02-24T19:17:28.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.625+0000 7ff11bfff640 1 -- 10.20.193.14:0/1755338058 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff1400b64c0 con 0x7ff1400b9f80 2026-02-24T19:17:28.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.625+0000 7ff11bfff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.625+0000 7ff11bfff640 1 -- 10.20.193.14:0/1755338058 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ff130003700 con 0x7ff1400b9f80 2026-02-24T19:17:28.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.625+0000 7ff11bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.625+0000 7ff11bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:28.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.625+0000 7ff11bfff640 10 monclient: dump: 2026-02-24T19:17:28.649 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.649 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.650 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.650 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.650 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.650 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.650 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.650 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.650 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.650 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.625+0000 7ff13dffb640 4 set_mon_vals no callback set 2026-02-24T19:17:28.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.625+0000 7f4db6ffd640 1 -- 10.20.193.14:0/4093622326 <== mon.1 v1:10.20.193.44:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7f4dcc0932b0 con 0x7f4dd00ba350 2026-02-24T19:17:28.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.625+0000 7f4db6ffd640 10 client.4462.objecter ms_dispatch2 0x7f4dd0000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:28.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.625+0000 7f4db6ffd640 3 client.4462.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:28.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.625+0000 7f4db6ffd640 3 client.4462.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:28.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.626+0000 7f4db6ffd640 10 client.4462.objecter checking command 1 2026-02-24T19:17:28.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.626+0000 7ff11bfff640 1 -- 10.20.193.14:0/1755338058 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7ff13001c5b0 con 0x7ff1400b9f80 2026-02-24T19:17:28.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.626+0000 7f4db6ffd640 20 client.4462.objecter _get_session s=0x7f4da00a0c50 osd=5 3 2026-02-24T19:17:28.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.626+0000 7f4db6ffd640 20 client.4462.objecter put_session s=0x7f4da00a0c50 osd=5 3 2026-02-24T19:17:28.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.626+0000 7f4db6ffd640 15 client.4462.objecter _session_command_op_remove -1 1 2026-02-24T19:17:28.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.626+0000 7f4db6ffd640 20 client.4462.objecter _get_session s=0x7f4da00a0c50 osd=5 3 2026-02-24T19:17:28.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.626+0000 7f4db6ffd640 20 client.4462.objecter get_session s=0x7f4da00a0c50 osd=5 3 2026-02-24T19:17:28.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.626+0000 7f4db6ffd640 15 client.4462.objecter _session_command_op_assign 5 1 2026-02-24T19:17:28.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.626+0000 7f4db6ffd640 20 client.4462.objecter put_session s=0x7f4da00a0c50 osd=5 4 2026-02-24T19:17:28.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.626+0000 7f4db6ffd640 10 client.4462.objecter _send_command 1 2026-02-24T19:17:28.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.626+0000 7f4db6ffd640 1 -- 10.20.193.14:0/4093622326 --> v1:10.20.193.44:6811/2261252351 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4da00c2f00 con 0x7f4da00a1300 2026-02-24T19:17:28.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.626+0000 7f4db6ffd640 20 client.4462.objecter dump_active .. 0 homeless 2026-02-24T19:17:28.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.626+0000 7f4dd5b37640 10 monclient: get_auth_request con 0x7f4da00a1300 auth_method 0 2026-02-24T19:17:28.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.626+0000 7ff13f7fe640 10 monclient: get_auth_request con 0x7ff110077ec0 auth_method 0 2026-02-24T19:17:28.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.626+0000 7ff11bfff640 10 client.4457.objecter ms_handle_connect 0x7ff110077ec0 2026-02-24T19:17:28.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.627+0000 7f56c77fe640 1 -- 10.20.193.14:0/1171845697 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f56e8164970 con 0x7f56e8157780 2026-02-24T19:17:28.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.627+0000 7f56c77fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.627+0000 7f56c77fe640 1 -- 10.20.193.14:0/1171845697 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f56dc0039b0 con 0x7f56e8157780 2026-02-24T19:17:28.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.627+0000 7f56c77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.627+0000 7f56e5573640 4 set_mon_vals no callback set 2026-02-24T19:17:28.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.627+0000 7f56c77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.627+0000 7f56c77fe640 10 monclient: dump: 2026-02-24T19:17:28.651 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.651 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.651 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.651 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.651 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.651 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.651 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.651 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.651 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.651 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.627+0000 7f4db6ffd640 1 -- 10.20.193.14:0/4093622326 <== mon.1 v1:10.20.193.44:6789/0 9 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (unknown 3108795433 0 0) 0x7f4dcc059950 con 0x7f4dd00ba350 2026-02-24T19:17:28.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.627+0000 7f4db6ffd640 10 monclient: handle_get_version_reply finishing 1 version 31 2026-02-24T19:17:28.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.627+0000 7f56c77fe640 1 -- 10.20.193.14:0/1171845697 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f56dc003b90 con 0x7f56e8157780 2026-02-24T19:17:28.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.627+0000 7f4db6ffd640 10 client.4462.objecter ms_handle_connect 0x7f4da00a1300 2026-02-24T19:17:28.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.628+0000 7f56e6575640 10 monclient: get_auth_request con 0x7f56b4077ef0 auth_method 0 2026-02-24T19:17:28.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.628+0000 7f56c77fe640 10 client.4458.objecter ms_handle_connect 0x7f56b4077ef0 2026-02-24T19:17:28.652 INFO:teuthology.orchestra.run.trial014.stdout:90194313220 2026-02-24T19:17:28.652 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-24T19:17:28.652 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.629+0000 7ff11bfff640 1 -- 10.20.193.14:0/1755338058 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7ff130091d40 con 0x7ff1400b9f80 2026-02-24T19:17:28.652 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.629+0000 7ff11bfff640 10 client.4457.objecter ms_dispatch2 0x7ff140000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:28.652 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.629+0000 7ff11bfff640 3 client.4457.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:28.652 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.629+0000 7ff11bfff640 3 client.4457.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:28.652 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.629+0000 7ff11bfff640 10 client.4457.objecter checking command 1 2026-02-24T19:17:28.652 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.629+0000 7ff11bfff640 20 client.4457.objecter _get_session s=0x7ff1100a0d40 osd=0 3 2026-02-24T19:17:28.652 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.629+0000 7ff11bfff640 20 client.4457.objecter put_session s=0x7ff1100a0d40 osd=0 3 2026-02-24T19:17:28.652 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.629+0000 7ff11bfff640 15 client.4457.objecter _session_command_op_remove -1 1 2026-02-24T19:17:28.652 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.629+0000 7ff11bfff640 20 client.4457.objecter _get_session s=0x7ff1100a0d40 osd=0 3 2026-02-24T19:17:28.652 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.629+0000 7ff11bfff640 20 client.4457.objecter get_session s=0x7ff1100a0d40 osd=0 3 2026-02-24T19:17:28.652 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.629+0000 7ff11bfff640 15 client.4457.objecter _session_command_op_assign 0 1 2026-02-24T19:17:28.652 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.629+0000 7ff11bfff640 20 client.4457.objecter put_session s=0x7ff1100a0d40 osd=0 4 2026-02-24T19:17:28.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.629+0000 7ff11bfff640 10 client.4457.objecter _send_command 1 2026-02-24T19:17:28.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.629+0000 7ff11bfff640 1 -- 10.20.193.14:0/1755338058 --> v1:10.20.193.14:6806/3263337386 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff1100c2ff0 con 0x7ff1100a13f0 2026-02-24T19:17:28.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.629+0000 7ff11bfff640 20 client.4457.objecter dump_active .. 0 homeless 2026-02-24T19:17:28.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.629+0000 7ff11bfff640 1 -- 10.20.193.14:0/1755338058 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (unknown 3108795433 0 0) 0x7ff13005be40 con 0x7ff1400b9f80 2026-02-24T19:17:28.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.629+0000 7ff11bfff640 10 monclient: handle_get_version_reply finishing 1 version 31 2026-02-24T19:17:28.653 INFO:teuthology.orchestra.run.trial014.stdout:90194313221 2026-02-24T19:17:28.653 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-24T19:17:28.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.630+0000 7ff13ffff640 10 monclient: get_auth_request con 0x7ff1100a13f0 auth_method 0 2026-02-24T19:17:28.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.630+0000 7f56c77fe640 1 -- 10.20.193.14:0/1171845697 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7f56dc093080 con 0x7f56e8157780 2026-02-24T19:17:28.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.630+0000 7f56c77fe640 10 client.4458.objecter ms_dispatch2 0x7f56e8000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:28.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.630+0000 7f56c77fe640 3 client.4458.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:28.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.630+0000 7f56c77fe640 3 client.4458.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:28.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.630+0000 7f56c77fe640 10 client.4458.objecter checking command 1 2026-02-24T19:17:28.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.630+0000 7f56c77fe640 20 client.4458.objecter _get_session s=0x7f56b40a0d70 osd=1 3 2026-02-24T19:17:28.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.630+0000 7f56c77fe640 20 client.4458.objecter put_session s=0x7f56b40a0d70 osd=1 3 2026-02-24T19:17:28.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.630+0000 7f56c77fe640 15 client.4458.objecter _session_command_op_remove -1 1 2026-02-24T19:17:28.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.630+0000 7f56c77fe640 20 client.4458.objecter _get_session s=0x7f56b40a0d70 osd=1 3 2026-02-24T19:17:28.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.630+0000 7f56c77fe640 20 client.4458.objecter get_session s=0x7f56b40a0d70 osd=1 3 2026-02-24T19:17:28.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.630+0000 7f56c77fe640 15 client.4458.objecter _session_command_op_assign 1 1 2026-02-24T19:17:28.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.630+0000 7f56c77fe640 20 client.4458.objecter put_session s=0x7f56b40a0d70 osd=1 4 2026-02-24T19:17:28.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.630+0000 7f56c77fe640 10 client.4458.objecter _send_command 1 2026-02-24T19:17:28.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.630+0000 7f56c77fe640 1 -- 10.20.193.14:0/1171845697 --> v1:10.20.193.44:6804/1955152616 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f56b40c3020 con 0x7f56b40a1420 2026-02-24T19:17:28.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.630+0000 7f56c77fe640 20 client.4458.objecter dump_active .. 0 homeless 2026-02-24T19:17:28.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.630+0000 7f56c77fe640 1 -- 10.20.193.14:0/1171845697 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (unknown 3108795433 0 0) 0x7f56dc059720 con 0x7f56e8157780 2026-02-24T19:17:28.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.630+0000 7f56c77fe640 10 monclient: handle_get_version_reply finishing 1 version 31 2026-02-24T19:17:28.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.631+0000 7f5f62ffd640 1 -- 10.20.193.14:0/2714502469 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3284658010 0 0) 0x7f5f7c1faf30 con 0x7f5f7c058070 2026-02-24T19:17:28.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.631+0000 7f5f62ffd640 1 -- 10.20.193.14:0/2714502469 >> v1:10.20.193.44:6789/0 conn(0x7f5f7c159e40 legacy=0x7f5f7c1fe1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.631+0000 7f5f62ffd640 1 -- 10.20.193.14:0/2714502469 >> v1:10.20.193.14:6789/0 conn(0x7f5f7c159a70 legacy=0x7f5f7c15bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.631+0000 7f5f62ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.631+0000 7f5f62ffd640 1 monclient: found mon.c 2026-02-24T19:17:28.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.631+0000 7f5f62ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.631+0000 7f5f62ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.631+0000 7f5f62ffd640 1 -- 10.20.193.14:0/2714502469 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f7c1fb210 con 0x7f5f7c058070 2026-02-24T19:17:28.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.631+0000 7f5f62ffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.631+0000 7f5f62ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.631+0000 7f56e7577640 10 monclient: get_auth_request con 0x7f56b40a1420 auth_method 0 2026-02-24T19:17:28.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.631+0000 7f5f62ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.631+0000 7f5f80ee8640 5 monclient: authenticate success, global_id 4484 2026-02-24T19:17:28.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.631+0000 7f5f80ee8640 10 monclient: _renew_subs 2026-02-24T19:17:28.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.631+0000 7f5f80ee8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.631+0000 7f5f80ee8640 1 -- 10.20.193.14:0/2714502469 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5f7c1fb4f0 con 0x7f5f7c058070 2026-02-24T19:17:28.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.631+0000 7f5f80ee8640 10 client.4484.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.631+0000 7f5f80ee8640 10 monclient: _renew_subs 2026-02-24T19:17:28.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.631+0000 7f5f80ee8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.631+0000 7f5f80ee8640 1 -- 10.20.193.14:0/2714502469 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5f7c1fbab0 con 0x7f5f7c058070 2026-02-24T19:17:28.655 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.631+0000 7f5f80ee8640 1 librados: init done 2026-02-24T19:17:28.655 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.631+0000 7ff11bfff640 10 client.4457.objecter ms_handle_connect 0x7ff1100a13f0 2026-02-24T19:17:28.655 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.631+0000 7f5f80ee8640 10 client.4484.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.655 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.631+0000 7f5f80ee8640 15 client.4484.objecter _session_command_op_assign -1 1 2026-02-24T19:17:28.655 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.631+0000 7f5f80ee8640 20 client.4484.objecter _get_session osd=-1 returning homeless 2026-02-24T19:17:28.655 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.631+0000 7f5f80ee8640 10 client.4484.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.655 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.631+0000 7f5f80ee8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.655 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.631+0000 7f5f80ee8640 1 -- 10.20.193.14:0/2714502469 --> v1:10.20.193.170:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f5f7c1face0 con 0x7f5f7c058070 2026-02-24T19:17:28.655 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.632+0000 7f56c77fe640 10 client.4458.objecter ms_handle_connect 0x7f56b40a1420 2026-02-24T19:17:28.655 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.635+0000 7fa2867fc640 1 -- 10.20.193.14:0/852388800 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa29813a9d0 con 0x7fa29815deb0 2026-02-24T19:17:28.655 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.635+0000 7fa2867fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.655 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.635+0000 7fa2867fc640 1 -- 10.20.193.14:0/852388800 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fa28c0039b0 con 0x7fa29815deb0 2026-02-24T19:17:28.655 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.635+0000 7fa2867fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.655 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.635+0000 7fa2867fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.655 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.635+0000 7fa2867fc640 10 monclient: dump: 2026-02-24T19:17:28.655 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.655 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.655 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.655 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.655 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.655 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.655 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.655 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.656 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.656 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.656 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.635+0000 7fa287fff640 4 set_mon_vals no callback set 2026-02-24T19:17:28.656 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.636+0000 7fa2867fc640 1 -- 10.20.193.14:0/852388800 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7fa28c003bc0 con 0x7fa29815deb0 2026-02-24T19:17:28.656 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.637+0000 7fa29d811640 10 monclient: get_auth_request con 0x7fa268077d30 auth_method 0 2026-02-24T19:17:28.656 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.637+0000 7fa2867fc640 10 client.4464.objecter ms_handle_connect 0x7fa268077d30 2026-02-24T19:17:28.656 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.637+0000 7fc58effd640 1 -- 10.20.193.14:0/2603662831 <== osd.8 v1:10.20.193.14:6809/1223168292 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fc5740c2e10 con 0x7fc5740a1210 2026-02-24T19:17:28.656 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.637+0000 7fc58effd640 10 client.4450.objecter ms_dispatch2 0x7fc5a4000b90 command_reply(tid 1: 0 ) 2026-02-24T19:17:28.656 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.637+0000 7fc58effd640 10 client.4450.objecter _finish_command 1 = system:0 2026-02-24T19:17:28.656 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.637+0000 7fc58effd640 20 client.4450.objecter put_session s=0x7fc5740a0b60 osd=8 4 2026-02-24T19:17:28.656 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.637+0000 7fc58effd640 15 client.4450.objecter _session_command_op_remove 8 1 2026-02-24T19:17:28.656 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.639+0000 7feed8ff9640 1 -- 10.20.193.14:0/912187155 <== mon.1 v1:10.20.193.44:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feedc0b96a0 con 0x7feedc0b9f80 2026-02-24T19:17:28.656 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.639+0000 7feed8ff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.656 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.639+0000 7feed8ff9640 1 -- 10.20.193.14:0/912187155 <== mon.1 v1:10.20.193.44:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7feecc003700 con 0x7feedc0b9f80 2026-02-24T19:17:28.656 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.639+0000 7feed8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.656 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.639+0000 7feed8ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:28.656 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.639+0000 7feed8ff9640 10 monclient: dump: 2026-02-24T19:17:28.656 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.656 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.656 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.656 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.656 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.656 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.656 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.656 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.656 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.656 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.656 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.639+0000 7feeda7fc640 4 set_mon_vals no callback set 2026-02-24T19:17:28.656 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.639+0000 7f775bfff640 1 -- 10.20.193.14:0/3545456418 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f77800525e0 con 0x7f77801f88c0 2026-02-24T19:17:28.656 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.639+0000 7f775bfff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.639+0000 7f775bfff640 1 -- 10.20.193.14:0/3545456418 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7774003d30 con 0x7f77801f88c0 2026-02-24T19:17:28.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.639+0000 7f775bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.639+0000 7f775bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:28.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.639+0000 7f775bfff640 10 monclient: dump: 2026-02-24T19:17:28.657 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.657 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.657 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.657 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.657 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.657 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.657 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.657 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.657 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.657 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.639+0000 7fa2867fc640 1 -- 10.20.193.14:0/852388800 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7fa28c093180 con 0x7fa29815deb0 2026-02-24T19:17:28.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.639+0000 7fa2867fc640 10 client.4464.objecter ms_dispatch2 0x7fa298000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:28.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.639+0000 7fa2867fc640 3 client.4464.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:28.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.639+0000 7fa2867fc640 3 client.4464.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:28.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.639+0000 7f777dffb640 4 set_mon_vals no callback set 2026-02-24T19:17:28.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.639+0000 7fa2867fc640 10 client.4464.objecter checking command 1 2026-02-24T19:17:28.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.639+0000 7fa2867fc640 20 client.4464.objecter _get_session s=0x7fa2680a0bb0 osd=2 3 2026-02-24T19:17:28.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.639+0000 7fa2867fc640 20 client.4464.objecter put_session s=0x7fa2680a0bb0 osd=2 3 2026-02-24T19:17:28.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.639+0000 7fa2867fc640 15 client.4464.objecter _session_command_op_remove -1 1 2026-02-24T19:17:28.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.639+0000 7fa2867fc640 20 client.4464.objecter _get_session s=0x7fa2680a0bb0 osd=2 3 2026-02-24T19:17:28.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.639+0000 7fa2867fc640 20 client.4464.objecter get_session s=0x7fa2680a0bb0 osd=2 3 2026-02-24T19:17:28.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.639+0000 7fa2867fc640 15 client.4464.objecter _session_command_op_assign 2 1 2026-02-24T19:17:28.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.639+0000 7fa2867fc640 20 client.4464.objecter put_session s=0x7fa2680a0bb0 osd=2 4 2026-02-24T19:17:28.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.639+0000 7fa2867fc640 10 client.4464.objecter _send_command 1 2026-02-24T19:17:28.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.639+0000 7fa2867fc640 1 -- 10.20.193.14:0/852388800 --> v1:10.20.193.170:6804/993713135 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa2680c2e60 con 0x7fa2680a1260 2026-02-24T19:17:28.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.639+0000 7fa2867fc640 20 client.4464.objecter dump_active .. 0 homeless 2026-02-24T19:17:28.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.639+0000 7fa2867fc640 1 -- 10.20.193.14:0/852388800 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (unknown 3108795433 0 0) 0x7fa28c059820 con 0x7fa29815deb0 2026-02-24T19:17:28.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.639+0000 7fa2867fc640 10 monclient: handle_get_version_reply finishing 1 version 31 2026-02-24T19:17:28.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.639+0000 7feed8ff9640 1 -- 10.20.193.14:0/912187155 <== mon.1 v1:10.20.193.44:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7feecc01c5b0 con 0x7feedc0b9f80 2026-02-24T19:17:28.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.639+0000 7fa29e012640 10 monclient: get_auth_request con 0x7fa2680a1260 auth_method 0 2026-02-24T19:17:28.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.640+0000 7f595a7fc640 1 -- 10.20.193.14:0/2765925491 <== osd.15 v1:10.20.193.195:6809/3316970219 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f593c0c3060 con 0x7f593c0a1460 2026-02-24T19:17:28.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.640+0000 7f595a7fc640 10 client.4452.objecter ms_dispatch2 0x7f596c000b90 command_reply(tid 1: 0 ) 2026-02-24T19:17:28.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.640+0000 7f595a7fc640 10 client.4452.objecter _finish_command 1 = system:0 2026-02-24T19:17:28.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.640+0000 7f595a7fc640 20 client.4452.objecter put_session s=0x7f593c0a0db0 osd=15 4 2026-02-24T19:17:28.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.640+0000 7f595a7fc640 15 client.4452.objecter _session_command_op_remove 15 1 2026-02-24T19:17:28.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.640+0000 7feedbfff640 10 monclient: get_auth_request con 0x7feeac077d20 auth_method 0 2026-02-24T19:17:28.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.640+0000 7f775bfff640 1 -- 10.20.193.14:0/3545456418 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f7774003f40 con 0x7f77801f88c0 2026-02-24T19:17:28.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.640+0000 7feed8ff9640 10 client.4459.objecter ms_handle_connect 0x7feeac077d20 2026-02-24T19:17:28.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.640+0000 7f4eb5ffb640 1 -- 10.20.193.14:0/1929189111 <== osd.11 v1:10.20.193.195:6804/2798179318 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f4e980c2ef0 con 0x7f4e980a12f0 2026-02-24T19:17:28.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.640+0000 7f4eb5ffb640 10 client.4451.objecter ms_dispatch2 0x7f4ec8000b90 command_reply(tid 1: 0 ) 2026-02-24T19:17:28.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.640+0000 7f4eb5ffb640 10 client.4451.objecter _finish_command 1 = system:0 2026-02-24T19:17:28.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.640+0000 7f4eb5ffb640 20 client.4451.objecter put_session s=0x7f4e980a0c40 osd=11 4 2026-02-24T19:17:28.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.640+0000 7f4eb5ffb640 15 client.4451.objecter _session_command_op_remove 11 1 2026-02-24T19:17:28.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.640+0000 7fa2867fc640 10 client.4464.objecter ms_handle_connect 0x7fa2680a1260 2026-02-24T19:17:28.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.640+0000 7f777f7fe640 10 monclient: get_auth_request con 0x7f7750077fb0 auth_method 0 2026-02-24T19:17:28.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.641+0000 7f775bfff640 10 client.4454.objecter ms_handle_connect 0x7f7750077fb0 2026-02-24T19:17:28.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.641+0000 7f48a37fe640 1 -- 10.20.193.14:0/3396094211 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 704466431 0 0) 0x7f48c40b30c0 con 0x7f48c405a240 2026-02-24T19:17:28.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.641+0000 7f48a37fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.641+0000 7f48a37fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.641+0000 7f48a37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.641+0000 7f48a37fe640 10 monclient(hunting): my global_id is 4485 2026-02-24T19:17:28.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.641+0000 7f48a37fe640 1 -- 10.20.193.14:0/3396094211 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4890003610 con 0x7f48c405a240 2026-02-24T19:17:28.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.642+0000 7f775bfff640 1 -- 10.20.193.14:0/3545456418 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7f7774003d30 con 0x7f77801f88c0 2026-02-24T19:17:28.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.642+0000 7f775bfff640 10 client.4454.objecter ms_dispatch2 0x7f7780000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:28.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.642+0000 7f775bfff640 3 client.4454.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:28.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.642+0000 7f775bfff640 3 client.4454.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:28.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.642+0000 7f775bfff640 10 client.4454.objecter checking command 1 2026-02-24T19:17:28.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.642+0000 7f775bfff640 20 client.4454.objecter _get_session s=0x7f77500a0e30 osd=9 3 2026-02-24T19:17:28.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.642+0000 7f775bfff640 20 client.4454.objecter put_session s=0x7f77500a0e30 osd=9 3 2026-02-24T19:17:28.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.642+0000 7f775bfff640 15 client.4454.objecter _session_command_op_remove -1 1 2026-02-24T19:17:28.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.642+0000 7f775bfff640 20 client.4454.objecter _get_session s=0x7f77500a0e30 osd=9 3 2026-02-24T19:17:28.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.642+0000 7f775bfff640 20 client.4454.objecter get_session s=0x7f77500a0e30 osd=9 3 2026-02-24T19:17:28.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.642+0000 7f775bfff640 15 client.4454.objecter _session_command_op_assign 9 1 2026-02-24T19:17:28.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.642+0000 7f775bfff640 20 client.4454.objecter put_session s=0x7f77500a0e30 osd=9 4 2026-02-24T19:17:28.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.642+0000 7f775bfff640 10 client.4454.objecter _send_command 1 2026-02-24T19:17:28.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.642+0000 7f775bfff640 1 -- 10.20.193.14:0/3545456418 --> v1:10.20.193.44:6808/4259724385 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f77500c30e0 con 0x7f77500a14e0 2026-02-24T19:17:28.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.642+0000 7f775bfff640 20 client.4454.objecter dump_active .. 0 homeless 2026-02-24T19:17:28.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.642+0000 7f775bfff640 1 -- 10.20.193.14:0/3545456418 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (unknown 3108795433 0 0) 0x7f7774059aa0 con 0x7f77801f88c0 2026-02-24T19:17:28.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.642+0000 7f775bfff640 10 monclient: handle_get_version_reply finishing 1 version 31 2026-02-24T19:17:28.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.642+0000 7f82ea7fc640 1 -- 10.20.193.14:0/897198496 <== mon.1 v1:10.20.193.44:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f82fc0b64c0 con 0x7f82fc0b9f80 2026-02-24T19:17:28.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.642+0000 7f82ea7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.642+0000 7f82ea7fc640 1 -- 10.20.193.14:0/897198496 <== mon.1 v1:10.20.193.44:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f82f0002f70 con 0x7f82fc0b9f80 2026-02-24T19:17:28.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.642+0000 7f82ea7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.642+0000 7f82ea7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:28.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.642+0000 7f82ea7fc640 10 monclient: dump: 2026-02-24T19:17:28.660 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.660 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.660 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.660 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.660 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.660 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.660 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.660 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.660 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.660 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.642+0000 7f82ebfff640 4 set_mon_vals no callback set 2026-02-24T19:17:28.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.643+0000 7f777effd640 10 monclient: get_auth_request con 0x7f77500a14e0 auth_method 0 2026-02-24T19:17:28.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.643+0000 7fab357fa640 1 -- 10.20.193.14:0/2139916363 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4001450223 0 0) 0x7fab401fb730 con 0x7fab400b9f80 2026-02-24T19:17:28.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.643+0000 7fab357fa640 1 -- 10.20.193.14:0/2139916363 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fab40159ea0 con 0x7fab400b9f80 2026-02-24T19:17:28.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.643+0000 7fab357fa640 1 -- 10.20.193.14:0/2139916363 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fab28003190 con 0x7fab400b9f80 2026-02-24T19:17:28.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.643+0000 7fab357fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.643+0000 7fab357fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.643+0000 7fab357fa640 10 monclient(hunting): dump: 2026-02-24T19:17:28.660 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.660 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.661 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.661 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.661 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.661 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.661 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.661 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.661 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.661 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.661 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.643+0000 7f82ea7fc640 1 -- 10.20.193.14:0/897198496 <== mon.1 v1:10.20.193.44:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f82f001d850 con 0x7f82fc0b9f80 2026-02-24T19:17:28.661 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.643+0000 7fdcebfff640 1 -- 10.20.193.14:0/1366958924 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3711610156 0 0) 0x7fdd101fe890 con 0x7fdd10058070 2026-02-24T19:17:28.661 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.644+0000 7fdcebfff640 1 -- 10.20.193.14:0/1366958924 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdd101feb70 con 0x7fdd10058070 2026-02-24T19:17:28.661 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.644+0000 7fdcebfff640 1 -- 10.20.193.14:0/1366958924 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fdcfc0030d0 con 0x7fdd10058070 2026-02-24T19:17:28.661 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.644+0000 7fdcebfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.661 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.644+0000 7fdcebfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.661 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.644+0000 7fdcebfff640 10 monclient(hunting): dump: 2026-02-24T19:17:28.661 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.661 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.661 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.661 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.661 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.661 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.661 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.661 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.661 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.661 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.661 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.644+0000 7f8301a1b640 10 monclient: get_auth_request con 0x7f82cc077ca0 auth_method 0 2026-02-24T19:17:28.661 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.644+0000 7f82ea7fc640 10 client.4468.objecter ms_handle_connect 0x7f82cc077ca0 2026-02-24T19:17:28.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.644+0000 7f775bfff640 10 client.4454.objecter ms_handle_connect 0x7f77500a14e0 2026-02-24T19:17:28.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.645+0000 7feed8ff9640 1 -- 10.20.193.14:0/912187155 <== mon.1 v1:10.20.193.44:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7feecc091f20 con 0x7feedc0b9f80 2026-02-24T19:17:28.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.645+0000 7feed8ff9640 10 client.4459.objecter ms_dispatch2 0x7feedc000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:28.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.645+0000 7feed8ff9640 3 client.4459.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:28.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.645+0000 7feed8ff9640 3 client.4459.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:28.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.646+0000 7feed8ff9640 10 client.4459.objecter checking command 1 2026-02-24T19:17:28.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.646+0000 7feed8ff9640 20 client.4459.objecter _get_session s=0x7feeac0a0ba0 osd=14 3 2026-02-24T19:17:28.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.646+0000 7feed8ff9640 20 client.4459.objecter put_session s=0x7feeac0a0ba0 osd=14 3 2026-02-24T19:17:28.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.646+0000 7feed8ff9640 15 client.4459.objecter _session_command_op_remove -1 1 2026-02-24T19:17:28.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.646+0000 7feed8ff9640 20 client.4459.objecter _get_session s=0x7feeac0a0ba0 osd=14 3 2026-02-24T19:17:28.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.646+0000 7feed8ff9640 20 client.4459.objecter get_session s=0x7feeac0a0ba0 osd=14 3 2026-02-24T19:17:28.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.646+0000 7feed8ff9640 15 client.4459.objecter _session_command_op_assign 14 1 2026-02-24T19:17:28.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.646+0000 7feed8ff9640 20 client.4459.objecter put_session s=0x7feeac0a0ba0 osd=14 4 2026-02-24T19:17:28.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.646+0000 7feed8ff9640 10 client.4459.objecter _send_command 1 2026-02-24T19:17:28.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.646+0000 7feed8ff9640 1 -- 10.20.193.14:0/912187155 --> v1:10.20.193.170:6809/2177297767 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feeac0c2e50 con 0x7feeac0a1250 2026-02-24T19:17:28.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.646+0000 7feed8ff9640 20 client.4459.objecter dump_active .. 0 homeless 2026-02-24T19:17:28.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.646+0000 7feee0a15640 10 monclient: get_auth_request con 0x7feeac0a1250 auth_method 0 2026-02-24T19:17:28.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fab357fa640 1 -- 10.20.193.14:0/2139916363 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2903251987 0 0) 0x7fab401fb450 con 0x7fab400585e0 2026-02-24T19:17:28.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fab357fa640 1 -- 10.20.193.14:0/2139916363 >> v1:10.20.193.44:6789/0 conn(0x7fab400ba350 legacy=0x7fab40160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fab357fa640 1 -- 10.20.193.14:0/2139916363 >> v1:10.20.193.14:6789/0 conn(0x7fab400b9f80 legacy=0x7fab4015daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fab357fa640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fab357fa640 1 monclient: found mon.c 2026-02-24T19:17:28.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fab357fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fab357fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fab357fa640 1 -- 10.20.193.14:0/2139916363 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab401fba10 con 0x7fab400585e0 2026-02-24T19:17:28.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fab357fa640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fab357fa640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fab357fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fab46cd8640 5 monclient: authenticate success, global_id 4469 2026-02-24T19:17:28.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fab46cd8640 10 monclient: _renew_subs 2026-02-24T19:17:28.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fab46cd8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fab46cd8640 1 -- 10.20.193.14:0/2139916363 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fab401fbcf0 con 0x7fab400585e0 2026-02-24T19:17:28.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fab46cd8640 10 client.4469.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fab46cd8640 10 monclient: _renew_subs 2026-02-24T19:17:28.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fab46cd8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fab46cd8640 1 -- 10.20.193.14:0/2139916363 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fab4015faf0 con 0x7fab400585e0 2026-02-24T19:17:28.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fab46cd8640 1 librados: init done 2026-02-24T19:17:28.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fc5ac955640 10 client.4450.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:17:28.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fc5ac955640 15 client.4450.objecter _session_command_op_assign -1 2 2026-02-24T19:17:28.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fc5ac955640 20 client.4450.objecter _get_session s=0x7fc5740a0b60 osd=8 3 2026-02-24T19:17:28.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fc5ac955640 20 client.4450.objecter put_session s=0x7fc5740a0b60 osd=8 3 2026-02-24T19:17:28.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fc5ac955640 20 client.4450.objecter _get_session s=0x7fc5740a0b60 osd=8 3 2026-02-24T19:17:28.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fc5ac955640 15 client.4450.objecter _session_command_op_remove -1 2 2026-02-24T19:17:28.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fc5ac955640 20 client.4450.objecter get_session s=0x7fc5740a0b60 osd=8 3 2026-02-24T19:17:28.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fc5ac955640 15 client.4450.objecter _session_command_op_assign 8 2 2026-02-24T19:17:28.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fc5ac955640 20 client.4450.objecter put_session s=0x7fc5740a0b60 osd=8 4 2026-02-24T19:17:28.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fc5ac955640 10 client.4450.objecter _send_command 2 2026-02-24T19:17:28.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fc5ac955640 1 -- 10.20.193.14:0/2603662831 --> v1:10.20.193.14:6809/1223168292 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc5a40b6950 con 0x7fc5740a1210 2026-02-24T19:17:28.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fab46cd8640 10 client.4469.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fab46cd8640 15 client.4469.objecter _session_command_op_assign -1 1 2026-02-24T19:17:28.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fab46cd8640 20 client.4469.objecter _get_session osd=-1 returning homeless 2026-02-24T19:17:28.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fab46cd8640 10 client.4469.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fab46cd8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fab46cd8640 1 -- 10.20.193.14:0/2139916363 --> v1:10.20.193.170:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fab40157dc0 con 0x7fab400585e0 2026-02-24T19:17:28.664 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7feed8ff9640 1 -- 10.20.193.14:0/912187155 <== mon.1 v1:10.20.193.44:6789/0 9 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (unknown 3108795433 0 0) 0x7feecc05c020 con 0x7feedc0b9f80 2026-02-24T19:17:28.664 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7feed8ff9640 10 monclient: handle_get_version_reply finishing 1 version 31 2026-02-24T19:17:28.664 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7f48a37fe640 1 -- 10.20.193.14:0/3396094211 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1221906683 0 0) 0x7f48c41f9260 con 0x7f48c4059e70 2026-02-24T19:17:28.664 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7f48a37fe640 1 -- 10.20.193.14:0/3396094211 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f48c40b30c0 con 0x7f48c4059e70 2026-02-24T19:17:28.664 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7f48a37fe640 1 -- 10.20.193.14:0/3396094211 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f48ac003350 con 0x7f48c4059e70 2026-02-24T19:17:28.664 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7f48a37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.664 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7f48a37fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:28.664 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7f48a37fe640 10 monclient(hunting): dump: 2026-02-24T19:17:28.664 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.664 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.664 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.664 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.664 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.664 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.664 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.664 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.664 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.664 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.664 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7f48a37fe640 1 -- 10.20.193.14:0/3396094211 <== mon.1 v1:10.20.193.44:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1779350458 0 0) 0x7f48c41f9540 con 0x7f48c4058580 2026-02-24T19:17:28.664 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7f48a37fe640 1 -- 10.20.193.14:0/3396094211 >> v1:10.20.193.170:6789/0 conn(0x7f48c4059e70 legacy=0x7f48c4134eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.664 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7f48a37fe640 1 -- 10.20.193.14:0/3396094211 >> v1:10.20.193.14:6789/0 conn(0x7f48c405a240 legacy=0x7f48c40b29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.664 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7f48a37fe640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.664 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7f48a37fe640 1 monclient: found mon.b 2026-02-24T19:17:28.664 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7f48a37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.664 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7f48a37fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.664 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7f48a37fe640 1 -- 10.20.193.14:0/3396094211 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48c41f9820 con 0x7f48c4058580 2026-02-24T19:17:28.664 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7f48a37fe640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.664 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7f48a37fe640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.664 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7f48a37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.665 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7f48c915c640 5 monclient: authenticate success, global_id 4480 2026-02-24T19:17:28.665 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7f48c915c640 10 monclient: _renew_subs 2026-02-24T19:17:28.665 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7f48c915c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.665 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7f48c915c640 1 -- 10.20.193.14:0/3396094211 --> v1:10.20.193.44:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f48c41346b0 con 0x7f48c4058580 2026-02-24T19:17:28.665 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fdcebfff640 1 -- 10.20.193.14:0/1366958924 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4097914290 0 0) 0x7fdce0003610 con 0x7fdd10159a70 2026-02-24T19:17:28.665 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fdcebfff640 1 -- 10.20.193.14:0/1366958924 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdd101fe890 con 0x7fdd10159a70 2026-02-24T19:17:28.665 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fdcebfff640 1 -- 10.20.193.14:0/1366958924 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fdd00003310 con 0x7fdd10159a70 2026-02-24T19:17:28.665 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fdcebfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.665 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fdcebfff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:28.665 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.647+0000 7fdcebfff640 10 monclient(hunting): dump: 2026-02-24T19:17:28.665 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.665 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.665 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.665 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.665 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.665 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.665 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.665 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.665 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.665 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.665 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.648+0000 7f48c915c640 10 client.4480.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.665 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.648+0000 7f48c915c640 10 monclient: _renew_subs 2026-02-24T19:17:28.665 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.648+0000 7f48c915c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.665 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.648+0000 7f48c915c640 1 -- 10.20.193.14:0/3396094211 --> v1:10.20.193.44:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f48c4137bc0 con 0x7f48c4058580 2026-02-24T19:17:28.665 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.648+0000 7f48c915c640 1 librados: init done 2026-02-24T19:17:28.665 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.648+0000 7f5973d45640 10 client.4452.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:17:28.665 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.648+0000 7f5973d45640 15 client.4452.objecter _session_command_op_assign -1 2 2026-02-24T19:17:28.666 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.648+0000 7f5973d45640 20 client.4452.objecter _get_session s=0x7f593c0a0db0 osd=15 3 2026-02-24T19:17:28.666 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.648+0000 7f5973d45640 20 client.4452.objecter put_session s=0x7f593c0a0db0 osd=15 3 2026-02-24T19:17:28.666 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.648+0000 7f5973d45640 20 client.4452.objecter _get_session s=0x7f593c0a0db0 osd=15 3 2026-02-24T19:17:28.666 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.648+0000 7f5973d45640 15 client.4452.objecter _session_command_op_remove -1 2 2026-02-24T19:17:28.666 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.648+0000 7f5973d45640 20 client.4452.objecter get_session s=0x7f593c0a0db0 osd=15 3 2026-02-24T19:17:28.666 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.648+0000 7f5973d45640 15 client.4452.objecter _session_command_op_assign 15 2 2026-02-24T19:17:28.666 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.648+0000 7f5973d45640 20 client.4452.objecter put_session s=0x7f593c0a0db0 osd=15 4 2026-02-24T19:17:28.666 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.648+0000 7f5973d45640 10 client.4452.objecter _send_command 2 2026-02-24T19:17:28.666 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.648+0000 7f5973d45640 1 -- 10.20.193.14:0/2765925491 --> v1:10.20.193.195:6809/3316970219 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f596c157dc0 con 0x7f593c0a1460 2026-02-24T19:17:28.666 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.648+0000 7feed8ff9640 10 client.4459.objecter ms_handle_connect 0x7feeac0a1250 2026-02-24T19:17:28.666 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.648+0000 7f48c915c640 10 client.4480.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.666 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.648+0000 7f48c915c640 15 client.4480.objecter _session_command_op_assign -1 1 2026-02-24T19:17:28.666 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.648+0000 7f48c915c640 20 client.4480.objecter _get_session osd=-1 returning homeless 2026-02-24T19:17:28.666 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.648+0000 7f48c915c640 10 client.4480.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.666 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.648+0000 7f48c915c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.666 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.648+0000 7f48c915c640 1 -- 10.20.193.14:0/3396094211 --> v1:10.20.193.44:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f48c4060200 con 0x7f48c4058580 2026-02-24T19:17:28.666 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.649+0000 7f4ecf88b640 10 client.4451.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:17:28.666 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.649+0000 7f4ecf88b640 15 client.4451.objecter _session_command_op_assign -1 2 2026-02-24T19:17:28.666 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.649+0000 7f4ecf88b640 20 client.4451.objecter _get_session s=0x7f4e980a0c40 osd=11 3 2026-02-24T19:17:28.666 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.649+0000 7f4ecf88b640 20 client.4451.objecter put_session s=0x7f4e980a0c40 osd=11 3 2026-02-24T19:17:28.666 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.649+0000 7f4ecf88b640 20 client.4451.objecter _get_session s=0x7f4e980a0c40 osd=11 3 2026-02-24T19:17:28.666 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.649+0000 7f4ecf88b640 15 client.4451.objecter _session_command_op_remove -1 2 2026-02-24T19:17:28.666 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.649+0000 7f4ecf88b640 20 client.4451.objecter get_session s=0x7f4e980a0c40 osd=11 3 2026-02-24T19:17:28.666 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.649+0000 7f4ecf88b640 15 client.4451.objecter _session_command_op_assign 11 2 2026-02-24T19:17:28.666 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.649+0000 7f4ecf88b640 20 client.4451.objecter put_session s=0x7f4e980a0c40 osd=11 4 2026-02-24T19:17:28.666 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.649+0000 7f4ecf88b640 10 client.4451.objecter _send_command 2 2026-02-24T19:17:28.666 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.649+0000 7f4ecf88b640 1 -- 10.20.193.14:0/1929189111 --> v1:10.20.193.195:6804/2798179318 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4ec813b760 con 0x7f4e980a12f0 2026-02-24T19:17:28.666 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.649+0000 7fc58effd640 1 -- 10.20.193.14:0/2603662831 <== osd.8 v1:10.20.193.14:6809/1223168292 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7fc5a40b6950 con 0x7fc5740a1210 2026-02-24T19:17:28.666 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.649+0000 7fc58effd640 10 client.4450.objecter ms_dispatch2 0x7fc5a4000b90 command_reply(tid 2: 0 ) 2026-02-24T19:17:28.666 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.649+0000 7fc58effd640 10 client.4450.objecter _finish_command 2 = system:0 2026-02-24T19:17:28.666 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.649+0000 7fc58effd640 20 client.4450.objecter put_session s=0x7fc5740a0b60 osd=8 4 2026-02-24T19:17:28.667 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.649+0000 7fc58effd640 15 client.4450.objecter _session_command_op_remove 8 2 2026-02-24T19:17:28.667 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.650+0000 7fc5ac955640 10 librados: watch_flush enter 2026-02-24T19:17:28.667 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.650+0000 7fc5ac955640 10 librados: watch_flush exit 2026-02-24T19:17:28.667 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.650+0000 7fc5ac955640 10 client.4450.objecter close_session for osd.8 2026-02-24T19:17:28.667 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.650+0000 7fc5ac955640 1 -- 10.20.193.14:0/2603662831 >> v1:10.20.193.14:6809/1223168292 conn(0x7fc5740a1210 legacy=0x7fc5740c1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.667 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.650+0000 7fc5ac955640 20 client.4450.objecter put_session s=0x7fc5740a0b60 osd=8 1 2026-02-24T19:17:28.667 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.650+0000 7fc5ac955640 20 client.4450.objecter shutdown clearing up homeless session... 2026-02-24T19:17:28.667 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.650+0000 7fc5ac955640 10 client.4450.objecter successfully canceled tick 2026-02-24T19:17:28.667 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.650+0000 7fc5ac955640 1 -- 10.20.193.14:0/2603662831 >> v1:10.20.193.14:6800/4014096310 conn(0x7fc574077ce0 legacy=0x7fc574098190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.667 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.650+0000 7fc5ac955640 10 monclient: shutdown 2026-02-24T19:17:28.667 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.650+0000 7fc5ac955640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.667 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.650+0000 7fc5ac955640 1 -- 10.20.193.14:0/2603662831 >> v1:10.20.193.44:6789/0 conn(0x7fc5a415b350 legacy=0x7fc5a40b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.667 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.650+0000 7fc5aaecb640 1 -- 10.20.193.14:0/2603662831 reap_dead start 2026-02-24T19:17:28.667 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.650+0000 7fc5ac955640 1 -- 10.20.193.14:0/2603662831 shutdown_connections 2026-02-24T19:17:28.667 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.650+0000 7fc5ac955640 1 -- 10.20.193.14:0/2603662831 >> 10.20.193.14:0/2603662831 conn(0x7fc5a40b5270 msgr2=0x7fc5a41618b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.667 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.650+0000 7fc5ac955640 1 -- 10.20.193.14:0/2603662831 shutdown_connections 2026-02-24T19:17:28.667 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.650+0000 7fc5ac955640 1 -- 10.20.193.14:0/2603662831 wait complete. 2026-02-24T19:17:28.667 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.650+0000 7fc5ac955640 1 librados: shutdown 2026-02-24T19:17:28.667 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.650+0000 7f4db6ffd640 1 -- 10.20.193.14:0/4093622326 <== osd.5 v1:10.20.193.44:6811/2261252351 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f4da00c2f00 con 0x7f4da00a1300 2026-02-24T19:17:28.667 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.650+0000 7f4db6ffd640 10 client.4462.objecter ms_dispatch2 0x7f4dd0000b90 command_reply(tid 1: 0 ) 2026-02-24T19:17:28.667 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.650+0000 7f4db6ffd640 10 client.4462.objecter _finish_command 1 = system:0 2026-02-24T19:17:28.667 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.650+0000 7f4db6ffd640 20 client.4462.objecter put_session s=0x7f4da00a0c50 osd=5 4 2026-02-24T19:17:28.668 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.650+0000 7f4db6ffd640 15 client.4462.objecter _session_command_op_remove 5 1 2026-02-24T19:17:28.668 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f82ea7fc640 1 -- 10.20.193.14:0/897198496 <== mon.1 v1:10.20.193.44:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7f82f0093080 con 0x7f82fc0b9f80 2026-02-24T19:17:28.668 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f82ea7fc640 10 client.4468.objecter ms_dispatch2 0x7f82fc000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:28.668 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f82ea7fc640 3 client.4468.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:28.668 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f82ea7fc640 3 client.4468.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:28.668 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f82ea7fc640 10 client.4468.objecter checking command 1 2026-02-24T19:17:28.668 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f82ea7fc640 20 client.4468.objecter _get_session s=0x7f82cc0a0b20 osd=7 3 2026-02-24T19:17:28.668 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f82ea7fc640 20 client.4468.objecter put_session s=0x7f82cc0a0b20 osd=7 3 2026-02-24T19:17:28.668 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f82ea7fc640 15 client.4468.objecter _session_command_op_remove -1 1 2026-02-24T19:17:28.668 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f82ea7fc640 20 client.4468.objecter _get_session s=0x7f82cc0a0b20 osd=7 3 2026-02-24T19:17:28.668 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f82ea7fc640 20 client.4468.objecter get_session s=0x7f82cc0a0b20 osd=7 3 2026-02-24T19:17:28.668 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f82ea7fc640 15 client.4468.objecter _session_command_op_assign 7 1 2026-02-24T19:17:28.668 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f82ea7fc640 20 client.4468.objecter put_session s=0x7f82cc0a0b20 osd=7 4 2026-02-24T19:17:28.668 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f82ea7fc640 10 client.4468.objecter _send_command 1 2026-02-24T19:17:28.668 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f82ea7fc640 1 -- 10.20.193.14:0/897198496 --> v1:10.20.193.195:6808/798109025 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f82cc0c2dd0 con 0x7f82cc0a11d0 2026-02-24T19:17:28.668 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f82ea7fc640 20 client.4468.objecter dump_active .. 0 homeless 2026-02-24T19:17:28.668 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f595a7fc640 1 -- 10.20.193.14:0/2765925491 <== osd.15 v1:10.20.193.195:6809/3316970219 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7f596c157dc0 con 0x7f593c0a1460 2026-02-24T19:17:28.668 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f595a7fc640 10 client.4452.objecter ms_dispatch2 0x7f596c000b90 command_reply(tid 2: 0 ) 2026-02-24T19:17:28.668 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f595a7fc640 10 client.4452.objecter _finish_command 2 = system:0 2026-02-24T19:17:28.668 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f595a7fc640 20 client.4452.objecter put_session s=0x7f593c0a0db0 osd=15 4 2026-02-24T19:17:28.668 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f595a7fc640 15 client.4452.objecter _session_command_op_remove 15 2 2026-02-24T19:17:28.668 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f82ea7fc640 1 -- 10.20.193.14:0/897198496 <== mon.1 v1:10.20.193.44:6789/0 9 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (unknown 3108795433 0 0) 0x7f82f0059720 con 0x7f82fc0b9f80 2026-02-24T19:17:28.668 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f82ea7fc640 10 monclient: handle_get_version_reply finishing 1 version 31 2026-02-24T19:17:28.669 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7ff11bfff640 1 -- 10.20.193.14:0/1755338058 <== osd.0 v1:10.20.193.14:6806/3263337386 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7ff1100c2ff0 con 0x7ff1100a13f0 2026-02-24T19:17:28.669 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7ff11bfff640 10 client.4457.objecter ms_dispatch2 0x7ff140000b90 command_reply(tid 1: 0 ) 2026-02-24T19:17:28.669 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7ff11bfff640 10 client.4457.objecter _finish_command 1 = system:0 2026-02-24T19:17:28.669 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7ff11bfff640 20 client.4457.objecter put_session s=0x7ff1100a0d40 osd=0 4 2026-02-24T19:17:28.669 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7ff11bfff640 15 client.4457.objecter _session_command_op_remove 0 1 2026-02-24T19:17:28.669 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f5973d45640 10 librados: watch_flush enter 2026-02-24T19:17:28.669 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f5973d45640 10 librados: watch_flush exit 2026-02-24T19:17:28.669 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f5973d45640 10 client.4452.objecter close_session for osd.15 2026-02-24T19:17:28.669 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f5973d45640 1 -- 10.20.193.14:0/2765925491 >> v1:10.20.193.195:6809/3316970219 conn(0x7f593c0a1460 legacy=0x7f593c0c1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.669 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f5973d45640 20 client.4452.objecter put_session s=0x7f593c0a0db0 osd=15 1 2026-02-24T19:17:28.669 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f5973d45640 20 client.4452.objecter shutdown clearing up homeless session... 2026-02-24T19:17:28.669 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f5973d45640 10 client.4452.objecter successfully canceled tick 2026-02-24T19:17:28.669 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f4eb5ffb640 1 -- 10.20.193.14:0/1929189111 <== osd.11 v1:10.20.193.195:6804/2798179318 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7f4ec813b760 con 0x7f4e980a12f0 2026-02-24T19:17:28.669 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f4eb5ffb640 10 client.4451.objecter ms_dispatch2 0x7f4ec8000b90 command_reply(tid 2: 0 ) 2026-02-24T19:17:28.669 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f4eb5ffb640 10 client.4451.objecter _finish_command 2 = system:0 2026-02-24T19:17:28.669 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f4eb5ffb640 20 client.4451.objecter put_session s=0x7f4e980a0c40 osd=11 4 2026-02-24T19:17:28.669 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f4eb5ffb640 15 client.4451.objecter _session_command_op_remove 11 2 2026-02-24T19:17:28.669 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f5973d45640 1 -- 10.20.193.14:0/2765925491 >> v1:10.20.193.14:6800/4014096310 conn(0x7f593c077ed0 legacy=0x7f593c098380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.669 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f5973d45640 10 monclient: shutdown 2026-02-24T19:17:28.669 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f5973d45640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.669 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f5973d45640 1 -- 10.20.193.14:0/2765925491 >> v1:10.20.193.14:6789/0 conn(0x7f596c0b9f80 legacy=0x7f596c15daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.669 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f830221c640 10 monclient: get_auth_request con 0x7f82cc0a11d0 auth_method 0 2026-02-24T19:17:28.670 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f59722bb640 1 -- 10.20.193.14:0/2765925491 reap_dead start 2026-02-24T19:17:28.670 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f5973d45640 1 -- 10.20.193.14:0/2765925491 shutdown_connections 2026-02-24T19:17:28.670 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f5973d45640 1 -- 10.20.193.14:0/2765925491 >> 10.20.193.14:0/2765925491 conn(0x7f596c0b7990 msgr2=0x7f596c15ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.670 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f5973d45640 1 -- 10.20.193.14:0/2765925491 shutdown_connections 2026-02-24T19:17:28.670 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f5973d45640 1 -- 10.20.193.14:0/2765925491 wait complete. 2026-02-24T19:17:28.670 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f5973d45640 1 librados: shutdown 2026-02-24T19:17:28.670 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f4ecf88b640 10 librados: watch_flush enter 2026-02-24T19:17:28.670 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f4ecf88b640 10 librados: watch_flush exit 2026-02-24T19:17:28.670 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f4ecf88b640 10 client.4451.objecter close_session for osd.11 2026-02-24T19:17:28.670 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f4ecf88b640 1 -- 10.20.193.14:0/1929189111 >> v1:10.20.193.195:6804/2798179318 conn(0x7f4e980a12f0 legacy=0x7f4e980c1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.670 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f4ecf88b640 20 client.4451.objecter put_session s=0x7f4e980a0c40 osd=11 1 2026-02-24T19:17:28.670 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f4ecf88b640 20 client.4451.objecter shutdown clearing up homeless session... 2026-02-24T19:17:28.670 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f4ecf88b640 10 client.4451.objecter successfully canceled tick 2026-02-24T19:17:28.670 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f4ecf88b640 1 -- 10.20.193.14:0/1929189111 >> v1:10.20.193.14:6800/4014096310 conn(0x7f4e98077dc0 legacy=0x7f4e98098270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f4ecf88b640 10 monclient: shutdown 2026-02-24T19:17:28.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f4ecf88b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f4ecf88b640 1 -- 10.20.193.14:0/1929189111 >> v1:10.20.193.170:6789/0 conn(0x7f4ec80b9f80 legacy=0x7f4ec80b4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f4ecde01640 1 -- 10.20.193.14:0/1929189111 reap_dead start 2026-02-24T19:17:28.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f4ecf88b640 1 -- 10.20.193.14:0/1929189111 shutdown_connections 2026-02-24T19:17:28.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f4ecf88b640 1 -- 10.20.193.14:0/1929189111 >> 10.20.193.14:0/1929189111 conn(0x7f4ec80b7990 msgr2=0x7f4ec80b66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.651+0000 7f4ecf88b640 1 -- 10.20.193.14:0/1929189111 shutdown_connections 2026-02-24T19:17:28.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.652+0000 7f4ecf88b640 1 -- 10.20.193.14:0/1929189111 wait complete. 2026-02-24T19:17:28.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.652+0000 7f4ecf88b640 1 librados: shutdown 2026-02-24T19:17:28.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.652+0000 7f5f62ffd640 1 -- 10.20.193.14:0/2714502469 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5f7c1face0 con 0x7f5f7c058070 2026-02-24T19:17:28.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.652+0000 7f5f62ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.652+0000 7f5f62ffd640 1 -- 10.20.193.14:0/2714502469 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5f70004b80 con 0x7f5f7c058070 2026-02-24T19:17:28.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.652+0000 7f5f62ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.652+0000 7f5f62ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:28.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.652+0000 7f5f78d72640 4 set_mon_vals no callback set 2026-02-24T19:17:28.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.652+0000 7f5f62ffd640 10 monclient: dump: 2026-02-24T19:17:28.671 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.671 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.671 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.671 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.671 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.671 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.671 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.671 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.671 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.671 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.652+0000 7f56c77fe640 1 -- 10.20.193.14:0/1171845697 <== osd.1 v1:10.20.193.44:6804/1955152616 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f56b40c3020 con 0x7f56b40a1420 2026-02-24T19:17:28.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.652+0000 7f56c77fe640 10 client.4458.objecter ms_dispatch2 0x7f56e8000b90 command_reply(tid 1: 0 ) 2026-02-24T19:17:28.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.652+0000 7f56c77fe640 10 client.4458.objecter _finish_command 1 = system:0 2026-02-24T19:17:28.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.652+0000 7f56c77fe640 20 client.4458.objecter put_session s=0x7f56b40a0d70 osd=1 4 2026-02-24T19:17:28.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.652+0000 7f56c77fe640 15 client.4458.objecter _session_command_op_remove 1 1 2026-02-24T19:17:28.672 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.653+0000 7f5f62ffd640 1 -- 10.20.193.14:0/2714502469 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f5f7001d9f0 con 0x7f5f7c058070 2026-02-24T19:17:28.672 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.653+0000 7f82ea7fc640 10 client.4468.objecter ms_handle_connect 0x7f82cc0a11d0 2026-02-24T19:17:28.672 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.653+0000 7f5f79d74640 10 monclient: get_auth_request con 0x7f5f48077ef0 auth_method 0 2026-02-24T19:17:28.672 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.653+0000 7f5f62ffd640 10 client.4484.objecter ms_handle_connect 0x7f5f48077ef0 2026-02-24T19:17:28.672 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.653+0000 7f48a37fe640 1 -- 10.20.193.14:0/3396094211 <== mon.1 v1:10.20.193.44:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f48c4060200 con 0x7f48c4058580 2026-02-24T19:17:28.672 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.653+0000 7f48a37fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.672 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.653+0000 7f48c1573640 4 set_mon_vals no callback set 2026-02-24T19:17:28.672 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.654+0000 7f48a37fe640 1 -- 10.20.193.14:0/3396094211 <== mon.1 v1:10.20.193.44:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f48b80039b0 con 0x7f48c4058580 2026-02-24T19:17:28.672 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.654+0000 7f48a37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.672 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.654+0000 7f48a37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:28.672 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.654+0000 7f48a37fe640 10 monclient: dump: 2026-02-24T19:17:28.672 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.672 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.672 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.672 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.672 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.672 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.672 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.672 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.672 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.672 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.673 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.654+0000 7f5f62ffd640 1 -- 10.20.193.14:0/2714502469 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7f5f70092df0 con 0x7f5f7c058070 2026-02-24T19:17:28.673 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.654+0000 7f5f62ffd640 10 client.4484.objecter ms_dispatch2 0x7f5f7c000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:28.673 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.654+0000 7f5f62ffd640 3 client.4484.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:28.673 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.654+0000 7f5f62ffd640 3 client.4484.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:28.673 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.654+0000 7f5f62ffd640 10 client.4484.objecter checking command 1 2026-02-24T19:17:28.673 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.654+0000 7f5f62ffd640 20 client.4484.objecter _get_session s=0x7f5f480a0d70 osd=13 3 2026-02-24T19:17:28.673 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.654+0000 7f5f62ffd640 20 client.4484.objecter put_session s=0x7f5f480a0d70 osd=13 3 2026-02-24T19:17:28.673 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.654+0000 7f5f62ffd640 15 client.4484.objecter _session_command_op_remove -1 1 2026-02-24T19:17:28.673 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.654+0000 7f5f62ffd640 20 client.4484.objecter _get_session s=0x7f5f480a0d70 osd=13 3 2026-02-24T19:17:28.673 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.654+0000 7f5f62ffd640 20 client.4484.objecter get_session s=0x7f5f480a0d70 osd=13 3 2026-02-24T19:17:28.673 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.654+0000 7f5f62ffd640 15 client.4484.objecter _session_command_op_assign 13 1 2026-02-24T19:17:28.673 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.654+0000 7f5f62ffd640 20 client.4484.objecter put_session s=0x7f5f480a0d70 osd=13 4 2026-02-24T19:17:28.673 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.654+0000 7f5f62ffd640 10 client.4484.objecter _send_command 1 2026-02-24T19:17:28.673 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.654+0000 7f5f62ffd640 1 -- 10.20.193.14:0/2714502469 --> v1:10.20.193.44:6800/3795416779 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5f480c3020 con 0x7f5f480a1420 2026-02-24T19:17:28.673 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.654+0000 7f5f62ffd640 20 client.4484.objecter dump_active .. 0 homeless 2026-02-24T19:17:28.673 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.654+0000 7f5f62ffd640 1 -- 10.20.193.14:0/2714502469 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (unknown 3108795433 0 0) 0x7f5f70059490 con 0x7f5f7c058070 2026-02-24T19:17:28.673 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.654+0000 7f5f62ffd640 10 monclient: handle_get_version_reply finishing 1 version 31 2026-02-24T19:17:28.673 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.655+0000 7f5f7ad76640 10 monclient: get_auth_request con 0x7f5f480a1420 auth_method 0 2026-02-24T19:17:28.673 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.656+0000 7fdcebfff640 1 -- 10.20.193.14:0/1366958924 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2071042793 0 0) 0x7fdd101feb70 con 0x7fdd10058070 2026-02-24T19:17:28.673 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.656+0000 7fdcebfff640 1 -- 10.20.193.14:0/1366958924 >> v1:10.20.193.170:6789/0 conn(0x7fdd10159a70 legacy=0x7fdd100b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.673 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.656+0000 7fdcebfff640 1 -- 10.20.193.14:0/1366958924 >> v1:10.20.193.44:6789/0 conn(0x7fdd10159e40 legacy=0x7fdd1013b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.673 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.656+0000 7fdcebfff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.673 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.656+0000 7fdcebfff640 1 monclient: found mon.a 2026-02-24T19:17:28.674 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.656+0000 7fdcebfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.674 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.656+0000 7fdcebfff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.674 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.656+0000 7fdcebfff640 1 -- 10.20.193.14:0/1366958924 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd101fee50 con 0x7fdd10058070 2026-02-24T19:17:28.674 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.656+0000 7fdcebfff640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.674 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.656+0000 7fdcebfff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.674 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.656+0000 7fdcebfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.674 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.656+0000 7fdd15c4d640 5 monclient: authenticate success, global_id 4482 2026-02-24T19:17:28.674 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.656+0000 7fdd15c4d640 10 monclient: _renew_subs 2026-02-24T19:17:28.674 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.656+0000 7fdd15c4d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.674 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.656+0000 7fdd15c4d640 1 -- 10.20.193.14:0/1366958924 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdd101ff130 con 0x7fdd10058070 2026-02-24T19:17:28.674 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.656+0000 7fdd15c4d640 10 client.4482.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.674 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.656+0000 7fdd15c4d640 10 monclient: _renew_subs 2026-02-24T19:17:28.674 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.656+0000 7fdd15c4d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.674 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.656+0000 7fdd15c4d640 1 -- 10.20.193.14:0/1366958924 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fdd100b4250 con 0x7fdd10058070 2026-02-24T19:17:28.674 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.656+0000 7fdd15c4d640 1 librados: init done 2026-02-24T19:17:28.674 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.656+0000 7fdd15c4d640 10 client.4482.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.674 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.656+0000 7fdd15c4d640 15 client.4482.objecter _session_command_op_assign -1 1 2026-02-24T19:17:28.674 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.656+0000 7fdd15c4d640 20 client.4482.objecter _get_session osd=-1 returning homeless 2026-02-24T19:17:28.674 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.656+0000 7fdd15c4d640 10 client.4482.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.674 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.656+0000 7fdd15c4d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.674 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.656+0000 7fdd15c4d640 1 -- 10.20.193.14:0/1366958924 --> v1:10.20.193.14:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fdd101fe640 con 0x7fdd10058070 2026-02-24T19:17:28.674 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.657+0000 7f5f62ffd640 10 client.4484.objecter ms_handle_connect 0x7f5f480a1420 2026-02-24T19:17:28.674 INFO:teuthology.orchestra.run.trial014.stdout:90194313220 2026-02-24T19:17:28.674 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2026-02-24T19:17:28.675 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.659+0000 7f4dd85c3640 10 client.4462.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:17:28.675 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.659+0000 7f4dd85c3640 15 client.4462.objecter _session_command_op_assign -1 2 2026-02-24T19:17:28.675 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.659+0000 7f4dd85c3640 20 client.4462.objecter _get_session s=0x7f4da00a0c50 osd=5 3 2026-02-24T19:17:28.675 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.659+0000 7f4dd85c3640 20 client.4462.objecter put_session s=0x7f4da00a0c50 osd=5 3 2026-02-24T19:17:28.675 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.659+0000 7f4dd85c3640 20 client.4462.objecter _get_session s=0x7f4da00a0c50 osd=5 3 2026-02-24T19:17:28.675 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.659+0000 7f4dd85c3640 15 client.4462.objecter _session_command_op_remove -1 2 2026-02-24T19:17:28.675 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.659+0000 7f4dd85c3640 20 client.4462.objecter get_session s=0x7f4da00a0c50 osd=5 3 2026-02-24T19:17:28.675 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.659+0000 7f4dd85c3640 15 client.4462.objecter _session_command_op_assign 5 2 2026-02-24T19:17:28.675 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.659+0000 7f4dd85c3640 20 client.4462.objecter put_session s=0x7f4da00a0c50 osd=5 4 2026-02-24T19:17:28.675 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.659+0000 7f4dd85c3640 10 client.4462.objecter _send_command 2 2026-02-24T19:17:28.675 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.659+0000 7f4dd85c3640 1 -- 10.20.193.14:0/4093622326 --> v1:10.20.193.44:6811/2261252351 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4dd0157dc0 con 0x7f4da00a1300 2026-02-24T19:17:28.675 INFO:teuthology.orchestra.run.trial014.stdout:90194313220 2026-02-24T19:17:28.675 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2026-02-24T19:17:28.675 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.659+0000 7ff14612c640 10 client.4457.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:17:28.675 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.659+0000 7ff14612c640 15 client.4457.objecter _session_command_op_assign -1 2 2026-02-24T19:17:28.675 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.659+0000 7ff14612c640 20 client.4457.objecter _get_session s=0x7ff1100a0d40 osd=0 3 2026-02-24T19:17:28.675 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.659+0000 7ff14612c640 20 client.4457.objecter put_session s=0x7ff1100a0d40 osd=0 3 2026-02-24T19:17:28.676 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.659+0000 7ff14612c640 20 client.4457.objecter _get_session s=0x7ff1100a0d40 osd=0 3 2026-02-24T19:17:28.676 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.659+0000 7ff14612c640 15 client.4457.objecter _session_command_op_remove -1 2 2026-02-24T19:17:28.676 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.659+0000 7ff14612c640 20 client.4457.objecter get_session s=0x7ff1100a0d40 osd=0 3 2026-02-24T19:17:28.676 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.659+0000 7ff14612c640 15 client.4457.objecter _session_command_op_assign 0 2 2026-02-24T19:17:28.676 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.659+0000 7ff14612c640 20 client.4457.objecter put_session s=0x7ff1100a0d40 osd=0 4 2026-02-24T19:17:28.676 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.659+0000 7ff14612c640 10 client.4457.objecter _send_command 2 2026-02-24T19:17:28.676 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.659+0000 7ff14612c640 1 -- 10.20.193.14:0/1755338058 --> v1:10.20.193.14:6806/3263337386 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff1400b94f0 con 0x7ff1100a13f0 2026-02-24T19:17:28.676 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.659+0000 7fa2867fc640 1 -- 10.20.193.14:0/852388800 <== osd.2 v1:10.20.193.170:6804/993713135 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fa2680c2e60 con 0x7fa2680a1260 2026-02-24T19:17:28.676 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.659+0000 7fa2867fc640 10 client.4464.objecter ms_dispatch2 0x7fa298000b90 command_reply(tid 1: 0 ) 2026-02-24T19:17:28.676 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.659+0000 7fa2867fc640 10 client.4464.objecter _finish_command 1 = system:0 2026-02-24T19:17:28.676 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.659+0000 7fa2867fc640 20 client.4464.objecter put_session s=0x7fa2680a0bb0 osd=2 4 2026-02-24T19:17:28.676 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.659+0000 7fa2867fc640 15 client.4464.objecter _session_command_op_remove 2 1 2026-02-24T19:17:28.676 INFO:teuthology.orchestra.run.trial014.stdout:90194313220 2026-02-24T19:17:28.676 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2026-02-24T19:17:28.676 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.660+0000 7f56ed25c640 10 client.4458.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:17:28.676 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.660+0000 7f56ed25c640 15 client.4458.objecter _session_command_op_assign -1 2 2026-02-24T19:17:28.676 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.660+0000 7f56ed25c640 20 client.4458.objecter _get_session s=0x7f56b40a0d70 osd=1 3 2026-02-24T19:17:28.676 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.660+0000 7f56ed25c640 20 client.4458.objecter put_session s=0x7f56b40a0d70 osd=1 3 2026-02-24T19:17:28.676 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.660+0000 7f56ed25c640 20 client.4458.objecter _get_session s=0x7f56b40a0d70 osd=1 3 2026-02-24T19:17:28.676 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.660+0000 7f56ed25c640 15 client.4458.objecter _session_command_op_remove -1 2 2026-02-24T19:17:28.676 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.660+0000 7f56ed25c640 20 client.4458.objecter get_session s=0x7f56b40a0d70 osd=1 3 2026-02-24T19:17:28.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.660+0000 7f56ed25c640 15 client.4458.objecter _session_command_op_assign 1 2 2026-02-24T19:17:28.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.660+0000 7f56ed25c640 20 client.4458.objecter put_session s=0x7f56b40a0d70 osd=1 4 2026-02-24T19:17:28.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.660+0000 7f56ed25c640 10 client.4458.objecter _send_command 2 2026-02-24T19:17:28.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.660+0000 7f56ed25c640 1 -- 10.20.193.14:0/1171845697 --> v1:10.20.193.44:6804/1955152616 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f56e80aed90 con 0x7f56b40a1420 2026-02-24T19:17:28.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.662+0000 7f4db6ffd640 1 -- 10.20.193.14:0/4093622326 <== osd.5 v1:10.20.193.44:6811/2261252351 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7f4dd0157dc0 con 0x7f4da00a1300 2026-02-24T19:17:28.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.662+0000 7f4db6ffd640 10 client.4462.objecter ms_dispatch2 0x7f4dd0000b90 command_reply(tid 2: 0 ) 2026-02-24T19:17:28.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.662+0000 7f4db6ffd640 10 client.4462.objecter _finish_command 2 = system:0 2026-02-24T19:17:28.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.662+0000 7f4db6ffd640 20 client.4462.objecter put_session s=0x7f4da00a0c50 osd=5 4 2026-02-24T19:17:28.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.662+0000 7f4db6ffd640 15 client.4462.objecter _session_command_op_remove 5 2 2026-02-24T19:17:28.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.662+0000 7f4dd85c3640 10 librados: watch_flush enter 2026-02-24T19:17:28.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.662+0000 7f4dd85c3640 10 librados: watch_flush exit 2026-02-24T19:17:28.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.662+0000 7f4dd85c3640 10 client.4462.objecter close_session for osd.5 2026-02-24T19:17:28.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.662+0000 7f4dd85c3640 1 -- 10.20.193.14:0/4093622326 >> v1:10.20.193.44:6811/2261252351 conn(0x7f4da00a1300 legacy=0x7f4da00c1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.662+0000 7f4dd85c3640 20 client.4462.objecter put_session s=0x7f4da00a0c50 osd=5 1 2026-02-24T19:17:28.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.662+0000 7f4dd85c3640 20 client.4462.objecter shutdown clearing up homeless session... 2026-02-24T19:17:28.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.662+0000 7f4dd85c3640 10 client.4462.objecter successfully canceled tick 2026-02-24T19:17:28.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.662+0000 7f4dd85c3640 1 -- 10.20.193.14:0/4093622326 >> v1:10.20.193.14:6800/4014096310 conn(0x7f4da0077d70 legacy=0x7f4da0098220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.662+0000 7f4dd85c3640 10 monclient: shutdown 2026-02-24T19:17:28.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.662+0000 7f4dd85c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.662+0000 7f4dd85c3640 1 -- 10.20.193.14:0/4093622326 >> v1:10.20.193.44:6789/0 conn(0x7f4dd00ba350 legacy=0x7f4dd0160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.662+0000 7f4dd6b39640 1 -- 10.20.193.14:0/4093622326 reap_dead start 2026-02-24T19:17:28.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.662+0000 7f4dd85c3640 1 -- 10.20.193.14:0/4093622326 shutdown_connections 2026-02-24T19:17:28.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.662+0000 7f4dd85c3640 1 -- 10.20.193.14:0/4093622326 >> 10.20.193.14:0/4093622326 conn(0x7f4dd00b7990 msgr2=0x7f4dd015ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.678 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.662+0000 7f4dd85c3640 1 -- 10.20.193.14:0/4093622326 shutdown_connections 2026-02-24T19:17:28.678 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.662+0000 7f4dd85c3640 1 -- 10.20.193.14:0/4093622326 wait complete. 2026-02-24T19:17:28.678 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.662+0000 7f4dd85c3640 1 librados: shutdown 2026-02-24T19:17:28.678 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.664+0000 7f48a37fe640 1 -- 10.20.193.14:0/3396094211 <== mon.1 v1:10.20.193.44:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f48b8003bd0 con 0x7f48c4058580 2026-02-24T19:17:28.678 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.665+0000 7ff11bfff640 1 -- 10.20.193.14:0/1755338058 <== osd.0 v1:10.20.193.14:6806/3263337386 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7ff1400b94f0 con 0x7ff1100a13f0 2026-02-24T19:17:28.678 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.665+0000 7ff11bfff640 10 client.4457.objecter ms_dispatch2 0x7ff140000b90 command_reply(tid 2: 0 ) 2026-02-24T19:17:28.678 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.665+0000 7ff11bfff640 10 client.4457.objecter _finish_command 2 = system:0 2026-02-24T19:17:28.678 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.665+0000 7ff11bfff640 20 client.4457.objecter put_session s=0x7ff1100a0d40 osd=0 4 2026-02-24T19:17:28.678 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.665+0000 7ff11bfff640 15 client.4457.objecter _session_command_op_remove 0 2 2026-02-24T19:17:28.678 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.665+0000 7ff14612c640 10 librados: watch_flush enter 2026-02-24T19:17:28.678 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.665+0000 7f48c2575640 10 monclient: get_auth_request con 0x7f4890077d70 auth_method 0 2026-02-24T19:17:28.678 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.665+0000 7ff14612c640 10 librados: watch_flush exit 2026-02-24T19:17:28.678 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.665+0000 7ff14612c640 10 client.4457.objecter close_session for osd.0 2026-02-24T19:17:28.678 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.665+0000 7ff14612c640 1 -- 10.20.193.14:0/1755338058 >> v1:10.20.193.14:6806/3263337386 conn(0x7ff1100a13f0 legacy=0x7ff1100c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.678 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.665+0000 7ff14612c640 20 client.4457.objecter put_session s=0x7ff1100a0d40 osd=0 1 2026-02-24T19:17:28.678 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.665+0000 7ff14612c640 20 client.4457.objecter shutdown clearing up homeless session... 2026-02-24T19:17:28.678 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.665+0000 7ff14612c640 10 client.4457.objecter successfully canceled tick 2026-02-24T19:17:28.679 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.665+0000 7ff14612c640 1 -- 10.20.193.14:0/1755338058 >> v1:10.20.193.14:6800/4014096310 conn(0x7ff110077ec0 legacy=0x7ff110098370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.679 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.665+0000 7ff14612c640 10 monclient: shutdown 2026-02-24T19:17:28.679 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.665+0000 7ff14612c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.679 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.665+0000 7ff14612c640 1 -- 10.20.193.14:0/1755338058 >> v1:10.20.193.170:6789/0 conn(0x7ff1400b9f80 legacy=0x7ff1401fc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.679 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.665+0000 7ff13ffff640 1 -- 10.20.193.14:0/1755338058 reap_dead start 2026-02-24T19:17:28.679 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.665+0000 7f48a37fe640 10 client.4480.objecter ms_handle_connect 0x7f4890077d70 2026-02-24T19:17:28.679 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.665+0000 7ff14612c640 1 -- 10.20.193.14:0/1755338058 shutdown_connections 2026-02-24T19:17:28.679 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.665+0000 7ff14612c640 1 -- 10.20.193.14:0/1755338058 >> 10.20.193.14:0/1755338058 conn(0x7ff1400b7990 msgr2=0x7ff1400b66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.679 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.665+0000 7ff14612c640 1 -- 10.20.193.14:0/1755338058 shutdown_connections 2026-02-24T19:17:28.679 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.665+0000 7ff14612c640 1 -- 10.20.193.14:0/1755338058 wait complete. 2026-02-24T19:17:28.679 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.665+0000 7ff14612c640 1 librados: shutdown 2026-02-24T19:17:28.679 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.666+0000 7f56c77fe640 1 -- 10.20.193.14:0/1171845697 <== osd.1 v1:10.20.193.44:6804/1955152616 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7f56e80aed90 con 0x7f56b40a1420 2026-02-24T19:17:28.679 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.666+0000 7f56c77fe640 10 client.4458.objecter ms_dispatch2 0x7f56e8000b90 command_reply(tid 2: 0 ) 2026-02-24T19:17:28.679 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.666+0000 7f56c77fe640 10 client.4458.objecter _finish_command 2 = system:0 2026-02-24T19:17:28.679 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.666+0000 7f56c77fe640 20 client.4458.objecter put_session s=0x7f56b40a0d70 osd=1 4 2026-02-24T19:17:28.679 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.666+0000 7f56c77fe640 15 client.4458.objecter _session_command_op_remove 1 2 2026-02-24T19:17:28.679 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.667+0000 7fdcebfff640 1 -- 10.20.193.14:0/1366958924 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdd101fe640 con 0x7fdd10058070 2026-02-24T19:17:28.679 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.667+0000 7fdcebfff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.679 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.667+0000 7fdcebfff640 1 -- 10.20.193.14:0/1366958924 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fdcfc0038a0 con 0x7fdd10058070 2026-02-24T19:17:28.679 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.667+0000 7fdcebfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.679 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.667+0000 7fdcebfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.680 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.667+0000 7fdcebfff640 10 monclient: dump: 2026-02-24T19:17:28.680 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.680 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.680 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.680 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.680 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.680 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.680 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.680 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.680 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.680 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.680 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.667+0000 7fdd0dffb640 4 set_mon_vals no callback set 2026-02-24T19:17:28.680 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.667+0000 7f56ed25c640 10 librados: watch_flush enter 2026-02-24T19:17:28.680 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.667+0000 7f56ed25c640 10 librados: watch_flush exit 2026-02-24T19:17:28.680 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.667+0000 7f56ed25c640 10 client.4458.objecter close_session for osd.1 2026-02-24T19:17:28.680 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.667+0000 7f56ed25c640 1 -- 10.20.193.14:0/1171845697 >> v1:10.20.193.44:6804/1955152616 conn(0x7f56b40a1420 legacy=0x7f56b40c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.680 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.667+0000 7f56ed25c640 20 client.4458.objecter put_session s=0x7f56b40a0d70 osd=1 1 2026-02-24T19:17:28.680 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.667+0000 7f56ed25c640 20 client.4458.objecter shutdown clearing up homeless session... 2026-02-24T19:17:28.680 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.667+0000 7f56ed25c640 10 client.4458.objecter successfully canceled tick 2026-02-24T19:17:28.680 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.667+0000 7f56ed25c640 1 -- 10.20.193.14:0/1171845697 >> v1:10.20.193.14:6800/4014096310 conn(0x7f56b4077ef0 legacy=0x7f56b40983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.680 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.667+0000 7f56ed25c640 10 monclient: shutdown 2026-02-24T19:17:28.680 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.667+0000 7f56ed25c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.680 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.667+0000 7f56ed25c640 1 -- 10.20.193.14:0/1171845697 >> v1:10.20.193.14:6789/0 conn(0x7f56e8157780 legacy=0x7f56e8158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.680 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.667+0000 7f56e7577640 1 -- 10.20.193.14:0/1171845697 reap_dead start 2026-02-24T19:17:28.680 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.667+0000 7f56ed25c640 1 -- 10.20.193.14:0/1171845697 shutdown_connections 2026-02-24T19:17:28.680 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.667+0000 7f56ed25c640 1 -- 10.20.193.14:0/1171845697 >> 10.20.193.14:0/1171845697 conn(0x7f56e80b2ef0 msgr2=0x7f56e80b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.680 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.667+0000 7f56ed25c640 1 -- 10.20.193.14:0/1171845697 shutdown_connections 2026-02-24T19:17:28.681 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.667+0000 7f56ed25c640 1 -- 10.20.193.14:0/1171845697 wait complete. 2026-02-24T19:17:28.681 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.667+0000 7f56ed25c640 1 librados: shutdown 2026-02-24T19:17:28.681 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.667+0000 7fab357fa640 1 -- 10.20.193.14:0/2139916363 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fab40157dc0 con 0x7fab400585e0 2026-02-24T19:17:28.681 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.667+0000 7fab357fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.681 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.667+0000 7fab357fa640 1 -- 10.20.193.14:0/2139916363 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fab30004a70 con 0x7fab400585e0 2026-02-24T19:17:28.681 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.667+0000 7fab357fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.681 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.667+0000 7fab357fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:28.681 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.667+0000 7fab357fa640 10 monclient: dump: 2026-02-24T19:17:28.681 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.681 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.681 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.681 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.681 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.681 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.681 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.681 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.681 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.681 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.681 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.667+0000 7fab36ffd640 4 set_mon_vals no callback set 2026-02-24T19:17:28.681 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.667+0000 7fdcebfff640 1 -- 10.20.193.14:0/1366958924 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7fdcfc003a70 con 0x7fdd10058070 2026-02-24T19:17:28.681 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.668+0000 7f775bfff640 1 -- 10.20.193.14:0/3545456418 <== osd.9 v1:10.20.193.44:6808/4259724385 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f77500c30e0 con 0x7f77500a14e0 2026-02-24T19:17:28.681 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.668+0000 7f775bfff640 10 client.4454.objecter ms_dispatch2 0x7f7780000b90 command_reply(tid 1: 0 ) 2026-02-24T19:17:28.681 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.668+0000 7f775bfff640 10 client.4454.objecter _finish_command 1 = system:0 2026-02-24T19:17:28.681 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.668+0000 7f775bfff640 20 client.4454.objecter put_session s=0x7f77500a0e30 osd=9 4 2026-02-24T19:17:28.681 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.668+0000 7f775bfff640 15 client.4454.objecter _session_command_op_remove 9 1 2026-02-24T19:17:28.681 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.668+0000 7fdd0effd640 10 monclient: get_auth_request con 0x7fdce0077e90 auth_method 0 2026-02-24T19:17:28.682 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.668+0000 7fdcebfff640 10 client.4482.objecter ms_handle_connect 0x7fdce0077e90 2026-02-24T19:17:28.682 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.668+0000 7fab357fa640 1 -- 10.20.193.14:0/2139916363 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7fab30004c80 con 0x7fab400585e0 2026-02-24T19:17:28.682 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.668+0000 7f48a37fe640 1 -- 10.20.193.14:0/3396094211 <== mon.1 v1:10.20.193.44:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7f48b80595e0 con 0x7f48c4058580 2026-02-24T19:17:28.682 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.668+0000 7f48a37fe640 10 client.4480.objecter ms_dispatch2 0x7f48c4000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:28.682 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.668+0000 7f48a37fe640 3 client.4480.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:28.682 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.668+0000 7f48a37fe640 3 client.4480.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:28.682 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.668+0000 7fab37fff640 10 monclient: get_auth_request con 0x7fab10077e60 auth_method 0 2026-02-24T19:17:28.682 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.668+0000 7f48a37fe640 10 client.4480.objecter checking command 1 2026-02-24T19:17:28.682 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.668+0000 7f48a37fe640 20 client.4480.objecter _get_session s=0x7f48900a0bf0 osd=10 3 2026-02-24T19:17:28.682 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.668+0000 7f48a37fe640 20 client.4480.objecter put_session s=0x7f48900a0bf0 osd=10 3 2026-02-24T19:17:28.682 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.668+0000 7f48a37fe640 15 client.4480.objecter _session_command_op_remove -1 1 2026-02-24T19:17:28.682 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.668+0000 7f48a37fe640 20 client.4480.objecter _get_session s=0x7f48900a0bf0 osd=10 3 2026-02-24T19:17:28.682 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7f48a37fe640 20 client.4480.objecter get_session s=0x7f48900a0bf0 osd=10 3 2026-02-24T19:17:28.682 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7f48a37fe640 15 client.4480.objecter _session_command_op_assign 10 1 2026-02-24T19:17:28.682 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7f48a37fe640 20 client.4480.objecter put_session s=0x7f48900a0bf0 osd=10 4 2026-02-24T19:17:28.682 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7f48a37fe640 10 client.4480.objecter _send_command 1 2026-02-24T19:17:28.682 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7f48a37fe640 1 -- 10.20.193.14:0/3396094211 --> v1:10.20.193.170:6808/983512563 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f48900c2ea0 con 0x7f48900a12a0 2026-02-24T19:17:28.682 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7f48a37fe640 20 client.4480.objecter dump_active .. 0 homeless 2026-02-24T19:17:28.682 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7fab357fa640 10 client.4469.objecter ms_handle_connect 0x7fab10077e60 2026-02-24T19:17:28.682 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7f48a37fe640 1 -- 10.20.193.14:0/3396094211 <== mon.1 v1:10.20.193.44:6789/0 9 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (unknown 3108795433 0 0) 0x7f48b80599c0 con 0x7f48c4058580 2026-02-24T19:17:28.683 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7f48a37fe640 10 monclient: handle_get_version_reply finishing 1 version 31 2026-02-24T19:17:28.683 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7fa29fa9c640 10 client.4464.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:17:28.683 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7fa29fa9c640 15 client.4464.objecter _session_command_op_assign -1 2 2026-02-24T19:17:28.683 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7fa29fa9c640 20 client.4464.objecter _get_session s=0x7fa2680a0bb0 osd=2 3 2026-02-24T19:17:28.683 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7fa29fa9c640 20 client.4464.objecter put_session s=0x7fa2680a0bb0 osd=2 3 2026-02-24T19:17:28.683 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7fa29fa9c640 20 client.4464.objecter _get_session s=0x7fa2680a0bb0 osd=2 3 2026-02-24T19:17:28.683 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7fa29fa9c640 15 client.4464.objecter _session_command_op_remove -1 2 2026-02-24T19:17:28.683 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7fa29fa9c640 20 client.4464.objecter get_session s=0x7fa2680a0bb0 osd=2 3 2026-02-24T19:17:28.683 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7fa29fa9c640 15 client.4464.objecter _session_command_op_assign 2 2 2026-02-24T19:17:28.683 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7fa29fa9c640 20 client.4464.objecter put_session s=0x7fa2680a0bb0 osd=2 4 2026-02-24T19:17:28.683 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7fa29fa9c640 10 client.4464.objecter _send_command 2 2026-02-24T19:17:28.683 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7fa29fa9c640 1 -- 10.20.193.14:0/852388800 --> v1:10.20.193.170:6804/993713135 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa29813a6f0 con 0x7fa2680a1260 2026-02-24T19:17:28.683 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7fab357fa640 1 -- 10.20.193.14:0/2139916363 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7fab30004a70 con 0x7fab400585e0 2026-02-24T19:17:28.683 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7fab357fa640 10 client.4469.objecter ms_dispatch2 0x7fab40000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:28.683 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7fab357fa640 3 client.4469.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:28.683 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7fab357fa640 3 client.4469.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:28.683 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7fab357fa640 10 client.4469.objecter checking command 1 2026-02-24T19:17:28.683 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7f48c3577640 10 monclient: get_auth_request con 0x7f48900a12a0 auth_method 0 2026-02-24T19:17:28.683 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7fab357fa640 20 client.4469.objecter _get_session s=0x7fab100a0d40 osd=3 3 2026-02-24T19:17:28.683 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7fab357fa640 20 client.4469.objecter put_session s=0x7fab100a0d40 osd=3 3 2026-02-24T19:17:28.683 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7fab357fa640 15 client.4469.objecter _session_command_op_remove -1 1 2026-02-24T19:17:28.683 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7fab357fa640 20 client.4469.objecter _get_session s=0x7fab100a0d40 osd=3 3 2026-02-24T19:17:28.683 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7fab357fa640 20 client.4469.objecter get_session s=0x7fab100a0d40 osd=3 3 2026-02-24T19:17:28.683 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7fab357fa640 15 client.4469.objecter _session_command_op_assign 3 1 2026-02-24T19:17:28.684 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7fab357fa640 20 client.4469.objecter put_session s=0x7fab100a0d40 osd=3 4 2026-02-24T19:17:28.684 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7fab357fa640 10 client.4469.objecter _send_command 1 2026-02-24T19:17:28.684 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7fab357fa640 1 -- 10.20.193.14:0/2139916363 --> v1:10.20.193.195:6800/3081016231 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fab100c2ff0 con 0x7fab100a13f0 2026-02-24T19:17:28.684 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7fab357fa640 20 client.4469.objecter dump_active .. 0 homeless 2026-02-24T19:17:28.684 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7fab357fa640 1 -- 10.20.193.14:0/2139916363 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (unknown 3108795433 0 0) 0x7fab30059730 con 0x7fab400585e0 2026-02-24T19:17:28.684 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7fab357fa640 10 monclient: handle_get_version_reply finishing 1 version 31 2026-02-24T19:17:28.684 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.670+0000 7fab4524e640 10 monclient: get_auth_request con 0x7fab100a13f0 auth_method 0 2026-02-24T19:17:28.684 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7feed8ff9640 1 -- 10.20.193.14:0/912187155 <== osd.14 v1:10.20.193.170:6809/2177297767 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7feeac0c2e50 con 0x7feeac0a1250 2026-02-24T19:17:28.684 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7feed8ff9640 10 client.4459.objecter ms_dispatch2 0x7feedc000b90 command_reply(tid 1: 0 ) 2026-02-24T19:17:28.684 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7feed8ff9640 10 client.4459.objecter _finish_command 1 = system:0 2026-02-24T19:17:28.684 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7feed8ff9640 20 client.4459.objecter put_session s=0x7feeac0a0ba0 osd=14 4 2026-02-24T19:17:28.684 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.669+0000 7feed8ff9640 15 client.4459.objecter _session_command_op_remove 14 1 2026-02-24T19:17:28.684 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.670+0000 7fdcebfff640 1 -- 10.20.193.14:0/1366958924 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7fdcfc092ff0 con 0x7fdd10058070 2026-02-24T19:17:28.684 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.670+0000 7fdcebfff640 10 client.4482.objecter ms_dispatch2 0x7fdd10000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:28.685 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.670+0000 7fdcebfff640 3 client.4482.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:28.685 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.670+0000 7fdcebfff640 3 client.4482.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:28.685 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.670+0000 7fdcebfff640 10 client.4482.objecter checking command 1 2026-02-24T19:17:28.685 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.670+0000 7fdcebfff640 20 client.4482.objecter _get_session s=0x7fdce00a0d10 osd=12 3 2026-02-24T19:17:28.685 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.670+0000 7fdcebfff640 20 client.4482.objecter put_session s=0x7fdce00a0d10 osd=12 3 2026-02-24T19:17:28.685 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.670+0000 7fdcebfff640 15 client.4482.objecter _session_command_op_remove -1 1 2026-02-24T19:17:28.685 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.670+0000 7fdcebfff640 20 client.4482.objecter _get_session s=0x7fdce00a0d10 osd=12 3 2026-02-24T19:17:28.685 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.670+0000 7fdcebfff640 20 client.4482.objecter get_session s=0x7fdce00a0d10 osd=12 3 2026-02-24T19:17:28.685 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.670+0000 7fdcebfff640 15 client.4482.objecter _session_command_op_assign 12 1 2026-02-24T19:17:28.685 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.670+0000 7fdcebfff640 20 client.4482.objecter put_session s=0x7fdce00a0d10 osd=12 4 2026-02-24T19:17:28.685 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.670+0000 7fdcebfff640 10 client.4482.objecter _send_command 1 2026-02-24T19:17:28.685 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.670+0000 7fdcebfff640 1 -- 10.20.193.14:0/1366958924 --> v1:10.20.193.14:6801/1483397197 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdce00c3060 con 0x7fdce00a13c0 2026-02-24T19:17:28.685 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.670+0000 7fdcebfff640 20 client.4482.objecter dump_active .. 0 homeless 2026-02-24T19:17:28.685 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.670+0000 7fdcebfff640 1 -- 10.20.193.14:0/1366958924 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (unknown 3108795433 0 0) 0x7fdcfc059690 con 0x7fdd10058070 2026-02-24T19:17:28.685 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.670+0000 7fdcebfff640 10 monclient: handle_get_version_reply finishing 1 version 31 2026-02-24T19:17:28.685 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.671+0000 7f48a37fe640 10 client.4480.objecter ms_handle_connect 0x7f48900a12a0 2026-02-24T19:17:28.685 INFO:teuthology.orchestra.run.trial014.stdout:90194313220 2026-02-24T19:17:28.685 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-24T19:17:28.685 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.671+0000 7fdd0ffff640 10 monclient: get_auth_request con 0x7fdce00a13c0 auth_method 0 2026-02-24T19:17:28.686 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.671+0000 7fab357fa640 10 client.4469.objecter ms_handle_connect 0x7fab100a13f0 2026-02-24T19:17:28.686 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.672+0000 7fa2867fc640 1 -- 10.20.193.14:0/852388800 <== osd.2 v1:10.20.193.170:6804/993713135 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7fa29813a6f0 con 0x7fa2680a1260 2026-02-24T19:17:28.686 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.672+0000 7fa2867fc640 10 client.4464.objecter ms_dispatch2 0x7fa298000b90 command_reply(tid 2: 0 ) 2026-02-24T19:17:28.686 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.672+0000 7fa2867fc640 10 client.4464.objecter _finish_command 2 = system:0 2026-02-24T19:17:28.686 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.672+0000 7fa2867fc640 20 client.4464.objecter put_session s=0x7fa2680a0bb0 osd=2 4 2026-02-24T19:17:28.686 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.672+0000 7fa2867fc640 15 client.4464.objecter _session_command_op_remove 2 2 2026-02-24T19:17:28.686 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.672+0000 7fa29fa9c640 10 librados: watch_flush enter 2026-02-24T19:17:28.686 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.672+0000 7fdcebfff640 10 client.4482.objecter ms_handle_connect 0x7fdce00a13c0 2026-02-24T19:17:28.686 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.672+0000 7fa29fa9c640 10 librados: watch_flush exit 2026-02-24T19:17:28.686 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.672+0000 7fa29fa9c640 10 client.4464.objecter close_session for osd.2 2026-02-24T19:17:28.686 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.672+0000 7fa29fa9c640 1 -- 10.20.193.14:0/852388800 >> v1:10.20.193.170:6804/993713135 conn(0x7fa2680a1260 legacy=0x7fa2680c1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.686 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.672+0000 7fa29fa9c640 20 client.4464.objecter put_session s=0x7fa2680a0bb0 osd=2 1 2026-02-24T19:17:28.686 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.672+0000 7fa29fa9c640 20 client.4464.objecter shutdown clearing up homeless session... 2026-02-24T19:17:28.686 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.672+0000 7fa29fa9c640 10 client.4464.objecter successfully canceled tick 2026-02-24T19:17:28.687 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.672+0000 7f82ea7fc640 1 -- 10.20.193.14:0/897198496 <== osd.7 v1:10.20.193.195:6808/798109025 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f82cc0c2dd0 con 0x7f82cc0a11d0 2026-02-24T19:17:28.687 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.672+0000 7f82ea7fc640 10 client.4468.objecter ms_dispatch2 0x7f82fc000b90 command_reply(tid 1: 0 ) 2026-02-24T19:17:28.687 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.672+0000 7f82ea7fc640 10 client.4468.objecter _finish_command 1 = system:0 2026-02-24T19:17:28.687 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.672+0000 7f82ea7fc640 20 client.4468.objecter put_session s=0x7f82cc0a0b20 osd=7 4 2026-02-24T19:17:28.687 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.673+0000 7f82ea7fc640 15 client.4468.objecter _session_command_op_remove 7 1 2026-02-24T19:17:28.687 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.673+0000 7fa29fa9c640 1 -- 10.20.193.14:0/852388800 >> v1:10.20.193.14:6800/4014096310 conn(0x7fa268077d30 legacy=0x7fa2680981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.687 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.673+0000 7fa29fa9c640 10 monclient: shutdown 2026-02-24T19:17:28.687 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.673+0000 7fa29fa9c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.687 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.673+0000 7fa29fa9c640 1 -- 10.20.193.14:0/852388800 >> v1:10.20.193.14:6789/0 conn(0x7fa29815deb0 legacy=0x7fa2980b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.687 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.673+0000 7fa29e012640 1 -- 10.20.193.14:0/852388800 reap_dead start 2026-02-24T19:17:28.687 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.673+0000 7fa29fa9c640 1 -- 10.20.193.14:0/852388800 shutdown_connections 2026-02-24T19:17:28.687 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.673+0000 7fa29fa9c640 1 -- 10.20.193.14:0/852388800 >> 10.20.193.14:0/852388800 conn(0x7fa2980b7990 msgr2=0x7fa2980b9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.687 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.673+0000 7fa29fa9c640 1 -- 10.20.193.14:0/852388800 shutdown_connections 2026-02-24T19:17:28.687 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.673+0000 7fa29fa9c640 1 -- 10.20.193.14:0/852388800 wait complete. 2026-02-24T19:17:28.687 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.673+0000 7fa29fa9c640 1 librados: shutdown 2026-02-24T19:17:28.687 INFO:teuthology.orchestra.run.trial014.stdout:90194313220 2026-02-24T19:17:28.688 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-24T19:17:28.688 INFO:teuthology.orchestra.run.trial014.stdout:90194313220 2026-02-24T19:17:28.688 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-24T19:17:28.688 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.677+0000 7f7785bd9640 10 client.4454.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:17:28.688 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.677+0000 7f7785bd9640 15 client.4454.objecter _session_command_op_assign -1 2 2026-02-24T19:17:28.688 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.677+0000 7f7785bd9640 20 client.4454.objecter _get_session s=0x7f77500a0e30 osd=9 3 2026-02-24T19:17:28.688 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.677+0000 7f7785bd9640 20 client.4454.objecter put_session s=0x7f77500a0e30 osd=9 3 2026-02-24T19:17:28.688 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.677+0000 7f7785bd9640 20 client.4454.objecter _get_session s=0x7f77500a0e30 osd=9 3 2026-02-24T19:17:28.688 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.677+0000 7f7785bd9640 15 client.4454.objecter _session_command_op_remove -1 2 2026-02-24T19:17:28.688 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.677+0000 7f7785bd9640 20 client.4454.objecter get_session s=0x7f77500a0e30 osd=9 3 2026-02-24T19:17:28.688 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.677+0000 7f7785bd9640 15 client.4454.objecter _session_command_op_assign 9 2 2026-02-24T19:17:28.688 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.677+0000 7f7785bd9640 20 client.4454.objecter put_session s=0x7f77500a0e30 osd=9 4 2026-02-24T19:17:28.688 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.677+0000 7f7785bd9640 10 client.4454.objecter _send_command 2 2026-02-24T19:17:28.688 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.677+0000 7f7785bd9640 1 -- 10.20.193.14:0/3545456418 --> v1:10.20.193.44:6808/4259724385 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f778005bbc0 con 0x7f77500a14e0 2026-02-24T19:17:28.689 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.677+0000 7f5f62ffd640 1 -- 10.20.193.14:0/2714502469 <== osd.13 v1:10.20.193.44:6800/3795416779 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f5f480c3020 con 0x7f5f480a1420 2026-02-24T19:17:28.689 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.677+0000 7f5f62ffd640 10 client.4484.objecter ms_dispatch2 0x7f5f7c000b90 command_reply(tid 1: 0 ) 2026-02-24T19:17:28.689 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.677+0000 7f5f62ffd640 10 client.4484.objecter _finish_command 1 = system:0 2026-02-24T19:17:28.689 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.677+0000 7f5f62ffd640 20 client.4484.objecter put_session s=0x7f5f480a0d70 osd=13 4 2026-02-24T19:17:28.689 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.677+0000 7f5f62ffd640 15 client.4484.objecter _session_command_op_remove 13 1 2026-02-24T19:17:28.689 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.677+0000 7feee249f640 10 client.4459.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:17:28.689 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.677+0000 7feee249f640 15 client.4459.objecter _session_command_op_assign -1 2 2026-02-24T19:17:28.689 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.677+0000 7feee249f640 20 client.4459.objecter _get_session s=0x7feeac0a0ba0 osd=14 3 2026-02-24T19:17:28.689 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.677+0000 7feee249f640 20 client.4459.objecter put_session s=0x7feeac0a0ba0 osd=14 3 2026-02-24T19:17:28.689 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.677+0000 7feee249f640 20 client.4459.objecter _get_session s=0x7feeac0a0ba0 osd=14 3 2026-02-24T19:17:28.689 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.677+0000 7feee249f640 15 client.4459.objecter _session_command_op_remove -1 2 2026-02-24T19:17:28.689 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.677+0000 7feee249f640 20 client.4459.objecter get_session s=0x7feeac0a0ba0 osd=14 3 2026-02-24T19:17:28.689 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.677+0000 7feee249f640 15 client.4459.objecter _session_command_op_assign 14 2 2026-02-24T19:17:28.689 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.677+0000 7feee249f640 20 client.4459.objecter put_session s=0x7feeac0a0ba0 osd=14 4 2026-02-24T19:17:28.689 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.677+0000 7feee249f640 10 client.4459.objecter _send_command 2 2026-02-24T19:17:28.689 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.677+0000 7feee249f640 1 -- 10.20.193.14:0/912187155 --> v1:10.20.193.170:6809/2177297767 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7feedc0b93c0 con 0x7feeac0a1250 2026-02-24T19:17:28.689 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.680+0000 7feed8ff9640 1 -- 10.20.193.14:0/912187155 <== osd.14 v1:10.20.193.170:6809/2177297767 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7feedc0b93c0 con 0x7feeac0a1250 2026-02-24T19:17:28.689 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.680+0000 7feed8ff9640 10 client.4459.objecter ms_dispatch2 0x7feedc000b90 command_reply(tid 2: 0 ) 2026-02-24T19:17:28.689 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.680+0000 7feed8ff9640 10 client.4459.objecter _finish_command 2 = system:0 2026-02-24T19:17:28.689 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.680+0000 7feed8ff9640 20 client.4459.objecter put_session s=0x7feeac0a0ba0 osd=14 4 2026-02-24T19:17:28.689 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.680+0000 7feed8ff9640 15 client.4459.objecter _session_command_op_remove 14 2 2026-02-24T19:17:28.690 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7feee249f640 10 librados: watch_flush enter 2026-02-24T19:17:28.690 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7feee249f640 10 librados: watch_flush exit 2026-02-24T19:17:28.690 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7feee249f640 10 client.4459.objecter close_session for osd.14 2026-02-24T19:17:28.690 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7feee249f640 1 -- 10.20.193.14:0/912187155 >> v1:10.20.193.170:6809/2177297767 conn(0x7feeac0a1250 legacy=0x7feeac0c1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.690 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7feee249f640 20 client.4459.objecter put_session s=0x7feeac0a0ba0 osd=14 1 2026-02-24T19:17:28.690 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7feee249f640 20 client.4459.objecter shutdown clearing up homeless session... 2026-02-24T19:17:28.690 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7feee249f640 10 client.4459.objecter successfully canceled tick 2026-02-24T19:17:28.690 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7feee249f640 1 -- 10.20.193.14:0/912187155 >> v1:10.20.193.14:6800/4014096310 conn(0x7feeac077d20 legacy=0x7feeac0981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.690 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7feee249f640 10 monclient: shutdown 2026-02-24T19:17:28.690 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7feee249f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.690 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7feee249f640 1 -- 10.20.193.14:0/912187155 >> v1:10.20.193.44:6789/0 conn(0x7feedc0b9f80 legacy=0x7feedc156620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.690 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7f775bfff640 1 -- 10.20.193.14:0/3545456418 <== osd.9 v1:10.20.193.44:6808/4259724385 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7f778005bbc0 con 0x7f77500a14e0 2026-02-24T19:17:28.690 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7f775bfff640 10 client.4454.objecter ms_dispatch2 0x7f7780000b90 command_reply(tid 2: 0 ) 2026-02-24T19:17:28.690 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7f775bfff640 10 client.4454.objecter _finish_command 2 = system:0 2026-02-24T19:17:28.690 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7f775bfff640 20 client.4454.objecter put_session s=0x7f77500a0e30 osd=9 4 2026-02-24T19:17:28.690 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7f775bfff640 15 client.4454.objecter _session_command_op_remove 9 2 2026-02-24T19:17:28.690 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7feee0a15640 1 -- 10.20.193.14:0/912187155 reap_dead start 2026-02-24T19:17:28.690 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7feee249f640 1 -- 10.20.193.14:0/912187155 shutdown_connections 2026-02-24T19:17:28.690 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7feee249f640 1 -- 10.20.193.14:0/912187155 >> 10.20.193.14:0/912187155 conn(0x7feedc0b7990 msgr2=0x7feedc15acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.690 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7feee249f640 1 -- 10.20.193.14:0/912187155 shutdown_connections 2026-02-24T19:17:28.690 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7feee249f640 1 -- 10.20.193.14:0/912187155 wait complete. 2026-02-24T19:17:28.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7f7785bd9640 10 librados: watch_flush enter 2026-02-24T19:17:28.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7f7785bd9640 10 librados: watch_flush exit 2026-02-24T19:17:28.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7f7785bd9640 10 client.4454.objecter close_session for osd.9 2026-02-24T19:17:28.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7f7785bd9640 1 -- 10.20.193.14:0/3545456418 >> v1:10.20.193.44:6808/4259724385 conn(0x7f77500a14e0 legacy=0x7f77500c1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7f7785bd9640 20 client.4454.objecter put_session s=0x7f77500a0e30 osd=9 1 2026-02-24T19:17:28.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7f7785bd9640 20 client.4454.objecter shutdown clearing up homeless session... 2026-02-24T19:17:28.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7f7785bd9640 10 client.4454.objecter successfully canceled tick 2026-02-24T19:17:28.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7f7785bd9640 1 -- 10.20.193.14:0/3545456418 >> v1:10.20.193.14:6800/4014096310 conn(0x7f7750077fb0 legacy=0x7f7750098460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7f7785bd9640 10 monclient: shutdown 2026-02-24T19:17:28.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7f7785bd9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7f7785bd9640 1 -- 10.20.193.14:0/3545456418 >> v1:10.20.193.170:6789/0 conn(0x7f77801f88c0 legacy=0x7f778015fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7f777ffff640 1 -- 10.20.193.14:0/3545456418 reap_dead start 2026-02-24T19:17:28.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7feee249f640 1 librados: shutdown 2026-02-24T19:17:28.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7f8303ca6640 10 client.4468.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:17:28.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7f8303ca6640 15 client.4468.objecter _session_command_op_assign -1 2 2026-02-24T19:17:28.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7f8303ca6640 20 client.4468.objecter _get_session s=0x7f82cc0a0b20 osd=7 3 2026-02-24T19:17:28.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7f8303ca6640 20 client.4468.objecter put_session s=0x7f82cc0a0b20 osd=7 3 2026-02-24T19:17:28.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7f8303ca6640 20 client.4468.objecter _get_session s=0x7f82cc0a0b20 osd=7 3 2026-02-24T19:17:28.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7f8303ca6640 15 client.4468.objecter _session_command_op_remove -1 2 2026-02-24T19:17:28.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7f8303ca6640 20 client.4468.objecter get_session s=0x7f82cc0a0b20 osd=7 3 2026-02-24T19:17:28.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7f8303ca6640 15 client.4468.objecter _session_command_op_assign 7 2 2026-02-24T19:17:28.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7f7785bd9640 1 -- 10.20.193.14:0/3545456418 shutdown_connections 2026-02-24T19:17:28.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7f7785bd9640 1 -- 10.20.193.14:0/3545456418 >> 10.20.193.14:0/3545456418 conn(0x7f77800b5290 msgr2=0x7f77800b5660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7f8303ca6640 20 client.4468.objecter put_session s=0x7f82cc0a0b20 osd=7 4 2026-02-24T19:17:28.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7f8303ca6640 10 client.4468.objecter _send_command 2 2026-02-24T19:17:28.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7f8303ca6640 1 -- 10.20.193.14:0/897198496 --> v1:10.20.193.195:6808/798109025 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f82fc0b94f0 con 0x7f82cc0a11d0 2026-02-24T19:17:28.692 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7f7785bd9640 1 -- 10.20.193.14:0/3545456418 shutdown_connections 2026-02-24T19:17:28.692 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7f7785bd9640 1 -- 10.20.193.14:0/3545456418 wait complete. 2026-02-24T19:17:28.692 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.681+0000 7f7785bd9640 1 librados: shutdown 2026-02-24T19:17:28.692 INFO:teuthology.orchestra.run.trial014.stdout:90194313220 2026-02-24T19:17:28.692 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-24T19:17:28.692 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.685+0000 7f5f80ee8640 10 client.4484.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:17:28.692 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.685+0000 7f5f80ee8640 15 client.4484.objecter _session_command_op_assign -1 2 2026-02-24T19:17:28.692 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.685+0000 7f5f80ee8640 20 client.4484.objecter _get_session s=0x7f5f480a0d70 osd=13 3 2026-02-24T19:17:28.692 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.685+0000 7f5f80ee8640 20 client.4484.objecter put_session s=0x7f5f480a0d70 osd=13 3 2026-02-24T19:17:28.692 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.685+0000 7f5f80ee8640 20 client.4484.objecter _get_session s=0x7f5f480a0d70 osd=13 3 2026-02-24T19:17:28.692 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.685+0000 7f5f80ee8640 15 client.4484.objecter _session_command_op_remove -1 2 2026-02-24T19:17:28.692 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.685+0000 7f5f80ee8640 20 client.4484.objecter get_session s=0x7f5f480a0d70 osd=13 3 2026-02-24T19:17:28.692 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.685+0000 7f5f80ee8640 15 client.4484.objecter _session_command_op_assign 13 2 2026-02-24T19:17:28.692 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.685+0000 7f5f80ee8640 20 client.4484.objecter put_session s=0x7f5f480a0d70 osd=13 4 2026-02-24T19:17:28.692 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.685+0000 7f5f80ee8640 10 client.4484.objecter _send_command 2 2026-02-24T19:17:28.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.685+0000 7f5f80ee8640 1 -- 10.20.193.14:0/2714502469 --> v1:10.20.193.44:6800/3795416779 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5f7c15bbb0 con 0x7f5f480a1420 2026-02-24T19:17:28.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.686+0000 7f82ea7fc640 1 -- 10.20.193.14:0/897198496 <== osd.7 v1:10.20.193.195:6808/798109025 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7f82fc0b94f0 con 0x7f82cc0a11d0 2026-02-24T19:17:28.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.686+0000 7f82ea7fc640 10 client.4468.objecter ms_dispatch2 0x7f82fc000b90 command_reply(tid 2: 0 ) 2026-02-24T19:17:28.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.686+0000 7f82ea7fc640 10 client.4468.objecter _finish_command 2 = system:0 2026-02-24T19:17:28.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.686+0000 7f82ea7fc640 20 client.4468.objecter put_session s=0x7f82cc0a0b20 osd=7 4 2026-02-24T19:17:28.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.686+0000 7f82ea7fc640 15 client.4468.objecter _session_command_op_remove 7 2 2026-02-24T19:17:28.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.686+0000 7f8303ca6640 10 librados: watch_flush enter 2026-02-24T19:17:28.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.686+0000 7f8303ca6640 10 librados: watch_flush exit 2026-02-24T19:17:28.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.686+0000 7f8303ca6640 10 client.4468.objecter close_session for osd.7 2026-02-24T19:17:28.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.686+0000 7f8303ca6640 1 -- 10.20.193.14:0/897198496 >> v1:10.20.193.195:6808/798109025 conn(0x7f82cc0a11d0 legacy=0x7f82cc0c1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.686+0000 7f8303ca6640 20 client.4468.objecter put_session s=0x7f82cc0a0b20 osd=7 1 2026-02-24T19:17:28.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.686+0000 7f8303ca6640 20 client.4468.objecter shutdown clearing up homeless session... 2026-02-24T19:17:28.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.686+0000 7f8303ca6640 10 client.4468.objecter successfully canceled tick 2026-02-24T19:17:28.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.686+0000 7f8303ca6640 1 -- 10.20.193.14:0/897198496 >> v1:10.20.193.14:6800/4014096310 conn(0x7f82cc077ca0 legacy=0x7f82cc098150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.686+0000 7f8303ca6640 10 monclient: shutdown 2026-02-24T19:17:28.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.686+0000 7f8303ca6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.686+0000 7f8303ca6640 1 -- 10.20.193.14:0/897198496 >> v1:10.20.193.44:6789/0 conn(0x7f82fc0b9f80 legacy=0x7f82fc1fc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.686+0000 7f830221c640 1 -- 10.20.193.14:0/897198496 reap_dead start 2026-02-24T19:17:28.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.686+0000 7f8303ca6640 1 -- 10.20.193.14:0/897198496 shutdown_connections 2026-02-24T19:17:28.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.686+0000 7f8303ca6640 1 -- 10.20.193.14:0/897198496 >> 10.20.193.14:0/897198496 conn(0x7f82fc0b7990 msgr2=0x7f82fc0b66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.686+0000 7f8303ca6640 1 -- 10.20.193.14:0/897198496 shutdown_connections 2026-02-24T19:17:28.694 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.686+0000 7f8303ca6640 1 -- 10.20.193.14:0/897198496 wait complete. 2026-02-24T19:17:28.694 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.686+0000 7f8303ca6640 1 librados: shutdown 2026-02-24T19:17:28.694 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.688+0000 7f5f62ffd640 1 -- 10.20.193.14:0/2714502469 <== osd.13 v1:10.20.193.44:6800/3795416779 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7f5f7c15bbb0 con 0x7f5f480a1420 2026-02-24T19:17:28.694 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.688+0000 7f5f62ffd640 10 client.4484.objecter ms_dispatch2 0x7f5f7c000b90 command_reply(tid 2: 0 ) 2026-02-24T19:17:28.694 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.688+0000 7f5f62ffd640 10 client.4484.objecter _finish_command 2 = system:0 2026-02-24T19:17:28.694 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.688+0000 7f5f62ffd640 20 client.4484.objecter put_session s=0x7f5f480a0d70 osd=13 4 2026-02-24T19:17:28.694 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.688+0000 7f5f62ffd640 15 client.4484.objecter _session_command_op_remove 13 2 2026-02-24T19:17:28.695 INFO:teuthology.orchestra.run.trial014.stdout:90194313220 2026-02-24T19:17:28.695 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.690+0000 7f48a37fe640 1 -- 10.20.193.14:0/3396094211 <== osd.10 v1:10.20.193.170:6808/983512563 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f48900c2ea0 con 0x7f48900a12a0 2026-02-24T19:17:28.695 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.690+0000 7f48a37fe640 10 client.4480.objecter ms_dispatch2 0x7f48c4000b90 command_reply(tid 1: 0 ) 2026-02-24T19:17:28.695 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.690+0000 7f48a37fe640 10 client.4480.objecter _finish_command 1 = system:0 2026-02-24T19:17:28.695 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.690+0000 7f48a37fe640 20 client.4480.objecter put_session s=0x7f48900a0bf0 osd=10 4 2026-02-24T19:17:28.695 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.690+0000 7f48a37fe640 15 client.4480.objecter _session_command_op_remove 10 1 2026-02-24T19:17:28.695 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.689+0000 7f5f80ee8640 10 librados: watch_flush enter 2026-02-24T19:17:28.695 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.689+0000 7f5f80ee8640 10 librados: watch_flush exit 2026-02-24T19:17:28.695 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.689+0000 7f5f80ee8640 10 client.4484.objecter close_session for osd.13 2026-02-24T19:17:28.695 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.689+0000 7f5f80ee8640 1 -- 10.20.193.14:0/2714502469 >> v1:10.20.193.44:6800/3795416779 conn(0x7f5f480a1420 legacy=0x7f5f480c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.695 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.689+0000 7f5f80ee8640 20 client.4484.objecter put_session s=0x7f5f480a0d70 osd=13 1 2026-02-24T19:17:28.695 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.689+0000 7f5f80ee8640 20 client.4484.objecter shutdown clearing up homeless session... 2026-02-24T19:17:28.695 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.689+0000 7f5f80ee8640 10 client.4484.objecter successfully canceled tick 2026-02-24T19:17:28.695 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.689+0000 7f5f80ee8640 1 -- 10.20.193.14:0/2714502469 >> v1:10.20.193.14:6800/4014096310 conn(0x7f5f48077ef0 legacy=0x7f5f480983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.695 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.689+0000 7f5f80ee8640 10 monclient: shutdown 2026-02-24T19:17:28.695 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.689+0000 7f5f80ee8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.695 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.689+0000 7f5f80ee8640 1 -- 10.20.193.14:0/2714502469 >> v1:10.20.193.170:6789/0 conn(0x7f5f7c058070 legacy=0x7f5f7c0b8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.695 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.689+0000 7f5f7ad76640 1 -- 10.20.193.14:0/2714502469 reap_dead start 2026-02-24T19:17:28.695 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.689+0000 7f5f80ee8640 1 -- 10.20.193.14:0/2714502469 shutdown_connections 2026-02-24T19:17:28.695 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.689+0000 7f5f80ee8640 1 -- 10.20.193.14:0/2714502469 >> 10.20.193.14:0/2714502469 conn(0x7f5f7c0b7780 msgr2=0x7f5f7c161d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.695 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.689+0000 7f5f80ee8640 1 -- 10.20.193.14:0/2714502469 shutdown_connections 2026-02-24T19:17:28.695 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.689+0000 7f5f80ee8640 1 -- 10.20.193.14:0/2714502469 wait complete. 2026-02-24T19:17:28.695 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.689+0000 7f5f80ee8640 1 librados: shutdown 2026-02-24T19:17:28.696 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-24T19:17:28.696 INFO:teuthology.orchestra.run.trial014.stdout:90194313220 2026-02-24T19:17:28.696 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2026-02-24T19:17:28.696 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.692+0000 7fab357fa640 1 -- 10.20.193.14:0/2139916363 <== osd.3 v1:10.20.193.195:6800/3081016231 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fab100c2ff0 con 0x7fab100a13f0 2026-02-24T19:17:28.696 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.692+0000 7fab357fa640 10 client.4469.objecter ms_dispatch2 0x7fab40000b90 command_reply(tid 1: 0 ) 2026-02-24T19:17:28.696 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.692+0000 7fab357fa640 10 client.4469.objecter _finish_command 1 = system:0 2026-02-24T19:17:28.696 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.692+0000 7fab357fa640 20 client.4469.objecter put_session s=0x7fab100a0d40 osd=3 4 2026-02-24T19:17:28.696 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.692+0000 7fab357fa640 15 client.4469.objecter _session_command_op_remove 3 1 2026-02-24T19:17:28.697 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.694+0000 7fdcebfff640 1 -- 10.20.193.14:0/1366958924 <== osd.12 v1:10.20.193.14:6801/1483397197 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fdce00c3060 con 0x7fdce00a13c0 2026-02-24T19:17:28.697 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.694+0000 7fdcebfff640 10 client.4482.objecter ms_dispatch2 0x7fdd10000b90 command_reply(tid 1: 0 ) 2026-02-24T19:17:28.697 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.694+0000 7fdcebfff640 10 client.4482.objecter _finish_command 1 = system:0 2026-02-24T19:17:28.697 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.694+0000 7fdcebfff640 20 client.4482.objecter put_session s=0x7fdce00a0d10 osd=12 4 2026-02-24T19:17:28.697 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.694+0000 7fdcebfff640 15 client.4482.objecter _session_command_op_remove 12 1 2026-02-24T19:17:28.697 INFO:teuthology.orchestra.run.trial014.stdout:90194313220 2026-02-24T19:17:28.697 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-24T19:17:28.698 INFO:teuthology.orchestra.run.trial014.stdout:90194313220 2026-02-24T19:17:28.699 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2026-02-24T19:17:28.701 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.699+0000 7f48c915c640 10 client.4480.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:17:28.701 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.699+0000 7f48c915c640 15 client.4480.objecter _session_command_op_assign -1 2 2026-02-24T19:17:28.701 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.699+0000 7f48c915c640 20 client.4480.objecter _get_session s=0x7f48900a0bf0 osd=10 3 2026-02-24T19:17:28.701 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.699+0000 7f48c915c640 20 client.4480.objecter put_session s=0x7f48900a0bf0 osd=10 3 2026-02-24T19:17:28.701 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.699+0000 7f48c915c640 20 client.4480.objecter _get_session s=0x7f48900a0bf0 osd=10 3 2026-02-24T19:17:28.701 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.699+0000 7f48c915c640 15 client.4480.objecter _session_command_op_remove -1 2 2026-02-24T19:17:28.701 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.699+0000 7f48c915c640 20 client.4480.objecter get_session s=0x7f48900a0bf0 osd=10 3 2026-02-24T19:17:28.701 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.699+0000 7f48c915c640 15 client.4480.objecter _session_command_op_assign 10 2 2026-02-24T19:17:28.701 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.699+0000 7f48c915c640 20 client.4480.objecter put_session s=0x7f48900a0bf0 osd=10 4 2026-02-24T19:17:28.701 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.699+0000 7f48c915c640 10 client.4480.objecter _send_command 2 2026-02-24T19:17:28.701 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.699+0000 7f48c915c640 1 -- 10.20.193.14:0/3396094211 --> v1:10.20.193.170:6808/983512563 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f48c4136d30 con 0x7f48900a12a0 2026-02-24T19:17:28.704 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.703+0000 7fab46cd8640 10 client.4469.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:17:28.704 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.703+0000 7fab46cd8640 15 client.4469.objecter _session_command_op_assign -1 2 2026-02-24T19:17:28.704 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.703+0000 7fab46cd8640 20 client.4469.objecter _get_session s=0x7fab100a0d40 osd=3 3 2026-02-24T19:17:28.704 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.703+0000 7fab46cd8640 20 client.4469.objecter put_session s=0x7fab100a0d40 osd=3 3 2026-02-24T19:17:28.704 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.703+0000 7fab46cd8640 20 client.4469.objecter _get_session s=0x7fab100a0d40 osd=3 3 2026-02-24T19:17:28.704 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.703+0000 7fab46cd8640 15 client.4469.objecter _session_command_op_remove -1 2 2026-02-24T19:17:28.704 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.703+0000 7fab46cd8640 20 client.4469.objecter get_session s=0x7fab100a0d40 osd=3 3 2026-02-24T19:17:28.704 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.703+0000 7fab46cd8640 15 client.4469.objecter _session_command_op_assign 3 2 2026-02-24T19:17:28.704 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.703+0000 7fab46cd8640 20 client.4469.objecter put_session s=0x7fab100a0d40 osd=3 4 2026-02-24T19:17:28.704 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.703+0000 7fab46cd8640 10 client.4469.objecter _send_command 2 2026-02-24T19:17:28.704 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.703+0000 7fab46cd8640 1 -- 10.20.193.14:0/2139916363 --> v1:10.20.193.195:6800/3081016231 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fab40157ae0 con 0x7fab100a13f0 2026-02-24T19:17:28.706 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.705+0000 7fdd15c4d640 10 client.4482.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:17:28.706 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.705+0000 7fdd15c4d640 15 client.4482.objecter _session_command_op_assign -1 2 2026-02-24T19:17:28.706 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.705+0000 7fdd15c4d640 20 client.4482.objecter _get_session s=0x7fdce00a0d10 osd=12 3 2026-02-24T19:17:28.706 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.705+0000 7fdd15c4d640 20 client.4482.objecter put_session s=0x7fdce00a0d10 osd=12 3 2026-02-24T19:17:28.706 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.705+0000 7fdd15c4d640 20 client.4482.objecter _get_session s=0x7fdce00a0d10 osd=12 3 2026-02-24T19:17:28.706 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.705+0000 7fdd15c4d640 15 client.4482.objecter _session_command_op_remove -1 2 2026-02-24T19:17:28.706 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.705+0000 7fdd15c4d640 20 client.4482.objecter get_session s=0x7fdce00a0d10 osd=12 3 2026-02-24T19:17:28.706 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.705+0000 7fdd15c4d640 15 client.4482.objecter _session_command_op_assign 12 2 2026-02-24T19:17:28.706 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.705+0000 7fdd15c4d640 20 client.4482.objecter put_session s=0x7fdce00a0d10 osd=12 4 2026-02-24T19:17:28.706 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.705+0000 7fdd15c4d640 10 client.4482.objecter _send_command 2 2026-02-24T19:17:28.706 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.705+0000 7fdd15c4d640 1 -- 10.20.193.14:0/1366958924 --> v1:10.20.193.14:6801/1483397197 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdd10164340 con 0x7fdce00a13c0 2026-02-24T19:17:28.706 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.705+0000 7f48a37fe640 1 -- 10.20.193.14:0/3396094211 <== osd.10 v1:10.20.193.170:6808/983512563 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7f48c4136d30 con 0x7f48900a12a0 2026-02-24T19:17:28.706 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.705+0000 7f48a37fe640 10 client.4480.objecter ms_dispatch2 0x7f48c4000b90 command_reply(tid 2: 0 ) 2026-02-24T19:17:28.706 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.705+0000 7f48a37fe640 10 client.4480.objecter _finish_command 2 = system:0 2026-02-24T19:17:28.706 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.705+0000 7f48a37fe640 20 client.4480.objecter put_session s=0x7f48900a0bf0 osd=10 4 2026-02-24T19:17:28.706 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.705+0000 7f48a37fe640 15 client.4480.objecter _session_command_op_remove 10 2 2026-02-24T19:17:28.707 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.706+0000 7f48c915c640 10 librados: watch_flush enter 2026-02-24T19:17:28.707 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.706+0000 7f48c915c640 10 librados: watch_flush exit 2026-02-24T19:17:28.707 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.706+0000 7f48c915c640 10 client.4480.objecter close_session for osd.10 2026-02-24T19:17:28.707 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.706+0000 7f48c915c640 1 -- 10.20.193.14:0/3396094211 >> v1:10.20.193.170:6808/983512563 conn(0x7f48900a12a0 legacy=0x7f48900c16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.707 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.706+0000 7f48c915c640 20 client.4480.objecter put_session s=0x7f48900a0bf0 osd=10 1 2026-02-24T19:17:28.707 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.706+0000 7f48c915c640 20 client.4480.objecter shutdown clearing up homeless session... 2026-02-24T19:17:28.707 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.706+0000 7f48c915c640 10 client.4480.objecter successfully canceled tick 2026-02-24T19:17:28.707 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.706+0000 7f48c915c640 1 -- 10.20.193.14:0/3396094211 >> v1:10.20.193.14:6800/4014096310 conn(0x7f4890077d70 legacy=0x7f4890098220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.707 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.706+0000 7f48c915c640 10 monclient: shutdown 2026-02-24T19:17:28.707 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.706+0000 7f48c915c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.707 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.706+0000 7f48c915c640 1 -- 10.20.193.14:0/3396094211 >> v1:10.20.193.44:6789/0 conn(0x7f48c4058580 legacy=0x7f48c41f8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.707 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.706+0000 7f48c3577640 1 -- 10.20.193.14:0/3396094211 reap_dead start 2026-02-24T19:17:28.707 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.706+0000 7f48c915c640 1 -- 10.20.193.14:0/3396094211 shutdown_connections 2026-02-24T19:17:28.707 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.706+0000 7f48c915c640 1 -- 10.20.193.14:0/3396094211 >> 10.20.193.14:0/3396094211 conn(0x7f48c40590f0 msgr2=0x7f48c40594c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.707 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.706+0000 7f48c915c640 1 -- 10.20.193.14:0/3396094211 shutdown_connections 2026-02-24T19:17:28.707 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.706+0000 7f48c915c640 1 -- 10.20.193.14:0/3396094211 wait complete. 2026-02-24T19:17:28.707 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.706+0000 7f48c915c640 1 librados: shutdown 2026-02-24T19:17:28.709 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.708+0000 7fdcebfff640 1 -- 10.20.193.14:0/1366958924 <== osd.12 v1:10.20.193.14:6801/1483397197 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7fdd10164340 con 0x7fdce00a13c0 2026-02-24T19:17:28.709 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.708+0000 7fdcebfff640 10 client.4482.objecter ms_dispatch2 0x7fdd10000b90 command_reply(tid 2: 0 ) 2026-02-24T19:17:28.709 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.708+0000 7fdcebfff640 10 client.4482.objecter _finish_command 2 = system:0 2026-02-24T19:17:28.709 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.708+0000 7fdcebfff640 20 client.4482.objecter put_session s=0x7fdce00a0d10 osd=12 4 2026-02-24T19:17:28.709 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.708+0000 7fdcebfff640 15 client.4482.objecter _session_command_op_remove 12 2 2026-02-24T19:17:28.709 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.708+0000 7fab357fa640 1 -- 10.20.193.14:0/2139916363 <== osd.3 v1:10.20.193.195:6800/3081016231 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7fab40157ae0 con 0x7fab100a13f0 2026-02-24T19:17:28.709 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.708+0000 7fab357fa640 10 client.4469.objecter ms_dispatch2 0x7fab40000b90 command_reply(tid 2: 0 ) 2026-02-24T19:17:28.709 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.708+0000 7fab357fa640 10 client.4469.objecter _finish_command 2 = system:0 2026-02-24T19:17:28.709 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.708+0000 7fab357fa640 20 client.4469.objecter put_session s=0x7fab100a0d40 osd=3 4 2026-02-24T19:17:28.709 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.708+0000 7fab357fa640 15 client.4469.objecter _session_command_op_remove 3 2 2026-02-24T19:17:28.710 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.709+0000 7fdd15c4d640 10 librados: watch_flush enter 2026-02-24T19:17:28.710 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.709+0000 7fab46cd8640 10 librados: watch_flush enter 2026-02-24T19:17:28.710 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.709+0000 7fab46cd8640 10 librados: watch_flush exit 2026-02-24T19:17:28.710 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.709+0000 7fab46cd8640 10 client.4469.objecter close_session for osd.3 2026-02-24T19:17:28.710 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.709+0000 7fab46cd8640 1 -- 10.20.193.14:0/2139916363 >> v1:10.20.193.195:6800/3081016231 conn(0x7fab100a13f0 legacy=0x7fab100c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.710 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.709+0000 7fab46cd8640 20 client.4469.objecter put_session s=0x7fab100a0d40 osd=3 1 2026-02-24T19:17:28.710 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.709+0000 7fab46cd8640 20 client.4469.objecter shutdown clearing up homeless session... 2026-02-24T19:17:28.710 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.709+0000 7fab46cd8640 10 client.4469.objecter successfully canceled tick 2026-02-24T19:17:28.710 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.709+0000 7fab46cd8640 1 -- 10.20.193.14:0/2139916363 >> v1:10.20.193.14:6800/4014096310 conn(0x7fab10077e60 legacy=0x7fab10098310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.710 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.709+0000 7fab46cd8640 10 monclient: shutdown 2026-02-24T19:17:28.711 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.709+0000 7fab46cd8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.711 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.709+0000 7fab46cd8640 1 -- 10.20.193.14:0/2139916363 >> v1:10.20.193.170:6789/0 conn(0x7fab400585e0 legacy=0x7fab40159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.711 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.709+0000 7fab4524e640 1 -- 10.20.193.14:0/2139916363 reap_dead start 2026-02-24T19:17:28.711 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.709+0000 7fdd15c4d640 10 librados: watch_flush exit 2026-02-24T19:17:28.711 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.709+0000 7fdd15c4d640 10 client.4482.objecter close_session for osd.12 2026-02-24T19:17:28.711 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.709+0000 7fdd15c4d640 1 -- 10.20.193.14:0/1366958924 >> v1:10.20.193.14:6801/1483397197 conn(0x7fdce00a13c0 legacy=0x7fdce00c17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.711 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.709+0000 7fdd15c4d640 20 client.4482.objecter put_session s=0x7fdce00a0d10 osd=12 1 2026-02-24T19:17:28.711 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.709+0000 7fdd15c4d640 20 client.4482.objecter shutdown clearing up homeless session... 2026-02-24T19:17:28.711 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.709+0000 7fdd15c4d640 10 client.4482.objecter successfully canceled tick 2026-02-24T19:17:28.711 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.710+0000 7fdd15c4d640 1 -- 10.20.193.14:0/1366958924 >> v1:10.20.193.14:6800/4014096310 conn(0x7fdce0077e90 legacy=0x7fdce0098340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.711 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.710+0000 7fdd15c4d640 10 monclient: shutdown 2026-02-24T19:17:28.711 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.710+0000 7fdd15c4d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.711 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.710+0000 7fdd15c4d640 1 -- 10.20.193.14:0/1366958924 >> v1:10.20.193.14:6789/0 conn(0x7fdd10058070 legacy=0x7fdd100b4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.711 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.710+0000 7fdd0ffff640 1 -- 10.20.193.14:0/1366958924 reap_dead start 2026-02-24T19:17:28.712 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.712+0000 7fdd15c4d640 1 -- 10.20.193.14:0/1366958924 shutdown_connections 2026-02-24T19:17:28.713 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.712+0000 7fdd15c4d640 1 -- 10.20.193.14:0/1366958924 >> 10.20.193.14:0/1366958924 conn(0x7fdd100b7780 msgr2=0x7fdd10058460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.714 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.713+0000 7fdd15c4d640 1 -- 10.20.193.14:0/1366958924 shutdown_connections 2026-02-24T19:17:28.714 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.713+0000 7fdd15c4d640 1 -- 10.20.193.14:0/1366958924 wait complete. 2026-02-24T19:17:28.714 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.713+0000 7fdd15c4d640 1 librados: shutdown 2026-02-24T19:17:28.714 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.713+0000 7fab46cd8640 1 -- 10.20.193.14:0/2139916363 shutdown_connections 2026-02-24T19:17:28.714 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.713+0000 7fab46cd8640 1 -- 10.20.193.14:0/2139916363 >> 10.20.193.14:0/2139916363 conn(0x7fab400b7990 msgr2=0x7fab4015ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.714 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.713+0000 7fab46cd8640 1 -- 10.20.193.14:0/2139916363 shutdown_connections 2026-02-24T19:17:28.716 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.716+0000 7fab46cd8640 1 -- 10.20.193.14:0/2139916363 wait complete. 2026-02-24T19:17:28.717 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.716+0000 7fab46cd8640 1 librados: shutdown 2026-02-24T19:17:28.718 INFO:teuthology.orchestra.run.trial014.stdout:90194313220 2026-02-24T19:17:28.718 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2026-02-24T19:17:28.724 INFO:teuthology.orchestra.run.trial014.stdout:90194313220 2026-02-24T19:17:28.724 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2026-02-24T19:17:28.728 INFO:teuthology.orchestra.run.trial014.stdout:90194313220 2026-02-24T19:17:28.728 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-24T19:17:28.755 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.753+0000 7f2fc4de0640 10 monclient: get_monmap_and_config 2026-02-24T19:17:28.755 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.753+0000 7f2fc4de0640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.755 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.753+0000 7f2fc4de0640 10 monclient: monmap: 2026-02-24T19:17:28.755 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.755 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.755 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:28.754217+0000 2026-02-24T19:17:28.755 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:28.754217+0000 2026-02-24T19:17:28.755 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.755 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.755 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.755 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.755 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.755 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.754+0000 7f2fc4de0640 1 Processor -- start 2026-02-24T19:17:28.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.754+0000 7f2fc4de0640 1 -- start start 2026-02-24T19:17:28.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.754+0000 7f2fc4de0640 10 monclient: init 2026-02-24T19:17:28.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.755+0000 7f2fc4de0640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.755+0000 7f2fc4de0640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:28.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.755+0000 7f2fc4de0640 10 monclient(hunting): picked mon.noname-a con 0x7f2fc00b9f80 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.755+0000 7f2fc4de0640 10 monclient(hunting): picked mon.noname-c con 0x7f2fc00ba350 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.755+0000 7f2fc4de0640 10 monclient(hunting): picked mon.noname-b con 0x7f2fc00585e0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.755+0000 7f2fc4de0640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fc0163930 con 0x7f2fc00b9f80 2026-02-24T19:17:28.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.755+0000 7f2fc4de0640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fc0163bb0 con 0x7f2fc00585e0 2026-02-24T19:17:28.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.755+0000 7f2fc4de0640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fc0163e90 con 0x7f2fc00ba350 2026-02-24T19:17:28.757 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.755+0000 7f2fc4de0640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.757 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.755+0000 7f2fc4de0640 10 monclient(hunting): authenticate will time out at 3623.436266s 2026-02-24T19:17:28.757 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.755+0000 7f7893a9c640 10 monclient: get_monmap_and_config 2026-02-24T19:17:28.757 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.755+0000 7f7893a9c640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.757 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.755+0000 7f7893a9c640 10 monclient: monmap: 2026-02-24T19:17:28.757 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.757 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.757 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:28.755943+0000 2026-02-24T19:17:28.757 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:28.755943+0000 2026-02-24T19:17:28.757 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.757 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.757 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.757 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.757 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.757 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.758 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.755+0000 7f2fbdd74640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7f2fc00ba350 0x7f2fc0057ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:44990/0 (socket says 10.20.193.14:44990) 2026-02-24T19:17:28.758 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.755+0000 7f2fbdd74640 1 -- 10.20.193.14:0/3158964699 learned_addr learned my addr 10.20.193.14:0/3158964699 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.758 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.755+0000 7f7893a9c640 1 Processor -- start 2026-02-24T19:17:28.758 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.756+0000 7f7893a9c640 1 -- start start 2026-02-24T19:17:28.758 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.756+0000 7f7893a9c640 10 monclient: init 2026-02-24T19:17:28.758 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.756+0000 7f7893a9c640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.759 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.756+0000 7f7893a9c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:28.759 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.756+0000 7f7893a9c640 10 monclient(hunting): picked mon.noname-b con 0x7f788c0b9f80 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.759 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.756+0000 7f7893a9c640 10 monclient(hunting): picked mon.noname-c con 0x7f788c0ba350 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.759 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.756+0000 7f7893a9c640 10 monclient(hunting): picked mon.noname-a con 0x7f788c0585e0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.759 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.756+0000 7f7893a9c640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f788c163930 con 0x7f788c0585e0 2026-02-24T19:17:28.759 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.756+0000 7f7893a9c640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f788c163bb0 con 0x7f788c0b9f80 2026-02-24T19:17:28.759 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.756+0000 7f7893a9c640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f788c163e90 con 0x7f788c0ba350 2026-02-24T19:17:28.759 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.756+0000 7f7893a9c640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.759 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.756+0000 7f7893a9c640 10 monclient(hunting): authenticate will time out at 3623.437726s 2026-02-24T19:17:28.759 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.757+0000 7f2fbd573640 1 -- 10.20.193.14:0/3158964699 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1898992859 0 0) 0x7f2fc0163e90 con 0x7f2fc00ba350 2026-02-24T19:17:28.759 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.757+0000 7f2fbd573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.759 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.757+0000 7f2fbd573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.759 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.757+0000 7f2fbd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.759 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.757+0000 7f2fbd573640 10 monclient(hunting): my global_id is 4493 2026-02-24T19:17:28.759 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.757+0000 7f2fbd573640 1 -- 10.20.193.14:0/3158964699 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fac003610 con 0x7f2fc00ba350 2026-02-24T19:17:28.760 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.757+0000 7f7892012640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f788c0585e0 0x7f788c166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:54936/0 (socket says 10.20.193.14:54936) 2026-02-24T19:17:28.760 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.757+0000 7f7892012640 1 -- 10.20.193.14:0/22447962 learned_addr learned my addr 10.20.193.14:0/22447962 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.760 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.757+0000 7f2fbd573640 1 -- 10.20.193.14:0/3158964699 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3574357383 0 0) 0x7f2fc0163bb0 con 0x7f2fc00585e0 2026-02-24T19:17:28.760 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.757+0000 7f2fbd573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.760 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.757+0000 7f2fbd573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.760 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.757+0000 7f2fbd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.760 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.757+0000 7f2fbd573640 10 monclient(hunting): my global_id is 4483 2026-02-24T19:17:28.760 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.757+0000 7f2fbd573640 1 -- 10.20.193.14:0/3158964699 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fc0163e90 con 0x7f2fc00585e0 2026-02-24T19:17:28.760 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.758+0000 7f2fbd573640 1 -- 10.20.193.14:0/3158964699 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3588597620 0 0) 0x7f2fb4002910 con 0x7f2fc00b9f80 2026-02-24T19:17:28.760 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.758+0000 7f2fbd573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.760 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.758+0000 7f2fbd573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.760 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.758+0000 7f2fbd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.760 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.758+0000 7f2fbd573640 10 monclient(hunting): my global_id is 4488 2026-02-24T19:17:28.760 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.758+0000 7f2fbd573640 1 -- 10.20.193.14:0/3158964699 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fc0163bb0 con 0x7f2fc00b9f80 2026-02-24T19:17:28.761 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.759+0000 7f2fbd573640 1 -- 10.20.193.14:0/3158964699 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1730271200 0 0) 0x7f2fc0163e90 con 0x7f2fc00585e0 2026-02-24T19:17:28.761 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.760+0000 7f2fbd573640 1 -- 10.20.193.14:0/3158964699 >> v1:10.20.193.170:6789/0 conn(0x7f2fc00ba350 legacy=0x7f2fc0057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.761 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.760+0000 7f2fbd573640 1 -- 10.20.193.14:0/3158964699 >> v1:10.20.193.14:6789/0 conn(0x7f2fc00b9f80 legacy=0x7f2fc0163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.761 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.760+0000 7f2fbd573640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.761 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.760+0000 7f2fbd573640 1 monclient: found mon.noname-b 2026-02-24T19:17:28.761 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.760+0000 7f2fbd573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.761 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.760+0000 7f2fbd573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.761 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.760+0000 7f2fbd573640 1 -- 10.20.193.14:0/3158964699 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc00573f0 con 0x7f2fc00585e0 2026-02-24T19:17:28.761 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.760+0000 7f2fbd573640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.761 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.760+0000 7f2fbd573640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.761 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.760+0000 7f2fbd573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.761 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.760+0000 7f2fbd573640 1 -- 10.20.193.14:0/3158964699 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f2fb0003170 con 0x7f2fc00585e0 2026-02-24T19:17:28.761 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.760+0000 7f2fbd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.761 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.760+0000 7f2fbd573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:28.762 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.760+0000 7f2fbd573640 10 monclient: dump: 2026-02-24T19:17:28.762 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.762 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.762 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.762 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.762 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.762 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.762 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.762 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.762 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.762 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.762 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.760+0000 7f2fc4de0640 5 monclient: authenticate success, global_id 4483 2026-02-24T19:17:28.762 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.760+0000 7f2fc4de0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.762 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.760+0000 7f789080f640 1 -- 10.20.193.14:0/22447962 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1849092350 0 0) 0x7f788c163e90 con 0x7f788c0ba350 2026-02-24T19:17:28.762 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.760+0000 7f789080f640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.763 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.760+0000 7f789080f640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.763 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.760+0000 7f789080f640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.763 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.760+0000 7f789080f640 10 monclient(hunting): my global_id is 4496 2026-02-24T19:17:28.763 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.760+0000 7f789080f640 1 -- 10.20.193.14:0/22447962 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7874003610 con 0x7f788c0ba350 2026-02-24T19:17:28.763 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.761+0000 7f789080f640 1 -- 10.20.193.14:0/22447962 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1037290180 0 0) 0x7f788c163bb0 con 0x7f788c0b9f80 2026-02-24T19:17:28.763 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.761+0000 7f789080f640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.763 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.761+0000 7f789080f640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.763 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.761+0000 7f789080f640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.763 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.761+0000 7f789080f640 10 monclient(hunting): my global_id is 4486 2026-02-24T19:17:28.763 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.761+0000 7f789080f640 1 -- 10.20.193.14:0/22447962 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7874003970 con 0x7f788c0b9f80 2026-02-24T19:17:28.763 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f2fbd573640 1 -- 10.20.193.14:0/3158964699 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2fb0003340 con 0x7f2fc00585e0 2026-02-24T19:17:28.763 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f2fbd573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.763 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f2fbd573640 1 -- 10.20.193.14:0/3158964699 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f2fb0003780 con 0x7f2fc00585e0 2026-02-24T19:17:28.763 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f2fbd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.763 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f2fbd573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:28.763 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f2fbd573640 10 monclient: dump: 2026-02-24T19:17:28.764 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.764 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.764 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.764 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.764 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.764 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.764 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.764 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.764 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.764 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.764 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f2fc4de0640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:28.764 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f2fc4de0640 4 set_mon_vals no callback set 2026-02-24T19:17:28.764 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f2fc4de0640 10 monclient: shutdown 2026-02-24T19:17:28.764 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f2fc4de0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.764 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f2fc4de0640 1 -- 10.20.193.14:0/3158964699 >> v1:10.20.193.44:6789/0 conn(0x7f2fc00585e0 legacy=0x7f2fc0166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.765 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f789080f640 1 -- 10.20.193.14:0/22447962 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2065612441 0 0) 0x7f7888002c90 con 0x7f788c0585e0 2026-02-24T19:17:28.765 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f789080f640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.765 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f789080f640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.765 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f789080f640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.765 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f789080f640 10 monclient(hunting): my global_id is 4491 2026-02-24T19:17:28.765 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f789080f640 1 -- 10.20.193.14:0/22447962 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f788c163bb0 con 0x7f788c0585e0 2026-02-24T19:17:28.765 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f789080f640 1 -- 10.20.193.14:0/22447962 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3441496348 0 0) 0x7f7874003610 con 0x7f788c0ba350 2026-02-24T19:17:28.765 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f789080f640 1 -- 10.20.193.14:0/22447962 >> v1:10.20.193.44:6789/0 conn(0x7f788c0b9f80 legacy=0x7f788c163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.765 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f789080f640 1 -- 10.20.193.14:0/22447962 >> v1:10.20.193.14:6789/0 conn(0x7f788c0585e0 legacy=0x7f788c166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.765 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f789080f640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.765 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f789080f640 1 monclient: found mon.noname-c 2026-02-24T19:17:28.765 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f789080f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.765 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f789080f640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.765 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f789080f640 1 -- 10.20.193.14:0/22447962 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f788c0573f0 con 0x7f788c0ba350 2026-02-24T19:17:28.765 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f789080f640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.765 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f789080f640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.765 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f789080f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.765 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f789080f640 1 -- 10.20.193.14:0/22447962 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7880002dd0 con 0x7f788c0ba350 2026-02-24T19:17:28.765 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f789080f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.765 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f789080f640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:28.765 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f789080f640 10 monclient: dump: 2026-02-24T19:17:28.765 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.765 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.766 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.766 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.766 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.766 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.766 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.766 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.766 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.766 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.766 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f7893a9c640 5 monclient: authenticate success, global_id 4496 2026-02-24T19:17:28.766 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f7893a9c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.767 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f2fc4de0640 1 -- 10.20.193.14:0/3158964699 shutdown_connections 2026-02-24T19:17:28.767 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f2fc4de0640 1 -- 10.20.193.14:0/3158964699 >> 10.20.193.14:0/3158964699 conn(0x7f2fc00b7990 msgr2=0x7f2fc00b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.767 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f2fc4de0640 1 -- 10.20.193.14:0/3158964699 shutdown_connections 2026-02-24T19:17:28.767 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.762+0000 7f2fc4de0640 1 -- 10.20.193.14:0/3158964699 wait complete. 2026-02-24T19:17:28.767 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.763+0000 7f2fc4de0640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.767 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.763+0000 7f2fc4de0640 10 monclient: monmap: 2026-02-24T19:17:28.767 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.767 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:28.767 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:28.767 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:28.767 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.767 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:28.767 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.767 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.767 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.767 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.767 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.763+0000 7f2fc4de0640 1 librados: starting msgr at 2026-02-24T19:17:28.768 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.763+0000 7f2fc4de0640 1 librados: starting objecter 2026-02-24T19:17:28.768 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.763+0000 7f2fc4de0640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:28.768 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.763+0000 7f2fc4de0640 1 Processor -- start 2026-02-24T19:17:28.768 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.763+0000 7f2fc4de0640 1 -- start start 2026-02-24T19:17:28.768 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.763+0000 7f2fc4de0640 1 librados: setting wanted keys 2026-02-24T19:17:28.768 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.763+0000 7f2fc4de0640 1 librados: calling monclient init 2026-02-24T19:17:28.768 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.763+0000 7f2fc4de0640 10 monclient: init 2026-02-24T19:17:28.768 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.764+0000 7f2fc4de0640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.768 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.764+0000 7f2fc4de0640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:28.768 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.764+0000 7f2fc4de0640 10 monclient(hunting): picked mon.noname-c con 0x7f2fc00585e0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.768 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.764+0000 7f2fc4de0640 10 monclient(hunting): picked mon.noname-a con 0x7f2fc00b9f80 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.768 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.764+0000 7f2fc4de0640 10 monclient(hunting): picked mon.noname-b con 0x7f2fc00ba350 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.768 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.764+0000 7f2fc4de0640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fc0164640 con 0x7f2fc00b9f80 2026-02-24T19:17:28.768 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.764+0000 7f2fc4de0640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fc01fc050 con 0x7f2fc00ba350 2026-02-24T19:17:28.768 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.764+0000 7f2fc4de0640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fc01fba90 con 0x7f2fc00585e0 2026-02-24T19:17:28.768 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.764+0000 7f2fc4de0640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.768 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.764+0000 7f2fc4de0640 10 monclient(hunting): authenticate will time out at 3623.445398s 2026-02-24T19:17:28.768 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.764+0000 7f2fbe575640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7f2fc00585e0 0x7f2fc01fb150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:44998/0 (socket says 10.20.193.14:44998) 2026-02-24T19:17:28.768 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.764+0000 7f2fbe575640 1 -- 10.20.193.14:0/1935728667 learned_addr learned my addr 10.20.193.14:0/1935728667 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.768 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.764+0000 7f789080f640 1 -- 10.20.193.14:0/22447962 <== mon.2 v1:10.20.193.170:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7880003020 con 0x7f788c0ba350 2026-02-24T19:17:28.768 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.764+0000 7f789080f640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.764+0000 7f789080f640 1 -- 10.20.193.14:0/22447962 <== mon.2 v1:10.20.193.170:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7880003460 con 0x7f788c0ba350 2026-02-24T19:17:28.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.764+0000 7f789080f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.764+0000 7f789080f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:28.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.764+0000 7f789080f640 10 monclient: dump: 2026-02-24T19:17:28.769 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.769 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.769 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.769 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.769 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.769 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.769 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.769 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.769 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.769 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.764+0000 7f7893a9c640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:28.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.764+0000 7f7893a9c640 4 set_mon_vals no callback set 2026-02-24T19:17:28.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.765+0000 7f2fa6ffd640 10 client.?.objecter ms_handle_connect 0x7f2fc00585e0 2026-02-24T19:17:28.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.765+0000 7f2fa6ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.770 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.765+0000 7f2fa6ffd640 10 client.?.objecter ms_handle_connect 0x7f2fc00ba350 2026-02-24T19:17:28.770 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.765+0000 7f2fa6ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.770 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.765+0000 7f7893a9c640 10 monclient: shutdown 2026-02-24T19:17:28.770 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.765+0000 7f7893a9c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.770 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.765+0000 7f7893a9c640 1 -- 10.20.193.14:0/22447962 >> v1:10.20.193.170:6789/0 conn(0x7f788c0ba350 legacy=0x7f788c057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.770 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.765+0000 7f7893a9c640 1 -- 10.20.193.14:0/22447962 shutdown_connections 2026-02-24T19:17:28.770 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.765+0000 7f7893a9c640 1 -- 10.20.193.14:0/22447962 >> 10.20.193.14:0/22447962 conn(0x7f788c0b7990 msgr2=0x7f788c0b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.770 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.765+0000 7f7893a9c640 1 -- 10.20.193.14:0/22447962 shutdown_connections 2026-02-24T19:17:28.770 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.765+0000 7f7893a9c640 1 -- 10.20.193.14:0/22447962 wait complete. 2026-02-24T19:17:28.770 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.766+0000 7f2fa6ffd640 1 -- 10.20.193.14:0/1935728667 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2612736903 0 0) 0x7f2fc01fc050 con 0x7f2fc00ba350 2026-02-24T19:17:28.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.766+0000 7f2fa6ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.766+0000 7f2fa6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.766+0000 7f2fa6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.766+0000 7f2fa6ffd640 10 monclient(hunting): my global_id is 4489 2026-02-24T19:17:28.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.766+0000 7f2fa6ffd640 1 -- 10.20.193.14:0/1935728667 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f8c003610 con 0x7f2fc00ba350 2026-02-24T19:17:28.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.766+0000 7f2fa6ffd640 1 -- 10.20.193.14:0/1935728667 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3144848094 0 0) 0x7f2fc01fba90 con 0x7f2fc00585e0 2026-02-24T19:17:28.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.766+0000 7f2fa6ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.766+0000 7f2fa6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.766+0000 7f2fa6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.766+0000 7f2fa6ffd640 10 monclient(hunting): my global_id is 4499 2026-02-24T19:17:28.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.766+0000 7f2fa6ffd640 1 -- 10.20.193.14:0/1935728667 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fc01fc050 con 0x7f2fc00585e0 2026-02-24T19:17:28.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.766+0000 7f2fa6ffd640 10 client.?.objecter ms_handle_connect 0x7f2fc00b9f80 2026-02-24T19:17:28.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.766+0000 7f2fa6ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.772 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.766+0000 7f7893a9c640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.772 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.766+0000 7f7893a9c640 10 monclient: monmap: 2026-02-24T19:17:28.772 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.772 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:28.772 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:28.772 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:28.772 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.772 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:28.772 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.772 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.772 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.772 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.772 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.766+0000 7f7893a9c640 1 librados: starting msgr at 2026-02-24T19:17:28.772 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.766+0000 7f7893a9c640 1 librados: starting objecter 2026-02-24T19:17:28.772 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.766+0000 7f7893a9c640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:28.772 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.766+0000 7f7893a9c640 1 Processor -- start 2026-02-24T19:17:28.772 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.766+0000 7f7893a9c640 1 -- start start 2026-02-24T19:17:28.772 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.766+0000 7f7893a9c640 1 librados: setting wanted keys 2026-02-24T19:17:28.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.766+0000 7f7893a9c640 1 librados: calling monclient init 2026-02-24T19:17:28.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.766+0000 7f7893a9c640 10 monclient: init 2026-02-24T19:17:28.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.767+0000 7f7893a9c640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.767+0000 7f7893a9c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:28.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.767+0000 7f7893a9c640 10 monclient(hunting): picked mon.noname-b con 0x7f788c0585e0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.767+0000 7f7893a9c640 10 monclient(hunting): picked mon.noname-a con 0x7f788c0b9f80 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.767+0000 7f7893a9c640 10 monclient(hunting): picked mon.noname-c con 0x7f788c0ba350 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.767+0000 7f7893a9c640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f788c13a300 con 0x7f788c0b9f80 2026-02-24T19:17:28.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.767+0000 7f7893a9c640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f788c13a5e0 con 0x7f788c0585e0 2026-02-24T19:17:28.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.767+0000 7f7893a9c640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f788c13a8c0 con 0x7f788c0ba350 2026-02-24T19:17:28.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.767+0000 7f7893a9c640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.767+0000 7f7893a9c640 10 monclient(hunting): authenticate will time out at 3623.448583s 2026-02-24T19:17:28.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.768+0000 7f2fa6ffd640 1 -- 10.20.193.14:0/1935728667 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2671062136 0 0) 0x7f2fc0164640 con 0x7f2fc00b9f80 2026-02-24T19:17:28.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.768+0000 7f2fa6ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.768+0000 7f2fa6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.768+0000 7f2fa6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.774 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.768+0000 7f2fa6ffd640 10 monclient(hunting): my global_id is 4494 2026-02-24T19:17:28.774 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.768+0000 7f2fa6ffd640 1 -- 10.20.193.14:0/1935728667 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fc01fba90 con 0x7f2fc00b9f80 2026-02-24T19:17:28.774 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.768+0000 7f2fa6ffd640 1 -- 10.20.193.14:0/1935728667 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1810302641 0 0) 0x7f2f8c003610 con 0x7f2fc00ba350 2026-02-24T19:17:28.774 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.768+0000 7f2fa6ffd640 1 -- 10.20.193.14:0/1935728667 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2fc0164640 con 0x7f2fc00ba350 2026-02-24T19:17:28.774 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.768+0000 7f2fa6ffd640 1 -- 10.20.193.14:0/1935728667 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f2fb0003690 con 0x7f2fc00ba350 2026-02-24T19:17:28.774 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.768+0000 7f2fa6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.774 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.768+0000 7f2fa6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:28.774 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.768+0000 7f2fa6ffd640 10 monclient(hunting): dump: 2026-02-24T19:17:28.774 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.774 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.774 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.774 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.774 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.774 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.774 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.774 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.774 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.774 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.774 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.768+0000 7f2fa6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:28.774 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.768+0000 7f2fa6ffd640 1 -- 10.20.193.14:0/1935728667 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3066226560 0 0) 0x7f2fc01fc050 con 0x7f2fc00585e0 2026-02-24T19:17:28.774 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.768+0000 7f7891811640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7f788c0585e0 0x7f788c1fc2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:34654/0 (socket says 10.20.193.14:34654) 2026-02-24T19:17:28.774 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.768+0000 7f7891811640 1 -- 10.20.193.14:0/7685078 learned_addr learned my addr 10.20.193.14:0/7685078 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.775 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.768+0000 7f2fa6ffd640 1 -- 10.20.193.14:0/1935728667 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2f8c003610 con 0x7f2fc00585e0 2026-02-24T19:17:28.775 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.768+0000 7f2fa6ffd640 1 -- 10.20.193.14:0/1935728667 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f2fb4003260 con 0x7f2fc00585e0 2026-02-24T19:17:28.775 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.768+0000 7f2fa6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.775 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.768+0000 7f2fa6ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:28.775 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.768+0000 7f2fa6ffd640 10 monclient(hunting): dump: 2026-02-24T19:17:28.775 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.775 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.775 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.775 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.775 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.775 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.775 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.775 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.775 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.775 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.775 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.769+0000 7f787a7fc640 10 client.?.objecter ms_handle_connect 0x7f788c0585e0 2026-02-24T19:17:28.775 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.769+0000 7f787a7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.776 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.770+0000 7f2fa6ffd640 1 -- 10.20.193.14:0/1935728667 <== mon.1 v1:10.20.193.44:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1172165978 0 0) 0x7f2fc0164640 con 0x7f2fc00ba350 2026-02-24T19:17:28.776 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.770+0000 7f2fa6ffd640 1 -- 10.20.193.14:0/1935728667 >> v1:10.20.193.170:6789/0 conn(0x7f2fc00585e0 legacy=0x7f2fc01fb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.776 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.770+0000 7f2fa6ffd640 1 -- 10.20.193.14:0/1935728667 >> v1:10.20.193.14:6789/0 conn(0x7f2fc00b9f80 legacy=0x7f2fc01565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.776 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.770+0000 7f2fa6ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.776 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.770+0000 7f2fa6ffd640 1 monclient: found mon.b 2026-02-24T19:17:28.776 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.770+0000 7f2fa6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.776 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.770+0000 7f2fa6ffd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.776 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.770+0000 7f2fa6ffd640 1 -- 10.20.193.14:0/1935728667 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc01fbd70 con 0x7f2fc00ba350 2026-02-24T19:17:28.776 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.770+0000 7f2fa6ffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.776 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.770+0000 7f2fa6ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.776 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.770+0000 7f2fa6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.776 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.770+0000 7f2fc4de0640 5 monclient: authenticate success, global_id 4489 2026-02-24T19:17:28.776 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.770+0000 7f2fc4de0640 10 monclient: _renew_subs 2026-02-24T19:17:28.776 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.770+0000 7f2fc4de0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.776 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.770+0000 7f2fc4de0640 1 -- 10.20.193.14:0/1935728667 --> v1:10.20.193.44:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2fc01648e0 con 0x7f2fc00ba350 2026-02-24T19:17:28.776 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.770+0000 7f2fc4de0640 10 client.4489.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.776 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.770+0000 7f2fc4de0640 10 monclient: _renew_subs 2026-02-24T19:17:28.776 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.770+0000 7f2fc4de0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.776 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.770+0000 7f2fc4de0640 1 -- 10.20.193.14:0/1935728667 --> v1:10.20.193.44:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2fc00b2500 con 0x7f2fc00ba350 2026-02-24T19:17:28.776 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.770+0000 7f2fc4de0640 1 librados: init done 2026-02-24T19:17:28.777 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.770+0000 7f787a7fc640 10 client.?.objecter ms_handle_connect 0x7f788c0ba350 2026-02-24T19:17:28.777 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.770+0000 7f787a7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.777 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.771+0000 7f2d0ff08640 10 monclient: get_monmap_and_config 2026-02-24T19:17:28.777 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.771+0000 7f2d0ff08640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.777 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.771+0000 7f2d0ff08640 10 monclient: monmap: 2026-02-24T19:17:28.777 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.777 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.777 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:28.771928+0000 2026-02-24T19:17:28.777 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:28.771928+0000 2026-02-24T19:17:28.777 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.777 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.777 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.777 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.777 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.777 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.777 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.771+0000 7f7c3c533640 10 monclient: get_monmap_and_config 2026-02-24T19:17:28.777 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.771+0000 7f7c3c533640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.777 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.771+0000 7f7c3c533640 10 monclient: monmap: 2026-02-24T19:17:28.778 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.778 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.778 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:28.771972+0000 2026-02-24T19:17:28.778 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:28.771972+0000 2026-02-24T19:17:28.778 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.778 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.778 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.778 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.778 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.778 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.778 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.771+0000 7f2fc4de0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.778 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.771+0000 7f2fc4de0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.778 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.771+0000 7f2fc4de0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.778 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.771+0000 7f2fc4de0640 1 -- 10.20.193.14:0/1935728667 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fc0159b70 con 0x7f2fc00ba350 2026-02-24T19:17:28.779 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.771+0000 7f7c3c533640 1 Processor -- start 2026-02-24T19:17:28.779 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.771+0000 7f7c3c533640 1 -- start start 2026-02-24T19:17:28.779 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.771+0000 7f7c3c533640 10 monclient: init 2026-02-24T19:17:28.779 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.771+0000 7f2d0ff08640 1 Processor -- start 2026-02-24T19:17:28.779 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.772+0000 7f2d0ff08640 1 -- start start 2026-02-24T19:17:28.779 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.772+0000 7f2d0ff08640 10 monclient: init 2026-02-24T19:17:28.779 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.772+0000 7f787a7fc640 1 -- 10.20.193.14:0/7685078 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3975392455 0 0) 0x7f788c13a5e0 con 0x7f788c0585e0 2026-02-24T19:17:28.779 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.772+0000 7f787a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.779 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.772+0000 7f787a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.779 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.772+0000 7f787a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.779 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.772+0000 7f787a7fc640 10 monclient(hunting): my global_id is 4492 2026-02-24T19:17:28.779 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.772+0000 7f787a7fc640 1 -- 10.20.193.14:0/7685078 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f785c003610 con 0x7f788c0585e0 2026-02-24T19:17:28.779 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.772+0000 7f787a7fc640 1 -- 10.20.193.14:0/7685078 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 733541731 0 0) 0x7f788c13a8c0 con 0x7f788c0ba350 2026-02-24T19:17:28.779 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.772+0000 7f787a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.779 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.772+0000 7f787a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.779 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.772+0000 7f787a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.772+0000 7f787a7fc640 10 monclient(hunting): my global_id is 4502 2026-02-24T19:17:28.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.772+0000 7f787a7fc640 1 -- 10.20.193.14:0/7685078 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f788c13a5e0 con 0x7f788c0ba350 2026-02-24T19:17:28.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.772+0000 7f76c319b640 10 monclient: get_monmap_and_config 2026-02-24T19:17:28.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.772+0000 7f76c319b640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.772+0000 7f76c319b640 10 monclient: monmap: 2026-02-24T19:17:28.780 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.780 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.780 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:28.773035+0000 2026-02-24T19:17:28.780 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:28.773035+0000 2026-02-24T19:17:28.780 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.780 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.780 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.780 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.780 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.780 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.772+0000 7f7c3c533640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.772+0000 7f7c3c533640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:28.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.772+0000 7f7c3c533640 10 monclient(hunting): picked mon.noname-a con 0x7f7c340b9f80 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.772+0000 7f7c3c533640 10 monclient(hunting): picked mon.noname-b con 0x7f7c340ba350 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.772+0000 7f2d0ff08640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.772+0000 7f2d0ff08640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:28.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.772+0000 7f7c3c533640 10 monclient(hunting): picked mon.noname-c con 0x7f7c340585e0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.772+0000 7f2d0ff08640 10 monclient(hunting): picked mon.noname-c con 0x7f2d08155bc0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.772+0000 7f2d0ff08640 10 monclient(hunting): picked mon.noname-a con 0x7f2d08155f90 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.772+0000 7f7c3c533640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c34163930 con 0x7f7c340b9f80 2026-02-24T19:17:28.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.773+0000 7f7c3c533640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c34163bb0 con 0x7f7c340ba350 2026-02-24T19:17:28.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.773+0000 7f787a7fc640 10 client.?.objecter ms_handle_connect 0x7f788c0b9f80 2026-02-24T19:17:28.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.773+0000 7f787a7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.773+0000 7f2d0ff08640 10 monclient(hunting): picked mon.noname-b con 0x7f2d080b27c0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.773+0000 7f2d0ff08640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d0805c200 con 0x7f2d08155f90 2026-02-24T19:17:28.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.773+0000 7f7c3c533640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c34163e90 con 0x7f7c340585e0 2026-02-24T19:17:28.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.773+0000 7f76c319b640 1 Processor -- start 2026-02-24T19:17:28.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.773+0000 7f2d0ff08640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d0805c4e0 con 0x7f2d080b27c0 2026-02-24T19:17:28.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.773+0000 7f7c3c533640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.773+0000 7f7c3c533640 10 monclient(hunting): authenticate will time out at 3623.454204s 2026-02-24T19:17:28.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.773+0000 7f2d0ff08640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d0805c7c0 con 0x7f2d08155bc0 2026-02-24T19:17:28.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.773+0000 7f2d0ff08640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.773+0000 7f2d0ff08640 10 monclient(hunting): authenticate will time out at 3623.454221s 2026-02-24T19:17:28.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.773+0000 7f76c319b640 1 -- start start 2026-02-24T19:17:28.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.773+0000 7f76c319b640 10 monclient: init 2026-02-24T19:17:28.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.773+0000 7f76c319b640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.773+0000 7f76c319b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:28.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.773+0000 7f76c319b640 10 monclient(hunting): picked mon.noname-b con 0x7f76bc0b9f80 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.773+0000 7f76c319b640 10 monclient(hunting): picked mon.noname-c con 0x7f76bc0ba350 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.773+0000 7f76c319b640 10 monclient(hunting): picked mon.noname-a con 0x7f76bc0585e0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.774+0000 7f76c319b640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76bc163930 con 0x7f76bc0585e0 2026-02-24T19:17:28.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.774+0000 7f76c319b640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76bc163bb0 con 0x7f76bc0b9f80 2026-02-24T19:17:28.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.774+0000 7f76c319b640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76bc163e90 con 0x7f76bc0ba350 2026-02-24T19:17:28.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.774+0000 7f76c319b640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.774+0000 7f76c319b640 10 monclient(hunting): authenticate will time out at 3623.455146s 2026-02-24T19:17:28.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.774+0000 7f7c3a2a8640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f7c340b9f80 0x7f7c34163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:54970/0 (socket says 10.20.193.14:54970) 2026-02-24T19:17:28.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.774+0000 7f7c3a2a8640 1 -- 10.20.193.14:0/2574189318 learned_addr learned my addr 10.20.193.14:0/2574189318 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.774+0000 7f2d0d47c640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f2d08155f90 0x7f2d080b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:54972/0 (socket says 10.20.193.14:54972) 2026-02-24T19:17:28.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.774+0000 7f2d0d47c640 1 -- 10.20.193.14:0/438250246 learned_addr learned my addr 10.20.193.14:0/438250246 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.775+0000 7f4f2f26a640 10 monclient: get_monmap_and_config 2026-02-24T19:17:28.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.775+0000 7f4f2f26a640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.775+0000 7f4f2f26a640 10 monclient: monmap: 2026-02-24T19:17:28.784 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.784 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.784 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:28.776379+0000 2026-02-24T19:17:28.784 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:28.776379+0000 2026-02-24T19:17:28.784 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.784 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.784 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.784 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.784 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.784 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.775+0000 7f787a7fc640 1 -- 10.20.193.14:0/7685078 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2886549694 0 0) 0x7f788c13a5e0 con 0x7f788c0ba350 2026-02-24T19:17:28.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.775+0000 7f787a7fc640 1 -- 10.20.193.14:0/7685078 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f788c13a8c0 con 0x7f788c0ba350 2026-02-24T19:17:28.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.775+0000 7f787a7fc640 1 -- 10.20.193.14:0/7685078 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f78880035d0 con 0x7f788c0ba350 2026-02-24T19:17:28.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.775+0000 7f787a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.775+0000 7f787a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:28.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.775+0000 7f787a7fc640 10 monclient(hunting): dump: 2026-02-24T19:17:28.785 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.785 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.785 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.785 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.785 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.785 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.785 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.785 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.785 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.785 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.785 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.775+0000 7f787a7fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:28.785 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.776+0000 7f4f2f26a640 1 Processor -- start 2026-02-24T19:17:28.785 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.776+0000 7f4f2f26a640 1 -- start start 2026-02-24T19:17:28.785 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.776+0000 7f4f2f26a640 10 monclient: init 2026-02-24T19:17:28.785 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.777+0000 7feee8533640 10 monclient: get_monmap_and_config 2026-02-24T19:17:28.785 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.777+0000 7feee8533640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.785 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.777+0000 7feee8533640 10 monclient: monmap: 2026-02-24T19:17:28.785 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.785 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.785 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:28.777881+0000 2026-02-24T19:17:28.785 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:28.777881+0000 2026-02-24T19:17:28.785 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.785 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.786 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.786 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.786 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.786 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.786 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.777+0000 7f2d0cc7b640 1 -- 10.20.193.14:0/438250246 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3708235817 0 0) 0x7f2d0805c200 con 0x7f2d08155f90 2026-02-24T19:17:28.786 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.777+0000 7f2d0cc7b640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.786 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.777+0000 7f2d0cc7b640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.786 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.777+0000 7f2d0cc7b640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.786 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.777+0000 7f2d0cc7b640 10 monclient(hunting): my global_id is 4503 2026-02-24T19:17:28.786 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.777+0000 7f2d0cc7b640 1 -- 10.20.193.14:0/438250246 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cf0003610 con 0x7f2d08155f90 2026-02-24T19:17:28.786 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.777+0000 7f4f2f26a640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.786 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.777+0000 7f4f2f26a640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:28.786 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.777+0000 7f4f2f26a640 10 monclient(hunting): picked mon.noname-b con 0x7f4f2815d610 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.786 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.777+0000 7f4f2f26a640 10 monclient(hunting): picked mon.noname-c con 0x7f4f281667e0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.786 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.777+0000 7f4f2f26a640 10 monclient(hunting): picked mon.noname-a con 0x7f4f28056ea0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.786 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.777+0000 7f4f2f26a640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f2815d9e0 con 0x7f4f28056ea0 2026-02-24T19:17:28.786 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.777+0000 7f4f2f26a640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f28055b20 con 0x7f4f2815d610 2026-02-24T19:17:28.786 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.777+0000 7f4f2f26a640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f28055e00 con 0x7f4f281667e0 2026-02-24T19:17:28.786 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.777+0000 7f4f2f26a640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.786 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.777+0000 7f4f2f26a640 10 monclient(hunting): authenticate will time out at 3623.458891s 2026-02-24T19:17:28.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.777+0000 7feee8533640 1 Processor -- start 2026-02-24T19:17:28.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.777+0000 7feee8533640 1 -- start start 2026-02-24T19:17:28.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.777+0000 7feee8533640 10 monclient: init 2026-02-24T19:17:28.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.778+0000 7feee8533640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.778+0000 7feee8533640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:28.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.778+0000 7feee8533640 10 monclient(hunting): picked mon.noname-c con 0x7feee00b9f80 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.778+0000 7feee8533640 10 monclient(hunting): picked mon.noname-b con 0x7feee00ba350 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.778+0000 7feee8533640 10 monclient(hunting): picked mon.noname-a con 0x7feee00585e0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.778+0000 7feee8533640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feee0163930 con 0x7feee00585e0 2026-02-24T19:17:28.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.778+0000 7feee8533640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feee0163bb0 con 0x7feee00ba350 2026-02-24T19:17:28.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.778+0000 7feee8533640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feee0163e90 con 0x7feee00b9f80 2026-02-24T19:17:28.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.778+0000 7feee8533640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.778+0000 7feee8533640 10 monclient(hunting): authenticate will time out at 3623.459522s 2026-02-24T19:17:28.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.778+0000 7f4a1c5cf640 10 monclient: get_monmap_and_config 2026-02-24T19:17:28.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.778+0000 7f4a1c5cf640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.778+0000 7f4a1c5cf640 10 monclient: monmap: 2026-02-24T19:17:28.787 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.788 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.788 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:28.779326+0000 2026-02-24T19:17:28.788 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:28.779326+0000 2026-02-24T19:17:28.788 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.788 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.788 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.788 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.788 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.788 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.788 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.779+0000 7f787a7fc640 1 -- 10.20.193.14:0/7685078 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 411230938 0 0) 0x7f788c13a300 con 0x7f788c0b9f80 2026-02-24T19:17:28.788 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.779+0000 7f787a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.788 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.779+0000 7f787a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.788 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.779+0000 7f787a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.788 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.779+0000 7f787a7fc640 10 monclient(hunting): my global_id is 4497 2026-02-24T19:17:28.788 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.779+0000 7f787a7fc640 1 -- 10.20.193.14:0/7685078 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f788c13a5e0 con 0x7f788c0b9f80 2026-02-24T19:17:28.788 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.779+0000 7f76c1711640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f76bc0585e0 0x7f76bc166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:54982/0 (socket says 10.20.193.14:54982) 2026-02-24T19:17:28.788 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.779+0000 7f76c1711640 1 -- 10.20.193.14:0/3023190150 learned_addr learned my addr 10.20.193.14:0/3023190150 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.789 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.779+0000 7f4a1c5cf640 1 Processor -- start 2026-02-24T19:17:28.789 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.779+0000 7f4a1c5cf640 1 -- start start 2026-02-24T19:17:28.789 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.779+0000 7f4a1c5cf640 10 monclient: init 2026-02-24T19:17:28.789 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.779+0000 7f59b08d0640 10 monclient: get_monmap_and_config 2026-02-24T19:17:28.789 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.779+0000 7f59b08d0640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.789 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.779+0000 7f59b08d0640 10 monclient: monmap: 2026-02-24T19:17:28.789 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.789 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.789 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:28.780018+0000 2026-02-24T19:17:28.789 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:28.780018+0000 2026-02-24T19:17:28.789 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.789 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.789 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.789 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.789 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.789 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.789 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.779+0000 7f4a1c5cf640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.790 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.779+0000 7f4a1c5cf640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:28.790 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.779+0000 7f4a1c5cf640 10 monclient(hunting): picked mon.noname-a con 0x7f4a14157780 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.790 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.779+0000 7f4a1c5cf640 10 monclient(hunting): picked mon.noname-b con 0x7f4a14157b50 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.790 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.779+0000 7f4a1c5cf640 10 monclient(hunting): picked mon.noname-c con 0x7f4a14164d00 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.790 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.779+0000 7f4a1c5cf640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a1405de70 con 0x7f4a14157780 2026-02-24T19:17:28.790 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.779+0000 7f4a1c5cf640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a14055b20 con 0x7f4a14157b50 2026-02-24T19:17:28.790 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.779+0000 7f4a1c5cf640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a14055e00 con 0x7f4a14164d00 2026-02-24T19:17:28.790 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.779+0000 7f4a1c5cf640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.790 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.779+0000 7f4a1c5cf640 10 monclient(hunting): authenticate will time out at 3623.460993s 2026-02-24T19:17:28.790 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7feee6aa9640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7feee00585e0 0x7feee0166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:54990/0 (socket says 10.20.193.14:54990) 2026-02-24T19:17:28.790 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7feee6aa9640 1 -- 10.20.193.14:0/1111115706 learned_addr learned my addr 10.20.193.14:0/1111115706 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.790 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f787a7fc640 1 -- 10.20.193.14:0/7685078 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3775378336 0 0) 0x7f788c13a8c0 con 0x7f788c0ba350 2026-02-24T19:17:28.790 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f787a7fc640 1 -- 10.20.193.14:0/7685078 >> v1:10.20.193.44:6789/0 conn(0x7f788c0585e0 legacy=0x7f788c1fc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.790 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f787a7fc640 1 -- 10.20.193.14:0/7685078 >> v1:10.20.193.14:6789/0 conn(0x7f788c0b9f80 legacy=0x7f788c155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.790 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.779+0000 7f59b08d0640 1 Processor -- start 2026-02-24T19:17:28.790 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f59b08d0640 1 -- start start 2026-02-24T19:17:28.790 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f59b08d0640 10 monclient: init 2026-02-24T19:17:28.791 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f59b08d0640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.791 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f59b08d0640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:28.791 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f787a7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.791 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f787a7fc640 1 monclient: found mon.c 2026-02-24T19:17:28.791 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f787a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.791 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f787a7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.791 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f787a7fc640 1 -- 10.20.193.14:0/7685078 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f788c13aba0 con 0x7f788c0ba350 2026-02-24T19:17:28.791 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f787a7fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.791 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f787a7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.791 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f787a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.791 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f59b08d0640 10 monclient(hunting): picked mon.noname-b con 0x7f59a80b9f10 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.791 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f59b08d0640 10 monclient(hunting): picked mon.noname-c con 0x7f59a80afef0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.791 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f59b08d0640 10 monclient(hunting): picked mon.noname-a con 0x7f59a80ba2e0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.791 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f59b08d0640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a80b5b80 con 0x7f59a80ba2e0 2026-02-24T19:17:28.791 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f59b08d0640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a80b5e40 con 0x7f59a80b9f10 2026-02-24T19:17:28.791 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f7893a9c640 5 monclient: authenticate success, global_id 4502 2026-02-24T19:17:28.791 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f7893a9c640 10 monclient: _renew_subs 2026-02-24T19:17:28.791 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f7893a9c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.791 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f7893a9c640 1 -- 10.20.193.14:0/7685078 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f788c13ae80 con 0x7f788c0ba350 2026-02-24T19:17:28.791 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f4f1ffff640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7f4f281667e0 0x7f4f280ba010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:45054/0 (socket says 10.20.193.14:45054) 2026-02-24T19:17:28.791 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f4f1ffff640 1 -- 10.20.193.14:0/1254929845 learned_addr learned my addr 10.20.193.14:0/1254929845 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.792 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f2d0cc7b640 1 -- 10.20.193.14:0/438250246 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1530410846 0 0) 0x7f2d0805c7c0 con 0x7f2d08155bc0 2026-02-24T19:17:28.792 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f2d0cc7b640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.792 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f2d0cc7b640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.792 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f2d0cc7b640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.792 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f2d0cc7b640 10 monclient(hunting): my global_id is 4508 2026-02-24T19:17:28.792 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f7893a9c640 10 client.4502.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.792 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f7893a9c640 10 monclient: _renew_subs 2026-02-24T19:17:28.792 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f7893a9c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.792 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f7893a9c640 1 -- 10.20.193.14:0/7685078 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f788c13b580 con 0x7f788c0ba350 2026-02-24T19:17:28.792 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f7893a9c640 1 librados: init done 2026-02-24T19:17:28.792 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f2d0cc7b640 1 -- 10.20.193.14:0/438250246 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d0805c200 con 0x7f2d08155bc0 2026-02-24T19:17:28.792 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f59b08d0640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a80b6120 con 0x7f59a80afef0 2026-02-24T19:17:28.792 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f59b08d0640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.792 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.780+0000 7f59b08d0640 10 monclient(hunting): authenticate will time out at 3623.461768s 2026-02-24T19:17:28.792 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.781+0000 7fbaf6502640 10 monclient: get_monmap_and_config 2026-02-24T19:17:28.792 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.781+0000 7fbaf6502640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.792 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.781+0000 7fbaf6502640 10 monclient: monmap: 2026-02-24T19:17:28.792 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.792 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.793 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:28.781763+0000 2026-02-24T19:17:28.793 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:28.781763+0000 2026-02-24T19:17:28.793 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.793 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.793 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.793 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.793 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.793 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.793 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.781+0000 7f7893a9c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.793 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.781+0000 7f7893a9c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.793 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.781+0000 7f7893a9c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.793 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.781+0000 7f7893a9c640 1 -- 10.20.193.14:0/7685078 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f788c0b64c0 con 0x7f788c0ba350 2026-02-24T19:17:28.793 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.781+0000 7fbaf6502640 1 Processor -- start 2026-02-24T19:17:28.793 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.781+0000 7fbaf6502640 1 -- start start 2026-02-24T19:17:28.793 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.781+0000 7fbaf6502640 10 monclient: init 2026-02-24T19:17:28.793 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.781+0000 7f7c392a6640 1 -- 10.20.193.14:0/2574189318 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2975103704 0 0) 0x7f7c34163e90 con 0x7f7c340585e0 2026-02-24T19:17:28.793 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.782+0000 7f7c392a6640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.793 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.782+0000 7f7c392a6640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.793 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.782+0000 7f7c392a6640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.793 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.782+0000 7f7c392a6640 10 monclient(hunting): my global_id is 4505 2026-02-24T19:17:28.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.782+0000 7f7c392a6640 1 -- 10.20.193.14:0/2574189318 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c1c003610 con 0x7f7c340585e0 2026-02-24T19:17:28.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.782+0000 7fbaf6502640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.782+0000 7fbaf6502640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:28.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.782+0000 7fbaf6502640 10 monclient(hunting): picked mon.noname-c con 0x7fbaf0159a70 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.782+0000 7fbaf6502640 10 monclient(hunting): picked mon.noname-b con 0x7fbaf0159e40 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.782+0000 7fbaf6502640 10 monclient(hunting): picked mon.noname-a con 0x7fbaf0058070 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.782+0000 7fbaf6502640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaf0163930 con 0x7fbaf0058070 2026-02-24T19:17:28.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.782+0000 7fbaf6502640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaf0163bf0 con 0x7fbaf0159e40 2026-02-24T19:17:28.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.782+0000 7fbaf6502640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaf0163ed0 con 0x7fbaf0159a70 2026-02-24T19:17:28.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.782+0000 7fbaf6502640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.782+0000 7fbaf6502640 10 monclient(hunting): authenticate will time out at 3623.463396s 2026-02-24T19:17:28.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.783+0000 7f4a1ab45640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7f4a14164d00 0x7f4a141c5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:45074/0 (socket says 10.20.193.14:45074) 2026-02-24T19:17:28.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.783+0000 7f4a1ab45640 1 -- 10.20.193.14:0/2893126948 learned_addr learned my addr 10.20.193.14:0/2893126948 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.783+0000 7ff7d2d6f640 10 monclient: get_monmap_and_config 2026-02-24T19:17:28.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.783+0000 7ff7d2d6f640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.783+0000 7ff7d2d6f640 10 monclient: monmap: 2026-02-24T19:17:28.794 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.794 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.794 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:28.784092+0000 2026-02-24T19:17:28.794 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:28.784092+0000 2026-02-24T19:17:28.794 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.795 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.795 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.795 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.795 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.795 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.795 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7ff7d2d6f640 1 Processor -- start 2026-02-24T19:17:28.795 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7f76b37fe640 1 -- 10.20.193.14:0/3023190150 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3620619413 0 0) 0x7f76bc163e90 con 0x7f76bc0ba350 2026-02-24T19:17:28.795 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7ff7d2d6f640 1 -- start start 2026-02-24T19:17:28.795 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7ff7d2d6f640 10 monclient: init 2026-02-24T19:17:28.795 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7f76b37fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.795 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7f76b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.795 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7f76b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.795 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7f76b37fe640 10 monclient(hunting): my global_id is 4511 2026-02-24T19:17:28.795 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7f76b37fe640 1 -- 10.20.193.14:0/3023190150 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76a8003610 con 0x7f76bc0ba350 2026-02-24T19:17:28.795 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7feee52a6640 1 -- 10.20.193.14:0/1111115706 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1928509114 0 0) 0x7feedc002c90 con 0x7feee00585e0 2026-02-24T19:17:28.795 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7feee52a6640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.795 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7feee52a6640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.795 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7feee52a6640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7feee52a6640 10 monclient(hunting): my global_id is 4509 2026-02-24T19:17:28.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7feee52a6640 1 -- 10.20.193.14:0/1111115706 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feec8003610 con 0x7feee00585e0 2026-02-24T19:17:28.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7f9e8e11b640 10 monclient: get_monmap_and_config 2026-02-24T19:17:28.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7f9e8e11b640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7f9e8e11b640 10 monclient: monmap: 2026-02-24T19:17:28.796 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.796 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.796 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:28.785129+0000 2026-02-24T19:17:28.796 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:28.785129+0000 2026-02-24T19:17:28.796 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.796 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.796 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.796 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.796 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.796 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7f2d0cc7b640 1 -- 10.20.193.14:0/438250246 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3607864437 0 0) 0x7f2cf0003610 con 0x7f2d08155f90 2026-02-24T19:17:28.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7f2d0cc7b640 1 -- 10.20.193.14:0/438250246 >> v1:10.20.193.170:6789/0 conn(0x7f2d08155bc0 legacy=0x7f2d080518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7f2d0cc7b640 1 -- 10.20.193.14:0/438250246 >> v1:10.20.193.44:6789/0 conn(0x7f2d080b27c0 legacy=0x7f2d08059990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:28.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7f2d0cc7b640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7f2d0cc7b640 1 monclient: found mon.noname-a 2026-02-24T19:17:28.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7f2d0cc7b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7f2d0cc7b640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7f2d0cc7b640 1 -- 10.20.193.14:0/438250246 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d0805caa0 con 0x7f2d08155f90 2026-02-24T19:17:28.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7f2d0cc7b640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7f2d0cc7b640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7f2d0cc7b640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7f2d0cc7b640 1 -- 10.20.193.14:0/438250246 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f2cfc002df0 con 0x7f2d08155f90 2026-02-24T19:17:28.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7f2d0ff08640 5 monclient: authenticate success, global_id 4503 2026-02-24T19:17:28.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7f2d0ff08640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7f2d0cc7b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7f2d0cc7b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:28.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7f2d0cc7b640 10 monclient: dump: 2026-02-24T19:17:28.797 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.797 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.797 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.797 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.797 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.797 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.797 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.797 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.797 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.797 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7f2d0ff08640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7feee52a6640 1 -- 10.20.193.14:0/1111115706 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4285743932 0 0) 0x7feee0163e90 con 0x7feee00b9f80 2026-02-24T19:17:28.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7feee52a6640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7feee52a6640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7feee52a6640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7feee52a6640 10 monclient(hunting): my global_id is 4517 2026-02-24T19:17:28.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7feee52a6640 1 -- 10.20.193.14:0/1111115706 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feedc002c90 con 0x7feee00b9f80 2026-02-24T19:17:28.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7f7c392a6640 1 -- 10.20.193.14:0/2574189318 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2935968753 0 0) 0x7f7c24002910 con 0x7f7c340b9f80 2026-02-24T19:17:28.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7f7c392a6640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7f7c392a6640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7f7c392a6640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7f7c392a6640 10 monclient(hunting): my global_id is 4500 2026-02-24T19:17:28.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7f7c392a6640 1 -- 10.20.193.14:0/2574189318 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c34163e90 con 0x7f7c340b9f80 2026-02-24T19:17:28.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7ff7d2d6f640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7ff7d2d6f640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:28.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7ff7d2d6f640 10 monclient(hunting): picked mon.noname-b con 0x7ff7cc0b9f80 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7ff7d2d6f640 10 monclient(hunting): picked mon.noname-a con 0x7ff7cc0ba350 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7ff7d2d6f640 10 monclient(hunting): picked mon.noname-c con 0x7ff7cc0585e0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7ff7d2d6f640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7cc163930 con 0x7ff7cc0ba350 2026-02-24T19:17:28.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7ff7d2d6f640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7cc163bb0 con 0x7ff7cc0b9f80 2026-02-24T19:17:28.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7ff7d2d6f640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7cc163e90 con 0x7ff7cc0585e0 2026-02-24T19:17:28.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7ff7d2d6f640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.784+0000 7ff7d2d6f640 10 monclient(hunting): authenticate will time out at 3623.465988s 2026-02-24T19:17:28.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.785+0000 7f9e8e11b640 1 Processor -- start 2026-02-24T19:17:28.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.785+0000 7f9e8e11b640 1 -- start start 2026-02-24T19:17:28.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.785+0000 7f9e8e11b640 10 monclient: init 2026-02-24T19:17:28.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.785+0000 7fbaf4a78640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7fbaf0058070 0x7fbaf0058460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:55014/0 (socket says 10.20.193.14:55014) 2026-02-24T19:17:28.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.785+0000 7fbaf4a78640 1 -- 10.20.193.14:0/3948573619 learned_addr learned my addr 10.20.193.14:0/3948573619 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.785+0000 7f4f1f7fe640 1 -- 10.20.193.14:0/1254929845 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 988172809 0 0) 0x7f4f28055e00 con 0x7f4f281667e0 2026-02-24T19:17:28.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.785+0000 7f4f1f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.785+0000 7f4f1f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.785+0000 7f4f1f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.785+0000 7f4f1f7fe640 10 monclient(hunting): my global_id is 4514 2026-02-24T19:17:28.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.785+0000 7f4f1f7fe640 1 -- 10.20.193.14:0/1254929845 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f14003610 con 0x7f4f281667e0 2026-02-24T19:17:28.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.785+0000 7f9e8e11b640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.785+0000 7f9e8e11b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:28.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.785+0000 7f9e8e11b640 10 monclient(hunting): picked mon.noname-a con 0x7f9e880b9f80 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.785+0000 7f9e8e11b640 10 monclient(hunting): picked mon.noname-b con 0x7f9e880ba350 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.785+0000 7f9e8e11b640 10 monclient(hunting): picked mon.noname-c con 0x7f9e880585e0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.785+0000 7f9e8e11b640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e88163930 con 0x7f9e880b9f80 2026-02-24T19:17:28.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.785+0000 7f9e8e11b640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e88163bb0 con 0x7f9e880ba350 2026-02-24T19:17:28.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.785+0000 7f9e8e11b640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e88163e90 con 0x7f9e880585e0 2026-02-24T19:17:28.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.785+0000 7f9e8e11b640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.785+0000 7f9e8e11b640 10 monclient(hunting): authenticate will time out at 3623.466792s 2026-02-24T19:17:28.800 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.785+0000 7f76b37fe640 1 -- 10.20.193.14:0/3023190150 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2447760511 0 0) 0x7f76b8002c90 con 0x7f76bc0585e0 2026-02-24T19:17:28.800 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.785+0000 7f76b37fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.800 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.785+0000 7f76b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.800 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.785+0000 7f76b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.800 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.785+0000 7f76b37fe640 10 monclient(hunting): my global_id is 4506 2026-02-24T19:17:28.800 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.785+0000 7f76b37fe640 1 -- 10.20.193.14:0/3023190150 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76bc163e90 con 0x7f76bc0585e0 2026-02-24T19:17:28.800 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.786+0000 7f59ade44640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7f59a80afef0 0x7f59a80b6ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:45084/0 (socket says 10.20.193.14:45084) 2026-02-24T19:17:28.800 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.786+0000 7f59ade44640 1 -- 10.20.193.14:0/4256302412 learned_addr learned my addr 10.20.193.14:0/4256302412 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.800 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.787+0000 7f570e6b1640 10 monclient: get_monmap_and_config 2026-02-24T19:17:28.800 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.787+0000 7f570e6b1640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.800 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.787+0000 7f570e6b1640 10 monclient: monmap: 2026-02-24T19:17:28.800 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.800 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.800 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:28.788248+0000 2026-02-24T19:17:28.801 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:28.788248+0000 2026-02-24T19:17:28.801 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.801 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.801 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.801 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.801 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.801 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.788+0000 7f570e6b1640 1 Processor -- start 2026-02-24T19:17:28.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.788+0000 7f570e6b1640 1 -- start start 2026-02-24T19:17:28.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.788+0000 7f570e6b1640 10 monclient: init 2026-02-24T19:17:28.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.788+0000 7f570e6b1640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.789+0000 7f570e6b1640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:28.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.789+0000 7f570e6b1640 10 monclient(hunting): picked mon.noname-c con 0x7f57080b9f80 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.789+0000 7f570e6b1640 10 monclient(hunting): picked mon.noname-b con 0x7f57080ba350 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.789+0000 7f570e6b1640 10 monclient(hunting): picked mon.noname-a con 0x7f57080585e0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.789+0000 7f570e6b1640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5708163930 con 0x7f57080585e0 2026-02-24T19:17:28.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.789+0000 7f570e6b1640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5708163bb0 con 0x7f57080ba350 2026-02-24T19:17:28.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.789+0000 7f570e6b1640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5708163e90 con 0x7f57080b9f80 2026-02-24T19:17:28.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.789+0000 7f570e6b1640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.789+0000 7f570e6b1640 10 monclient(hunting): authenticate will time out at 3623.470064s 2026-02-24T19:17:28.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.789+0000 7f4a19342640 1 -- 10.20.193.14:0/2893126948 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1358842192 0 0) 0x7f4a1405de70 con 0x7f4a14157780 2026-02-24T19:17:28.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.789+0000 7f4a19342640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.789+0000 7f4a19342640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.789+0000 7f4a19342640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.789+0000 7f4a19342640 10 monclient(hunting): my global_id is 4512 2026-02-24T19:17:28.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.789+0000 7f4a19342640 1 -- 10.20.193.14:0/2893126948 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49fc003610 con 0x7f4a14157780 2026-02-24T19:17:28.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.789+0000 7ff7c3fff640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7ff7cc0ba350 0x7ff7cc057ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:55028/0 (socket says 10.20.193.14:55028) 2026-02-24T19:17:28.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.789+0000 7ff7c3fff640 1 -- 10.20.193.14:0/823292562 learned_addr learned my addr 10.20.193.14:0/823292562 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.794+0000 7f9e877fe640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f9e880b9f80 0x7f9e88163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:55036/0 (socket says 10.20.193.14:55036) 2026-02-24T19:17:28.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.794+0000 7f9e877fe640 1 -- 10.20.193.14:0/894131579 learned_addr learned my addr 10.20.193.14:0/894131579 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7fbaeeffd640 1 -- 10.20.193.14:0/3948573619 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 359305335 0 0) 0x7fbaf0163930 con 0x7fbaf0058070 2026-02-24T19:17:28.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7fbaeeffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7fbaeeffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7fbaeeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7fbaeeffd640 10 monclient(hunting): my global_id is 4515 2026-02-24T19:17:28.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7fbaeeffd640 1 -- 10.20.193.14:0/3948573619 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbad4003610 con 0x7fbaf0058070 2026-02-24T19:17:28.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7f2d0cc7b640 1 -- 10.20.193.14:0/438250246 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2cfc003000 con 0x7f2d08155f90 2026-02-24T19:17:28.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7f2d0cc7b640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7f2d0ff08640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:28.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7f2d0cc7b640 1 -- 10.20.193.14:0/438250246 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f2cfc003440 con 0x7f2d08155f90 2026-02-24T19:17:28.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7f2d0ff08640 4 set_mon_vals no callback set 2026-02-24T19:17:28.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7f2d0cc7b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7f2d0cc7b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7f2d0cc7b640 10 monclient: dump: 2026-02-24T19:17:28.802 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.802 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.802 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.802 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.802 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.802 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.802 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.802 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.802 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.802 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7feee52a6640 1 -- 10.20.193.14:0/1111115706 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1962865615 0 0) 0x7feec8003610 con 0x7feee00585e0 2026-02-24T19:17:28.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7feee52a6640 1 -- 10.20.193.14:0/1111115706 >> v1:10.20.193.170:6789/0 conn(0x7feee00b9f80 legacy=0x7feee0163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7feee52a6640 1 -- 10.20.193.14:0/1111115706 >> v1:10.20.193.44:6789/0 conn(0x7feee00ba350 legacy=0x7feee0057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:28.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7feee52a6640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7feee52a6640 1 monclient: found mon.noname-a 2026-02-24T19:17:28.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7feee52a6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7feee52a6640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7feee52a6640 1 -- 10.20.193.14:0/1111115706 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee00573f0 con 0x7feee00585e0 2026-02-24T19:17:28.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7feee52a6640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7feee52a6640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7feee52a6640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7feee52a6640 1 -- 10.20.193.14:0/1111115706 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7feedc003340 con 0x7feee00585e0 2026-02-24T19:17:28.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7feee52a6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7feee52a6640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:28.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7feee52a6640 10 monclient: dump: 2026-02-24T19:17:28.803 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.803 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.803 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.803 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.803 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.803 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.803 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.803 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.803 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.803 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7feee8533640 5 monclient: authenticate success, global_id 4509 2026-02-24T19:17:28.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7feee8533640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7f2d0ff08640 10 monclient: shutdown 2026-02-24T19:17:28.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7f2d0ff08640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7f2d0ff08640 1 -- 10.20.193.14:0/438250246 >> v1:10.20.193.14:6789/0 conn(0x7f2d08155f90 legacy=0x7f2d080b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7f2d0ff08640 1 -- 10.20.193.14:0/438250246 shutdown_connections 2026-02-24T19:17:28.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7f2d0ff08640 1 -- 10.20.193.14:0/438250246 >> 10.20.193.14:0/438250246 conn(0x7f2d080b7120 msgr2=0x7f2d080b7520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.804 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7f2d0ff08640 1 -- 10.20.193.14:0/438250246 shutdown_connections 2026-02-24T19:17:28.804 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.799+0000 7f2d0ff08640 1 -- 10.20.193.14:0/438250246 wait complete. 2026-02-24T19:17:28.804 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f7c392a6640 1 -- 10.20.193.14:0/2574189318 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1352519834 0 0) 0x7f7c34163e90 con 0x7f7c340b9f80 2026-02-24T19:17:28.804 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f7c392a6640 1 -- 10.20.193.14:0/2574189318 >> v1:10.20.193.170:6789/0 conn(0x7f7c340585e0 legacy=0x7f7c34166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.804 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f7c392a6640 1 -- 10.20.193.14:0/2574189318 >> v1:10.20.193.44:6789/0 conn(0x7f7c340ba350 legacy=0x7f7c34057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:28.804 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f7c392a6640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.804 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f7c392a6640 1 monclient: found mon.noname-a 2026-02-24T19:17:28.804 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f7c392a6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.804 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f7c392a6640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.804 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f7c392a6640 1 -- 10.20.193.14:0/2574189318 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c340573f0 con 0x7f7c340b9f80 2026-02-24T19:17:28.804 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f7c392a6640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.804 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f7c392a6640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.804 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f7c392a6640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.804 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f7c392a6640 1 -- 10.20.193.14:0/2574189318 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7c24002fc0 con 0x7f7c340b9f80 2026-02-24T19:17:28.804 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f7c392a6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.804 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f7c392a6640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:28.804 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f7c392a6640 10 monclient: dump: 2026-02-24T19:17:28.804 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.804 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.804 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.804 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.804 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.804 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.805 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.805 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.805 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.805 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f7c3c533640 5 monclient: authenticate success, global_id 4500 2026-02-24T19:17:28.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f7c3c533640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f2d0ff08640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f2d0ff08640 10 monclient: monmap: 2026-02-24T19:17:28.805 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.805 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:28.805 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:28.805 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:28.805 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.805 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:28.805 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.805 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.805 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.805 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f4f1f7fe640 1 -- 10.20.193.14:0/1254929845 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1545851736 0 0) 0x7f4f2815d9e0 con 0x7f4f28056ea0 2026-02-24T19:17:28.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f4f1f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f4f1f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f4f1f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f4f1f7fe640 10 monclient(hunting): my global_id is 4521 2026-02-24T19:17:28.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f4f1f7fe640 1 -- 10.20.193.14:0/1254929845 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f28055e00 con 0x7f4f28056ea0 2026-02-24T19:17:28.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f2d0ff08640 1 librados: starting msgr at 2026-02-24T19:17:28.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f2d0ff08640 1 librados: starting objecter 2026-02-24T19:17:28.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f59ad643640 1 -- 10.20.193.14:0/4256302412 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1858708303 0 0) 0x7f59a80b5b80 con 0x7f59a80ba2e0 2026-02-24T19:17:28.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f2d0ff08640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:28.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f2d0ff08640 1 Processor -- start 2026-02-24T19:17:28.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f59ad643640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f59ad643640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f59ad643640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f59ad643640 10 monclient(hunting): my global_id is 4524 2026-02-24T19:17:28.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f59ad643640 1 -- 10.20.193.14:0/4256302412 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5998003610 con 0x7f59a80ba2e0 2026-02-24T19:17:28.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f2d0ff08640 1 -- start start 2026-02-24T19:17:28.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f2d0ff08640 1 librados: setting wanted keys 2026-02-24T19:17:28.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f2d0ff08640 1 librados: calling monclient init 2026-02-24T19:17:28.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.800+0000 7f2d0ff08640 10 monclient: init 2026-02-24T19:17:28.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.801+0000 7f2d0ff08640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.801+0000 7f2d0ff08640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:28.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.801+0000 7f2d0ff08640 10 monclient(hunting): picked mon.noname-a con 0x7f2d080b27c0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.801+0000 7f2d0ff08640 10 monclient(hunting): picked mon.noname-c con 0x7f2d08155bc0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.801+0000 7f2d0ff08640 10 monclient(hunting): picked mon.noname-b con 0x7f2d08155f90 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.801+0000 7f2d0ff08640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d08148730 con 0x7f2d080b27c0 2026-02-24T19:17:28.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.801+0000 7f2d0ff08640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d08148a10 con 0x7f2d08155f90 2026-02-24T19:17:28.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.801+0000 7f2d0ff08640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d08131690 con 0x7f2d08155bc0 2026-02-24T19:17:28.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.801+0000 7f2d0ff08640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.801+0000 7f2d0ff08640 10 monclient(hunting): authenticate will time out at 3623.482330s 2026-02-24T19:17:28.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.801+0000 7f570cc27640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f57080585e0 0x7f5708166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:55046/0 (socket says 10.20.193.14:55046) 2026-02-24T19:17:28.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.801+0000 7f570cc27640 1 -- 10.20.193.14:0/1003158123 learned_addr learned my addr 10.20.193.14:0/1003158123 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.801+0000 7ff7c37fe640 1 -- 10.20.193.14:0/823292562 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1968356324 0 0) 0x7ff7b4002910 con 0x7ff7cc0ba350 2026-02-24T19:17:28.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.801+0000 7ff7c37fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.801+0000 7ff7c37fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.801+0000 7ff7c37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.801+0000 7ff7c37fe640 10 monclient(hunting): my global_id is 4518 2026-02-24T19:17:28.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.801+0000 7ff7c37fe640 1 -- 10.20.193.14:0/823292562 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7b8003610 con 0x7ff7cc0ba350 2026-02-24T19:17:28.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.801+0000 7f2d0dc7d640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f2d080b27c0 0x7f2d0814bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:55048/0 (socket says 10.20.193.14:55048) 2026-02-24T19:17:28.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.801+0000 7f2d0dc7d640 1 -- 10.20.193.14:0/3238434083 learned_addr learned my addr 10.20.193.14:0/3238434083 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.802+0000 7f2cee7fc640 10 client.?.objecter ms_handle_connect 0x7f2d080b27c0 2026-02-24T19:17:28.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.802+0000 7f2cee7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.802+0000 7f76b37fe640 1 -- 10.20.193.14:0/3023190150 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2654413245 0 0) 0x7f76bc163e90 con 0x7f76bc0585e0 2026-02-24T19:17:28.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.802+0000 7f76b37fe640 1 -- 10.20.193.14:0/3023190150 >> v1:10.20.193.170:6789/0 conn(0x7f76bc0ba350 legacy=0x7f76bc057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.802+0000 7f76b37fe640 1 -- 10.20.193.14:0/3023190150 >> v1:10.20.193.44:6789/0 conn(0x7f76bc0b9f80 legacy=0x7f76bc163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:28.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.802+0000 7f76b37fe640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.802+0000 7f76b37fe640 1 monclient: found mon.noname-a 2026-02-24T19:17:28.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.802+0000 7f76b37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.802+0000 7f76b37fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.802+0000 7f76b37fe640 1 -- 10.20.193.14:0/3023190150 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76bc0573f0 con 0x7f76bc0585e0 2026-02-24T19:17:28.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.802+0000 7f76b37fe640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.802+0000 7f76b37fe640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.808 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.802+0000 7f76b37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.808 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.802+0000 7f76b37fe640 1 -- 10.20.193.14:0/3023190150 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f76b8003340 con 0x7f76bc0585e0 2026-02-24T19:17:28.808 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.802+0000 7f76b37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.808 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.802+0000 7f76b37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:28.808 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.802+0000 7f76b37fe640 10 monclient: dump: 2026-02-24T19:17:28.808 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.808 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.808 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.808 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.808 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.808 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.808 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.808 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.808 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.808 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.808 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.802+0000 7f76c319b640 5 monclient: authenticate success, global_id 4506 2026-02-24T19:17:28.808 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.802+0000 7f76c319b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.808 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.804+0000 7f95d9ba2640 10 monclient: get_monmap_and_config 2026-02-24T19:17:28.808 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.804+0000 7f95d9ba2640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.808 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.804+0000 7f95d9ba2640 10 monclient: monmap: 2026-02-24T19:17:28.808 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.808 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.808 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:28.805136+0000 2026-02-24T19:17:28.808 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:28.805136+0000 2026-02-24T19:17:28.808 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.808 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.809 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.809 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.809 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.809 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.805+0000 7f95d9ba2640 1 Processor -- start 2026-02-24T19:17:28.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.805+0000 7f95d9ba2640 1 -- start start 2026-02-24T19:17:28.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.805+0000 7f95d9ba2640 10 monclient: init 2026-02-24T19:17:28.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.805+0000 7f95d9ba2640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.805+0000 7f95d9ba2640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:28.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.805+0000 7f95d9ba2640 10 monclient(hunting): picked mon.noname-c con 0x7f95d40b9f80 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.805+0000 7f95d9ba2640 10 monclient(hunting): picked mon.noname-b con 0x7f95d40ba350 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.805+0000 7f95d9ba2640 10 monclient(hunting): picked mon.noname-a con 0x7f95d40585e0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.805+0000 7f95d9ba2640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95d4163930 con 0x7f95d40585e0 2026-02-24T19:17:28.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.805+0000 7f95d9ba2640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95d4163bb0 con 0x7f95d40ba350 2026-02-24T19:17:28.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.805+0000 7f95d9ba2640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95d4163e90 con 0x7f95d40b9f80 2026-02-24T19:17:28.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.805+0000 7f95d9ba2640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.805+0000 7f95d9ba2640 10 monclient(hunting): authenticate will time out at 3623.486965s 2026-02-24T19:17:28.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.806+0000 7f9e867fc640 1 -- 10.20.193.14:0/894131579 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 252544670 0 0) 0x7f9e74002910 con 0x7f9e880b9f80 2026-02-24T19:17:28.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.806+0000 7f9e867fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.806+0000 7f9e867fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.806+0000 7f9e867fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.806+0000 7f9e867fc640 10 monclient(hunting): my global_id is 4527 2026-02-24T19:17:28.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.806+0000 7f9e867fc640 1 -- 10.20.193.14:0/894131579 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e6c003610 con 0x7f9e880b9f80 2026-02-24T19:17:28.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.807+0000 7ffacaa4d640 10 monclient: get_monmap_and_config 2026-02-24T19:17:28.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.807+0000 7f8d0e526640 10 monclient: get_monmap_and_config 2026-02-24T19:17:28.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.807+0000 7f8d0e526640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.807+0000 7f8d0e526640 10 monclient: monmap: 2026-02-24T19:17:28.809 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.809 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.809 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:28.808247+0000 2026-02-24T19:17:28.809 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:28.808247+0000 2026-02-24T19:17:28.809 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.810 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.810 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.810 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.810 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.810 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.810 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.807+0000 7ffacaa4d640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.810 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.807+0000 7ffacaa4d640 10 monclient: monmap: 2026-02-24T19:17:28.810 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.810 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.810 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:28.808234+0000 2026-02-24T19:17:28.810 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:28.808234+0000 2026-02-24T19:17:28.810 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.810 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.810 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.810 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.810 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.810 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.810 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7f8d0e526640 1 Processor -- start 2026-02-24T19:17:28.810 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7ffacaa4d640 1 Processor -- start 2026-02-24T19:17:28.810 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7ffacaa4d640 1 -- start start 2026-02-24T19:17:28.810 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7ffacaa4d640 10 monclient: init 2026-02-24T19:17:28.810 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7f8d0e526640 1 -- start start 2026-02-24T19:17:28.810 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7f8d0e526640 10 monclient: init 2026-02-24T19:17:28.810 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7fbaeeffd640 1 -- 10.20.193.14:0/3948573619 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 657757051 0 0) 0x7fbad4003610 con 0x7fbaf0058070 2026-02-24T19:17:28.810 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7fbaeeffd640 1 -- 10.20.193.14:0/3948573619 >> v1:10.20.193.170:6789/0 conn(0x7fbaf0159a70 legacy=0x7fbaf00b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7ffacaa4d640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7ffacaa4d640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:28.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7ffacaa4d640 10 monclient(hunting): picked mon.noname-b con 0x7ffac40b9f80 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7ffacaa4d640 10 monclient(hunting): picked mon.noname-c con 0x7ffac40ba350 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7ffacaa4d640 10 monclient(hunting): picked mon.noname-a con 0x7ffac40585e0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7f2cee7fc640 1 -- 10.20.193.14:0/3238434083 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3998658619 0 0) 0x7f2d08148730 con 0x7f2d080b27c0 2026-02-24T19:17:28.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7f2cee7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7f2cee7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7f2cee7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7f2cee7fc640 10 monclient(hunting): my global_id is 4533 2026-02-24T19:17:28.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7f2cee7fc640 1 -- 10.20.193.14:0/3238434083 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cd8003610 con 0x7f2d080b27c0 2026-02-24T19:17:28.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7ffacaa4d640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffac4163930 con 0x7ffac40585e0 2026-02-24T19:17:28.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7ffacaa4d640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffac4163bb0 con 0x7ffac40b9f80 2026-02-24T19:17:28.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7ffacaa4d640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffac4163e90 con 0x7ffac40ba350 2026-02-24T19:17:28.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7fbaeeffd640 1 -- 10.20.193.14:0/3948573619 >> v1:10.20.193.44:6789/0 conn(0x7fbaf0159e40 legacy=0x7fbaf0163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:28.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7fbaeeffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7fbaeeffd640 1 monclient: found mon.noname-a 2026-02-24T19:17:28.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7fbaeeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7fbaeeffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7fbaeeffd640 1 -- 10.20.193.14:0/3948573619 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf0057590 con 0x7fbaf0058070 2026-02-24T19:17:28.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7fbaeeffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7fbaeeffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7fbaeeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7fbaeeffd640 1 -- 10.20.193.14:0/3948573619 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fbae4003170 con 0x7fbaf0058070 2026-02-24T19:17:28.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7fbaeeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7fbaeeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:28.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7f8d0e526640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7ffacaa4d640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7ffacaa4d640 10 monclient(hunting): authenticate will time out at 3623.489800s 2026-02-24T19:17:28.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7fbaeeffd640 10 monclient: dump: 2026-02-24T19:17:28.812 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.812 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.812 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.812 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.812 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.812 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.812 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.812 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.812 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.812 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7feee52a6640 1 -- 10.20.193.14:0/1111115706 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feedc003550 con 0x7feee00585e0 2026-02-24T19:17:28.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7feee52a6640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7feee8533640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:28.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7feee52a6640 1 -- 10.20.193.14:0/1111115706 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7feedc004d10 con 0x7feee00585e0 2026-02-24T19:17:28.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7feee52a6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7feee8533640 4 set_mon_vals no callback set 2026-02-24T19:17:28.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7feee52a6640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7fbaf6502640 5 monclient: authenticate success, global_id 4515 2026-02-24T19:17:28.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7fbaf6502640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7feee52a6640 10 monclient: dump: 2026-02-24T19:17:28.812 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.812 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.813 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.813 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.813 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.813 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.813 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.813 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.813 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.813 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.813 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7f8d0e526640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:28.813 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7f8d0e526640 10 monclient(hunting): picked mon.noname-b con 0x7f8d0815d0c0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.813 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7f8d0e526640 10 monclient(hunting): picked mon.noname-c con 0x7f8d080b0ca0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.813 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7f8d0e526640 10 monclient(hunting): picked mon.noname-a con 0x7f8d080b28b0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.813 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7f8d0e526640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d080b8540 con 0x7f8d080b28b0 2026-02-24T19:17:28.813 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7f8d0e526640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d080b5da0 con 0x7f8d0815d0c0 2026-02-24T19:17:28.813 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7f8d0e526640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d080b6080 con 0x7f8d080b0ca0 2026-02-24T19:17:28.813 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7f8d0e526640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.813 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7f95d3fff640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f95d40585e0 0x7f95d4166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:55050/0 (socket says 10.20.193.14:55050) 2026-02-24T19:17:28.813 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7f95d3fff640 1 -- 10.20.193.14:0/2616746216 learned_addr learned my addr 10.20.193.14:0/2616746216 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.813 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.808+0000 7f8d0e526640 10 monclient(hunting): authenticate will time out at 3623.489935s 2026-02-24T19:17:28.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.809+0000 7feee8533640 10 monclient: shutdown 2026-02-24T19:17:28.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.809+0000 7feee8533640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.809+0000 7feee8533640 1 -- 10.20.193.14:0/1111115706 >> v1:10.20.193.14:6789/0 conn(0x7feee00585e0 legacy=0x7feee0166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.809+0000 7feee8533640 1 -- 10.20.193.14:0/1111115706 shutdown_connections 2026-02-24T19:17:28.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.809+0000 7feee8533640 1 -- 10.20.193.14:0/1111115706 >> 10.20.193.14:0/1111115706 conn(0x7feee00b7990 msgr2=0x7feee00b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.809+0000 7feee8533640 1 -- 10.20.193.14:0/1111115706 shutdown_connections 2026-02-24T19:17:28.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.809+0000 7feee8533640 1 -- 10.20.193.14:0/1111115706 wait complete. 2026-02-24T19:17:28.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.810+0000 7feee8533640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.810+0000 7feee8533640 10 monclient: monmap: 2026-02-24T19:17:28.814 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.814 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:28.814 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:28.814 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:28.814 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.814 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:28.814 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.814 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.814 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.814 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.810+0000 7feee8533640 1 librados: starting msgr at 2026-02-24T19:17:28.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.810+0000 7feee8533640 1 librados: starting objecter 2026-02-24T19:17:28.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.810+0000 7feee8533640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:28.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.810+0000 7feee8533640 1 Processor -- start 2026-02-24T19:17:28.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.810+0000 7feee8533640 1 -- start start 2026-02-24T19:17:28.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.810+0000 7feee8533640 1 librados: setting wanted keys 2026-02-24T19:17:28.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.810+0000 7feee8533640 1 librados: calling monclient init 2026-02-24T19:17:28.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.810+0000 7feee8533640 10 monclient: init 2026-02-24T19:17:28.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.810+0000 7f4a19342640 1 -- 10.20.193.14:0/2893126948 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2305087688 0 0) 0x7f49fc003610 con 0x7f4a14157780 2026-02-24T19:17:28.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.810+0000 7f4a19342640 1 -- 10.20.193.14:0/2893126948 >> v1:10.20.193.170:6789/0 conn(0x7f4a14164d00 legacy=0x7f4a141c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.810+0000 7f4a19342640 1 -- 10.20.193.14:0/2893126948 >> v1:10.20.193.44:6789/0 conn(0x7f4a14157b50 legacy=0x7f4a141645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:28.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.810+0000 7f4a19342640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.815 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.810+0000 7f4a19342640 1 monclient: found mon.noname-a 2026-02-24T19:17:28.815 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.810+0000 7f4a19342640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.815 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.810+0000 7f4a19342640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.815 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.810+0000 7f4a19342640 1 -- 10.20.193.14:0/2893126948 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a140560e0 con 0x7f4a14157780 2026-02-24T19:17:28.815 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.810+0000 7f4a19342640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.815 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.810+0000 7f4a19342640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.815 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.810+0000 7f4a19342640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.815 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.810+0000 7f4a19342640 1 -- 10.20.193.14:0/2893126948 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4a04002df0 con 0x7f4a14157780 2026-02-24T19:17:28.815 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.810+0000 7f4a19342640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.815 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.811+0000 7f4a19342640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:28.815 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.811+0000 7f4a19342640 10 monclient: dump: 2026-02-24T19:17:28.815 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.815 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.815 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.815 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.815 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.815 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.815 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.815 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.815 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.815 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.815 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.811+0000 7f4a1c5cf640 5 monclient: authenticate success, global_id 4512 2026-02-24T19:17:28.815 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.811+0000 7f4a1c5cf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.815 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.811+0000 7feee8533640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.815 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.811+0000 7feee8533640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:28.815 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.811+0000 7feee8533640 10 monclient(hunting): picked mon.noname-a con 0x7feee00585e0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.815 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.811+0000 7feee8533640 10 monclient(hunting): picked mon.noname-b con 0x7feee00b9f80 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.815 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.811+0000 7feee8533640 10 monclient(hunting): picked mon.noname-c con 0x7feee00ba350 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.815 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.811+0000 7feee8533640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feee01f89e0 con 0x7feee00585e0 2026-02-24T19:17:28.815 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.811+0000 7feee8533640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feee00b5160 con 0x7feee00b9f80 2026-02-24T19:17:28.815 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.811+0000 7feee8533640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feee01fd6d0 con 0x7feee00ba350 2026-02-24T19:17:28.816 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.811+0000 7feee8533640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.816 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.811+0000 7feee8533640 10 monclient(hunting): authenticate will time out at 3623.492252s 2026-02-24T19:17:28.816 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.811+0000 7ff7c37fe640 1 -- 10.20.193.14:0/823292562 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1602518989 0 0) 0x7ff7b8003610 con 0x7ff7cc0ba350 2026-02-24T19:17:28.816 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.811+0000 7ff7c37fe640 1 -- 10.20.193.14:0/823292562 >> v1:10.20.193.170:6789/0 conn(0x7ff7cc0585e0 legacy=0x7ff7cc166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:28.816 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.811+0000 7ff7c37fe640 1 -- 10.20.193.14:0/823292562 >> v1:10.20.193.44:6789/0 conn(0x7ff7cc0b9f80 legacy=0x7ff7cc163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:28.816 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.811+0000 7ff7c37fe640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.816 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.811+0000 7ff7c37fe640 1 monclient: found mon.noname-a 2026-02-24T19:17:28.816 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.811+0000 7ff7c37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.816 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.811+0000 7ff7c37fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.816 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.811+0000 7ff7c37fe640 1 -- 10.20.193.14:0/823292562 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7cc0573f0 con 0x7ff7cc0ba350 2026-02-24T19:17:28.816 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.811+0000 7ff7c37fe640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.816 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.811+0000 7ff7c37fe640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.816 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.811+0000 7ff7c37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.816 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.811+0000 7ff7c37fe640 1 -- 10.20.193.14:0/823292562 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ff7b4002fc0 con 0x7ff7cc0ba350 2026-02-24T19:17:28.816 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.811+0000 7ff7c37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.816 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.811+0000 7ff7c37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:28.816 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.811+0000 7ff7c37fe640 10 monclient: dump: 2026-02-24T19:17:28.816 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.816 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.816 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.816 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.816 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.816 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.816 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.816 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.816 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.816 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.816 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.811+0000 7ff7d2d6f640 5 monclient: authenticate success, global_id 4518 2026-02-24T19:17:28.816 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.811+0000 7ff7d2d6f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.816 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.811+0000 7f5706ffd640 1 -- 10.20.193.14:0/1003158123 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 607566607 0 0) 0x7f56fc002c90 con 0x7f57080585e0 2026-02-24T19:17:28.817 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.811+0000 7f5706ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.817 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.811+0000 7f5706ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.817 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.811+0000 7f5706ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.817 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.811+0000 7f5706ffd640 10 monclient(hunting): my global_id is 4530 2026-02-24T19:17:28.817 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.812+0000 7f5706ffd640 1 -- 10.20.193.14:0/1003158123 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56ec003610 con 0x7f57080585e0 2026-02-24T19:17:28.817 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.813+0000 7ffac8fc3640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7ffac40585e0 0x7ffac4166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:55054/0 (socket says 10.20.193.14:55054) 2026-02-24T19:17:28.817 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.813+0000 7ffac8fc3640 1 -- 10.20.193.14:0/2298518687 learned_addr learned my addr 10.20.193.14:0/2298518687 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.820+0000 7f95d27fc640 1 -- 10.20.193.14:0/2616746216 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 898133359 0 0) 0x7f95c8002c90 con 0x7f95d40585e0 2026-02-24T19:17:28.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.820+0000 7f95d27fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.820+0000 7f95d27fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.820+0000 7f95d27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.820+0000 7f95d27fc640 10 monclient(hunting): my global_id is 4536 2026-02-24T19:17:28.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.820+0000 7f95d27fc640 1 -- 10.20.193.14:0/2616746216 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95b8003610 con 0x7f95d40585e0 2026-02-24T19:17:28.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.820+0000 7feee62a8640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7feee00585e0 0x7feee00b4a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:55070/0 (socket says 10.20.193.14:55070) 2026-02-24T19:17:28.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.820+0000 7feee62a8640 1 -- 10.20.193.14:0/2287837901 learned_addr learned my addr 10.20.193.14:0/2287837901 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.820+0000 7f8d0ca9c640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f8d080b28b0 0x7f8d080b7e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:55058/0 (socket says 10.20.193.14:55058) 2026-02-24T19:17:28.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.820+0000 7f8d0ca9c640 1 -- 10.20.193.14:0/1773786792 learned_addr learned my addr 10.20.193.14:0/1773786792 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.824 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.823+0000 7feec6ffd640 10 client.?.objecter ms_handle_connect 0x7feee00585e0 2026-02-24T19:17:28.824 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.824+0000 7feec6ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.825 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.824+0000 7f76b37fe640 1 -- 10.20.193.14:0/3023190150 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f76b8003550 con 0x7f76bc0585e0 2026-02-24T19:17:28.825 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.824+0000 7f76b37fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.825 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.824+0000 7f76b37fe640 1 -- 10.20.193.14:0/3023190150 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f76b8004d10 con 0x7f76bc0585e0 2026-02-24T19:17:28.825 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.824+0000 7f76b37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.825 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.824+0000 7f76b37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.825 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.824+0000 7f76b37fe640 10 monclient: dump: 2026-02-24T19:17:28.825 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.825 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.825 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.825 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.825 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.825 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.825 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.825 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.825 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.825 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.825 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.824+0000 7f76c319b640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:28.825 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.824+0000 7f76c319b640 4 set_mon_vals no callback set 2026-02-24T19:17:28.826 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.824+0000 7f76c319b640 10 monclient: shutdown 2026-02-24T19:17:28.826 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.824+0000 7f76c319b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.826 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.824+0000 7f76c319b640 1 -- 10.20.193.14:0/3023190150 >> v1:10.20.193.14:6789/0 conn(0x7f76bc0585e0 legacy=0x7f76bc166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.826 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7f76c319b640 1 -- 10.20.193.14:0/3023190150 shutdown_connections 2026-02-24T19:17:28.826 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7f76c319b640 1 -- 10.20.193.14:0/3023190150 >> 10.20.193.14:0/3023190150 conn(0x7f76bc0b7990 msgr2=0x7f76bc0b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.826 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7f76c319b640 1 -- 10.20.193.14:0/3023190150 shutdown_connections 2026-02-24T19:17:28.826 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7f76c319b640 1 -- 10.20.193.14:0/3023190150 wait complete. 2026-02-24T19:17:28.826 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7f4f1f7fe640 1 -- 10.20.193.14:0/1254929845 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3613092213 0 0) 0x7f4f28055e00 con 0x7f4f28056ea0 2026-02-24T19:17:28.826 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7f4f1f7fe640 1 -- 10.20.193.14:0/1254929845 >> v1:10.20.193.170:6789/0 conn(0x7f4f281667e0 legacy=0x7f4f280ba010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.826 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7f4f1f7fe640 1 -- 10.20.193.14:0/1254929845 >> v1:10.20.193.44:6789/0 conn(0x7f4f2815d610 legacy=0x7f4f280b9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:28.826 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7f4f1f7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.826 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7f4f1f7fe640 1 monclient: found mon.noname-a 2026-02-24T19:17:28.826 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7f4a19342640 1 -- 10.20.193.14:0/2893126948 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4a04003000 con 0x7f4a14157780 2026-02-24T19:17:28.826 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7f4a19342640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.826 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7f4a19342640 1 -- 10.20.193.14:0/2893126948 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4a04003440 con 0x7f4a14157780 2026-02-24T19:17:28.826 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7f4a19342640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.826 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7f4a19342640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.826 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7f4a19342640 10 monclient: dump: 2026-02-24T19:17:28.826 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.826 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.826 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.826 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.826 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.826 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.827 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.827 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.827 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.827 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.827 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7f4a1c5cf640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:28.827 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7f4a1c5cf640 4 set_mon_vals no callback set 2026-02-24T19:17:28.827 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7f4f1f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.827 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7f4f1f7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.827 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7f4f1f7fe640 1 -- 10.20.193.14:0/1254929845 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f280560e0 con 0x7f4f28056ea0 2026-02-24T19:17:28.827 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7f4f1f7fe640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.827 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7f4f1f7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.827 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7f4f1f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.827 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7f4f1f7fe640 1 -- 10.20.193.14:0/1254929845 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4f24003170 con 0x7f4f28056ea0 2026-02-24T19:17:28.827 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7f4f1f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.827 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7f4f1f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:28.827 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7f4f1f7fe640 10 monclient: dump: 2026-02-24T19:17:28.827 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.827 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.827 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.827 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.827 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.827 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.827 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.827 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.827 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.827 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.827 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7f4f2f26a640 5 monclient: authenticate success, global_id 4521 2026-02-24T19:17:28.827 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7f4f2f26a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.827 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7ff7c37fe640 1 -- 10.20.193.14:0/823292562 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff7b40031d0 con 0x7ff7cc0ba350 2026-02-24T19:17:28.828 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7ff7c37fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.828 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7ff7c37fe640 1 -- 10.20.193.14:0/823292562 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ff7b4004990 con 0x7ff7cc0ba350 2026-02-24T19:17:28.828 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7ff7c37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.828 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7ff7c37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.828 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7ff7c37fe640 10 monclient: dump: 2026-02-24T19:17:28.828 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.828 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.828 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.828 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.828 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.828 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.828 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.828 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.828 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.828 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.828 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7ff7d2d6f640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:28.828 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7ff7d2d6f640 4 set_mon_vals no callback set 2026-02-24T19:17:28.828 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7fbaeeffd640 1 -- 10.20.193.14:0/3948573619 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbae4003380 con 0x7fbaf0058070 2026-02-24T19:17:28.828 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7fbaeeffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.828 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7f76c319b640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.828 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.825+0000 7f76c319b640 10 monclient: monmap: 2026-02-24T19:17:28.828 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.828 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:28.828 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:28.828 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:28.828 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.828 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:28.828 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.828 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.828 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.828 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.828 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f76c319b640 1 librados: starting msgr at 2026-02-24T19:17:28.828 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f76c319b640 1 librados: starting objecter 2026-02-24T19:17:28.829 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f76c319b640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:28.829 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7fbaeeffd640 1 -- 10.20.193.14:0/3948573619 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fbae40037c0 con 0x7fbaf0058070 2026-02-24T19:17:28.829 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7fbaf6502640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:28.829 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7fbaf6502640 4 set_mon_vals no callback set 2026-02-24T19:17:28.829 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7fbaeeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.829 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f76c319b640 1 Processor -- start 2026-02-24T19:17:28.829 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7fbaeeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.829 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7fbaeeffd640 10 monclient: dump: 2026-02-24T19:17:28.829 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.829 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.829 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.829 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.829 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.829 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.829 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.829 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.829 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.829 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.829 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f76c319b640 1 -- start start 2026-02-24T19:17:28.829 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f76c319b640 1 librados: setting wanted keys 2026-02-24T19:17:28.829 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f76c319b640 1 librados: calling monclient init 2026-02-24T19:17:28.829 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f76c319b640 10 monclient: init 2026-02-24T19:17:28.830 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f4a1c5cf640 10 monclient: shutdown 2026-02-24T19:17:28.830 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f4a1c5cf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.830 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f4a1c5cf640 1 -- 10.20.193.14:0/2893126948 >> v1:10.20.193.14:6789/0 conn(0x7f4a14157780 legacy=0x7f4a14056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.830 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7ff7d2d6f640 10 monclient: shutdown 2026-02-24T19:17:28.830 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7ff7d2d6f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.830 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7ff7d2d6f640 1 -- 10.20.193.14:0/823292562 >> v1:10.20.193.14:6789/0 conn(0x7ff7cc0ba350 legacy=0x7ff7cc057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.830 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7ff7d2d6f640 1 -- 10.20.193.14:0/823292562 shutdown_connections 2026-02-24T19:17:28.830 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7ff7d2d6f640 1 -- 10.20.193.14:0/823292562 >> 10.20.193.14:0/823292562 conn(0x7ff7cc0b7990 msgr2=0x7ff7cc0b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.830 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7ff7d2d6f640 1 -- 10.20.193.14:0/823292562 shutdown_connections 2026-02-24T19:17:28.830 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7fbaf6502640 10 monclient: shutdown 2026-02-24T19:17:28.830 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7fbaf6502640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.830 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7fbaf6502640 1 -- 10.20.193.14:0/3948573619 >> v1:10.20.193.14:6789/0 conn(0x7fbaf0058070 legacy=0x7fbaf0058460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.830 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f4a1c5cf640 1 -- 10.20.193.14:0/2893126948 shutdown_connections 2026-02-24T19:17:28.830 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f4a1c5cf640 1 -- 10.20.193.14:0/2893126948 >> 10.20.193.14:0/2893126948 conn(0x7f4a140b2ef0 msgr2=0x7f4a140b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.830 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f4a1c5cf640 1 -- 10.20.193.14:0/2893126948 shutdown_connections 2026-02-24T19:17:28.830 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f4a1c5cf640 1 -- 10.20.193.14:0/2893126948 wait complete. 2026-02-24T19:17:28.830 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7ff7d2d6f640 1 -- 10.20.193.14:0/823292562 wait complete. 2026-02-24T19:17:28.831 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f59ad643640 1 -- 10.20.193.14:0/4256302412 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1487905350 0 0) 0x7f5998003610 con 0x7f59a80ba2e0 2026-02-24T19:17:28.831 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f59ad643640 1 -- 10.20.193.14:0/4256302412 >> v1:10.20.193.170:6789/0 conn(0x7f59a80afef0 legacy=0x7f59a80b6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:28.831 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f59ad643640 1 -- 10.20.193.14:0/4256302412 >> v1:10.20.193.44:6789/0 conn(0x7f59a80b9f10 legacy=0x7f59a80b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:28.831 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f59ad643640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.831 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f59ad643640 1 monclient: found mon.noname-a 2026-02-24T19:17:28.831 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f59ad643640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.831 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f59ad643640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.831 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f59ad643640 1 -- 10.20.193.14:0/4256302412 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a80b3ed0 con 0x7f59a80ba2e0 2026-02-24T19:17:28.831 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f59ad643640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.831 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f59ad643640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.831 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f59ad643640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.831 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f59ad643640 1 -- 10.20.193.14:0/4256302412 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f599c003170 con 0x7f59a80ba2e0 2026-02-24T19:17:28.831 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f59ad643640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.831 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f59ad643640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:28.831 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f59ad643640 10 monclient: dump: 2026-02-24T19:17:28.831 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.831 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.831 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.831 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.831 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.831 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.831 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.831 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.831 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.831 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.831 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f59b08d0640 5 monclient: authenticate success, global_id 4524 2026-02-24T19:17:28.831 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f59b08d0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.831 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7fbaf6502640 1 -- 10.20.193.14:0/3948573619 shutdown_connections 2026-02-24T19:17:28.832 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7fbaf6502640 1 -- 10.20.193.14:0/3948573619 >> 10.20.193.14:0/3948573619 conn(0x7fbaf00b7780 msgr2=0x7fbaf00b7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.832 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7fbaf6502640 1 -- 10.20.193.14:0/3948573619 shutdown_connections 2026-02-24T19:17:28.832 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7fbaf6502640 1 -- 10.20.193.14:0/3948573619 wait complete. 2026-02-24T19:17:28.832 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f76c319b640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.832 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f76c319b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:28.832 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f76c319b640 10 monclient(hunting): picked mon.noname-b con 0x7f76bc0585e0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.832 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f76c319b640 10 monclient(hunting): picked mon.noname-c con 0x7f76bc0b9f80 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.832 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f76c319b640 10 monclient(hunting): picked mon.noname-a con 0x7f76bc0ba350 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.832 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f76c319b640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76bc0b9510 con 0x7f76bc0ba350 2026-02-24T19:17:28.832 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f76c319b640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76bc1ff9d0 con 0x7f76bc0585e0 2026-02-24T19:17:28.832 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f76c319b640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76bc1ffcb0 con 0x7f76bc0b9f80 2026-02-24T19:17:28.832 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f76c319b640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.832 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.826+0000 7f76c319b640 10 monclient(hunting): authenticate will time out at 3623.507984s 2026-02-24T19:17:28.832 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f2cee7fc640 1 -- 10.20.193.14:0/3238434083 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1944243882 0 0) 0x7f2cd8003610 con 0x7f2d080b27c0 2026-02-24T19:17:28.832 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f2cee7fc640 1 -- 10.20.193.14:0/3238434083 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2d08148730 con 0x7f2d080b27c0 2026-02-24T19:17:28.832 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f2cee7fc640 1 -- 10.20.193.14:0/3238434083 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f2cf80030d0 con 0x7f2d080b27c0 2026-02-24T19:17:28.832 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f2cee7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.833 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f2cee7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:28.833 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f2cee7fc640 10 monclient(hunting): dump: 2026-02-24T19:17:28.833 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.833 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.833 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.833 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.833 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.833 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.833 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.833 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.833 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.833 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.833 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f2cee7fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:28.833 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f4a1c5cf640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.833 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f4a1c5cf640 10 monclient: monmap: 2026-02-24T19:17:28.833 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.833 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:28.833 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:28.833 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:28.833 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.833 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:28.833 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.833 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.833 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.833 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.834 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f9e867fc640 1 -- 10.20.193.14:0/894131579 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 459810759 0 0) 0x7f9e6c003610 con 0x7f9e880b9f80 2026-02-24T19:17:28.834 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f9e867fc640 1 -- 10.20.193.14:0/894131579 >> v1:10.20.193.170:6789/0 conn(0x7f9e880585e0 legacy=0x7f9e88166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:28.834 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f9e867fc640 1 -- 10.20.193.14:0/894131579 >> v1:10.20.193.44:6789/0 conn(0x7f9e880ba350 legacy=0x7f9e88057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:28.834 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f9e867fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.834 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f9e867fc640 1 monclient: found mon.noname-a 2026-02-24T19:17:28.834 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f9e867fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.834 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f9e867fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.834 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f9e867fc640 1 -- 10.20.193.14:0/894131579 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e880573f0 con 0x7f9e880b9f80 2026-02-24T19:17:28.834 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f9e867fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.834 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f9e867fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.834 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f9e867fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.834 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f9e867fc640 1 -- 10.20.193.14:0/894131579 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f9e74002fc0 con 0x7f9e880b9f80 2026-02-24T19:17:28.834 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f9e867fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.834 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f9e867fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:28.834 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f9e867fc640 10 monclient: dump: 2026-02-24T19:17:28.834 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.834 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.834 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.834 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.834 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.834 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.834 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.834 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.834 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.834 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.834 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f9e8e11b640 5 monclient: authenticate success, global_id 4527 2026-02-24T19:17:28.834 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f9e8e11b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.834 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f5706ffd640 1 -- 10.20.193.14:0/1003158123 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4034003228 0 0) 0x7f56ec003610 con 0x7f57080585e0 2026-02-24T19:17:28.834 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7ff7d2d6f640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.835 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f5706ffd640 1 -- 10.20.193.14:0/1003158123 >> v1:10.20.193.170:6789/0 conn(0x7f57080b9f80 legacy=0x7f5708163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:28.835 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7ff7d2d6f640 10 monclient: monmap: 2026-02-24T19:17:28.835 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.835 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:28.835 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:28.835 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:28.835 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.835 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:28.835 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.835 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.835 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.835 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.835 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f5706ffd640 1 -- 10.20.193.14:0/1003158123 >> v1:10.20.193.44:6789/0 conn(0x7f57080ba350 legacy=0x7f5708057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:28.835 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f5706ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.835 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f5706ffd640 1 monclient: found mon.noname-a 2026-02-24T19:17:28.835 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f5706ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.835 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f5706ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.835 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f5706ffd640 1 -- 10.20.193.14:0/1003158123 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57080573f0 con 0x7f57080585e0 2026-02-24T19:17:28.835 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f5706ffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.835 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f5706ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.835 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f5706ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.835 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f5706ffd640 1 -- 10.20.193.14:0/1003158123 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f56fc003340 con 0x7f57080585e0 2026-02-24T19:17:28.835 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f5706ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.836 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f5706ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:28.836 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f5706ffd640 10 monclient: dump: 2026-02-24T19:17:28.836 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.836 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.836 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.836 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.836 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.836 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.836 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.836 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.836 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.836 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.836 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f570e6b1640 5 monclient: authenticate success, global_id 4530 2026-02-24T19:17:28.836 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f570e6b1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.836 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f4a1c5cf640 1 librados: starting msgr at 2026-02-24T19:17:28.836 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f4a1c5cf640 1 librados: starting objecter 2026-02-24T19:17:28.836 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7fbaf6502640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.836 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f4a1c5cf640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:28.836 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f4a1c5cf640 1 Processor -- start 2026-02-24T19:17:28.836 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7fbaf6502640 10 monclient: monmap: 2026-02-24T19:17:28.836 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.836 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:28.836 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:28.836 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:28.836 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.836 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:28.837 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.837 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.837 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.837 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.837 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7ff7d2d6f640 1 librados: starting msgr at 2026-02-24T19:17:28.837 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7ff7d2d6f640 1 librados: starting objecter 2026-02-24T19:17:28.837 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7ff7d2d6f640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:28.837 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7ff7d2d6f640 1 Processor -- start 2026-02-24T19:17:28.837 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7ff7d2d6f640 1 -- start start 2026-02-24T19:17:28.837 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7ff7d2d6f640 1 librados: setting wanted keys 2026-02-24T19:17:28.837 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7ff7d2d6f640 1 librados: calling monclient init 2026-02-24T19:17:28.837 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7ff7d2d6f640 10 monclient: init 2026-02-24T19:17:28.837 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7fbaf6502640 1 librados: starting msgr at 2026-02-24T19:17:28.837 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7fbaf6502640 1 librados: starting objecter 2026-02-24T19:17:28.837 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7fbaf6502640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:28.837 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7fbaf6502640 1 Processor -- start 2026-02-24T19:17:28.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f4a1c5cf640 1 -- start start 2026-02-24T19:17:28.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f4a1c5cf640 1 librados: setting wanted keys 2026-02-24T19:17:28.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f4a1c5cf640 1 librados: calling monclient init 2026-02-24T19:17:28.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f4a1c5cf640 10 monclient: init 2026-02-24T19:17:28.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f4a1c5cf640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f4a1c5cf640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:28.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f4a1c5cf640 10 monclient(hunting): picked mon.noname-a con 0x7f4a14157780 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f4a1c5cf640 10 monclient(hunting): picked mon.noname-c con 0x7f4a14157b50 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f4a1c5cf640 10 monclient(hunting): picked mon.noname-b con 0x7f4a14164d00 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f4a1c5cf640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a140a6cd0 con 0x7f4a14157780 2026-02-24T19:17:28.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f4a1c5cf640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a140b04f0 con 0x7f4a14164d00 2026-02-24T19:17:28.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f4a1c5cf640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a14130e80 con 0x7f4a14157b50 2026-02-24T19:17:28.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f4a1c5cf640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.827+0000 7f4a1c5cf640 10 monclient(hunting): authenticate will time out at 3623.508982s 2026-02-24T19:17:28.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.828+0000 7fbaf6502640 1 -- start start 2026-02-24T19:17:28.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.828+0000 7fbaf6502640 1 librados: setting wanted keys 2026-02-24T19:17:28.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.828+0000 7fbaf6502640 1 librados: calling monclient init 2026-02-24T19:17:28.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.828+0000 7fbaf6502640 10 monclient: init 2026-02-24T19:17:28.839 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.828+0000 7ff7d2d6f640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.839 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.828+0000 7ff7d2d6f640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:28.839 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.828+0000 7ff7d2d6f640 10 monclient(hunting): picked mon.noname-b con 0x7ff7cc0585e0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.839 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.828+0000 7ff7d2d6f640 10 monclient(hunting): picked mon.noname-a con 0x7ff7cc0b9f80 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.839 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.828+0000 7ff7d2d6f640 10 monclient(hunting): picked mon.noname-c con 0x7ff7cc0ba350 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.839 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.828+0000 7ff7d2d6f640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7cc1febd0 con 0x7ff7cc0b9f80 2026-02-24T19:17:28.839 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.828+0000 7ff7d2d6f640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7cc0b3100 con 0x7ff7cc0585e0 2026-02-24T19:17:28.839 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.828+0000 7ff7d2d6f640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7cc0b33e0 con 0x7ff7cc0ba350 2026-02-24T19:17:28.839 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.828+0000 7ff7d2d6f640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.839 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.828+0000 7ff7d2d6f640 10 monclient(hunting): authenticate will time out at 3623.509394s 2026-02-24T19:17:28.839 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.828+0000 7fbaf6502640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.839 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.828+0000 7fbaf6502640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:28.839 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.828+0000 7fbaf6502640 10 monclient(hunting): picked mon.noname-c con 0x7fbaf0058070 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.839 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.828+0000 7fbaf6502640 10 monclient(hunting): picked mon.noname-b con 0x7fbaf0159a70 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.839 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.828+0000 7fbaf6502640 10 monclient(hunting): picked mon.noname-a con 0x7fbaf0159e40 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.839 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.828+0000 7fbaf6502640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaf013b070 con 0x7fbaf0159e40 2026-02-24T19:17:28.839 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.828+0000 7fbaf6502640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaf013b310 con 0x7fbaf0159a70 2026-02-24T19:17:28.839 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.828+0000 7fbaf6502640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaf013b5f0 con 0x7fbaf0058070 2026-02-24T19:17:28.839 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.828+0000 7fbaf6502640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.839 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.828+0000 7fbaf6502640 10 monclient(hunting): authenticate will time out at 3623.509432s 2026-02-24T19:17:28.839 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.828+0000 7ffac2ffd640 1 -- 10.20.193.14:0/2298518687 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2694358461 0 0) 0x7ffab8002c90 con 0x7ffac40585e0 2026-02-24T19:17:28.839 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.828+0000 7ffac2ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.839 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.828+0000 7ffac2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.840 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.828+0000 7ffac2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.840 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.828+0000 7ffac2ffd640 10 monclient(hunting): my global_id is 4539 2026-02-24T19:17:28.840 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.828+0000 7ffac2ffd640 1 -- 10.20.193.14:0/2298518687 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffaac003610 con 0x7ffac40585e0 2026-02-24T19:17:28.840 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.829+0000 7f7c392a6640 1 -- 10.20.193.14:0/2574189318 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7c240031d0 con 0x7f7c340b9f80 2026-02-24T19:17:28.840 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.829+0000 7f7c392a6640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.840 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.829+0000 7f7c392a6640 1 -- 10.20.193.14:0/2574189318 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7c24004990 con 0x7f7c340b9f80 2026-02-24T19:17:28.840 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.829+0000 7f7c3c533640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:28.840 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.829+0000 7f7c3c533640 4 set_mon_vals no callback set 2026-02-24T19:17:28.840 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.830+0000 7f7c392a6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.840 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.830+0000 7f7c392a6640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.840 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.830+0000 7f7c392a6640 10 monclient: dump: 2026-02-24T19:17:28.840 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.840 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.840 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.840 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.840 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.840 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.840 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.840 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.841 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.841 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.841 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.830+0000 7f7c3c533640 10 monclient: shutdown 2026-02-24T19:17:28.841 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.830+0000 7f7c3c533640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.841 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.830+0000 7f7c3c533640 1 -- 10.20.193.14:0/2574189318 >> v1:10.20.193.14:6789/0 conn(0x7f7c340b9f80 legacy=0x7f7c34163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.841 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.830+0000 7f7c3c533640 1 -- 10.20.193.14:0/2574189318 shutdown_connections 2026-02-24T19:17:28.841 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.830+0000 7f7c3c533640 1 -- 10.20.193.14:0/2574189318 >> 10.20.193.14:0/2574189318 conn(0x7f7c340b7990 msgr2=0x7f7c340b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.841 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.830+0000 7f7c3c533640 1 -- 10.20.193.14:0/2574189318 shutdown_connections 2026-02-24T19:17:28.841 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.830+0000 7f7c3c533640 1 -- 10.20.193.14:0/2574189318 wait complete. 2026-02-24T19:17:28.841 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.830+0000 7f7c3c533640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.841 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.830+0000 7f7c3c533640 10 monclient: monmap: 2026-02-24T19:17:28.841 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.841 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:28.841 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:28.841 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:28.841 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.841 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:28.841 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.841 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.841 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.841 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.841 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.830+0000 7f7c3c533640 1 librados: starting msgr at 2026-02-24T19:17:28.841 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.830+0000 7f7c3c533640 1 librados: starting objecter 2026-02-24T19:17:28.841 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7f7c3c533640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:28.841 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7f7c3c533640 1 Processor -- start 2026-02-24T19:17:28.841 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7f7c3c533640 1 -- start start 2026-02-24T19:17:28.841 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7f7c3c533640 1 librados: setting wanted keys 2026-02-24T19:17:28.841 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7f7c3c533640 1 librados: calling monclient init 2026-02-24T19:17:28.841 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7f7c3c533640 10 monclient: init 2026-02-24T19:17:28.841 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7ff7c3fff640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7ff7cc0b9f80 0x7ff7cc1fe4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:55086/0 (socket says 10.20.193.14:55086) 2026-02-24T19:17:28.841 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7ff7c3fff640 1 -- 10.20.193.14:0/2275417262 learned_addr learned my addr 10.20.193.14:0/2275417262 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.841 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7ff7c17fa640 10 client.?.objecter ms_handle_connect 0x7ff7cc0b9f80 2026-02-24T19:17:28.841 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7ff7c17fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.842 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7feec6ffd640 1 -- 10.20.193.14:0/2287837901 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4046744917 0 0) 0x7feee01f89e0 con 0x7feee00585e0 2026-02-24T19:17:28.842 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7feec6ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.842 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7feec6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.842 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7feec6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.842 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7feec6ffd640 10 monclient(hunting): my global_id is 4545 2026-02-24T19:17:28.842 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7feec6ffd640 1 -- 10.20.193.14:0/2287837901 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feeb0003610 con 0x7feee00585e0 2026-02-24T19:17:28.842 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7f7c3c533640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.842 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7f7c3c533640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:28.842 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7f7c3c533640 10 monclient(hunting): picked mon.noname-a con 0x7f7c340585e0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.842 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7f7c3c533640 10 monclient(hunting): picked mon.noname-c con 0x7f7c340b9f80 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.842 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7f7c3c533640 10 monclient(hunting): picked mon.noname-b con 0x7f7c340ba350 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.842 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7f7c3c533640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c34166030 con 0x7f7c340585e0 2026-02-24T19:17:28.842 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7f7c3c533640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c340b36c0 con 0x7f7c340ba350 2026-02-24T19:17:28.842 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7f7c3c533640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c340b39a0 con 0x7f7c340b9f80 2026-02-24T19:17:28.842 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7f7c3c533640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.842 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7f7c3c533640 10 monclient(hunting): authenticate will time out at 3623.512693s 2026-02-24T19:17:28.842 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7fbaf4a78640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7fbaf0159e40 0x7fbaf0162d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:55090/0 (socket says 10.20.193.14:55090) 2026-02-24T19:17:28.842 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7fbaf4a78640 1 -- 10.20.193.14:0/3377738563 learned_addr learned my addr 10.20.193.14:0/3377738563 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.843 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7f95d27fc640 1 -- 10.20.193.14:0/2616746216 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3751854667 0 0) 0x7f95b8003610 con 0x7f95d40585e0 2026-02-24T19:17:28.843 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7f95d27fc640 1 -- 10.20.193.14:0/2616746216 >> v1:10.20.193.170:6789/0 conn(0x7f95d40b9f80 legacy=0x7f95d4163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:28.843 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7f95d27fc640 1 -- 10.20.193.14:0/2616746216 >> v1:10.20.193.44:6789/0 conn(0x7f95d40ba350 legacy=0x7f95d4057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:28.843 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7f95d27fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.843 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7f95d27fc640 1 monclient: found mon.noname-a 2026-02-24T19:17:28.843 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7f95d27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.843 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7f95d27fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.843 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7f95d27fc640 1 -- 10.20.193.14:0/2616746216 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95d40573f0 con 0x7f95d40585e0 2026-02-24T19:17:28.843 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.832+0000 7fbaecff9640 10 client.?.objecter ms_handle_connect 0x7fbaf0159e40 2026-02-24T19:17:28.843 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.832+0000 7fbaecff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.843 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7f95d27fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.843 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7f95d27fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.843 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7f95d27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.843 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7f95d27fc640 1 -- 10.20.193.14:0/2616746216 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f95c8003340 con 0x7f95d40585e0 2026-02-24T19:17:28.843 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7f95d27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.843 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7f95d27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:28.843 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7f95d27fc640 10 monclient: dump: 2026-02-24T19:17:28.843 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.843 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.843 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.843 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.843 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.843 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.843 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.843 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.843 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.843 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.843 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7f95d9ba2640 5 monclient: authenticate success, global_id 4536 2026-02-24T19:17:28.843 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.831+0000 7f95d9ba2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.844 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.832+0000 7f76c1711640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f76bc0ba350 0x7f76bc156760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:55080/0 (socket says 10.20.193.14:55080) 2026-02-24T19:17:28.844 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.832+0000 7f76c1711640 1 -- 10.20.193.14:0/2224669131 learned_addr learned my addr 10.20.193.14:0/2224669131 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.844 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.836+0000 7f76b17fa640 10 client.?.objecter ms_handle_connect 0x7f76bc0ba350 2026-02-24T19:17:28.844 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.836+0000 7f76b17fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.844 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7ff7c17fa640 1 -- 10.20.193.14:0/2275417262 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1919314363 0 0) 0x7ff7cc1febd0 con 0x7ff7cc0b9f80 2026-02-24T19:17:28.844 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7ff7c17fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.844 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7ff7c17fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.844 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f4a1a344640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f4a14157780 0x7f4a140afde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:55082/0 (socket says 10.20.193.14:55082) 2026-02-24T19:17:28.844 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f4a1a344640 1 -- 10.20.193.14:0/3446685470 learned_addr learned my addr 10.20.193.14:0/3446685470 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.844 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7ff7c17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.844 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7ff7c17fa640 10 monclient(hunting): my global_id is 4548 2026-02-24T19:17:28.844 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7ff7c17fa640 1 -- 10.20.193.14:0/2275417262 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff79c003610 con 0x7ff7cc0b9f80 2026-02-24T19:17:28.844 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f8d06ffd640 1 -- 10.20.193.14:0/1773786792 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2873561665 0 0) 0x7f8d080b8540 con 0x7f8d080b28b0 2026-02-24T19:17:28.844 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f8d06ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.844 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f8d06ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.844 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f8d06ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.844 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f8d06ffd640 10 monclient(hunting): my global_id is 4542 2026-02-24T19:17:28.844 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f8d06ffd640 1 -- 10.20.193.14:0/1773786792 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ce8003610 con 0x7f8d080b28b0 2026-02-24T19:17:28.845 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f4f1f7fe640 1 -- 10.20.193.14:0/1254929845 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4f24003380 con 0x7f4f28056ea0 2026-02-24T19:17:28.845 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f4f1f7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.845 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f4f1f7fe640 1 -- 10.20.193.14:0/1254929845 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4f240037c0 con 0x7f4f28056ea0 2026-02-24T19:17:28.845 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f4f1f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.845 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f4f1f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.845 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f4f1f7fe640 10 monclient: dump: 2026-02-24T19:17:28.845 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.845 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.845 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.845 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.845 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.845 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.845 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.845 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.845 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.845 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.845 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f4f2f26a640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:28.845 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f4f2f26a640 4 set_mon_vals no callback set 2026-02-24T19:17:28.845 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f59ad643640 1 -- 10.20.193.14:0/4256302412 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f599c003380 con 0x7f59a80ba2e0 2026-02-24T19:17:28.845 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f59ad643640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.845 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f59b08d0640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:28.845 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f59b08d0640 4 set_mon_vals no callback set 2026-02-24T19:17:28.845 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f59ad643640 1 -- 10.20.193.14:0/4256302412 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f599c0037c0 con 0x7f59a80ba2e0 2026-02-24T19:17:28.845 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f59ad643640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.845 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f59ad643640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.845 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f59ad643640 10 monclient: dump: 2026-02-24T19:17:28.845 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.845 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.845 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.845 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.845 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.846 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.846 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.846 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.846 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.846 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.846 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f49faffd640 10 client.?.objecter ms_handle_connect 0x7f4a14157780 2026-02-24T19:17:28.846 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f49faffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.846 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f5706ffd640 1 -- 10.20.193.14:0/1003158123 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f56fc003550 con 0x7f57080585e0 2026-02-24T19:17:28.846 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f5706ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.846 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f5706ffd640 1 -- 10.20.193.14:0/1003158123 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f56fc004d10 con 0x7f57080585e0 2026-02-24T19:17:28.846 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f5706ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.846 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f5706ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.846 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f5706ffd640 10 monclient: dump: 2026-02-24T19:17:28.846 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.846 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.846 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.846 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.846 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.846 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.846 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.846 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.846 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.846 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.846 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f570e6b1640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:28.846 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f570e6b1640 4 set_mon_vals no callback set 2026-02-24T19:17:28.846 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f9e867fc640 1 -- 10.20.193.14:0/894131579 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9e740031d0 con 0x7f9e880b9f80 2026-02-24T19:17:28.847 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f9e867fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.847 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f9e867fc640 1 -- 10.20.193.14:0/894131579 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f9e74004990 con 0x7f9e880b9f80 2026-02-24T19:17:28.847 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f9e8e11b640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:28.847 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f9e8e11b640 4 set_mon_vals no callback set 2026-02-24T19:17:28.847 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f9e867fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.847 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f9e867fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.847 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.839+0000 7f9e867fc640 10 monclient: dump: 2026-02-24T19:17:28.847 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.847 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.847 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.847 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.847 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.847 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.847 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.847 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.847 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.847 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.847 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f4f2f26a640 10 monclient: shutdown 2026-02-24T19:17:28.847 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f4f2f26a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.847 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f4f2f26a640 1 -- 10.20.193.14:0/1254929845 >> v1:10.20.193.14:6789/0 conn(0x7f4f28056ea0 legacy=0x7f4f281c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.847 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f59b08d0640 10 monclient: shutdown 2026-02-24T19:17:28.847 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f59b08d0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.847 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f4f2f26a640 1 -- 10.20.193.14:0/1254929845 shutdown_connections 2026-02-24T19:17:28.847 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f59b08d0640 1 -- 10.20.193.14:0/4256302412 >> v1:10.20.193.14:6789/0 conn(0x7f59a80ba2e0 legacy=0x7f59a80b5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.847 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f4f2f26a640 1 -- 10.20.193.14:0/1254929845 >> 10.20.193.14:0/1254929845 conn(0x7f4f280b7470 msgr2=0x7f4f280b7840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.848 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f4f2f26a640 1 -- 10.20.193.14:0/1254929845 shutdown_connections 2026-02-24T19:17:28.848 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f9e8e11b640 10 monclient: shutdown 2026-02-24T19:17:28.848 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f9e8e11b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.848 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f4f2f26a640 1 -- 10.20.193.14:0/1254929845 wait complete. 2026-02-24T19:17:28.848 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f9e8e11b640 1 -- 10.20.193.14:0/894131579 >> v1:10.20.193.14:6789/0 conn(0x7f9e880b9f80 legacy=0x7f9e88163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.848 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f59b08d0640 1 -- 10.20.193.14:0/4256302412 shutdown_connections 2026-02-24T19:17:28.848 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f59b08d0640 1 -- 10.20.193.14:0/4256302412 >> 10.20.193.14:0/4256302412 conn(0x7f59a80b7990 msgr2=0x7f59a80b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.848 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f59b08d0640 1 -- 10.20.193.14:0/4256302412 shutdown_connections 2026-02-24T19:17:28.848 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f59b08d0640 1 -- 10.20.193.14:0/4256302412 wait complete. 2026-02-24T19:17:28.848 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f9e8e11b640 1 -- 10.20.193.14:0/894131579 shutdown_connections 2026-02-24T19:17:28.848 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f9e8e11b640 1 -- 10.20.193.14:0/894131579 >> 10.20.193.14:0/894131579 conn(0x7f9e880b7990 msgr2=0x7f9e880b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.848 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f9e8e11b640 1 -- 10.20.193.14:0/894131579 shutdown_connections 2026-02-24T19:17:28.848 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f570e6b1640 10 monclient: shutdown 2026-02-24T19:17:28.848 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f570e6b1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.848 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f570e6b1640 1 -- 10.20.193.14:0/1003158123 >> v1:10.20.193.14:6789/0 conn(0x7f57080585e0 legacy=0x7f5708166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.849 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7fbaecff9640 1 -- 10.20.193.14:0/3377738563 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 738131600 0 0) 0x7fbaf013b070 con 0x7fbaf0159e40 2026-02-24T19:17:28.849 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7fbaecff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.849 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7fbaecff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.849 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7fbaecff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.849 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7fbaecff9640 10 monclient(hunting): my global_id is 4551 2026-02-24T19:17:28.849 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f9e8e11b640 1 -- 10.20.193.14:0/894131579 wait complete. 2026-02-24T19:17:28.849 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7fbaecff9640 1 -- 10.20.193.14:0/3377738563 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbac0003610 con 0x7fbaf0159e40 2026-02-24T19:17:28.849 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f570e6b1640 1 -- 10.20.193.14:0/1003158123 shutdown_connections 2026-02-24T19:17:28.849 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f570e6b1640 1 -- 10.20.193.14:0/1003158123 >> 10.20.193.14:0/1003158123 conn(0x7f57080b7990 msgr2=0x7f57080b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.849 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f570e6b1640 1 -- 10.20.193.14:0/1003158123 shutdown_connections 2026-02-24T19:17:28.849 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f570e6b1640 1 -- 10.20.193.14:0/1003158123 wait complete. 2026-02-24T19:17:28.849 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f4f2f26a640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.849 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f4f2f26a640 10 monclient: monmap: 2026-02-24T19:17:28.849 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.849 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:28.849 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:28.849 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:28.849 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.849 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:28.849 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.849 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.849 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.849 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.850 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f9e8e11b640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.850 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f9e8e11b640 10 monclient: monmap: 2026-02-24T19:17:28.850 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.850 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:28.850 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:28.850 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:28.850 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.850 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:28.850 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.850 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.850 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.850 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.850 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f59b08d0640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.850 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f59b08d0640 10 monclient: monmap: 2026-02-24T19:17:28.850 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.850 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:28.850 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:28.850 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:28.850 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.850 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:28.850 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.850 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.850 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.850 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.850 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f4f2f26a640 1 librados: starting msgr at 2026-02-24T19:17:28.850 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f4f2f26a640 1 librados: starting objecter 2026-02-24T19:17:28.850 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f9e8e11b640 1 librados: starting msgr at 2026-02-24T19:17:28.850 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f9e8e11b640 1 librados: starting objecter 2026-02-24T19:17:28.850 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f4f2f26a640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:28.851 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.840+0000 7f570e6b1640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.851 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f570e6b1640 10 monclient: monmap: 2026-02-24T19:17:28.851 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.851 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:28.851 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:28.851 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:28.851 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.851 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:28.851 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.851 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.851 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.851 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.851 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f4f2f26a640 1 Processor -- start 2026-02-24T19:17:28.851 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f9e8e11b640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:28.851 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f9e8e11b640 1 Processor -- start 2026-02-24T19:17:28.851 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f59b08d0640 1 librados: starting msgr at 2026-02-24T19:17:28.851 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f59b08d0640 1 librados: starting objecter 2026-02-24T19:17:28.851 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f4f2f26a640 1 -- start start 2026-02-24T19:17:28.851 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f4f2f26a640 1 librados: setting wanted keys 2026-02-24T19:17:28.851 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f4f2f26a640 1 librados: calling monclient init 2026-02-24T19:17:28.851 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f4f2f26a640 10 monclient: init 2026-02-24T19:17:28.852 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f9e8e11b640 1 -- start start 2026-02-24T19:17:28.852 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f9e8e11b640 1 librados: setting wanted keys 2026-02-24T19:17:28.852 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f9e8e11b640 1 librados: calling monclient init 2026-02-24T19:17:28.852 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f9e8e11b640 10 monclient: init 2026-02-24T19:17:28.852 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f59b08d0640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:28.852 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f59b08d0640 1 Processor -- start 2026-02-24T19:17:28.852 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f570e6b1640 1 librados: starting msgr at 2026-02-24T19:17:28.852 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f570e6b1640 1 librados: starting objecter 2026-02-24T19:17:28.852 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f570e6b1640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:28.852 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f570e6b1640 1 Processor -- start 2026-02-24T19:17:28.852 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f570e6b1640 1 -- start start 2026-02-24T19:17:28.852 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f570e6b1640 1 librados: setting wanted keys 2026-02-24T19:17:28.852 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f570e6b1640 1 librados: calling monclient init 2026-02-24T19:17:28.852 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f570e6b1640 10 monclient: init 2026-02-24T19:17:28.852 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f59b08d0640 1 -- start start 2026-02-24T19:17:28.852 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f4f2f26a640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.852 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f4f2f26a640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:28.852 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f4f2f26a640 10 monclient(hunting): picked mon.noname-a con 0x7f4f28056ea0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.852 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f59b08d0640 1 librados: setting wanted keys 2026-02-24T19:17:28.852 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f59b08d0640 1 librados: calling monclient init 2026-02-24T19:17:28.852 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f59b08d0640 10 monclient: init 2026-02-24T19:17:28.853 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f4f2f26a640 10 monclient(hunting): picked mon.noname-c con 0x7f4f2815d610 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.853 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f4f2f26a640 10 monclient(hunting): picked mon.noname-b con 0x7f4f281667e0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.853 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f4f2f26a640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f28131490 con 0x7f4f28056ea0 2026-02-24T19:17:28.853 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f4f2f26a640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f28131750 con 0x7f4f281667e0 2026-02-24T19:17:28.853 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f4f2f26a640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f28131a30 con 0x7f4f2815d610 2026-02-24T19:17:28.853 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f4f2f26a640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.853 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f4f2f26a640 10 monclient(hunting): authenticate will time out at 3623.522481s 2026-02-24T19:17:28.853 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f9e8e11b640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.853 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f9e8e11b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:28.853 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f9e8e11b640 10 monclient(hunting): picked mon.noname-a con 0x7f9e880585e0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.853 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f9e8e11b640 10 monclient(hunting): picked mon.noname-c con 0x7f9e880b9f80 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.853 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f9e8e11b640 10 monclient(hunting): picked mon.noname-b con 0x7f9e880ba350 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.853 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f9e8e11b640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e88155880 con 0x7f9e880585e0 2026-02-24T19:17:28.853 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f570e6b1640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.853 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f570e6b1640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:28.853 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f570e6b1640 10 monclient(hunting): picked mon.noname-a con 0x7f57080585e0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.853 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f59b08d0640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.853 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f59b08d0640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:28.854 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f59b08d0640 10 monclient(hunting): picked mon.noname-a con 0x7f59a80afef0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.854 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f59b08d0640 10 monclient(hunting): picked mon.noname-c con 0x7f59a80b9f10 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.854 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f59b08d0640 10 monclient(hunting): picked mon.noname-b con 0x7f59a80ba2e0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.854 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f59b08d0640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a81201d0 con 0x7f59a80afef0 2026-02-24T19:17:28.854 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f59b08d0640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a816f5c0 con 0x7f59a80ba2e0 2026-02-24T19:17:28.854 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f59b08d0640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a816ac70 con 0x7f59a80b9f10 2026-02-24T19:17:28.854 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f59b08d0640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.854 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f59b08d0640 10 monclient(hunting): authenticate will time out at 3623.522883s 2026-02-24T19:17:28.854 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f9e8e11b640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e881fd090 con 0x7f9e880ba350 2026-02-24T19:17:28.854 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f9e8e11b640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e881fd370 con 0x7f9e880b9f80 2026-02-24T19:17:28.854 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f9e8e11b640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.854 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f9e8e11b640 10 monclient(hunting): authenticate will time out at 3623.522896s 2026-02-24T19:17:28.854 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f570e6b1640 10 monclient(hunting): picked mon.noname-b con 0x7f57080b9f80 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.854 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f570e6b1640 10 monclient(hunting): picked mon.noname-c con 0x7f57080ba350 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.854 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f570e6b1640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57081febd0 con 0x7f57080585e0 2026-02-24T19:17:28.854 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f570e6b1640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57080b3100 con 0x7f57080b9f80 2026-02-24T19:17:28.854 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f570e6b1640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57080b33e0 con 0x7f57080ba350 2026-02-24T19:17:28.854 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f570e6b1640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.854 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.841+0000 7f570e6b1640 10 monclient(hunting): authenticate will time out at 3623.522896s 2026-02-24T19:17:28.854 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.842+0000 7ffac2ffd640 1 -- 10.20.193.14:0/2298518687 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 767613134 0 0) 0x7ffaac003610 con 0x7ffac40585e0 2026-02-24T19:17:28.854 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.842+0000 7ffac2ffd640 1 -- 10.20.193.14:0/2298518687 >> v1:10.20.193.170:6789/0 conn(0x7ffac40ba350 legacy=0x7ffac4057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:28.855 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.842+0000 7ffac2ffd640 1 -- 10.20.193.14:0/2298518687 >> v1:10.20.193.44:6789/0 conn(0x7ffac40b9f80 legacy=0x7ffac4163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:28.855 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.842+0000 7ffac2ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.855 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.842+0000 7ffac2ffd640 1 monclient: found mon.noname-a 2026-02-24T19:17:28.855 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.842+0000 7ffac2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.855 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.842+0000 7ffac2ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.855 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.842+0000 7ffac2ffd640 1 -- 10.20.193.14:0/2298518687 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffac40573f0 con 0x7ffac40585e0 2026-02-24T19:17:28.855 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.842+0000 7ffac2ffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.855 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.842+0000 7ffac2ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.855 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.842+0000 7ffac2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.855 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.842+0000 7ffac2ffd640 1 -- 10.20.193.14:0/2298518687 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ffab8003340 con 0x7ffac40585e0 2026-02-24T19:17:28.855 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.842+0000 7ffac2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.855 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.842+0000 7ffac2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:28.855 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.842+0000 7ffac2ffd640 10 monclient: dump: 2026-02-24T19:17:28.855 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.855 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.855 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.855 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.855 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.855 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.855 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.855 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.855 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.855 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.855 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.842+0000 7ffacaa4d640 5 monclient: authenticate success, global_id 4539 2026-02-24T19:17:28.855 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.842+0000 7ffacaa4d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.856 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f7c3a2a8640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f7c340585e0 0x7f7c34165920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:55100/0 (socket says 10.20.193.14:55100) 2026-02-24T19:17:28.856 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f7c3a2a8640 1 -- 10.20.193.14:0/1089186970 learned_addr learned my addr 10.20.193.14:0/1089186970 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.856 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f2cee7fc640 1 -- 10.20.193.14:0/3238434083 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 22194069 0 0) 0x7f2d08148730 con 0x7f2d080b27c0 2026-02-24T19:17:28.856 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f2cee7fc640 1 -- 10.20.193.14:0/3238434083 >> v1:10.20.193.170:6789/0 conn(0x7f2d08155bc0 legacy=0x7f2d08147d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.856 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f2cee7fc640 1 -- 10.20.193.14:0/3238434083 >> v1:10.20.193.44:6789/0 conn(0x7f2d08155f90 legacy=0x7f2d08136000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.856 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f2cee7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.856 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f2cee7fc640 1 monclient: found mon.a 2026-02-24T19:17:28.856 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f2cee7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.856 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f2cee7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.856 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f2cee7fc640 1 -- 10.20.193.14:0/3238434083 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d08131970 con 0x7f2d080b27c0 2026-02-24T19:17:28.856 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f2cee7fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f2cee7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f2cee7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f2d0ff08640 5 monclient: authenticate success, global_id 4533 2026-02-24T19:17:28.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f2d0ff08640 10 monclient: _renew_subs 2026-02-24T19:17:28.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f2d0ff08640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f2d0ff08640 1 -- 10.20.193.14:0/3238434083 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2d08131c50 con 0x7f2d080b27c0 2026-02-24T19:17:28.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f8d06ffd640 1 -- 10.20.193.14:0/1773786792 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 996854826 0 0) 0x7f8ce8003610 con 0x7f8d080b28b0 2026-02-24T19:17:28.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f8d06ffd640 1 -- 10.20.193.14:0/1773786792 >> v1:10.20.193.170:6789/0 conn(0x7f8d080b0ca0 legacy=0x7f8d080b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:28.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f8d06ffd640 1 -- 10.20.193.14:0/1773786792 >> v1:10.20.193.44:6789/0 conn(0x7f8d0815d0c0 legacy=0x7f8d080b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:28.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f8d06ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f8d06ffd640 1 monclient: found mon.noname-a 2026-02-24T19:17:28.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f8d06ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f8d06ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f8d06ffd640 1 -- 10.20.193.14:0/1773786792 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d08163e10 con 0x7f8d080b28b0 2026-02-24T19:17:28.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f8d06ffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f8d06ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f8d06ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f8d06ffd640 1 -- 10.20.193.14:0/1773786792 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f8cf4002df0 con 0x7f8d080b28b0 2026-02-24T19:17:28.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f8d06ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f8d06ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:28.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f8d06ffd640 10 monclient: dump: 2026-02-24T19:17:28.857 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.857 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.857 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.857 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.857 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.857 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.857 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.857 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.857 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.857 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f2d0ff08640 10 client.4533.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f2d0ff08640 10 monclient: _renew_subs 2026-02-24T19:17:28.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f2d0ff08640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f2d0ff08640 1 -- 10.20.193.14:0/3238434083 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2d08136710 con 0x7f2d080b27c0 2026-02-24T19:17:28.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f2d0ff08640 1 librados: init done 2026-02-24T19:17:28.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f8d0e526640 5 monclient: authenticate success, global_id 4542 2026-02-24T19:17:28.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.855+0000 7f8d0e526640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.856+0000 7f4f2cfdf640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f4f28056ea0 0x7f4f28165c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:55110/0 (socket says 10.20.193.14:55110) 2026-02-24T19:17:28.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.856+0000 7f4f2cfdf640 1 -- 10.20.193.14:0/3332313869 learned_addr learned my addr 10.20.193.14:0/3332313869 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.856+0000 7f76b17fa640 1 -- 10.20.193.14:0/2224669131 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3848240834 0 0) 0x7f76bc0b9510 con 0x7f76bc0ba350 2026-02-24T19:17:28.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.856+0000 7f76b17fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.856+0000 7f76b17fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.856+0000 7f76b17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.856+0000 7f76b17fa640 10 monclient(hunting): my global_id is 4554 2026-02-24T19:17:28.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.856+0000 7f76b17fa640 1 -- 10.20.193.14:0/2224669131 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f768c003610 con 0x7f76bc0ba350 2026-02-24T19:17:28.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.856+0000 7f2d0ff08640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.856+0000 7f2d0ff08640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.856+0000 7f2d0ff08640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:28.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.856+0000 7f2d0ff08640 1 -- 10.20.193.14:0/3238434083 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d0815cca0 con 0x7f2d080b27c0 2026-02-24T19:17:28.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.856+0000 7f7c1affd640 10 client.?.objecter ms_handle_connect 0x7f7c340585e0 2026-02-24T19:17:28.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.856+0000 7f7c1affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.857+0000 7f4f1d7fa640 10 client.?.objecter ms_handle_connect 0x7f4f28056ea0 2026-02-24T19:17:28.859 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.857+0000 7f4f1d7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.859 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.857+0000 7f49faffd640 1 -- 10.20.193.14:0/3446685470 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2356179834 0 0) 0x7f4a140a6cd0 con 0x7f4a14157780 2026-02-24T19:17:28.859 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.857+0000 7f49faffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.859 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.857+0000 7f49faffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.859 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.857+0000 7f49faffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.859 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.857+0000 7f49faffd640 10 monclient(hunting): my global_id is 4557 2026-02-24T19:17:28.859 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.857+0000 7f49faffd640 1 -- 10.20.193.14:0/3446685470 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49e4003610 con 0x7f4a14157780 2026-02-24T19:17:28.859 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.857+0000 7feec6ffd640 1 -- 10.20.193.14:0/2287837901 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1945766093 0 0) 0x7feeb0003610 con 0x7feee00585e0 2026-02-24T19:17:28.859 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.857+0000 7feec6ffd640 1 -- 10.20.193.14:0/2287837901 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feee01f89e0 con 0x7feee00585e0 2026-02-24T19:17:28.859 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.857+0000 7feec6ffd640 1 -- 10.20.193.14:0/2287837901 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7feed0003170 con 0x7feee00585e0 2026-02-24T19:17:28.859 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.857+0000 7feec6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.859 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.857+0000 7feec6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:28.859 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.857+0000 7feec6ffd640 10 monclient(hunting): dump: 2026-02-24T19:17:28.859 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.859 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.859 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.859 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.859 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.859 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.859 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.859 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.859 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.859 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.859 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.857+0000 7feec6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:28.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.858+0000 7ff7c17fa640 1 -- 10.20.193.14:0/2275417262 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 334014777 0 0) 0x7ff79c003610 con 0x7ff7cc0b9f80 2026-02-24T19:17:28.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.858+0000 7ff7c17fa640 1 -- 10.20.193.14:0/2275417262 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff7cc1febd0 con 0x7ff7cc0b9f80 2026-02-24T19:17:28.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.858+0000 7ff7c17fa640 1 -- 10.20.193.14:0/2275417262 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ff7b4002ed0 con 0x7ff7cc0b9f80 2026-02-24T19:17:28.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.858+0000 7ff7c17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.858+0000 7ff7c17fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:28.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.858+0000 7ff7c17fa640 10 monclient(hunting): dump: 2026-02-24T19:17:28.860 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.860 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.860 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.860 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.860 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.860 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.860 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.860 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.860 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.860 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.858+0000 7ff7c17fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:28.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.858+0000 7f9e877fe640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f9e880585e0 0x7f9e881fb660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:55120/0 (socket says 10.20.193.14:55120) 2026-02-24T19:17:28.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.858+0000 7f9e877fe640 1 -- 10.20.193.14:0/2794771459 learned_addr learned my addr 10.20.193.14:0/2794771459 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.859+0000 7f59ae645640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f59a80afef0 0x7f59a816d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:55150/0 (socket says 10.20.193.14:55150) 2026-02-24T19:17:28.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.859+0000 7f59ae645640 1 -- 10.20.193.14:0/2339725969 learned_addr learned my addr 10.20.193.14:0/2339725969 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.859+0000 7f95d27fc640 1 -- 10.20.193.14:0/2616746216 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f95c8003550 con 0x7f95d40585e0 2026-02-24T19:17:28.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.859+0000 7f95d27fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.859+0000 7f95d27fc640 1 -- 10.20.193.14:0/2616746216 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f95c8004d10 con 0x7f95d40585e0 2026-02-24T19:17:28.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.859+0000 7f95d27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.859+0000 7f95d27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.859+0000 7f95d27fc640 10 monclient: dump: 2026-02-24T19:17:28.861 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.861 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.861 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.861 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.861 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.861 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.861 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.861 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.861 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.861 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.859+0000 7f95d9ba2640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:28.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.859+0000 7f95d9ba2640 4 set_mon_vals no callback set 2026-02-24T19:17:28.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.859+0000 7f5992ffd640 10 client.?.objecter ms_handle_connect 0x7f59a80afef0 2026-02-24T19:17:28.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.859+0000 7f5992ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.859+0000 7f9e63fff640 10 client.?.objecter ms_handle_connect 0x7f9e880585e0 2026-02-24T19:17:28.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.859+0000 7f9e63fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.859+0000 7f95d9ba2640 10 monclient: shutdown 2026-02-24T19:17:28.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.859+0000 7f95d9ba2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.859+0000 7f95d9ba2640 1 -- 10.20.193.14:0/2616746216 >> v1:10.20.193.14:6789/0 conn(0x7f95d40585e0 legacy=0x7f95d4166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.860+0000 7f95d9ba2640 1 -- 10.20.193.14:0/2616746216 shutdown_connections 2026-02-24T19:17:28.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.860+0000 7f95d9ba2640 1 -- 10.20.193.14:0/2616746216 >> 10.20.193.14:0/2616746216 conn(0x7f95d40b7990 msgr2=0x7f95d40b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.860+0000 7f95d9ba2640 1 -- 10.20.193.14:0/2616746216 shutdown_connections 2026-02-24T19:17:28.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.860+0000 7f95d9ba2640 1 -- 10.20.193.14:0/2616746216 wait complete. 2026-02-24T19:17:28.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.860+0000 7f95d9ba2640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.860+0000 7f95d9ba2640 10 monclient: monmap: 2026-02-24T19:17:28.862 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.862 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:28.862 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:28.862 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:28.862 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.862 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:28.862 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.862 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.862 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.862 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.860+0000 7f95d9ba2640 1 librados: starting msgr at 2026-02-24T19:17:28.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.860+0000 7f95d9ba2640 1 librados: starting objecter 2026-02-24T19:17:28.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.860+0000 7f95d9ba2640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:28.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.860+0000 7f95d9ba2640 1 Processor -- start 2026-02-24T19:17:28.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.861+0000 7f95d9ba2640 1 -- start start 2026-02-24T19:17:28.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.861+0000 7f95d9ba2640 1 librados: setting wanted keys 2026-02-24T19:17:28.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.861+0000 7f95d9ba2640 1 librados: calling monclient init 2026-02-24T19:17:28.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.861+0000 7f95d9ba2640 10 monclient: init 2026-02-24T19:17:28.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.861+0000 7f95d9ba2640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.861+0000 7f95d9ba2640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:28.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.861+0000 7f95d9ba2640 10 monclient(hunting): picked mon.noname-a con 0x7f95d40585e0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.861+0000 7f95d9ba2640 10 monclient(hunting): picked mon.noname-c con 0x7f95d40b9f80 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.861+0000 7f95d9ba2640 10 monclient(hunting): picked mon.noname-b con 0x7f95d40ba350 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.861+0000 7f95d9ba2640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95d41febd0 con 0x7f95d40585e0 2026-02-24T19:17:28.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.861+0000 7f95d9ba2640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95d40b3100 con 0x7f95d40ba350 2026-02-24T19:17:28.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.861+0000 7f95d9ba2640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95d40b33e0 con 0x7f95d40b9f80 2026-02-24T19:17:28.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.861+0000 7f95d9ba2640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.861+0000 7f95d9ba2640 10 monclient(hunting): authenticate will time out at 3623.542706s 2026-02-24T19:17:28.863 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.862+0000 7f2fa6ffd640 1 -- 10.20.193.14:0/1935728667 <== mon.1 v1:10.20.193.44:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2fb0003300 con 0x7f2fc00ba350 2026-02-24T19:17:28.863 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.862+0000 7f2fa6ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.863 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.862+0000 7f2fa6ffd640 1 -- 10.20.193.14:0/1935728667 <== mon.1 v1:10.20.193.44:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f2fb0003e80 con 0x7f2fc00ba350 2026-02-24T19:17:28.864 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.862+0000 7f2fa6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.864 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.862+0000 7f2fa6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:28.864 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.862+0000 7f2fa6ffd640 10 monclient: dump: 2026-02-24T19:17:28.864 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.864 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.864 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.864 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.864 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.864 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.864 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.864 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.864 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.864 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.864 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.862+0000 7f2fbcd72640 4 set_mon_vals no callback set 2026-02-24T19:17:28.864 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.863+0000 7f5707fff640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f57080585e0 0x7f57080b2800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:55136/0 (socket says 10.20.193.14:55136) 2026-02-24T19:17:28.864 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.863+0000 7f5707fff640 1 -- 10.20.193.14:0/38327090 learned_addr learned my addr 10.20.193.14:0/38327090 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.864 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.863+0000 7f2fa6ffd640 1 -- 10.20.193.14:0/1935728667 <== mon.1 v1:10.20.193.44:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f2fb001ccf0 con 0x7f2fc00ba350 2026-02-24T19:17:28.864 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.864+0000 7f2fbe575640 10 monclient: get_auth_request con 0x7f2f8c077d30 auth_method 0 2026-02-24T19:17:28.865 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.864+0000 7f2fa6ffd640 10 client.4489.objecter ms_handle_connect 0x7f2f8c077d30 2026-02-24T19:17:28.866 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.865+0000 7f2fa6ffd640 1 -- 10.20.193.14:0/1935728667 <== mon.1 v1:10.20.193.44:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7f2fb00923c0 con 0x7f2fc00ba350 2026-02-24T19:17:28.866 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.865+0000 7f2fa6ffd640 10 client.4489.objecter ms_dispatch2 0x7f2fc0000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:28.866 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.865+0000 7f2fa6ffd640 3 client.4489.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:28.866 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.865+0000 7f2fa6ffd640 3 client.4489.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:28.866 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.865+0000 7f2fa6ffd640 20 client.4489.objecter dump_active .. 0 homeless 2026-02-24T19:17:28.870 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.869+0000 7f2fa6ffd640 1 -- 10.20.193.14:0/1935728667 <== mon.1 v1:10.20.193.44:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f2fb005cdf0 con 0x7f2fc00ba350 2026-02-24T19:17:28.870 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.869+0000 7f2fa6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.870 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.869+0000 7f2fa6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:28.877 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.876+0000 7f76b17fa640 10 client.?.objecter ms_handle_connect 0x7f76bc0585e0 2026-02-24T19:17:28.877 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.876+0000 7f76b17fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.879 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.878+0000 7ff7c17fa640 10 client.?.objecter ms_handle_connect 0x7ff7cc0585e0 2026-02-24T19:17:28.879 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.878+0000 7ff7c17fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.879 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.878+0000 7feec6ffd640 10 client.?.objecter ms_handle_connect 0x7feee00b9f80 2026-02-24T19:17:28.879 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.878+0000 7feec6ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.882 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.881+0000 7f49faffd640 10 client.?.objecter ms_handle_connect 0x7f4a14164d00 2026-02-24T19:17:28.882 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.881+0000 7f49faffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.882 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.881+0000 7f4f1d7fa640 10 client.?.objecter ms_handle_connect 0x7f4f281667e0 2026-02-24T19:17:28.882 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.881+0000 7f4f1d7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.882 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.881+0000 7f7c1affd640 10 client.?.objecter ms_handle_connect 0x7f7c340ba350 2026-02-24T19:17:28.882 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.881+0000 7f7c1affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.884 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.883+0000 7fbaecff9640 10 client.?.objecter ms_handle_connect 0x7fbaf0159a70 2026-02-24T19:17:28.884 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.883+0000 7fbaecff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.884 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.883+0000 7f5992ffd640 10 client.?.objecter ms_handle_connect 0x7f59a80ba2e0 2026-02-24T19:17:28.884 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.883+0000 7f5992ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.885 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.885+0000 7f5704ff9640 10 client.?.objecter ms_handle_connect 0x7f57080b9f80 2026-02-24T19:17:28.886 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.885+0000 7f5704ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.888 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.887+0000 7f95d3fff640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7f95d40ba350 0x7f95d4161a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:34902/0 (socket says 10.20.193.14:34902) 2026-02-24T19:17:28.888 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.887+0000 7f95d3fff640 1 -- 10.20.193.14:0/2431173474 learned_addr learned my addr 10.20.193.14:0/2431173474 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.888 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.887+0000 7f9e63fff640 10 client.?.objecter ms_handle_connect 0x7f9e880ba350 2026-02-24T19:17:28.888 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.887+0000 7f9e63fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.888 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.887+0000 7f95affff640 10 client.?.objecter ms_handle_connect 0x7f95d40ba350 2026-02-24T19:17:28.888 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.888+0000 7f95affff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.889 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.889+0000 7feec6ffd640 1 -- 10.20.193.14:0/2287837901 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3673349551 0 0) 0x7feee00b5160 con 0x7feee00b9f80 2026-02-24T19:17:28.890 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.889+0000 7feec6ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.890 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.889+0000 7feec6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.890 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.889+0000 7feec6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.890 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.889+0000 7feec6ffd640 10 monclient(hunting): my global_id is 4501 2026-02-24T19:17:28.890 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.889+0000 7feec6ffd640 1 -- 10.20.193.14:0/2287837901 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feeb0003610 con 0x7feee00b9f80 2026-02-24T19:17:28.890 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.889+0000 7f7c1affd640 1 -- 10.20.193.14:0/1089186970 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4226803086 0 0) 0x7f7c340b36c0 con 0x7f7c340ba350 2026-02-24T19:17:28.890 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.889+0000 7f7c1affd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.890 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.889+0000 7f7c1affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.890 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.889+0000 7f7c1affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.890 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.889+0000 7f7c1affd640 10 monclient(hunting): my global_id is 4510 2026-02-24T19:17:28.890 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.889+0000 7f7c1affd640 1 -- 10.20.193.14:0/1089186970 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c04003610 con 0x7f7c340ba350 2026-02-24T19:17:28.892 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.891+0000 7f5704ff9640 1 -- 10.20.193.14:0/38327090 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 20004277 0 0) 0x7f57080b3100 con 0x7f57080b9f80 2026-02-24T19:17:28.892 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.891+0000 7f5704ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.892 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.891+0000 7f5704ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.892 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.891+0000 7f5704ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.892 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.891+0000 7f5704ff9640 10 monclient(hunting): my global_id is 4519 2026-02-24T19:17:28.892 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.891+0000 7f5704ff9640 1 -- 10.20.193.14:0/38327090 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56d8003610 con 0x7f57080b9f80 2026-02-24T19:17:28.892 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.891+0000 7f76b17fa640 1 -- 10.20.193.14:0/2224669131 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1286035138 0 0) 0x7f76bc1ff9d0 con 0x7f76bc0585e0 2026-02-24T19:17:28.892 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.891+0000 7f76b17fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.892 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.891+0000 7f76b17fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.892 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.891+0000 7f76b17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.892 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.891+0000 7f76b17fa640 10 monclient(hunting): my global_id is 4495 2026-02-24T19:17:28.892 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.891+0000 7f76b17fa640 1 -- 10.20.193.14:0/2224669131 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76bc0b9510 con 0x7f76bc0585e0 2026-02-24T19:17:28.893 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.891+0000 7f49faffd640 1 -- 10.20.193.14:0/3446685470 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4277534347 0 0) 0x7f4a140b04f0 con 0x7f4a14164d00 2026-02-24T19:17:28.893 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.891+0000 7f49faffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.893 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.891+0000 7f49faffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.893 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.891+0000 7f49faffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.893 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.891+0000 7f49faffd640 10 monclient(hunting): my global_id is 4504 2026-02-24T19:17:28.893 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.891+0000 7f49faffd640 1 -- 10.20.193.14:0/3446685470 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a140a6cd0 con 0x7f4a14164d00 2026-02-24T19:17:28.893 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.891+0000 7ff7c17fa640 1 -- 10.20.193.14:0/2275417262 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 728956690 0 0) 0x7ff7cc0b3100 con 0x7ff7cc0585e0 2026-02-24T19:17:28.893 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.891+0000 7ff7c17fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.893 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.891+0000 7ff7c17fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.893 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.891+0000 7ff7c17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.893 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.891+0000 7ff7c17fa640 10 monclient(hunting): my global_id is 4498 2026-02-24T19:17:28.893 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.891+0000 7ff7c17fa640 1 -- 10.20.193.14:0/2275417262 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff79c003610 con 0x7ff7cc0585e0 2026-02-24T19:17:28.893 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.891+0000 7fbaecff9640 1 -- 10.20.193.14:0/3377738563 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 761288879 0 0) 0x7fbaf013b310 con 0x7fbaf0159a70 2026-02-24T19:17:28.893 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.891+0000 7fbaecff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.893 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.891+0000 7fbaecff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.893 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.891+0000 7fbaecff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.893 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.891+0000 7f4f1d7fa640 1 -- 10.20.193.14:0/3332313869 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1732275415 0 0) 0x7f4f28131750 con 0x7f4f281667e0 2026-02-24T19:17:28.894 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.892+0000 7f4f1d7fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.894 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.892+0000 7f4f1d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.894 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.892+0000 7f4f1d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.894 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.892+0000 7f4f1d7fa640 10 monclient(hunting): my global_id is 4507 2026-02-24T19:17:28.894 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.891+0000 7fbaecff9640 10 monclient(hunting): my global_id is 4513 2026-02-24T19:17:28.894 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.892+0000 7fbaecff9640 1 -- 10.20.193.14:0/3377738563 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbaf013b070 con 0x7fbaf0159a70 2026-02-24T19:17:28.894 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.892+0000 7f4f1d7fa640 1 -- 10.20.193.14:0/3332313869 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ef8003610 con 0x7f4f281667e0 2026-02-24T19:17:28.894 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.892+0000 7f787a7fc640 1 -- 10.20.193.14:0/7685078 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7888004c50 con 0x7f788c0ba350 2026-02-24T19:17:28.894 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.892+0000 7f787a7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.894 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.892+0000 7f787a7fc640 1 -- 10.20.193.14:0/7685078 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7888005020 con 0x7f788c0ba350 2026-02-24T19:17:28.894 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.892+0000 7f787a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.894 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.892+0000 7f787a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:28.894 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.892+0000 7f787a7fc640 10 monclient: dump: 2026-02-24T19:17:28.894 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.894 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.894 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.894 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.894 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.895 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.895 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.895 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.895 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.895 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.895 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.892+0000 7f787bfff640 4 set_mon_vals no callback set 2026-02-24T19:17:28.895 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.892+0000 7f787a7fc640 1 -- 10.20.193.14:0/7685078 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f7888005200 con 0x7f788c0ba350 2026-02-24T19:17:28.895 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.893+0000 7f7891811640 10 monclient: get_auth_request con 0x7f785c077db0 auth_method 0 2026-02-24T19:17:28.895 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.893+0000 7f787a7fc640 10 client.4502.objecter ms_handle_connect 0x7f785c077db0 2026-02-24T19:17:28.895 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.893+0000 7f787a7fc640 1 -- 10.20.193.14:0/7685078 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7f7888093670 con 0x7f788c0ba350 2026-02-24T19:17:28.895 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.893+0000 7f787a7fc640 10 client.4502.objecter ms_dispatch2 0x7f788c000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:28.895 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.893+0000 7f787a7fc640 3 client.4502.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:28.895 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.893+0000 7f787a7fc640 3 client.4502.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:28.895 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.893+0000 7f787a7fc640 20 client.4502.objecter dump_active .. 0 homeless 2026-02-24T19:17:28.896 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.895+0000 7f787a7fc640 1 -- 10.20.193.14:0/7685078 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f788c163930 con 0x7f788c0ba350 2026-02-24T19:17:28.896 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.895+0000 7f787a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.896 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.895+0000 7f787a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:28.896 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.895+0000 7f9e63fff640 1 -- 10.20.193.14:0/2794771459 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3057520446 0 0) 0x7f9e881fd090 con 0x7f9e880ba350 2026-02-24T19:17:28.896 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.895+0000 7f9e63fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.896 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.895+0000 7f9e63fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.896 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.895+0000 7f9e63fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.896 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.895+0000 7f9e63fff640 10 monclient(hunting): my global_id is 4522 2026-02-24T19:17:28.896 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.895+0000 7f9e63fff640 1 -- 10.20.193.14:0/2794771459 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e58003610 con 0x7f9e880ba350 2026-02-24T19:17:28.896 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.895+0000 7f5992ffd640 1 -- 10.20.193.14:0/2339725969 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1919798588 0 0) 0x7f59a816f5c0 con 0x7f59a80ba2e0 2026-02-24T19:17:28.896 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.895+0000 7f5992ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.896 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.895+0000 7f5992ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.896 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.895+0000 7f5992ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.896 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.895+0000 7f5992ffd640 10 monclient(hunting): my global_id is 4516 2026-02-24T19:17:28.896 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.895+0000 7f5992ffd640 1 -- 10.20.193.14:0/2339725969 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5978003610 con 0x7f59a80ba2e0 2026-02-24T19:17:28.897 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.896+0000 7f95affff640 1 -- 10.20.193.14:0/2431173474 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 82328111 0 0) 0x7f95d40b3100 con 0x7f95d40ba350 2026-02-24T19:17:28.897 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.896+0000 7f95affff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.897 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.896+0000 7f95affff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.898 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.896+0000 7f95affff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.898 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.896+0000 7f95affff640 10 monclient(hunting): my global_id is 4525 2026-02-24T19:17:28.898 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.896+0000 7f95affff640 1 -- 10.20.193.14:0/2431173474 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95a4003610 con 0x7f95d40ba350 2026-02-24T19:17:28.898 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.896+0000 7feec6ffd640 1 -- 10.20.193.14:0/2287837901 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 821439514 0 0) 0x7feeb0003610 con 0x7feee00b9f80 2026-02-24T19:17:28.898 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.896+0000 7feec6ffd640 1 -- 10.20.193.14:0/2287837901 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feee00b5160 con 0x7feee00b9f80 2026-02-24T19:17:28.898 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.897+0000 7feec6ffd640 1 -- 10.20.193.14:0/2287837901 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7feed4002ea0 con 0x7feee00b9f80 2026-02-24T19:17:28.898 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.897+0000 7feec6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.898 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.897+0000 7feec6ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:28.898 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.897+0000 7feec6ffd640 10 monclient(hunting): dump: 2026-02-24T19:17:28.898 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.898 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.898 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.898 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.898 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.898 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.898 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.898 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.898 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.898 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.898 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.897+0000 7feec6ffd640 10 client.?.objecter ms_handle_connect 0x7feee00ba350 2026-02-24T19:17:28.898 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.897+0000 7feec6ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.899 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.897+0000 7f49faffd640 10 client.?.objecter ms_handle_connect 0x7f4a14157b50 2026-02-24T19:17:28.899 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.897+0000 7f49faffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.900 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.899+0000 7ff7c17fa640 10 client.?.objecter ms_handle_connect 0x7ff7cc0ba350 2026-02-24T19:17:28.900 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.899+0000 7ff7c17fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.900 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.899+0000 7f76b17fa640 10 client.?.objecter ms_handle_connect 0x7f76bc0b9f80 2026-02-24T19:17:28.900 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.899+0000 7f76b17fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.902 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.901+0000 7f7c1affd640 1 -- 10.20.193.14:0/1089186970 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1714701574 0 0) 0x7f7c04003610 con 0x7f7c340ba350 2026-02-24T19:17:28.902 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.901+0000 7f7c1affd640 1 -- 10.20.193.14:0/1089186970 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7c340b36c0 con 0x7f7c340ba350 2026-02-24T19:17:28.902 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.901+0000 7f7c1affd640 1 -- 10.20.193.14:0/1089186970 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7c30003400 con 0x7f7c340ba350 2026-02-24T19:17:28.902 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.901+0000 7f7c1affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.902 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.901+0000 7f7c1affd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:28.902 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.901+0000 7f7c1affd640 10 monclient(hunting): dump: 2026-02-24T19:17:28.902 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.902 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.902 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.902 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.902 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.902 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.902 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.902 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.902 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.902 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.902 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.901+0000 7f7c1affd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:28.903 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.901+0000 7f7c1affd640 10 client.?.objecter ms_handle_connect 0x7f7c340b9f80 2026-02-24T19:17:28.903 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.901+0000 7f7c1affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.903 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.901+0000 7f4f1d7fa640 10 client.?.objecter ms_handle_connect 0x7f4f2815d610 2026-02-24T19:17:28.903 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.901+0000 7f4f1d7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.904 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.903+0000 7fbaecff9640 10 client.?.objecter ms_handle_connect 0x7fbaf0058070 2026-02-24T19:17:28.904 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.903+0000 7fbaecff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.905 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.904+0000 7f5704ff9640 10 client.?.objecter ms_handle_connect 0x7f57080ba350 2026-02-24T19:17:28.905 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.904+0000 7f5704ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.905 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.904+0000 7f5992ffd640 10 client.?.objecter ms_handle_connect 0x7f59a80b9f10 2026-02-24T19:17:28.905 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.904+0000 7f5992ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.906 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.905+0000 7f9e63fff640 10 client.?.objecter ms_handle_connect 0x7f9e880b9f80 2026-02-24T19:17:28.906 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.905+0000 7f9e63fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.908 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.907+0000 7f95affff640 10 client.?.objecter ms_handle_connect 0x7f95d40b9f80 2026-02-24T19:17:28.908 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.907+0000 7f95affff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.910 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.909+0000 7f49faffd640 1 -- 10.20.193.14:0/3446685470 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1016085311 0 0) 0x7f4a140a6cd0 con 0x7f4a14164d00 2026-02-24T19:17:28.910 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.909+0000 7f49faffd640 1 -- 10.20.193.14:0/3446685470 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4a140b04f0 con 0x7f4a14164d00 2026-02-24T19:17:28.910 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.909+0000 7f49faffd640 1 -- 10.20.193.14:0/3446685470 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4a100032f0 con 0x7f4a14164d00 2026-02-24T19:17:28.910 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.909+0000 7f49faffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.910 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.909+0000 7f49faffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:28.910 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.909+0000 7f49faffd640 10 monclient(hunting): dump: 2026-02-24T19:17:28.910 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.910 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.910 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.910 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.910 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.910 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.910 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.910 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.910 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.910 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.910 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.909+0000 7f49faffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:28.910 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.909+0000 7feec6ffd640 1 -- 10.20.193.14:0/2287837901 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2840181410 0 0) 0x7feee01fd6d0 con 0x7feee00ba350 2026-02-24T19:17:28.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.909+0000 7feec6ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.909+0000 7feec6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.909+0000 7feec6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.909+0000 7feec6ffd640 10 monclient(hunting): my global_id is 4526 2026-02-24T19:17:28.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.909+0000 7feec6ffd640 1 -- 10.20.193.14:0/2287837901 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feeb0003610 con 0x7feee00ba350 2026-02-24T19:17:28.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.909+0000 7ff7c17fa640 1 -- 10.20.193.14:0/2275417262 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4219971887 0 0) 0x7ff7cc0b33e0 con 0x7ff7cc0ba350 2026-02-24T19:17:28.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.909+0000 7ff7c17fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.909+0000 7ff7c17fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.909+0000 7ff7c17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.909+0000 7ff7c17fa640 10 monclient(hunting): my global_id is 4532 2026-02-24T19:17:28.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.909+0000 7ff7c17fa640 1 -- 10.20.193.14:0/2275417262 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7cc0b3100 con 0x7ff7cc0ba350 2026-02-24T19:17:28.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.910+0000 7f4f1d7fa640 1 -- 10.20.193.14:0/3332313869 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2134564164 0 0) 0x7f4f28131a30 con 0x7f4f2815d610 2026-02-24T19:17:28.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.910+0000 7f4f1d7fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.910+0000 7f4f1d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.910+0000 7f4f1d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.910+0000 7f4f1d7fa640 10 monclient(hunting): my global_id is 4538 2026-02-24T19:17:28.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.910+0000 7f4f1d7fa640 1 -- 10.20.193.14:0/3332313869 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f28131750 con 0x7f4f2815d610 2026-02-24T19:17:28.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.910+0000 7fbaecff9640 1 -- 10.20.193.14:0/3377738563 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 249123026 0 0) 0x7fbaf013b070 con 0x7fbaf0159a70 2026-02-24T19:17:28.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.910+0000 7fbaecff9640 1 -- 10.20.193.14:0/3377738563 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbaf013b310 con 0x7fbaf0159a70 2026-02-24T19:17:28.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.910+0000 7fbaecff9640 1 -- 10.20.193.14:0/3377738563 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fbae0003f90 con 0x7fbaf0159a70 2026-02-24T19:17:28.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.910+0000 7fbaecff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.911+0000 7fbaecff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:28.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.911+0000 7fbaecff9640 10 monclient(hunting): dump: 2026-02-24T19:17:28.912 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.912 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.912 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.912 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.912 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.912 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.912 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.912 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.912 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.912 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.911+0000 7fbaecff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:28.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.910+0000 7f5704ff9640 1 -- 10.20.193.14:0/38327090 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 375647624 0 0) 0x7f57080b33e0 con 0x7f57080ba350 2026-02-24T19:17:28.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.911+0000 7f5704ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.911+0000 7f5704ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.911+0000 7f5704ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.911+0000 7f5704ff9640 10 monclient(hunting): my global_id is 4547 2026-02-24T19:17:28.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.911+0000 7f5704ff9640 1 -- 10.20.193.14:0/38327090 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57080b3100 con 0x7f57080ba350 2026-02-24T19:17:28.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.911+0000 7f49faffd640 1 -- 10.20.193.14:0/3446685470 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1296559198 0 0) 0x7f4a14130e80 con 0x7f4a14157b50 2026-02-24T19:17:28.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.911+0000 7f49faffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.911+0000 7f49faffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.911+0000 7f49faffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.911+0000 7f49faffd640 10 monclient(hunting): my global_id is 4529 2026-02-24T19:17:28.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.911+0000 7f49faffd640 1 -- 10.20.193.14:0/3446685470 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a140a6cd0 con 0x7f4a14157b50 2026-02-24T19:17:28.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.911+0000 7f9e63fff640 1 -- 10.20.193.14:0/2794771459 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 536100197 0 0) 0x7f9e58003610 con 0x7f9e880ba350 2026-02-24T19:17:28.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.911+0000 7f9e63fff640 1 -- 10.20.193.14:0/2794771459 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9e881fd090 con 0x7f9e880ba350 2026-02-24T19:17:28.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.911+0000 7f9e63fff640 1 -- 10.20.193.14:0/2794771459 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f9e7c003240 con 0x7f9e880ba350 2026-02-24T19:17:28.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.911+0000 7f9e63fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.911+0000 7f9e63fff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:28.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.911+0000 7f9e63fff640 10 monclient(hunting): dump: 2026-02-24T19:17:28.913 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.913 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.913 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.913 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.913 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.913 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.913 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.914 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.914 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.914 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.914 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.911+0000 7f9e63fff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:28.914 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.912+0000 7f76b17fa640 1 -- 10.20.193.14:0/2224669131 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2525487249 0 0) 0x7f76bc1ffcb0 con 0x7f76bc0b9f80 2026-02-24T19:17:28.914 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.912+0000 7f76b17fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.914 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.912+0000 7f76b17fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.914 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.912+0000 7f76b17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.914 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.912+0000 7f76b17fa640 10 monclient(hunting): my global_id is 4535 2026-02-24T19:17:28.914 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.912+0000 7f76b17fa640 1 -- 10.20.193.14:0/2224669131 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76bc1ff9d0 con 0x7f76bc0b9f80 2026-02-24T19:17:28.914 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.913+0000 7f7c1affd640 1 -- 10.20.193.14:0/1089186970 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2646062605 0 0) 0x7f7c340b39a0 con 0x7f7c340b9f80 2026-02-24T19:17:28.914 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.913+0000 7f7c1affd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.914 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.913+0000 7f7c1affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.914 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.913+0000 7f7c1affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.914 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.913+0000 7f7c1affd640 10 monclient(hunting): my global_id is 4541 2026-02-24T19:17:28.914 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.913+0000 7f7c1affd640 1 -- 10.20.193.14:0/1089186970 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c04003610 con 0x7f7c340b9f80 2026-02-24T19:17:28.916 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.915+0000 7fbaecff9640 1 -- 10.20.193.14:0/3377738563 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1900813155 0 0) 0x7fbaf013b5f0 con 0x7fbaf0058070 2026-02-24T19:17:28.916 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.915+0000 7fbaecff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.916 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.915+0000 7fbaecff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.916 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.915+0000 7fbaecff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.916 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.915+0000 7fbaecff9640 10 monclient(hunting): my global_id is 4544 2026-02-24T19:17:28.916 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.915+0000 7fbaecff9640 1 -- 10.20.193.14:0/3377738563 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbaf013b070 con 0x7fbaf0058070 2026-02-24T19:17:28.916 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.915+0000 7f5992ffd640 1 -- 10.20.193.14:0/2339725969 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 43733005 0 0) 0x7f59a816ac70 con 0x7f59a80b9f10 2026-02-24T19:17:28.916 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.915+0000 7f5992ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.916 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.915+0000 7f5992ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.916 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.915+0000 7f5992ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.916 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.915+0000 7f5992ffd640 10 monclient(hunting): my global_id is 4550 2026-02-24T19:17:28.916 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.915+0000 7f5992ffd640 1 -- 10.20.193.14:0/2339725969 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59a816f5c0 con 0x7f59a80b9f10 2026-02-24T19:17:28.916 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.915+0000 7f9e63fff640 1 -- 10.20.193.14:0/2794771459 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1999291413 0 0) 0x7f9e881fd370 con 0x7f9e880b9f80 2026-02-24T19:17:28.916 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.915+0000 7f9e63fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.916 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.915+0000 7f9e63fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.916 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.915+0000 7f9e63fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.916 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.915+0000 7f9e63fff640 10 monclient(hunting): my global_id is 4553 2026-02-24T19:17:28.916 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.915+0000 7f9e63fff640 1 -- 10.20.193.14:0/2794771459 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e58003610 con 0x7f9e880b9f80 2026-02-24T19:17:28.917 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.915+0000 7f95affff640 1 -- 10.20.193.14:0/2431173474 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1127288267 0 0) 0x7f95d40b33e0 con 0x7f95d40b9f80 2026-02-24T19:17:28.917 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.915+0000 7f95affff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.917 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.915+0000 7f95affff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.917 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.915+0000 7f95affff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.917 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.915+0000 7f95affff640 10 monclient(hunting): my global_id is 4556 2026-02-24T19:17:28.917 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.915+0000 7f95affff640 1 -- 10.20.193.14:0/2431173474 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95d40b3100 con 0x7f95d40b9f80 2026-02-24T19:17:28.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.917+0000 7f5704ff9640 1 -- 10.20.193.14:0/38327090 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2646291460 0 0) 0x7f56d8003610 con 0x7f57080b9f80 2026-02-24T19:17:28.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.917+0000 7f5704ff9640 1 -- 10.20.193.14:0/38327090 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f57080b33e0 con 0x7f57080b9f80 2026-02-24T19:17:28.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.917+0000 7f5704ff9640 1 -- 10.20.193.14:0/38327090 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f56f8002ed0 con 0x7f57080b9f80 2026-02-24T19:17:28.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.917+0000 7f5704ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.917+0000 7f5704ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:28.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.917+0000 7f5704ff9640 10 monclient(hunting): dump: 2026-02-24T19:17:28.918 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.918 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.918 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.918 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.918 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.918 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.918 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.918 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.918 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.918 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.917+0000 7f5704ff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:28.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.917+0000 7f76b17fa640 1 -- 10.20.193.14:0/2224669131 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1368012846 0 0) 0x7f76bc0b9510 con 0x7f76bc0585e0 2026-02-24T19:17:28.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.917+0000 7f76b17fa640 1 -- 10.20.193.14:0/2224669131 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f76bc1ffcb0 con 0x7f76bc0585e0 2026-02-24T19:17:28.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.917+0000 7f76b17fa640 1 -- 10.20.193.14:0/2224669131 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f76ac002f70 con 0x7f76bc0585e0 2026-02-24T19:17:28.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.917+0000 7f76b17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.917+0000 7f76b17fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:28.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.917+0000 7f76b17fa640 10 monclient(hunting): dump: 2026-02-24T19:17:28.919 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.919 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.919 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.919 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.919 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.919 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.919 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.919 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.919 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.919 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.919 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.917+0000 7f76b17fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:28.919 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.917+0000 7ff7c17fa640 1 -- 10.20.193.14:0/2275417262 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2758019320 0 0) 0x7ff7cc0b3100 con 0x7ff7cc0ba350 2026-02-24T19:17:28.919 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.917+0000 7ff7c17fa640 1 -- 10.20.193.14:0/2275417262 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff7cc0b33e0 con 0x7ff7cc0ba350 2026-02-24T19:17:28.919 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.917+0000 7ff7c17fa640 1 -- 10.20.193.14:0/2275417262 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ff7c8003200 con 0x7ff7cc0ba350 2026-02-24T19:17:28.919 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.917+0000 7ff7c17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.919 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.917+0000 7ff7c17fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:28.919 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.917+0000 7ff7c17fa640 10 monclient(hunting): dump: 2026-02-24T19:17:28.919 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.919 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.919 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.919 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.919 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.919 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.919 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.919 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.919 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.919 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.918+0000 7feec6ffd640 1 -- 10.20.193.14:0/2287837901 <== mon.1 v1:10.20.193.44:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1274253774 0 0) 0x7feee00b5160 con 0x7feee00b9f80 2026-02-24T19:17:28.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.918+0000 7feec6ffd640 1 -- 10.20.193.14:0/2287837901 >> v1:10.20.193.170:6789/0 conn(0x7feee00ba350 legacy=0x7feee01656b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.918+0000 7feec6ffd640 1 -- 10.20.193.14:0/2287837901 >> v1:10.20.193.14:6789/0 conn(0x7feee00585e0 legacy=0x7feee00b4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.918+0000 7feec6ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.918+0000 7feec6ffd640 1 monclient: found mon.b 2026-02-24T19:17:28.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.918+0000 7feec6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.918+0000 7feec6ffd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.918+0000 7feec6ffd640 1 -- 10.20.193.14:0/2287837901 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee01fd9b0 con 0x7feee00b9f80 2026-02-24T19:17:28.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.918+0000 7feec6ffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.918+0000 7feec6ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.918+0000 7feec6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.918+0000 7feee8533640 5 monclient: authenticate success, global_id 4501 2026-02-24T19:17:28.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.918+0000 7feee8533640 10 monclient: _renew_subs 2026-02-24T19:17:28.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.918+0000 7feee8533640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.918+0000 7feee8533640 1 -- 10.20.193.14:0/2287837901 --> v1:10.20.193.44:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7feee01fdc90 con 0x7feee00b9f80 2026-02-24T19:17:28.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.918+0000 7feee8533640 10 client.4501.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.918+0000 7feee8533640 10 monclient: _renew_subs 2026-02-24T19:17:28.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.918+0000 7feee8533640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.918+0000 7feee8533640 1 -- 10.20.193.14:0/2287837901 --> v1:10.20.193.44:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7feee01f9b60 con 0x7feee00b9f80 2026-02-24T19:17:28.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.918+0000 7feee8533640 1 librados: init done 2026-02-24T19:17:28.921 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.919+0000 7feee8533640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.921 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.919+0000 7feee8533640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.921 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.919+0000 7feee8533640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.921 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.919+0000 7feee8533640 1 -- 10.20.193.14:0/2287837901 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feee015afb0 con 0x7feee00b9f80 2026-02-24T19:17:28.921 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.919+0000 7ff7c17fa640 1 -- 10.20.193.14:0/2275417262 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 149017914 0 0) 0x7ff79c003610 con 0x7ff7cc0585e0 2026-02-24T19:17:28.921 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.919+0000 7ff7c17fa640 1 -- 10.20.193.14:0/2275417262 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff7cc0b3100 con 0x7ff7cc0585e0 2026-02-24T19:17:28.921 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.919+0000 7ff7c17fa640 1 -- 10.20.193.14:0/2275417262 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ff7bc002f40 con 0x7ff7cc0585e0 2026-02-24T19:17:28.921 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.919+0000 7ff7c17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.921 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.919+0000 7ff7c17fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:28.921 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.919+0000 7ff7c17fa640 10 monclient(hunting): dump: 2026-02-24T19:17:28.921 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.921 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.921 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.921 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.921 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.921 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.921 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.921 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.921 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.921 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.922 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.920+0000 7f4f1d7fa640 1 -- 10.20.193.14:0/3332313869 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3392206874 0 0) 0x7f4ef8003610 con 0x7f4f281667e0 2026-02-24T19:17:28.922 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.920+0000 7f4f1d7fa640 1 -- 10.20.193.14:0/3332313869 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4f28131a30 con 0x7f4f281667e0 2026-02-24T19:17:28.922 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.920+0000 7f4f1d7fa640 1 -- 10.20.193.14:0/3332313869 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4f240036d0 con 0x7f4f281667e0 2026-02-24T19:17:28.922 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.920+0000 7f4f1d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.922 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.920+0000 7f4f1d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:28.922 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.920+0000 7f4f1d7fa640 10 monclient(hunting): dump: 2026-02-24T19:17:28.922 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.922 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.922 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.922 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.922 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.922 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.922 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.922 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.922 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.922 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.922 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.920+0000 7f4f1d7fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:28.925 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.924+0000 7f5992ffd640 1 -- 10.20.193.14:0/2339725969 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4145518637 0 0) 0x7f5978003610 con 0x7f59a80ba2e0 2026-02-24T19:17:28.925 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.924+0000 7f5992ffd640 1 -- 10.20.193.14:0/2339725969 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f59a816ac70 con 0x7f59a80ba2e0 2026-02-24T19:17:28.925 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.924+0000 7f5992ffd640 1 -- 10.20.193.14:0/2339725969 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f599c0036d0 con 0x7f59a80ba2e0 2026-02-24T19:17:28.925 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.924+0000 7f5992ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.925 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.924+0000 7f5992ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:28.925 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.924+0000 7f5992ffd640 10 monclient(hunting): dump: 2026-02-24T19:17:28.925 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.925 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.925 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.925 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.925 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.925 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.925 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.925 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.925 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.925 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.925 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.924+0000 7f5992ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:28.927 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7f49faffd640 1 -- 10.20.193.14:0/3446685470 <== mon.1 v1:10.20.193.44:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 314531488 0 0) 0x7f4a140b04f0 con 0x7f4a14164d00 2026-02-24T19:17:28.927 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7f49faffd640 1 -- 10.20.193.14:0/3446685470 >> v1:10.20.193.170:6789/0 conn(0x7f4a14157b50 legacy=0x7f4a140a94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.927 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7f49faffd640 1 -- 10.20.193.14:0/3446685470 >> v1:10.20.193.14:6789/0 conn(0x7f4a14157780 legacy=0x7f4a140afde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.927 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7f49faffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.927 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7f49faffd640 1 monclient: found mon.b 2026-02-24T19:17:28.927 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7f49faffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.927 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7f49faffd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.927 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7f49faffd640 1 -- 10.20.193.14:0/3446685470 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a140a6f90 con 0x7f4a14164d00 2026-02-24T19:17:28.927 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7f49faffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.927 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7f49faffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.927 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7f49faffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.927 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7f4a1c5cf640 5 monclient: authenticate success, global_id 4504 2026-02-24T19:17:28.927 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7f4a1c5cf640 10 monclient: _renew_subs 2026-02-24T19:17:28.927 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7f4a1c5cf640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.927 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7f4a1c5cf640 1 -- 10.20.193.14:0/3446685470 --> v1:10.20.193.44:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4a140a7270 con 0x7f4a14164d00 2026-02-24T19:17:28.928 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7f4a1c5cf640 10 client.4504.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.928 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7f4a1c5cf640 10 monclient: _renew_subs 2026-02-24T19:17:28.928 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7f4a1c5cf640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.928 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7f4a1c5cf640 1 -- 10.20.193.14:0/3446685470 --> v1:10.20.193.44:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4a14131160 con 0x7f4a14164d00 2026-02-24T19:17:28.928 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7f4a1c5cf640 1 librados: init done 2026-02-24T19:17:28.928 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7fbaecff9640 1 -- 10.20.193.14:0/3377738563 <== mon.1 v1:10.20.193.44:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 57654676 0 0) 0x7fbaf013b310 con 0x7fbaf0159a70 2026-02-24T19:17:28.928 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7fbaecff9640 1 -- 10.20.193.14:0/3377738563 >> v1:10.20.193.170:6789/0 conn(0x7fbaf0058070 legacy=0x7fbaf015ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.928 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7fbaecff9640 1 -- 10.20.193.14:0/3377738563 >> v1:10.20.193.14:6789/0 conn(0x7fbaf0159e40 legacy=0x7fbaf0162d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.928 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7fbaecff9640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.928 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7fbaecff9640 1 monclient: found mon.b 2026-02-24T19:17:28.928 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7fbaecff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.928 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7fbaecff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.928 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7fbaecff9640 1 -- 10.20.193.14:0/3377738563 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf013b8d0 con 0x7fbaf0159a70 2026-02-24T19:17:28.928 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7fbaecff9640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.928 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7fbaecff9640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.928 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7fbaecff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.928 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7fbaf6502640 5 monclient: authenticate success, global_id 4513 2026-02-24T19:17:28.928 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7fbaf6502640 10 monclient: _renew_subs 2026-02-24T19:17:28.928 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7fbaf6502640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.928 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7fbaf6502640 1 -- 10.20.193.14:0/3377738563 --> v1:10.20.193.44:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbaf013bbb0 con 0x7fbaf0159a70 2026-02-24T19:17:28.928 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7fbaf6502640 10 client.4513.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.928 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7fbaf6502640 10 monclient: _renew_subs 2026-02-24T19:17:28.929 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7fbaf6502640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.929 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7fbaf6502640 1 -- 10.20.193.14:0/3377738563 --> v1:10.20.193.44:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fbaf0146310 con 0x7fbaf0159a70 2026-02-24T19:17:28.929 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.926+0000 7fbaf6502640 1 librados: init done 2026-02-24T19:17:28.929 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.927+0000 7f4a1c5cf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.929 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.927+0000 7f4a1c5cf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.929 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.927+0000 7f4a1c5cf640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.929 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.927+0000 7f4a1c5cf640 1 -- 10.20.193.14:0/3446685470 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a1413d690 con 0x7f4a14164d00 2026-02-24T19:17:28.929 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.927+0000 7f9e63fff640 1 -- 10.20.193.14:0/2794771459 <== mon.1 v1:10.20.193.44:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1893105372 0 0) 0x7f9e881fd090 con 0x7f9e880ba350 2026-02-24T19:17:28.929 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.927+0000 7f9e63fff640 1 -- 10.20.193.14:0/2794771459 >> v1:10.20.193.170:6789/0 conn(0x7f9e880b9f80 legacy=0x7f9e88155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.929 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.927+0000 7f9e63fff640 1 -- 10.20.193.14:0/2794771459 >> v1:10.20.193.14:6789/0 conn(0x7f9e880585e0 legacy=0x7f9e881fb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.929 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.927+0000 7f9e63fff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.929 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.927+0000 7f9e63fff640 1 monclient: found mon.b 2026-02-24T19:17:28.929 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.927+0000 7fbaf6502640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.929 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.927+0000 7fbaf6502640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.929 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.927+0000 7fbaf6502640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.929 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.927+0000 7f9e63fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.929 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.927+0000 7f9e63fff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.930 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.927+0000 7f9e63fff640 1 -- 10.20.193.14:0/2794771459 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e881fd650 con 0x7f9e880ba350 2026-02-24T19:17:28.930 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.927+0000 7f9e63fff640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.930 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.927+0000 7f9e63fff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.930 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.927+0000 7f9e63fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.930 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.927+0000 7fbaf6502640 1 -- 10.20.193.14:0/3377738563 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaf00ba500 con 0x7fbaf0159a70 2026-02-24T19:17:28.930 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.927+0000 7f9e8e11b640 5 monclient: authenticate success, global_id 4522 2026-02-24T19:17:28.930 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.927+0000 7f9e8e11b640 10 monclient: _renew_subs 2026-02-24T19:17:28.930 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.927+0000 7f9e8e11b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.930 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.927+0000 7f9e8e11b640 1 -- 10.20.193.14:0/2794771459 --> v1:10.20.193.44:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9e881fd930 con 0x7f9e880ba350 2026-02-24T19:17:28.930 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.927+0000 7f9e8e11b640 10 client.4522.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.930 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.927+0000 7f9e8e11b640 10 monclient: _renew_subs 2026-02-24T19:17:28.930 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.927+0000 7f9e8e11b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.930 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.927+0000 7f9e8e11b640 1 -- 10.20.193.14:0/2794771459 --> v1:10.20.193.44:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9e881f9510 con 0x7f9e880ba350 2026-02-24T19:17:28.930 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.927+0000 7f9e8e11b640 1 librados: init done 2026-02-24T19:17:28.930 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.927+0000 7f9e8e11b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.930 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.927+0000 7f9e8e11b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.930 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.927+0000 7f9e8e11b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.930 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.927+0000 7f9e8e11b640 1 -- 10.20.193.14:0/2794771459 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e88159080 con 0x7f9e880ba350 2026-02-24T19:17:28.933 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.932+0000 7f4f1d7fa640 1 -- 10.20.193.14:0/3332313869 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 367257920 0 0) 0x7f4f28131750 con 0x7f4f2815d610 2026-02-24T19:17:28.933 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.932+0000 7f4f1d7fa640 1 -- 10.20.193.14:0/3332313869 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4ef8003610 con 0x7f4f2815d610 2026-02-24T19:17:28.933 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.932+0000 7f4f1d7fa640 1 -- 10.20.193.14:0/3332313869 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4f100030b0 con 0x7f4f2815d610 2026-02-24T19:17:28.933 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.932+0000 7f4f1d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.933 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.932+0000 7f4f1d7fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:28.933 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.932+0000 7f4f1d7fa640 10 monclient(hunting): dump: 2026-02-24T19:17:28.933 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.933 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.933 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.933 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.933 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.933 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.933 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.933 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.933 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.933 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.934 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.932+0000 7f76b17fa640 1 -- 10.20.193.14:0/2224669131 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1537898358 0 0) 0x7f76bc1ff9d0 con 0x7f76bc0b9f80 2026-02-24T19:17:28.934 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.932+0000 7f76b17fa640 1 -- 10.20.193.14:0/2224669131 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f76bc0b9510 con 0x7f76bc0b9f80 2026-02-24T19:17:28.934 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.932+0000 7f76b17fa640 1 -- 10.20.193.14:0/2224669131 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f76a4002fb0 con 0x7f76bc0b9f80 2026-02-24T19:17:28.934 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.932+0000 7f76b17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.934 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.932+0000 7f76b17fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:28.934 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.932+0000 7f76b17fa640 10 monclient(hunting): dump: 2026-02-24T19:17:28.934 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.934 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.934 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.934 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.934 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.934 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.934 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.934 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.934 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.934 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.934 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.933+0000 7f5704ff9640 1 -- 10.20.193.14:0/38327090 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2462620590 0 0) 0x7f57080b3100 con 0x7f57080ba350 2026-02-24T19:17:28.934 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.933+0000 7f5704ff9640 1 -- 10.20.193.14:0/38327090 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f56d8003610 con 0x7f57080ba350 2026-02-24T19:17:28.934 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.933+0000 7f5704ff9640 1 -- 10.20.193.14:0/38327090 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f56fc002c70 con 0x7f57080ba350 2026-02-24T19:17:28.934 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.933+0000 7f5704ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.934 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.933+0000 7f5704ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:28.934 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.933+0000 7f5704ff9640 10 monclient(hunting): dump: 2026-02-24T19:17:28.934 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.934 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.934 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.935 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.935 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.935 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.935 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.935 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.935 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.935 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.935 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.933+0000 7ff7c17fa640 1 -- 10.20.193.14:0/2275417262 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3443351606 0 0) 0x7ff7cc0b33e0 con 0x7ff7cc0ba350 2026-02-24T19:17:28.935 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.933+0000 7ff7c17fa640 1 -- 10.20.193.14:0/2275417262 >> v1:10.20.193.44:6789/0 conn(0x7ff7cc0585e0 legacy=0x7ff7cc0b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.935 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.933+0000 7ff7c17fa640 1 -- 10.20.193.14:0/2275417262 >> v1:10.20.193.14:6789/0 conn(0x7ff7cc0b9f80 legacy=0x7ff7cc1fe4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.935 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.933+0000 7ff7c17fa640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.935 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.933+0000 7ff7c17fa640 1 monclient: found mon.c 2026-02-24T19:17:28.935 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.933+0000 7ff7c17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.935 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.933+0000 7ff7c17fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.935 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.933+0000 7ff7c17fa640 1 -- 10.20.193.14:0/2275417262 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7cc0b36c0 con 0x7ff7cc0ba350 2026-02-24T19:17:28.935 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.933+0000 7ff7c17fa640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.935 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.933+0000 7ff7c17fa640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.935 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.933+0000 7ff7c17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.935 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.933+0000 7ff7d2d6f640 5 monclient: authenticate success, global_id 4532 2026-02-24T19:17:28.935 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.933+0000 7ff7d2d6f640 10 monclient: _renew_subs 2026-02-24T19:17:28.935 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.933+0000 7ff7d2d6f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.935 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.933+0000 7ff7d2d6f640 1 -- 10.20.193.14:0/2275417262 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff7cc161270 con 0x7ff7cc0ba350 2026-02-24T19:17:28.936 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.933+0000 7ff7d2d6f640 10 client.4532.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.936 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.933+0000 7ff7d2d6f640 10 monclient: _renew_subs 2026-02-24T19:17:28.936 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.933+0000 7ff7d2d6f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.936 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.933+0000 7ff7d2d6f640 1 -- 10.20.193.14:0/2275417262 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff7cc162180 con 0x7ff7cc0ba350 2026-02-24T19:17:28.936 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.933+0000 7ff7d2d6f640 1 librados: init done 2026-02-24T19:17:28.936 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.933+0000 7ff7d2d6f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.936 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.933+0000 7ff7d2d6f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.936 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.933+0000 7ff7d2d6f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:28.936 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.933+0000 7ff7d2d6f640 1 -- 10.20.193.14:0/2275417262 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7cc0b91d0 con 0x7ff7cc0ba350 2026-02-24T19:17:28.936 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.935+0000 7f7c1affd640 1 -- 10.20.193.14:0/1089186970 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3179602304 0 0) 0x7f7c04003610 con 0x7f7c340b9f80 2026-02-24T19:17:28.937 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.935+0000 7f7c1affd640 1 -- 10.20.193.14:0/1089186970 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7c340b39a0 con 0x7f7c340b9f80 2026-02-24T19:17:28.937 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.936+0000 7f7c1affd640 1 -- 10.20.193.14:0/1089186970 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7c28002ea0 con 0x7f7c340b9f80 2026-02-24T19:17:28.937 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.936+0000 7f7c1affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.937 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.936+0000 7f7c1affd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:28.937 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.936+0000 7f7c1affd640 10 monclient(hunting): dump: 2026-02-24T19:17:28.937 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.937 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.937 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.937 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.937 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.937 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.937 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.937 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.937 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.937 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.938 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.937+0000 7f5992ffd640 1 -- 10.20.193.14:0/2339725969 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1359290835 0 0) 0x7f59a816f5c0 con 0x7f59a80b9f10 2026-02-24T19:17:28.938 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.937+0000 7f5992ffd640 1 -- 10.20.193.14:0/2339725969 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5978003610 con 0x7f59a80b9f10 2026-02-24T19:17:28.938 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.937+0000 7f5992ffd640 1 -- 10.20.193.14:0/2339725969 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5994002cc0 con 0x7f59a80b9f10 2026-02-24T19:17:28.939 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.937+0000 7f5992ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.939 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.937+0000 7f5992ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:28.939 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.937+0000 7f5992ffd640 10 monclient(hunting): dump: 2026-02-24T19:17:28.939 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.939 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.939 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.939 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.939 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.939 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.939 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.939 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.939 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.939 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.957 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.956+0000 7f5704ff9640 10 client.?.objecter ms_handle_connect 0x7f57080585e0 2026-02-24T19:17:28.957 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.956+0000 7f5704ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.958 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.958+0000 7f4f1d7fa640 1 -- 10.20.193.14:0/3332313869 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3765712314 0 0) 0x7f4f28131490 con 0x7f4f28056ea0 2026-02-24T19:17:28.959 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.958+0000 7f4f1d7fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.959 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.958+0000 7f4f1d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.959 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.958+0000 7f4f1d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.959 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.958+0000 7f4f1d7fa640 10 monclient(hunting): my global_id is 4563 2026-02-24T19:17:28.959 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.958+0000 7f4f1d7fa640 1 -- 10.20.193.14:0/3332313869 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f28131750 con 0x7f4f28056ea0 2026-02-24T19:17:28.962 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.961+0000 7f5992ffd640 1 -- 10.20.193.14:0/2339725969 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3857633947 0 0) 0x7f59a81201d0 con 0x7f59a80afef0 2026-02-24T19:17:28.962 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.961+0000 7f5992ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.962 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.961+0000 7f5992ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.962 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.961+0000 7f5992ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.962 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.961+0000 7f5992ffd640 10 monclient(hunting): my global_id is 4569 2026-02-24T19:17:28.962 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.961+0000 7f5992ffd640 1 -- 10.20.193.14:0/2339725969 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59a816f5c0 con 0x7f59a80afef0 2026-02-24T19:17:28.963 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.961+0000 7ffac2ffd640 1 -- 10.20.193.14:0/2298518687 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffab8003550 con 0x7ffac40585e0 2026-02-24T19:17:28.963 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.962+0000 7ffac2ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.963 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.962+0000 7ffac2ffd640 1 -- 10.20.193.14:0/2298518687 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ffab8004d10 con 0x7ffac40585e0 2026-02-24T19:17:28.963 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.962+0000 7ffac2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.963 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.962+0000 7ffac2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.963 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.962+0000 7ffac2ffd640 10 monclient: dump: 2026-02-24T19:17:28.963 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.963 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.963 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.963 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.963 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.963 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.963 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.963 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.963 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.963 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.963 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.962+0000 7ffacaa4d640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:28.963 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.962+0000 7ffacaa4d640 4 set_mon_vals no callback set 2026-02-24T19:17:28.964 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.962+0000 7ffacaa4d640 10 monclient: shutdown 2026-02-24T19:17:28.964 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.962+0000 7ffacaa4d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.964 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.962+0000 7ffacaa4d640 1 -- 10.20.193.14:0/2298518687 >> v1:10.20.193.14:6789/0 conn(0x7ffac40585e0 legacy=0x7ffac4166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.964 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.962+0000 7ffacaa4d640 1 -- 10.20.193.14:0/2298518687 shutdown_connections 2026-02-24T19:17:28.964 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.962+0000 7ffacaa4d640 1 -- 10.20.193.14:0/2298518687 >> 10.20.193.14:0/2298518687 conn(0x7ffac40b7990 msgr2=0x7ffac40b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.964 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.962+0000 7ffacaa4d640 1 -- 10.20.193.14:0/2298518687 shutdown_connections 2026-02-24T19:17:28.964 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.962+0000 7ffacaa4d640 1 -- 10.20.193.14:0/2298518687 wait complete. 2026-02-24T19:17:28.964 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.963+0000 7ffacaa4d640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.964 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.963+0000 7ffacaa4d640 10 monclient: monmap: 2026-02-24T19:17:28.964 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.964 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:28.964 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:28.964 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:28.964 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.964 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:28.964 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.965 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.965 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.965 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.965 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.963+0000 7ffacaa4d640 1 librados: starting msgr at 2026-02-24T19:17:28.965 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.963+0000 7ffacaa4d640 1 librados: starting objecter 2026-02-24T19:17:28.965 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.963+0000 7ffacaa4d640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:28.965 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.963+0000 7ffacaa4d640 1 Processor -- start 2026-02-24T19:17:28.965 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.963+0000 7ffacaa4d640 1 -- start start 2026-02-24T19:17:28.965 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.963+0000 7ffacaa4d640 1 librados: setting wanted keys 2026-02-24T19:17:28.966 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.963+0000 7ffacaa4d640 1 librados: calling monclient init 2026-02-24T19:17:28.966 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.963+0000 7ffacaa4d640 10 monclient: init 2026-02-24T19:17:28.966 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.963+0000 7ffacaa4d640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.966 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.963+0000 7ffacaa4d640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:28.966 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.963+0000 7ffacaa4d640 10 monclient(hunting): picked mon.noname-c con 0x7ffac40585e0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.966 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.963+0000 7ffacaa4d640 10 monclient(hunting): picked mon.noname-a con 0x7ffac40b9f80 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.966 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.963+0000 7ffacaa4d640 10 monclient(hunting): picked mon.noname-b con 0x7ffac40ba350 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.966 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.963+0000 7ffacaa4d640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffac4155880 con 0x7ffac40b9f80 2026-02-24T19:17:28.966 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.963+0000 7ffacaa4d640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffac41fd090 con 0x7ffac40ba350 2026-02-24T19:17:28.966 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.963+0000 7ffacaa4d640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffac41fd370 con 0x7ffac40585e0 2026-02-24T19:17:28.966 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.963+0000 7ffacaa4d640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.966 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.963+0000 7ffacaa4d640 10 monclient(hunting): authenticate will time out at 3623.644982s 2026-02-24T19:17:28.973 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.972+0000 7f2cee7fc640 1 -- 10.20.193.14:0/3238434083 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2cf8003480 con 0x7f2d080b27c0 2026-02-24T19:17:28.973 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.972+0000 7f2cee7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.973 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.972+0000 7f2cee7fc640 1 -- 10.20.193.14:0/3238434083 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f2cf8003b90 con 0x7f2d080b27c0 2026-02-24T19:17:28.973 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.972+0000 7f2cee7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.973 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.972+0000 7f2cee7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.973 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.972+0000 7f2cee7fc640 10 monclient: dump: 2026-02-24T19:17:28.973 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.973 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.973 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.973 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.973 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.973 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.974 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.974 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.974 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.974 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.974 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.972+0000 7f2ceffff640 4 set_mon_vals no callback set 2026-02-24T19:17:28.974 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.973+0000 7f2cee7fc640 1 -- 10.20.193.14:0/3238434083 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f2cf8003d70 con 0x7f2d080b27c0 2026-02-24T19:17:28.974 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.973+0000 7f2d0d47c640 10 monclient: get_auth_request con 0x7f2cd8077c80 auth_method 0 2026-02-24T19:17:28.974 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.973+0000 7f2cee7fc640 10 client.4533.objecter ms_handle_connect 0x7f2cd8077c80 2026-02-24T19:17:28.978 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.977+0000 7f2cee7fc640 1 -- 10.20.193.14:0/3238434083 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7f2cf8093460 con 0x7f2d080b27c0 2026-02-24T19:17:28.978 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.977+0000 7f2cee7fc640 10 client.4533.objecter ms_dispatch2 0x7f2d08000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:28.978 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.977+0000 7f2cee7fc640 3 client.4533.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:28.978 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.977+0000 7f2cee7fc640 3 client.4533.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:28.978 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.977+0000 7f2cee7fc640 20 client.4533.objecter dump_active .. 0 homeless 2026-02-24T19:17:28.978 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.977+0000 7f2cee7fc640 1 -- 10.20.193.14:0/3238434083 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f2cf805de90 con 0x7f2d080b27c0 2026-02-24T19:17:28.978 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.977+0000 7f2cee7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.978 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.977+0000 7f2cee7fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:28.978 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.977+0000 7f2fc4de0640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-24T19:17:28.978 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.977+0000 7f2fc4de0640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-24T19:17:28.978 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.977+0000 7f2fc4de0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:28.978 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.977+0000 7f2fc4de0640 1 -- 10.20.193.14:0/1935728667 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f2fc0159890 con 0x7f2fc00ba350 2026-02-24T19:17:28.981 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.980+0000 7f8d06ffd640 1 -- 10.20.193.14:0/1773786792 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8cf4003000 con 0x7f8d080b28b0 2026-02-24T19:17:28.982 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.980+0000 7f8d06ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.982 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.980+0000 7f8d06ffd640 1 -- 10.20.193.14:0/1773786792 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f8cf4003440 con 0x7f8d080b28b0 2026-02-24T19:17:28.982 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.980+0000 7f8d06ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.982 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.980+0000 7f8d06ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.982 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.980+0000 7f8d06ffd640 10 monclient: dump: 2026-02-24T19:17:28.982 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.982 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.982 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.982 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.982 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.982 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.982 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.982 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.982 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.982 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.982 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.980+0000 7f8d0e526640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:28.982 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.980+0000 7f8d0e526640 4 set_mon_vals no callback set 2026-02-24T19:17:28.983 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.981+0000 7f8d0e526640 10 monclient: shutdown 2026-02-24T19:17:28.983 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.981+0000 7f8d0e526640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.983 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.981+0000 7f8d0e526640 1 -- 10.20.193.14:0/1773786792 >> v1:10.20.193.14:6789/0 conn(0x7f8d080b28b0 legacy=0x7f8d080b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.983 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.981+0000 7f8d0e526640 1 -- 10.20.193.14:0/1773786792 shutdown_connections 2026-02-24T19:17:28.983 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.981+0000 7f8d0e526640 1 -- 10.20.193.14:0/1773786792 >> 10.20.193.14:0/1773786792 conn(0x7f8d080b5290 msgr2=0x7f8d080b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.983 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.981+0000 7f8d0e526640 1 -- 10.20.193.14:0/1773786792 shutdown_connections 2026-02-24T19:17:28.983 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.981+0000 7f76b17fa640 1 -- 10.20.193.14:0/2224669131 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4147467147 0 0) 0x7f768c003610 con 0x7f76bc0ba350 2026-02-24T19:17:28.983 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.981+0000 7f76b17fa640 1 -- 10.20.193.14:0/2224669131 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f76bc1ff9d0 con 0x7f76bc0ba350 2026-02-24T19:17:28.983 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.981+0000 7f8d0e526640 1 -- 10.20.193.14:0/1773786792 wait complete. 2026-02-24T19:17:28.984 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.981+0000 7f76b17fa640 1 -- 10.20.193.14:0/2224669131 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f76b8002cb0 con 0x7f76bc0ba350 2026-02-24T19:17:28.984 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.981+0000 7f76b17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.984 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.981+0000 7f76b17fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.984 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.981+0000 7f76b17fa640 10 monclient(hunting): dump: 2026-02-24T19:17:28.984 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.984 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.984 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.984 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.984 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.984 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.984 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.984 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.984 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.984 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.984 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.982+0000 7f7c1affd640 1 -- 10.20.193.14:0/1089186970 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 483778963 0 0) 0x7f7c34166030 con 0x7f7c340585e0 2026-02-24T19:17:28.984 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.982+0000 7f7c1affd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.985 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.982+0000 7f7c1affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.985 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.982+0000 7f7c1affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.985 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.982+0000 7f7c1affd640 10 monclient(hunting): my global_id is 4560 2026-02-24T19:17:28.985 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.982+0000 7f7c1affd640 1 -- 10.20.193.14:0/1089186970 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c04003610 con 0x7f7c340585e0 2026-02-24T19:17:28.985 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.982+0000 7f8d0e526640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.985 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.982+0000 7f8d0e526640 10 monclient: monmap: 2026-02-24T19:17:28.985 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:28.985 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:28.985 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:28.985 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:28.985 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.985 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:28.985 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:28.985 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:28.985 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:28.986 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.986 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.982+0000 7f8d0e526640 1 librados: starting msgr at 2026-02-24T19:17:28.986 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.982+0000 7f8d0e526640 1 librados: starting objecter 2026-02-24T19:17:28.986 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.982+0000 7f8d0e526640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:28.986 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.982+0000 7f8d0e526640 1 Processor -- start 2026-02-24T19:17:28.986 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.982+0000 7f4f1d7fa640 1 -- 10.20.193.14:0/3332313869 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 860400835 0 0) 0x7f4f28131750 con 0x7f4f28056ea0 2026-02-24T19:17:28.986 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.982+0000 7f4f1d7fa640 1 -- 10.20.193.14:0/3332313869 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4f28131490 con 0x7f4f28056ea0 2026-02-24T19:17:28.986 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.982+0000 7f4f1d7fa640 1 -- 10.20.193.14:0/3332313869 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4f18002ea0 con 0x7f4f28056ea0 2026-02-24T19:17:28.986 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.982+0000 7f4f1d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.986 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.982+0000 7f4f1d7fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.986 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.982+0000 7f4f1d7fa640 10 monclient(hunting): dump: 2026-02-24T19:17:28.986 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.986 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.986 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.986 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.987 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.987 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.987 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.987 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.987 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.987 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.987 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.982+0000 7f8d0e526640 1 -- start start 2026-02-24T19:17:28.987 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.982+0000 7f8d0e526640 1 librados: setting wanted keys 2026-02-24T19:17:28.987 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.982+0000 7f8d0e526640 1 librados: calling monclient init 2026-02-24T19:17:28.987 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.982+0000 7f8d0e526640 10 monclient: init 2026-02-24T19:17:28.987 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.983+0000 7f5704ff9640 1 -- 10.20.193.14:0/38327090 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4041034268 0 0) 0x7f57081febd0 con 0x7f57080585e0 2026-02-24T19:17:28.987 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.983+0000 7f5704ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.987 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.983+0000 7f5704ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.987 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.983+0000 7f5704ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.988 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.983+0000 7f5704ff9640 10 monclient(hunting): my global_id is 4572 2026-02-24T19:17:28.988 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.983+0000 7f5704ff9640 1 -- 10.20.193.14:0/38327090 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57080b3100 con 0x7f57080585e0 2026-02-24T19:17:28.988 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.983+0000 7f8d0e526640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.988 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.983+0000 7f8d0e526640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:28.988 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.983+0000 7f8d0e526640 10 monclient(hunting): picked mon.noname-c con 0x7f8d080b0ca0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:28.988 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.983+0000 7f8d0e526640 10 monclient(hunting): picked mon.noname-a con 0x7f8d080b28b0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:28.988 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.983+0000 7f8d0e526640 10 monclient(hunting): picked mon.noname-b con 0x7f8d0815d0c0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:28.988 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.983+0000 7f8d0e526640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d081547d0 con 0x7f8d080b28b0 2026-02-24T19:17:28.988 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.983+0000 7f8d0e526640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d08119fe0 con 0x7f8d0815d0c0 2026-02-24T19:17:28.988 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.983+0000 7f8d0e526640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d0811a2c0 con 0x7f8d080b0ca0 2026-02-24T19:17:28.988 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.983+0000 7f8d0e526640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.988 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.983+0000 7f8d0e526640 10 monclient(hunting): authenticate will time out at 3623.664122s 2026-02-24T19:17:28.989 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.987+0000 7f5992ffd640 1 -- 10.20.193.14:0/2339725969 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1912717455 0 0) 0x7f59a816f5c0 con 0x7f59a80afef0 2026-02-24T19:17:28.989 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.987+0000 7f5992ffd640 1 -- 10.20.193.14:0/2339725969 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f59a81201d0 con 0x7f59a80afef0 2026-02-24T19:17:28.989 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.987+0000 7f5992ffd640 1 -- 10.20.193.14:0/2339725969 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f59a0002f40 con 0x7f59a80afef0 2026-02-24T19:17:28.989 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.987+0000 7f5992ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.989 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.987+0000 7f5992ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.989 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.987+0000 7f5992ffd640 10 monclient(hunting): dump: 2026-02-24T19:17:28.989 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.989 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.989 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.989 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:28.989 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.989 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:28.989 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:28.989 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:28.989 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:28.989 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:28.991 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.990+0000 7ffac37fe640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7ffac40b9f80 0x7ffac4155170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:55170/0 (socket says 10.20.193.14:55170) 2026-02-24T19:17:28.991 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.990+0000 7ffac37fe640 1 -- 10.20.193.14:0/3233866668 learned_addr learned my addr 10.20.193.14:0/3233866668 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.991 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.991+0000 7f8d077fe640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f8d080b28b0 0x7f8d08134400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:55176/0 (socket says 10.20.193.14:55176) 2026-02-24T19:17:28.992 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.991+0000 7f8d077fe640 1 -- 10.20.193.14:0/3643050912 learned_addr learned my addr 10.20.193.14:0/3643050912 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:28.995 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.994+0000 7ffac0ff9640 10 client.?.objecter ms_handle_connect 0x7ffac40b9f80 2026-02-24T19:17:28.995 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.994+0000 7ffac0ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.995 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.994+0000 7f8d04ff9640 10 client.?.objecter ms_handle_connect 0x7f8d080b28b0 2026-02-24T19:17:28.995 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.994+0000 7f8d04ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.997 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.996+0000 7f95affff640 10 client.?.objecter ms_handle_connect 0x7f95d40585e0 2026-02-24T19:17:28.997 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.996+0000 7f95affff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.999 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.998+0000 7f7c1affd640 1 -- 10.20.193.14:0/1089186970 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3700403772 0 0) 0x7f7c04003610 con 0x7f7c340585e0 2026-02-24T19:17:28.999 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.998+0000 7f7c1affd640 1 -- 10.20.193.14:0/1089186970 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7c34166030 con 0x7f7c340585e0 2026-02-24T19:17:28.999 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.998+0000 7f7c1affd640 1 -- 10.20.193.14:0/1089186970 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7c240028b0 con 0x7f7c340585e0 2026-02-24T19:17:28.999 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.998+0000 7f7c1affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.999 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.998+0000 7f7c1affd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.999 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:28.998+0000 7f7c1affd640 10 monclient(hunting): dump: 2026-02-24T19:17:28.999 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:28.999 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:28.999 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.000 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.000 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:29.000 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:29.000 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:29.000 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:29.000 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:29.000 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:29.001 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.000+0000 7f4f1d7fa640 1 -- 10.20.193.14:0/3332313869 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2538691100 0 0) 0x7f4f28131490 con 0x7f4f28056ea0 2026-02-24T19:17:29.001 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.000+0000 7f4f1d7fa640 1 -- 10.20.193.14:0/3332313869 >> v1:10.20.193.170:6789/0 conn(0x7f4f2815d610 legacy=0x7f4f2812f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.001 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.000+0000 7f4f1d7fa640 1 -- 10.20.193.14:0/3332313869 >> v1:10.20.193.44:6789/0 conn(0x7f4f281667e0 legacy=0x7f4f28142a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.001 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.000+0000 7f4f1d7fa640 10 monclient: _finish_hunting 0 2026-02-24T19:17:29.001 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.000+0000 7f4f1d7fa640 1 monclient: found mon.a 2026-02-24T19:17:29.001 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.000+0000 7f4f1d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:29.001 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.000+0000 7f4f1d7fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:29.001 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.000+0000 7f4f1d7fa640 1 -- 10.20.193.14:0/3332313869 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f28131d10 con 0x7f4f28056ea0 2026-02-24T19:17:29.001 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.000+0000 7f4f1d7fa640 10 monclient: _finish_auth 0 2026-02-24T19:17:29.001 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.000+0000 7f4f1d7fa640 10 monclient: _check_auth_tickets 2026-02-24T19:17:29.002 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.000+0000 7f4f1d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:29.002 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.000+0000 7f4f2f26a640 5 monclient: authenticate success, global_id 4563 2026-02-24T19:17:29.002 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.000+0000 7f4f2f26a640 10 monclient: _renew_subs 2026-02-24T19:17:29.002 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.000+0000 7f4f2f26a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:29.002 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.000+0000 7f4f2f26a640 1 -- 10.20.193.14:0/3332313869 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4f28131ff0 con 0x7f4f28056ea0 2026-02-24T19:17:29.002 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.000+0000 7f4f2f26a640 10 client.4563.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:29.002 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.000+0000 7f4f2f26a640 10 monclient: _renew_subs 2026-02-24T19:17:29.002 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.000+0000 7f4f2f26a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:29.002 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.000+0000 7f4f2f26a640 1 -- 10.20.193.14:0/3332313869 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4f281327f0 con 0x7f4f28056ea0 2026-02-24T19:17:29.002 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.000+0000 7f4f2f26a640 1 librados: init done 2026-02-24T19:17:29.002 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.000+0000 7f4f2f26a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:29.002 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.000+0000 7f4f2f26a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:29.002 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.000+0000 7f4f2f26a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:29.002 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.000+0000 7f4f2f26a640 1 -- 10.20.193.14:0/3332313869 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f28167910 con 0x7f4f28056ea0 2026-02-24T19:17:29.003 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7ffac0ff9640 1 -- 10.20.193.14:0/3233866668 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3588646842 0 0) 0x7ffac4155880 con 0x7ffac40b9f80 2026-02-24T19:17:29.003 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7ffac0ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:29.003 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7ffac0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:29.003 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7ffac0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:29.003 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7ffac0ff9640 10 monclient(hunting): my global_id is 4575 2026-02-24T19:17:29.003 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7ffac0ff9640 1 -- 10.20.193.14:0/3233866668 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa90003610 con 0x7ffac40b9f80 2026-02-24T19:17:29.003 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f5992ffd640 1 -- 10.20.193.14:0/2339725969 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2225250856 0 0) 0x7f59a81201d0 con 0x7f59a80afef0 2026-02-24T19:17:29.003 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f5992ffd640 1 -- 10.20.193.14:0/2339725969 >> v1:10.20.193.170:6789/0 conn(0x7f59a80b9f10 legacy=0x7f59a811fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.003 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f5992ffd640 1 -- 10.20.193.14:0/2339725969 >> v1:10.20.193.44:6789/0 conn(0x7f59a80ba2e0 legacy=0x7f59a816eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.004 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f5992ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:29.004 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f5992ffd640 1 monclient: found mon.a 2026-02-24T19:17:29.004 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f5992ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:29.004 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f5992ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:29.004 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f5992ffd640 1 -- 10.20.193.14:0/2339725969 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a816af50 con 0x7f59a80afef0 2026-02-24T19:17:29.004 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f5992ffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:29.004 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f5992ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:29.004 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f5992ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:29.004 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f59b08d0640 5 monclient: authenticate success, global_id 4569 2026-02-24T19:17:29.004 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f59b08d0640 10 monclient: _renew_subs 2026-02-24T19:17:29.004 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f59b08d0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:29.004 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f59b08d0640 1 -- 10.20.193.14:0/2339725969 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f59a816b230 con 0x7f59a80afef0 2026-02-24T19:17:29.004 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f59b08d0640 10 client.4569.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:29.004 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f59b08d0640 10 monclient: _renew_subs 2026-02-24T19:17:29.004 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f59b08d0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:29.004 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f59b08d0640 1 -- 10.20.193.14:0/2339725969 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f59a816b7f0 con 0x7f59a80afef0 2026-02-24T19:17:29.004 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f59b08d0640 1 librados: init done 2026-02-24T19:17:29.005 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f76b17fa640 1 -- 10.20.193.14:0/2224669131 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 883428694 0 0) 0x7f76bc1ff9d0 con 0x7f76bc0ba350 2026-02-24T19:17:29.005 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f76b17fa640 1 -- 10.20.193.14:0/2224669131 >> v1:10.20.193.170:6789/0 conn(0x7f76bc0b9f80 legacy=0x7f76bc0b8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.005 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f76b17fa640 1 -- 10.20.193.14:0/2224669131 >> v1:10.20.193.44:6789/0 conn(0x7f76bc0585e0 legacy=0x7f76bc1ff1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.005 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f76b17fa640 10 monclient: _finish_hunting 0 2026-02-24T19:17:29.005 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f76b17fa640 1 monclient: found mon.a 2026-02-24T19:17:29.005 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f76b17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:29.005 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f76b17fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:29.005 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f76b17fa640 1 -- 10.20.193.14:0/2224669131 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76bc0b0ad0 con 0x7f76bc0ba350 2026-02-24T19:17:29.005 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f76b17fa640 10 monclient: _finish_auth 0 2026-02-24T19:17:29.005 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f76b17fa640 10 monclient: _check_auth_tickets 2026-02-24T19:17:29.005 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f76b17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:29.005 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f76c319b640 5 monclient: authenticate success, global_id 4554 2026-02-24T19:17:29.005 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f76c319b640 10 monclient: _renew_subs 2026-02-24T19:17:29.005 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f76c319b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:29.005 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f76c319b640 1 -- 10.20.193.14:0/2224669131 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f76bc0b0db0 con 0x7f76bc0ba350 2026-02-24T19:17:29.005 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f76c319b640 10 client.4554.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:29.005 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f76c319b640 10 monclient: _renew_subs 2026-02-24T19:17:29.005 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f76c319b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:29.006 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f76c319b640 1 -- 10.20.193.14:0/2224669131 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f76bc1fff90 con 0x7f76bc0ba350 2026-02-24T19:17:29.006 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f76c319b640 1 librados: init done 2026-02-24T19:17:29.006 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f59b08d0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:29.006 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f59b08d0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:29.006 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f59b08d0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:29.006 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.001+0000 7f59b08d0640 1 -- 10.20.193.14:0/2339725969 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59a80b4c90 con 0x7f59a80afef0 2026-02-24T19:17:29.006 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.002+0000 7f5704ff9640 1 -- 10.20.193.14:0/38327090 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 608384628 0 0) 0x7f57080b3100 con 0x7f57080585e0 2026-02-24T19:17:29.006 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.002+0000 7f5704ff9640 1 -- 10.20.193.14:0/38327090 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f57081febd0 con 0x7f57080585e0 2026-02-24T19:17:29.006 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.002+0000 7f5704ff9640 1 -- 10.20.193.14:0/38327090 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f56f4002f00 con 0x7f57080585e0 2026-02-24T19:17:29.006 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.002+0000 7f5704ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:29.007 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.002+0000 7f5704ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:29.007 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.002+0000 7f5704ff9640 10 monclient(hunting): dump: 2026-02-24T19:17:29.007 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:29.007 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:29.007 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.007 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.007 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:29.007 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:29.007 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:29.007 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:29.007 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:29.007 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:29.007 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.002+0000 7f76c319b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:29.007 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.002+0000 7f76c319b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:29.007 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.002+0000 7f76c319b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:29.007 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.002+0000 7f76c319b640 1 -- 10.20.193.14:0/2224669131 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76bc0b7fa0 con 0x7f76bc0ba350 2026-02-24T19:17:29.008 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.002+0000 7f95affff640 1 -- 10.20.193.14:0/2431173474 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1463035372 0 0) 0x7f95d41febd0 con 0x7f95d40585e0 2026-02-24T19:17:29.008 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.002+0000 7f95affff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:29.008 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.002+0000 7f95affff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:29.008 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.002+0000 7f95affff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:29.008 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.003+0000 7f95affff640 10 monclient(hunting): my global_id is 4581 2026-02-24T19:17:29.008 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.003+0000 7f95affff640 1 -- 10.20.193.14:0/2431173474 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95d40b33e0 con 0x7f95d40585e0 2026-02-24T19:17:29.008 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.003+0000 7f8d04ff9640 1 -- 10.20.193.14:0/3643050912 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3909966956 0 0) 0x7f8d081547d0 con 0x7f8d080b28b0 2026-02-24T19:17:29.008 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.003+0000 7f8d04ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:29.008 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.003+0000 7f8d04ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:29.008 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.003+0000 7f8d04ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:29.008 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.003+0000 7f8d04ff9640 10 monclient(hunting): my global_id is 4578 2026-02-24T19:17:29.008 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.003+0000 7f8d04ff9640 1 -- 10.20.193.14:0/3643050912 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8cdc003610 con 0x7f8d080b28b0 2026-02-24T19:17:29.011 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.010+0000 7f7893a9c640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-24T19:17:29.011 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.010+0000 7f7893a9c640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-24T19:17:29.011 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.010+0000 7f7893a9c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:29.011 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.010+0000 7f7893a9c640 1 -- 10.20.193.14:0/7685078 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f788c1592e0 con 0x7f788c0ba350 2026-02-24T19:17:29.012 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.010+0000 7f7c1affd640 1 -- 10.20.193.14:0/1089186970 <== mon.1 v1:10.20.193.44:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3029079889 0 0) 0x7f7c340b36c0 con 0x7f7c340ba350 2026-02-24T19:17:29.012 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.010+0000 7f7c1affd640 1 -- 10.20.193.14:0/1089186970 >> v1:10.20.193.170:6789/0 conn(0x7f7c340b9f80 legacy=0x7f7c340b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.012 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.010+0000 7f7c1affd640 1 -- 10.20.193.14:0/1089186970 >> v1:10.20.193.14:6789/0 conn(0x7f7c340585e0 legacy=0x7f7c34165920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.012 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.010+0000 7f7c1affd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:29.012 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.010+0000 7f7c1affd640 1 monclient: found mon.b 2026-02-24T19:17:29.012 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.010+0000 7f7c1affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:29.012 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.010+0000 7f7c1affd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:29.012 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.010+0000 7f7c1affd640 1 -- 10.20.193.14:0/1089186970 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c340b3c80 con 0x7f7c340ba350 2026-02-24T19:17:29.012 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.010+0000 7f7c1affd640 10 monclient: _finish_auth 0 2026-02-24T19:17:29.012 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.010+0000 7f7c1affd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:29.012 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.010+0000 7f7c1affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:29.012 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.010+0000 7f7c3c533640 5 monclient: authenticate success, global_id 4510 2026-02-24T19:17:29.012 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.010+0000 7f7c3c533640 10 monclient: _renew_subs 2026-02-24T19:17:29.012 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.010+0000 7f7c3c533640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:29.012 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.010+0000 7f7c3c533640 1 -- 10.20.193.14:0/1089186970 --> v1:10.20.193.44:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7c340b3f60 con 0x7f7c340ba350 2026-02-24T19:17:29.012 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.010+0000 7f7c3c533640 10 client.4510.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:29.012 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.010+0000 7f7c3c533640 10 monclient: _renew_subs 2026-02-24T19:17:29.012 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.010+0000 7f7c3c533640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:29.013 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.010+0000 7f7c3c533640 1 -- 10.20.193.14:0/1089186970 --> v1:10.20.193.44:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7c340b4e70 con 0x7f7c340ba350 2026-02-24T19:17:29.013 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.010+0000 7f7c3c533640 1 librados: init done 2026-02-24T19:17:29.013 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.010+0000 7f7c3c533640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:29.013 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.010+0000 7f7c3c533640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:29.013 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.010+0000 7f7c3c533640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:29.013 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.010+0000 7f7c3c533640 1 -- 10.20.193.14:0/1089186970 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c340b64c0 con 0x7f7c340ba350 2026-02-24T19:17:29.014 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.013+0000 7f5704ff9640 1 -- 10.20.193.14:0/38327090 <== mon.1 v1:10.20.193.44:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 599252389 0 0) 0x7f57080b33e0 con 0x7f57080b9f80 2026-02-24T19:17:29.014 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.013+0000 7f5704ff9640 1 -- 10.20.193.14:0/38327090 >> v1:10.20.193.170:6789/0 conn(0x7f57080ba350 legacy=0x7f5708161a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.014 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.013+0000 7f5704ff9640 1 -- 10.20.193.14:0/38327090 >> v1:10.20.193.14:6789/0 conn(0x7f57080585e0 legacy=0x7f57080b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.014 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.013+0000 7f5704ff9640 10 monclient: _finish_hunting 0 2026-02-24T19:17:29.014 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.013+0000 7f5704ff9640 1 monclient: found mon.b 2026-02-24T19:17:29.014 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.013+0000 7f5704ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:29.014 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.013+0000 7f5704ff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:29.014 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.013+0000 7f5704ff9640 1 -- 10.20.193.14:0/38327090 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57080b36c0 con 0x7f57080b9f80 2026-02-24T19:17:29.014 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.013+0000 7f5704ff9640 10 monclient: _finish_auth 0 2026-02-24T19:17:29.014 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.013+0000 7f5704ff9640 10 monclient: _check_auth_tickets 2026-02-24T19:17:29.014 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.013+0000 7f5704ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:29.014 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.013+0000 7f570e6b1640 5 monclient: authenticate success, global_id 4519 2026-02-24T19:17:29.014 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.013+0000 7f570e6b1640 10 monclient: _renew_subs 2026-02-24T19:17:29.014 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.013+0000 7f570e6b1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:29.015 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.013+0000 7f570e6b1640 1 -- 10.20.193.14:0/38327090 --> v1:10.20.193.44:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5708161270 con 0x7f57080b9f80 2026-02-24T19:17:29.015 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.013+0000 7f570e6b1640 10 client.4519.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:29.015 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.013+0000 7f570e6b1640 10 monclient: _renew_subs 2026-02-24T19:17:29.015 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.013+0000 7f570e6b1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:29.015 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.013+0000 7f570e6b1640 1 -- 10.20.193.14:0/38327090 --> v1:10.20.193.44:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5708162180 con 0x7f57080b9f80 2026-02-24T19:17:29.015 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.013+0000 7f570e6b1640 1 librados: init done 2026-02-24T19:17:29.015 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.013+0000 7f570e6b1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:29.015 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.013+0000 7f570e6b1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:29.015 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.013+0000 7f570e6b1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:29.015 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.013+0000 7f570e6b1640 1 -- 10.20.193.14:0/38327090 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57080b91d0 con 0x7f57080b9f80 2026-02-24T19:17:29.018 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.017+0000 7feec6ffd640 1 -- 10.20.193.14:0/2287837901 <== mon.1 v1:10.20.193.44:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feed40034b0 con 0x7feee00b9f80 2026-02-24T19:17:29.018 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.017+0000 7feec6ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:29.018 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.017+0000 7feec6ffd640 1 -- 10.20.193.14:0/2287837901 <== mon.1 v1:10.20.193.44:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7feed4003800 con 0x7feee00b9f80 2026-02-24T19:17:29.018 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.017+0000 7feec6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:29.018 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.017+0000 7feec6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:29.019 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.017+0000 7feec6ffd640 10 monclient: dump: 2026-02-24T19:17:29.019 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:29.019 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:29.019 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.019 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.019 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:29.019 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:29.019 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:29.019 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:29.019 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:29.019 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:29.019 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.017+0000 7feee4aa5640 4 set_mon_vals no callback set 2026-02-24T19:17:29.019 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.018+0000 7feec6ffd640 1 -- 10.20.193.14:0/2287837901 <== mon.1 v1:10.20.193.44:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7feed401c670 con 0x7feee00b9f80 2026-02-24T19:17:29.020 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.018+0000 7feee62a8640 10 monclient: get_auth_request con 0x7feeb0077e50 auth_method 0 2026-02-24T19:17:29.020 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.019+0000 7feec6ffd640 10 client.4501.objecter ms_handle_connect 0x7feeb0077e50 2026-02-24T19:17:29.021 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.020+0000 7feec6ffd640 1 -- 10.20.193.14:0/2287837901 <== mon.1 v1:10.20.193.44:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7feed4092020 con 0x7feee00b9f80 2026-02-24T19:17:29.021 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.020+0000 7feec6ffd640 10 client.4501.objecter ms_dispatch2 0x7feee0000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:29.021 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.020+0000 7feec6ffd640 3 client.4501.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:29.021 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.020+0000 7feec6ffd640 3 client.4501.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:29.021 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.020+0000 7feec6ffd640 20 client.4501.objecter dump_active .. 0 homeless 2026-02-24T19:17:29.037 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.036+0000 7ff7c17fa640 1 -- 10.20.193.14:0/2275417262 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff7c80037b0 con 0x7ff7cc0ba350 2026-02-24T19:17:29.037 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.036+0000 7ff7c17fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:29.038 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.036+0000 7ff7c17fa640 1 -- 10.20.193.14:0/2275417262 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ff7c8003b00 con 0x7ff7cc0ba350 2026-02-24T19:17:29.038 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.036+0000 7ff7c17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:29.038 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.036+0000 7ff7c17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:29.038 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.036+0000 7ff7c17fa640 10 monclient: dump: 2026-02-24T19:17:29.038 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:29.038 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:29.038 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.038 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.038 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:29.038 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:29.038 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:29.038 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:29.038 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:29.038 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:29.038 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.036+0000 7ff7c2ffd640 4 set_mon_vals no callback set 2026-02-24T19:17:29.038 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.037+0000 7ff7c17fa640 1 -- 10.20.193.14:0/2275417262 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7ff7c801c970 con 0x7ff7cc0ba350 2026-02-24T19:17:29.039 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.038+0000 7ff7d0ae4640 10 monclient: get_auth_request con 0x7ff79c077f80 auth_method 0 2026-02-24T19:17:29.039 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.038+0000 7ff7c17fa640 10 client.4532.objecter ms_handle_connect 0x7ff79c077f80 2026-02-24T19:17:29.040 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.038+0000 7ff7c17fa640 1 -- 10.20.193.14:0/2275417262 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7ff7c8092160 con 0x7ff7cc0ba350 2026-02-24T19:17:29.040 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.038+0000 7ff7c17fa640 10 client.4532.objecter ms_dispatch2 0x7ff7cc000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:29.040 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.038+0000 7ff7c17fa640 3 client.4532.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:29.040 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.038+0000 7ff7c17fa640 3 client.4532.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:29.040 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.039+0000 7ff7c17fa640 20 client.4532.objecter dump_active .. 0 homeless 2026-02-24T19:17:29.041 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.040+0000 7ff7c17fa640 1 -- 10.20.193.14:0/2275417262 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7ff7c805cb90 con 0x7ff7cc0ba350 2026-02-24T19:17:29.041 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.040+0000 7ff7c17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:29.041 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.040+0000 7ff7c17fa640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:29.042 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.041+0000 7f95affff640 1 -- 10.20.193.14:0/2431173474 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1148404654 0 0) 0x7f95d40b3100 con 0x7f95d40b9f80 2026-02-24T19:17:29.042 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.041+0000 7f95affff640 1 -- 10.20.193.14:0/2431173474 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f95d41febd0 con 0x7f95d40b9f80 2026-02-24T19:17:29.042 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.041+0000 7f95affff640 1 -- 10.20.193.14:0/2431173474 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f95c4002ed0 con 0x7f95d40b9f80 2026-02-24T19:17:29.042 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.041+0000 7f95affff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:29.042 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.041+0000 7f95affff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:29.042 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.041+0000 7f95affff640 10 monclient(hunting): dump: 2026-02-24T19:17:29.042 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:29.042 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:29.042 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.042 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.042 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:29.042 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:29.042 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:29.042 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:29.043 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:29.043 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:29.043 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.041+0000 7f95affff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:29.044 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.043+0000 7ffac0ff9640 10 client.?.objecter ms_handle_connect 0x7ffac40585e0 2026-02-24T19:17:29.044 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.043+0000 7ffac0ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:29.053 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.052+0000 7f8d04ff9640 10 client.?.objecter ms_handle_connect 0x7f8d080b0ca0 2026-02-24T19:17:29.053 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.052+0000 7f8d04ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:29.053 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.052+0000 7f787a7fc640 1 -- 10.20.193.14:0/7685078 <== mon.2 v1:10.20.193.170:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (unknown 1274345170 0 1257367751) 0x7f788805e0a0 con 0x7f788c0ba350 2026-02-24T19:17:29.053 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.052+0000 7f787a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-24T19:17:29.053 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.052+0000 7f787a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:29.053 INFO:teuthology.orchestra.run.trial014.stdout:90194313220 2026-02-24T19:17:29.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.055+0000 7f7893a9c640 10 librados: watch_flush enter 2026-02-24T19:17:29.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.055+0000 7f7893a9c640 10 librados: watch_flush exit 2026-02-24T19:17:29.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.055+0000 7f7893a9c640 20 client.4502.objecter shutdown clearing up homeless session... 2026-02-24T19:17:29.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.055+0000 7f7893a9c640 10 client.4502.objecter successfully canceled tick 2026-02-24T19:17:29.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.055+0000 7f7893a9c640 1 -- 10.20.193.14:0/7685078 >> v1:10.20.193.14:6800/4014096310 conn(0x7f785c077db0 legacy=0x7f785c098260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.055+0000 7f7893a9c640 10 monclient: shutdown 2026-02-24T19:17:29.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.055+0000 7f7893a9c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:29.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.055+0000 7f7893a9c640 1 -- 10.20.193.14:0/7685078 >> v1:10.20.193.170:6789/0 conn(0x7f788c0ba350 legacy=0x7f788c0b88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.055+0000 7f7893a9c640 1 -- 10.20.193.14:0/7685078 shutdown_connections 2026-02-24T19:17:29.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.055+0000 7f7893a9c640 1 -- 10.20.193.14:0/7685078 >> 10.20.193.14:0/7685078 conn(0x7f788c0b7990 msgr2=0x7f788c056830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:29.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.055+0000 7f7893a9c640 1 -- 10.20.193.14:0/7685078 shutdown_connections 2026-02-24T19:17:29.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.055+0000 7f7893a9c640 1 -- 10.20.193.14:0/7685078 wait complete. 2026-02-24T19:17:29.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.055+0000 7f7893a9c640 1 librados: shutdown 2026-02-24T19:17:29.067 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313220 for osd.6 2026-02-24T19:17:29.092 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.091+0000 7f2d0ff08640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-24T19:17:29.092 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.091+0000 7f2d0ff08640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-24T19:17:29.092 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.091+0000 7f2d0ff08640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:29.092 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.091+0000 7f2d0ff08640 1 -- 10.20.193.14:0/3238434083 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f2d08137330 con 0x7f2d080b27c0 2026-02-24T19:17:29.105 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.104+0000 7f4f1d7fa640 1 -- 10.20.193.14:0/3332313869 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4f18003470 con 0x7f4f28056ea0 2026-02-24T19:17:29.105 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.104+0000 7f4f1d7fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:29.105 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.104+0000 7f4f1d7fa640 1 -- 10.20.193.14:0/3332313869 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4f18004af0 con 0x7f4f28056ea0 2026-02-24T19:17:29.106 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.104+0000 7f4f1d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:29.106 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.104+0000 7f4f1d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:29.106 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.104+0000 7f4f1d7fa640 10 monclient: dump: 2026-02-24T19:17:29.106 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:29.106 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:29.106 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.106 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.106 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:29.106 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:29.106 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:29.106 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:29.106 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:29.106 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:29.107 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.104+0000 7f4f1effd640 4 set_mon_vals no callback set 2026-02-24T19:17:29.107 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.104+0000 7f4f1d7fa640 1 -- 10.20.193.14:0/3332313869 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f4f1801d960 con 0x7f4f28056ea0 2026-02-24T19:17:29.107 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.105+0000 7f4f1ffff640 10 monclient: get_auth_request con 0x7f4ef8077f10 auth_method 0 2026-02-24T19:17:29.107 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.105+0000 7f4f1d7fa640 10 client.4563.objecter ms_handle_connect 0x7f4ef8077f10 2026-02-24T19:17:29.153 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.151+0000 7ff7d2d6f640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-24T19:17:29.153 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.151+0000 7ff7d2d6f640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-24T19:17:29.153 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.151+0000 7ff7d2d6f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:29.153 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.151+0000 7ff7d2d6f640 1 -- 10.20.193.14:0/2275417262 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7ff7cc0b8ef0 con 0x7ff7cc0ba350 2026-02-24T19:17:29.155 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.154+0000 7ff7c17fa640 1 -- 10.20.193.14:0/2275417262 <== mon.2 v1:10.20.193.170:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 778662779) 0x7ff7c805c490 con 0x7ff7cc0ba350 2026-02-24T19:17:29.155 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.154+0000 7ff7c17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-24T19:17:29.155 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.154+0000 7ff7c17fa640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:29.155 INFO:teuthology.orchestra.run.trial014.stdout:90194313219 2026-02-24T19:17:29.157 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.155+0000 7ff7d2d6f640 10 librados: watch_flush enter 2026-02-24T19:17:29.158 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.155+0000 7ff7d2d6f640 10 librados: watch_flush exit 2026-02-24T19:17:29.158 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.155+0000 7ff7d2d6f640 20 client.4532.objecter shutdown clearing up homeless session... 2026-02-24T19:17:29.158 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.155+0000 7ff7d2d6f640 10 client.4532.objecter successfully canceled tick 2026-02-24T19:17:29.158 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.155+0000 7ff7d2d6f640 1 -- 10.20.193.14:0/2275417262 >> v1:10.20.193.14:6800/4014096310 conn(0x7ff79c077f80 legacy=0x7ff79c098430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.158 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.155+0000 7ff7d2d6f640 10 monclient: shutdown 2026-02-24T19:17:29.158 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.155+0000 7ff7d2d6f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:29.158 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.155+0000 7ff7d2d6f640 1 -- 10.20.193.14:0/2275417262 >> v1:10.20.193.170:6789/0 conn(0x7ff7cc0ba350 legacy=0x7ff7cc161a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.158 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.155+0000 7ff7d2d6f640 1 -- 10.20.193.14:0/2275417262 shutdown_connections 2026-02-24T19:17:29.158 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.155+0000 7ff7d2d6f640 1 -- 10.20.193.14:0/2275417262 >> 10.20.193.14:0/2275417262 conn(0x7ff7cc0b7990 msgr2=0x7ff7cc158a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:29.158 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.155+0000 7ff7d2d6f640 1 -- 10.20.193.14:0/2275417262 shutdown_connections 2026-02-24T19:17:29.159 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.155+0000 7ff7d2d6f640 1 -- 10.20.193.14:0/2275417262 wait complete. 2026-02-24T19:17:29.159 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.155+0000 7ff7d2d6f640 1 librados: shutdown 2026-02-24T19:17:29.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.5 2026-02-24T19:17:29.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.193+0000 7feec6ffd640 1 -- 10.20.193.14:0/2287837901 <== mon.1 v1:10.20.193.44:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7feed405ca50 con 0x7feee00b9f80 2026-02-24T19:17:29.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.193+0000 7feec6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:29.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.193+0000 7feec6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:29.284 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.283+0000 7f76b17fa640 1 -- 10.20.193.14:0/2224669131 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f76b8002f70 con 0x7f76bc0ba350 2026-02-24T19:17:29.284 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.283+0000 7f76b17fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:29.284 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.283+0000 7f76b17fa640 1 -- 10.20.193.14:0/2224669131 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f76b8004f50 con 0x7f76bc0ba350 2026-02-24T19:17:29.284 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.283+0000 7f76b17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:29.284 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.283+0000 7f76b17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:29.284 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.283+0000 7f76b17fa640 10 monclient: dump: 2026-02-24T19:17:29.285 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:29.285 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:29.285 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.285 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.285 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:29.285 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:29.285 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:29.285 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:29.285 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:29.285 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:29.285 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.283+0000 7f76b2ffd640 4 set_mon_vals no callback set 2026-02-24T19:17:29.286 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.283+0000 7f76b17fa640 1 -- 10.20.193.14:0/2224669131 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f76b801ddc0 con 0x7f76bc0ba350 2026-02-24T19:17:29.286 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.284+0000 7f76c0f10640 10 monclient: get_auth_request con 0x7f768c077f40 auth_method 0 2026-02-24T19:17:29.287 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.284+0000 7f4f1d7fa640 1 -- 10.20.193.14:0/3332313869 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7f4f18093000 con 0x7f4f28056ea0 2026-02-24T19:17:29.287 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.284+0000 7f4f1d7fa640 10 client.4563.objecter ms_dispatch2 0x7f4f28000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:29.287 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.284+0000 7f4f1d7fa640 3 client.4563.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:29.287 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.284+0000 7f4f1d7fa640 3 client.4563.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:29.287 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.284+0000 7f4f1d7fa640 20 client.4563.objecter dump_active .. 0 homeless 2026-02-24T19:17:29.287 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.284+0000 7f4f1d7fa640 1 -- 10.20.193.14:0/3332313869 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f4f28167910 con 0x7f4f28056ea0 2026-02-24T19:17:29.287 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.284+0000 7f4f1d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:29.287 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.284+0000 7f4f1d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:29.288 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.284+0000 7f76b17fa640 10 client.4554.objecter ms_handle_connect 0x7f768c077f40 2026-02-24T19:17:29.289 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.285+0000 7f49faffd640 1 -- 10.20.193.14:0/3446685470 <== mon.1 v1:10.20.193.44:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4a10003890 con 0x7f4a14164d00 2026-02-24T19:17:29.289 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.285+0000 7f49faffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:29.289 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.285+0000 7f49faffd640 1 -- 10.20.193.14:0/3446685470 <== mon.1 v1:10.20.193.44:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4a10004df0 con 0x7f4a14164d00 2026-02-24T19:17:29.289 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.285+0000 7f49faffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:29.289 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.285+0000 7f49faffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:29.289 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.285+0000 7f49faffd640 10 monclient: dump: 2026-02-24T19:17:29.289 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:29.289 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:29.289 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.289 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.290 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:29.290 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:29.290 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:29.290 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:29.290 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:29.290 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:29.290 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.285+0000 7f4a18b41640 4 set_mon_vals no callback set 2026-02-24T19:17:29.290 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.286+0000 7f49faffd640 1 -- 10.20.193.14:0/3446685470 <== mon.1 v1:10.20.193.44:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f4a10004fd0 con 0x7f4a14164d00 2026-02-24T19:17:29.290 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.286+0000 7f4a1a344640 10 monclient: get_auth_request con 0x7f49e4077dc0 auth_method 0 2026-02-24T19:17:29.290 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.286+0000 7f49faffd640 10 client.4504.objecter ms_handle_connect 0x7f49e4077dc0 2026-02-24T19:17:29.290 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.287+0000 7f49faffd640 1 -- 10.20.193.14:0/3446685470 <== mon.1 v1:10.20.193.44:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7f4a10093630 con 0x7f4a14164d00 2026-02-24T19:17:29.290 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.287+0000 7f49faffd640 10 client.4504.objecter ms_dispatch2 0x7f4a14000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:29.291 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.287+0000 7f49faffd640 3 client.4504.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:29.291 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.287+0000 7f49faffd640 3 client.4504.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:29.291 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.287+0000 7f49faffd640 20 client.4504.objecter dump_active .. 0 homeless 2026-02-24T19:17:29.291 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.288+0000 7f76b17fa640 1 -- 10.20.193.14:0/2224669131 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7f76b80933e0 con 0x7f76bc0ba350 2026-02-24T19:17:29.291 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.288+0000 7f76b17fa640 10 client.4554.objecter ms_dispatch2 0x7f76bc000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:29.292 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.288+0000 7f76b17fa640 3 client.4554.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:29.292 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.288+0000 7f76b17fa640 3 client.4554.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:29.292 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.288+0000 7f76b17fa640 20 client.4554.objecter dump_active .. 0 homeless 2026-02-24T19:17:29.292 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.288+0000 7f76b17fa640 1 -- 10.20.193.14:0/2224669131 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f76bc0b7fa0 con 0x7f76bc0ba350 2026-02-24T19:17:29.292 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.288+0000 7f76b17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:29.292 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.288+0000 7f76b17fa640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:29.293 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.288+0000 7ffac0ff9640 1 -- 10.20.193.14:0/3233866668 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2119817336 0 0) 0x7ffa90003610 con 0x7ffac40b9f80 2026-02-24T19:17:29.293 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.288+0000 7ffac0ff9640 1 -- 10.20.193.14:0/3233866668 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffac4155880 con 0x7ffac40b9f80 2026-02-24T19:17:29.293 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.288+0000 7ffac0ff9640 1 -- 10.20.193.14:0/3233866668 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ffab0002f30 con 0x7ffac40b9f80 2026-02-24T19:17:29.293 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.288+0000 7ffac0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:29.293 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.288+0000 7ffac0ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:29.293 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.288+0000 7ffac0ff9640 10 monclient(hunting): dump: 2026-02-24T19:17:29.293 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:29.293 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:29.293 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.294 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.294 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:29.294 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:29.294 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:29.294 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:29.294 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:29.294 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:29.294 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.288+0000 7ffac0ff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:29.295 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.288+0000 7f95affff640 1 -- 10.20.193.14:0/2431173474 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2793750877 0 0) 0x7f95a4003610 con 0x7f95d40ba350 2026-02-24T19:17:29.295 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.288+0000 7f95affff640 1 -- 10.20.193.14:0/2431173474 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f95d40b3100 con 0x7f95d40ba350 2026-02-24T19:17:29.295 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.288+0000 7f95affff640 1 -- 10.20.193.14:0/2431173474 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f95c8002c70 con 0x7f95d40ba350 2026-02-24T19:17:29.295 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.288+0000 7f95affff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:29.295 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.288+0000 7f95affff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:29.295 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.288+0000 7f95affff640 10 monclient(hunting): dump: 2026-02-24T19:17:29.295 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:29.295 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:29.295 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.296 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.296 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:29.296 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:29.296 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:29.296 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:29.296 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:29.296 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:29.296 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.288+0000 7f49faffd640 1 -- 10.20.193.14:0/3446685470 <== mon.1 v1:10.20.193.44:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f4a1005e060 con 0x7f4a14164d00 2026-02-24T19:17:29.296 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.288+0000 7f49faffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:29.297 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.288+0000 7f49faffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:29.297 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.292+0000 7fbaecff9640 1 -- 10.20.193.14:0/3377738563 <== mon.1 v1:10.20.193.44:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbae0004610 con 0x7fbaf0159a70 2026-02-24T19:17:29.298 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.292+0000 7fbaecff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:29.298 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.292+0000 7fbaecff9640 1 -- 10.20.193.14:0/3377738563 <== mon.1 v1:10.20.193.44:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fbae0002af0 con 0x7fbaf0159a70 2026-02-24T19:17:29.298 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.292+0000 7fbaecff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:29.298 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.292+0000 7fbaecff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:29.298 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.292+0000 7fbaecff9640 10 monclient: dump: 2026-02-24T19:17:29.298 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:29.298 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:29.298 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.298 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.298 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:29.298 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:29.299 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:29.299 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:29.299 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:29.299 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:29.299 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.292+0000 7fbaee7fc640 4 set_mon_vals no callback set 2026-02-24T19:17:29.299 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.293+0000 7fbaecff9640 1 -- 10.20.193.14:0/3377738563 <== mon.1 v1:10.20.193.44:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7fbae0002cd0 con 0x7fbaf0159a70 2026-02-24T19:17:29.299 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.294+0000 7fbaeffff640 10 monclient: get_auth_request con 0x7fbac0077e50 auth_method 0 2026-02-24T19:17:29.299 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.294+0000 7fbaecff9640 10 client.4513.objecter ms_handle_connect 0x7fbac0077e50 2026-02-24T19:17:29.299 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.294+0000 7fbaecff9640 1 -- 10.20.193.14:0/3377738563 <== mon.1 v1:10.20.193.44:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7fbae00920f0 con 0x7fbaf0159a70 2026-02-24T19:17:29.299 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.294+0000 7fbaecff9640 10 client.4513.objecter ms_dispatch2 0x7fbaf0000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:29.299 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.294+0000 7fbaecff9640 3 client.4513.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:29.299 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.294+0000 7fbaecff9640 3 client.4513.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:29.300 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.295+0000 7fbaecff9640 20 client.4513.objecter dump_active .. 0 homeless 2026-02-24T19:17:29.300 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.296+0000 7f8d04ff9640 1 -- 10.20.193.14:0/3643050912 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2874007346 0 0) 0x7f8cdc003610 con 0x7f8d080b28b0 2026-02-24T19:17:29.300 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.296+0000 7f8d04ff9640 1 -- 10.20.193.14:0/3643050912 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8d081547d0 con 0x7f8d080b28b0 2026-02-24T19:17:29.300 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.296+0000 7f8d04ff9640 1 -- 10.20.193.14:0/3643050912 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f8cf0002fd0 con 0x7f8d080b28b0 2026-02-24T19:17:29.300 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.296+0000 7f8d04ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:29.301 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.296+0000 7f8d04ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:29.301 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.296+0000 7f8d04ff9640 10 monclient(hunting): dump: 2026-02-24T19:17:29.301 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:29.301 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:29.301 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.301 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.301 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:29.301 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:29.301 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:29.301 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:29.301 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:29.301 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:29.302 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.296+0000 7f8d04ff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:29.302 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.297+0000 7fbaecff9640 1 -- 10.20.193.14:0/3377738563 <== mon.1 v1:10.20.193.44:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fbae005cb20 con 0x7fbaf0159a70 2026-02-24T19:17:29.302 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.297+0000 7fbaecff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:29.302 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.297+0000 7fbaecff9640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:29.302 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.298+0000 7ffac0ff9640 10 client.?.objecter ms_handle_connect 0x7ffac40ba350 2026-02-24T19:17:29.302 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.298+0000 7ffac0ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:29.303 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.301+0000 7f95affff640 1 -- 10.20.193.14:0/2431173474 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1035318897 0 0) 0x7f95d40b33e0 con 0x7f95d40585e0 2026-02-24T19:17:29.303 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.301+0000 7f95affff640 1 -- 10.20.193.14:0/2431173474 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f95a4003610 con 0x7f95d40585e0 2026-02-24T19:17:29.303 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.301+0000 7f95affff640 1 -- 10.20.193.14:0/2431173474 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f95c0002f70 con 0x7f95d40585e0 2026-02-24T19:17:29.303 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.301+0000 7f95affff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:29.303 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.301+0000 7f95affff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:29.304 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.301+0000 7f95affff640 10 monclient(hunting): dump: 2026-02-24T19:17:29.304 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:29.304 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:29.304 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.304 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.304 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:29.304 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:29.304 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:29.304 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:29.304 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:29.304 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:29.305 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.302+0000 7f9e63fff640 1 -- 10.20.193.14:0/2794771459 <== mon.1 v1:10.20.193.44:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9e7c0038c0 con 0x7f9e880ba350 2026-02-24T19:17:29.305 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.302+0000 7f9e63fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:29.305 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.302+0000 7f9e63fff640 1 -- 10.20.193.14:0/2794771459 <== mon.1 v1:10.20.193.44:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f9e7c003c10 con 0x7f9e880ba350 2026-02-24T19:17:29.305 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.302+0000 7f9e63fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:29.306 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.302+0000 7f9e63fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:29.306 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.302+0000 7f9e63fff640 10 monclient: dump: 2026-02-24T19:17:29.306 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:29.306 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:29.306 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.306 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.306 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:29.306 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:29.306 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:29.306 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:29.306 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:29.306 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:29.306 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.302+0000 7f9e85ffb640 4 set_mon_vals no callback set 2026-02-24T19:17:29.307 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.302+0000 7f9e63fff640 1 -- 10.20.193.14:0/2794771459 <== mon.1 v1:10.20.193.44:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f9e7c01ca80 con 0x7f9e880ba350 2026-02-24T19:17:29.307 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.303+0000 7f9e877fe640 10 monclient: get_auth_request con 0x7f9e58077d90 auth_method 0 2026-02-24T19:17:29.307 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.303+0000 7feee8533640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-24T19:17:29.307 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.303+0000 7feee8533640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-24T19:17:29.307 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.303+0000 7feee8533640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:29.307 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.303+0000 7feee8533640 1 -- 10.20.193.14:0/2287837901 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7feee015acd0 con 0x7feee00b9f80 2026-02-24T19:17:29.308 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.303+0000 7f9e63fff640 10 client.4522.objecter ms_handle_connect 0x7f9e58077d90 2026-02-24T19:17:29.308 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.305+0000 7f5992ffd640 1 -- 10.20.193.14:0/2339725969 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f59a0003510 con 0x7f59a80afef0 2026-02-24T19:17:29.309 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.305+0000 7f5992ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:29.309 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.305+0000 7f5992ffd640 1 -- 10.20.193.14:0/2339725969 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f59a0004b90 con 0x7f59a80afef0 2026-02-24T19:17:29.309 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.305+0000 7f5992ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:29.309 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.305+0000 7f5992ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:29.309 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.305+0000 7f59ace42640 4 set_mon_vals no callback set 2026-02-24T19:17:29.309 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.305+0000 7f5992ffd640 10 monclient: dump: 2026-02-24T19:17:29.309 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:29.309 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:29.309 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.309 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.309 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:29.310 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:29.310 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:29.310 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:29.310 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:29.310 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:29.310 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.306+0000 7f5992ffd640 1 -- 10.20.193.14:0/2339725969 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f59a001da00 con 0x7f59a80afef0 2026-02-24T19:17:29.310 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.306+0000 7f59ade44640 10 monclient: get_auth_request con 0x7f5978077f10 auth_method 0 2026-02-24T19:17:29.310 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.306+0000 7f5992ffd640 10 client.4569.objecter ms_handle_connect 0x7f5978077f10 2026-02-24T19:17:29.312 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.311+0000 7f5992ffd640 1 -- 10.20.193.14:0/2339725969 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7f59a0093090 con 0x7f59a80afef0 2026-02-24T19:17:29.312 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.311+0000 7f5992ffd640 10 client.4569.objecter ms_dispatch2 0x7f59a8000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:29.312 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.311+0000 7f5992ffd640 3 client.4569.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:29.312 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.311+0000 7f5992ffd640 3 client.4569.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:29.313 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.311+0000 7f2cee7fc640 1 -- 10.20.193.14:0/3238434083 <== mon.0 v1:10.20.193.14:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+12 (unknown 3405404620 0 778662779) 0x7f2cf805d790 con 0x7f2d080b27c0 2026-02-24T19:17:29.313 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.311+0000 7f2cee7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-24T19:17:29.313 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.311+0000 7f2cee7fc640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:29.313 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.311+0000 7f5992ffd640 20 client.4569.objecter dump_active .. 0 homeless 2026-02-24T19:17:29.314 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.311+0000 7f5992ffd640 1 -- 10.20.193.14:0/2339725969 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f59a005dac0 con 0x7f59a80afef0 2026-02-24T19:17:29.314 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.311+0000 7f5992ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:29.314 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.311+0000 7f5992ffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:29.314 INFO:teuthology.orchestra.run.trial014.stdout:90194313219 2026-02-24T19:17:29.315 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.311+0000 7f8d04ff9640 1 -- 10.20.193.14:0/3643050912 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 841930851 0 0) 0x7f8d081547d0 con 0x7f8d080b28b0 2026-02-24T19:17:29.316 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.311+0000 7f8d04ff9640 1 -- 10.20.193.14:0/3643050912 >> v1:10.20.193.170:6789/0 conn(0x7f8d080b0ca0 legacy=0x7f8d081540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.316 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.311+0000 7f8d04ff9640 1 -- 10.20.193.14:0/3643050912 >> v1:10.20.193.44:6789/0 conn(0x7f8d0815d0c0 legacy=0x7f8d08140ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.316 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.311+0000 7f8d04ff9640 10 monclient: _finish_hunting 0 2026-02-24T19:17:29.316 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.311+0000 7f8d04ff9640 1 monclient: found mon.a 2026-02-24T19:17:29.316 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.311+0000 7f8d04ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:29.316 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.311+0000 7f8d04ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:29.316 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.311+0000 7f8d04ff9640 1 -- 10.20.193.14:0/3643050912 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d0811a5a0 con 0x7f8d080b28b0 2026-02-24T19:17:29.316 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.311+0000 7f8d04ff9640 10 monclient: _finish_auth 0 2026-02-24T19:17:29.316 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.311+0000 7f8d04ff9640 10 monclient: _check_auth_tickets 2026-02-24T19:17:29.316 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.311+0000 7f8d04ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:29.316 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.311+0000 7f8d0e526640 5 monclient: authenticate success, global_id 4578 2026-02-24T19:17:29.316 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.311+0000 7f8d0e526640 10 monclient: _renew_subs 2026-02-24T19:17:29.317 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.311+0000 7f8d0e526640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:29.317 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.311+0000 7f8d0e526640 1 -- 10.20.193.14:0/3643050912 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8d0811a880 con 0x7f8d080b28b0 2026-02-24T19:17:29.317 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.311+0000 7f8d0e526640 10 client.4578.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:29.317 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.311+0000 7f8d0e526640 10 monclient: _renew_subs 2026-02-24T19:17:29.317 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.311+0000 7f8d0e526640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:29.317 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.311+0000 7f8d0e526640 1 -- 10.20.193.14:0/3643050912 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8d08119af0 con 0x7f8d080b28b0 2026-02-24T19:17:29.317 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.311+0000 7f8d0e526640 1 librados: init done 2026-02-24T19:17:29.317 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.312+0000 7f8d0e526640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:29.317 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.312+0000 7f8d0e526640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:29.317 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.312+0000 7f8d0e526640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:29.317 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.312+0000 7f8d0e526640 1 -- 10.20.193.14:0/3643050912 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d080b2e60 con 0x7f8d080b28b0 2026-02-24T19:17:29.319 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.314+0000 7f2d0ff08640 10 librados: watch_flush enter 2026-02-24T19:17:29.319 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.314+0000 7f2d0ff08640 10 librados: watch_flush exit 2026-02-24T19:17:29.319 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.314+0000 7f2d0ff08640 20 client.4533.objecter shutdown clearing up homeless session... 2026-02-24T19:17:29.319 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.314+0000 7f2d0ff08640 10 client.4533.objecter successfully canceled tick 2026-02-24T19:17:29.319 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.314+0000 7f2d0ff08640 1 -- 10.20.193.14:0/3238434083 >> v1:10.20.193.14:6800/4014096310 conn(0x7f2cd8077c80 legacy=0x7f2cd8098130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.319 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.314+0000 7f2d0ff08640 10 monclient: shutdown 2026-02-24T19:17:29.319 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.314+0000 7f2d0ff08640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:29.319 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.314+0000 7f2d0ff08640 1 -- 10.20.193.14:0/3238434083 >> v1:10.20.193.14:6789/0 conn(0x7f2d080b27c0 legacy=0x7f2d0814bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.319 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.314+0000 7f2d0ff08640 1 -- 10.20.193.14:0/3238434083 shutdown_connections 2026-02-24T19:17:29.319 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.314+0000 7f2d0ff08640 1 -- 10.20.193.14:0/3238434083 >> 10.20.193.14:0/3238434083 conn(0x7f2d080b7120 msgr2=0x7f2d080518a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:29.320 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.314+0000 7f2d0ff08640 1 -- 10.20.193.14:0/3238434083 shutdown_connections 2026-02-24T19:17:29.320 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.314+0000 7f2d0ff08640 1 -- 10.20.193.14:0/3238434083 wait complete. 2026-02-24T19:17:29.320 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.314+0000 7f2d0ff08640 1 librados: shutdown 2026-02-24T19:17:29.321 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.315+0000 7ffac0ff9640 1 -- 10.20.193.14:0/3233866668 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3696198061 0 0) 0x7ffac4155880 con 0x7ffac40b9f80 2026-02-24T19:17:29.321 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.315+0000 7ffac0ff9640 1 -- 10.20.193.14:0/3233866668 >> v1:10.20.193.170:6789/0 conn(0x7ffac40585e0 legacy=0x7ffac41fb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.321 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.315+0000 7ffac0ff9640 1 -- 10.20.193.14:0/3233866668 >> v1:10.20.193.44:6789/0 conn(0x7ffac40ba350 legacy=0x7ffac41f8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.321 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.315+0000 7ffac0ff9640 10 monclient: _finish_hunting 0 2026-02-24T19:17:29.321 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.315+0000 7ffac0ff9640 1 monclient: found mon.a 2026-02-24T19:17:29.321 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.315+0000 7ffac0ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:29.321 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.315+0000 7ffac0ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:29.322 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.315+0000 7ffac0ff9640 1 -- 10.20.193.14:0/3233866668 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffac41fd650 con 0x7ffac40b9f80 2026-02-24T19:17:29.322 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.315+0000 7ffac0ff9640 10 monclient: _finish_auth 0 2026-02-24T19:17:29.322 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.315+0000 7ffac0ff9640 10 monclient: _check_auth_tickets 2026-02-24T19:17:29.322 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.315+0000 7ffac0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:29.322 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.315+0000 7ffacaa4d640 5 monclient: authenticate success, global_id 4575 2026-02-24T19:17:29.322 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.315+0000 7ffacaa4d640 10 monclient: _renew_subs 2026-02-24T19:17:29.322 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.315+0000 7ffacaa4d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:29.322 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.315+0000 7ffacaa4d640 1 -- 10.20.193.14:0/3233866668 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ffac41fd930 con 0x7ffac40b9f80 2026-02-24T19:17:29.322 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.315+0000 7ffacaa4d640 10 client.4575.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:29.322 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.315+0000 7ffacaa4d640 10 monclient: _renew_subs 2026-02-24T19:17:29.322 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.315+0000 7ffacaa4d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:29.322 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.315+0000 7ffacaa4d640 1 -- 10.20.193.14:0/3233866668 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ffac41f9510 con 0x7ffac40b9f80 2026-02-24T19:17:29.323 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.315+0000 7ffacaa4d640 1 librados: init done 2026-02-24T19:17:29.323 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.315+0000 7ffacaa4d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:29.323 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.315+0000 7ffacaa4d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:29.323 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.315+0000 7ffacaa4d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:29.323 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.315+0000 7ffacaa4d640 1 -- 10.20.193.14:0/3233866668 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffac4159080 con 0x7ffac40b9f80 2026-02-24T19:17:29.324 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.317+0000 7f95affff640 1 -- 10.20.193.14:0/2431173474 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3781961348 0 0) 0x7f95a4003610 con 0x7f95d40585e0 2026-02-24T19:17:29.324 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.318+0000 7f95affff640 1 -- 10.20.193.14:0/2431173474 >> v1:10.20.193.170:6789/0 conn(0x7f95d40b9f80 legacy=0x7f95d41fe4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.324 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.318+0000 7f95affff640 1 -- 10.20.193.14:0/2431173474 >> v1:10.20.193.44:6789/0 conn(0x7f95d40ba350 legacy=0x7f95d4161a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.325 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.318+0000 7f95affff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:29.325 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.318+0000 7f95affff640 1 monclient: found mon.a 2026-02-24T19:17:29.325 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.318+0000 7f95affff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:29.325 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.318+0000 7f95affff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:29.325 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.318+0000 7f95affff640 1 -- 10.20.193.14:0/2431173474 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95d40b36c0 con 0x7f95d40585e0 2026-02-24T19:17:29.325 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.318+0000 7f95affff640 10 monclient: _finish_auth 0 2026-02-24T19:17:29.325 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.318+0000 7f95affff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:29.325 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.318+0000 7f95affff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:29.325 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.318+0000 7f95d9ba2640 5 monclient: authenticate success, global_id 4581 2026-02-24T19:17:29.325 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.318+0000 7f95d9ba2640 10 monclient: _renew_subs 2026-02-24T19:17:29.325 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.318+0000 7f95d9ba2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:29.325 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.318+0000 7f95d9ba2640 1 -- 10.20.193.14:0/2431173474 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f95d4161270 con 0x7f95d40585e0 2026-02-24T19:17:29.325 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.318+0000 7f95d9ba2640 10 client.4581.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:29.326 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.318+0000 7f95d9ba2640 10 monclient: _renew_subs 2026-02-24T19:17:29.326 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.318+0000 7f95d9ba2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:29.326 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.318+0000 7f95d9ba2640 1 -- 10.20.193.14:0/2431173474 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f95d4162180 con 0x7f95d40585e0 2026-02-24T19:17:29.326 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.318+0000 7f95d9ba2640 1 librados: init done 2026-02-24T19:17:29.326 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.318+0000 7f95d9ba2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:29.326 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.318+0000 7f95d9ba2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:29.326 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.318+0000 7f95d9ba2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:29.326 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.318+0000 7f95d9ba2640 1 -- 10.20.193.14:0/2431173474 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95d40b91d0 con 0x7f95d40585e0 2026-02-24T19:17:29.327 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.11 2026-02-24T19:17:29.328 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.327+0000 7f8d04ff9640 1 -- 10.20.193.14:0/3643050912 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8cf00049c0 con 0x7f8d080b28b0 2026-02-24T19:17:29.328 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.327+0000 7f8d04ff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:29.329 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.327+0000 7f8d04ff9640 1 -- 10.20.193.14:0/3643050912 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f8cf0004b70 con 0x7f8d080b28b0 2026-02-24T19:17:29.329 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.327+0000 7f8d04ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:29.329 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.327+0000 7f8d04ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:29.329 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.327+0000 7f8d04ff9640 10 monclient: dump: 2026-02-24T19:17:29.329 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:29.329 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:29.329 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.329 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.329 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:29.329 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:29.329 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:29.329 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:29.330 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:29.330 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:29.330 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.327+0000 7f8d067fc640 4 set_mon_vals no callback set 2026-02-24T19:17:29.330 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.327+0000 7ffac0ff9640 1 -- 10.20.193.14:0/3233866668 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffab0004950 con 0x7ffac40b9f80 2026-02-24T19:17:29.330 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.327+0000 7ffac0ff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:29.330 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.327+0000 7ffac27fc640 4 set_mon_vals no callback set 2026-02-24T19:17:29.331 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.328+0000 7f8d04ff9640 1 -- 10.20.193.14:0/3643050912 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f8cf001da20 con 0x7f8d080b28b0 2026-02-24T19:17:29.331 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.328+0000 7f8d07fff640 10 monclient: get_auth_request con 0x7f8cdc077c40 auth_method 0 2026-02-24T19:17:29.331 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.328+0000 7f8d04ff9640 10 client.4578.objecter ms_handle_connect 0x7f8cdc077c40 2026-02-24T19:17:29.332 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.331+0000 7ffac0ff9640 1 -- 10.20.193.14:0/3233866668 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ffab0004b00 con 0x7ffac40b9f80 2026-02-24T19:17:29.333 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.331+0000 7ffac0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:29.333 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.331+0000 7ffac0ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:29.333 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.331+0000 7ffac0ff9640 10 monclient: dump: 2026-02-24T19:17:29.333 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:29.333 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:29.333 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.333 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.333 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:29.333 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:29.333 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:29.333 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:29.334 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:29.334 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:29.363 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.362+0000 7f8d04ff9640 1 -- 10.20.193.14:0/3643050912 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7f8cf00933c0 con 0x7f8d080b28b0 2026-02-24T19:17:29.363 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.362+0000 7f8d04ff9640 10 client.4578.objecter ms_dispatch2 0x7f8d08000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:29.363 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.362+0000 7f8d04ff9640 3 client.4578.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:29.363 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.362+0000 7f8d04ff9640 3 client.4578.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:29.363 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.362+0000 7f8d04ff9640 20 client.4578.objecter dump_active .. 0 homeless 2026-02-24T19:17:29.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.401+0000 7f4f2f26a640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-24T19:17:29.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.401+0000 7f4f2f26a640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-24T19:17:29.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.401+0000 7f4f2f26a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:29.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.401+0000 7f4f2f26a640 1 -- 10.20.193.14:0/3332313869 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f4f2812f5f0 con 0x7f4f28056ea0 2026-02-24T19:17:29.403 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.402+0000 7f76c319b640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-24T19:17:29.403 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.402+0000 7f76c319b640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-24T19:17:29.403 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.402+0000 7f76c319b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:29.403 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.402+0000 7f76c319b640 1 -- 10.20.193.14:0/2224669131 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f76bc13bb10 con 0x7f76bc0ba350 2026-02-24T19:17:29.404 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.403+0000 7f4a1c5cf640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-24T19:17:29.405 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.403+0000 7f4a1c5cf640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-24T19:17:29.405 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.403+0000 7f4a1c5cf640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:29.405 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.403+0000 7f4a1c5cf640 1 -- 10.20.193.14:0/3446685470 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f4a1413d3b0 con 0x7f4a14164d00 2026-02-24T19:17:29.412 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.410+0000 7fbaf6502640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-24T19:17:29.412 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.411+0000 7fbaf6502640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-24T19:17:29.412 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.411+0000 7fbaf6502640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:29.412 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.411+0000 7fbaf6502640 1 -- 10.20.193.14:0/3377738563 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fbaf00ba220 con 0x7fbaf0159a70 2026-02-24T19:17:29.429 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.428+0000 7f59b08d0640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-24T19:17:29.429 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.428+0000 7f59b08d0640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-24T19:17:29.429 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.428+0000 7f59b08d0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:29.429 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.428+0000 7f59b08d0640 1 -- 10.20.193.14:0/2339725969 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f59a80b49b0 con 0x7f59a80afef0 2026-02-24T19:17:29.459 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.457+0000 7f8d04ff9640 1 -- 10.20.193.14:0/3643050912 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f8d080b2e60 con 0x7f8d080b28b0 2026-02-24T19:17:29.459 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.457+0000 7f8d04ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:29.459 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.457+0000 7f8d04ff9640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:29.477 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.475+0000 7f9e63fff640 1 -- 10.20.193.14:0/2794771459 <== mon.1 v1:10.20.193.44:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7f9e7c0923f0 con 0x7f9e880ba350 2026-02-24T19:17:29.477 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.475+0000 7f9e63fff640 10 client.4522.objecter ms_dispatch2 0x7f9e88000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:29.477 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.475+0000 7f9e63fff640 3 client.4522.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:29.477 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.475+0000 7f9e63fff640 3 client.4522.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:29.477 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.475+0000 7f9e63fff640 20 client.4522.objecter dump_active .. 0 homeless 2026-02-24T19:17:29.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.477+0000 7f9e63fff640 1 -- 10.20.193.14:0/2794771459 <== mon.1 v1:10.20.193.44:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f9e88159080 con 0x7f9e880ba350 2026-02-24T19:17:29.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.477+0000 7f9e63fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:29.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.477+0000 7f9e63fff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:29.482 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.481+0000 7f7c1affd640 1 -- 10.20.193.14:0/1089186970 <== mon.1 v1:10.20.193.44:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7c30003a80 con 0x7f7c340ba350 2026-02-24T19:17:29.482 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.481+0000 7f7c1affd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:29.482 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.481+0000 7f7c1affd640 1 -- 10.20.193.14:0/1089186970 <== mon.1 v1:10.20.193.44:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7c30003dd0 con 0x7f7c340ba350 2026-02-24T19:17:29.482 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.481+0000 7f7c1affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:29.482 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.481+0000 7f7c1affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:29.482 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.481+0000 7f7c1affd640 10 monclient: dump: 2026-02-24T19:17:29.482 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:29.483 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:29.483 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.483 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.483 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:29.483 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:29.483 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:29.483 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:29.483 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:29.483 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:29.483 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.481+0000 7f7c38aa5640 4 set_mon_vals no callback set 2026-02-24T19:17:29.484 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.481+0000 7f7c1affd640 1 -- 10.20.193.14:0/1089186970 <== mon.1 v1:10.20.193.44:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f7c3001cc40 con 0x7f7c340ba350 2026-02-24T19:17:29.484 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.482+0000 7f7c3a2a8640 10 monclient: get_auth_request con 0x7f7c04077fd0 auth_method 0 2026-02-24T19:17:29.484 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.482+0000 7f7c1affd640 10 client.4510.objecter ms_handle_connect 0x7f7c04077fd0 2026-02-24T19:17:29.485 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.483+0000 7f7c1affd640 1 -- 10.20.193.14:0/1089186970 <== mon.1 v1:10.20.193.44:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7f7c300922c0 con 0x7f7c340ba350 2026-02-24T19:17:29.485 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.483+0000 7f7c1affd640 10 client.4510.objecter ms_dispatch2 0x7f7c34000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:29.485 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.483+0000 7f7c1affd640 3 client.4510.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:29.485 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.483+0000 7f7c1affd640 3 client.4510.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:29.485 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.483+0000 7f7c1affd640 20 client.4510.objecter dump_active .. 0 homeless 2026-02-24T19:17:29.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.485+0000 7f7c1affd640 1 -- 10.20.193.14:0/1089186970 <== mon.1 v1:10.20.193.44:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f7c3005ccf0 con 0x7f7c340ba350 2026-02-24T19:17:29.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.485+0000 7f7c1affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:29.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.485+0000 7f7c1affd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:29.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.490+0000 7f5704ff9640 1 -- 10.20.193.14:0/38327090 <== mon.1 v1:10.20.193.44:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f56f8003550 con 0x7f57080b9f80 2026-02-24T19:17:29.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.490+0000 7f5704ff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:29.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.490+0000 7f5704ff9640 1 -- 10.20.193.14:0/38327090 <== mon.1 v1:10.20.193.44:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f56f80038a0 con 0x7f57080b9f80 2026-02-24T19:17:29.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.490+0000 7f5704ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:29.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.490+0000 7f5704ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:29.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.490+0000 7f5704ff9640 10 monclient: dump: 2026-02-24T19:17:29.492 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:29.492 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:29.492 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.493 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.493 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:29.493 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:29.493 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:29.493 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:29.493 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:29.493 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:29.493 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.490+0000 7f57067fc640 4 set_mon_vals no callback set 2026-02-24T19:17:29.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.491+0000 7f5704ff9640 1 -- 10.20.193.14:0/38327090 <== mon.1 v1:10.20.193.44:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f56f801c710 con 0x7f57080b9f80 2026-02-24T19:17:29.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.492+0000 7f5707fff640 10 monclient: get_auth_request con 0x7f56d8077e70 auth_method 0 2026-02-24T19:17:29.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.492+0000 7f5704ff9640 10 client.4519.objecter ms_handle_connect 0x7f56d8077e70 2026-02-24T19:17:29.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.492+0000 7f5704ff9640 1 -- 10.20.193.14:0/38327090 <== mon.1 v1:10.20.193.44:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7f56f80581f0 con 0x7f57080b9f80 2026-02-24T19:17:29.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.492+0000 7f5704ff9640 10 client.4519.objecter ms_dispatch2 0x7f5708000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:29.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.492+0000 7f5704ff9640 3 client.4519.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:29.495 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.492+0000 7f5704ff9640 3 client.4519.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:29.495 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.492+0000 7f5704ff9640 20 client.4519.objecter dump_active .. 0 homeless 2026-02-24T19:17:29.496 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.495+0000 7f5704ff9640 1 -- 10.20.193.14:0/38327090 <== mon.1 v1:10.20.193.44:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f56f805c960 con 0x7f57080b9f80 2026-02-24T19:17:29.496 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.495+0000 7f5704ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:29.496 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.495+0000 7f5704ff9640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:29.499 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.498+0000 7f49faffd640 1 -- 10.20.193.14:0/3446685470 <== mon.1 v1:10.20.193.44:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (unknown 1482059429 0 778662779) 0x7f4a1005d960 con 0x7f4a14164d00 2026-02-24T19:17:29.500 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.498+0000 7f49faffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-24T19:17:29.500 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.498+0000 7f49faffd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:29.500 INFO:teuthology.orchestra.run.trial014.stdout:90194313219 2026-02-24T19:17:29.501 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.500+0000 7fbaecff9640 1 -- 10.20.193.14:0/3377738563 <== mon.1 v1:10.20.193.44:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+12 (unknown 2894986287 0 778662779) 0x7fbae005c420 con 0x7fbaf0159a70 2026-02-24T19:17:29.501 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.500+0000 7fbaecff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-24T19:17:29.501 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.500+0000 7fbaecff9640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:29.501 INFO:teuthology.orchestra.run.trial014.stdout:90194313219 2026-02-24T19:17:29.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.501+0000 7f4a1c5cf640 10 librados: watch_flush enter 2026-02-24T19:17:29.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.501+0000 7f4a1c5cf640 10 librados: watch_flush exit 2026-02-24T19:17:29.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.501+0000 7f4a1c5cf640 20 client.4504.objecter shutdown clearing up homeless session... 2026-02-24T19:17:29.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.501+0000 7f4a1c5cf640 10 client.4504.objecter successfully canceled tick 2026-02-24T19:17:29.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.501+0000 7f4a1c5cf640 1 -- 10.20.193.14:0/3446685470 >> v1:10.20.193.14:6800/4014096310 conn(0x7f49e4077dc0 legacy=0x7f49e4098270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.501+0000 7f4a1c5cf640 10 monclient: shutdown 2026-02-24T19:17:29.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.501+0000 7f4a1c5cf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:29.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.501+0000 7f4a1c5cf640 1 -- 10.20.193.14:0/3446685470 >> v1:10.20.193.44:6789/0 conn(0x7f4a14164d00 legacy=0x7f4a141302b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.501+0000 7f4a1c5cf640 1 -- 10.20.193.14:0/3446685470 shutdown_connections 2026-02-24T19:17:29.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.501+0000 7f4a1c5cf640 1 -- 10.20.193.14:0/3446685470 >> 10.20.193.14:0/3446685470 conn(0x7f4a140b2ef0 msgr2=0x7f4a1405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:29.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.501+0000 7f4a1c5cf640 1 -- 10.20.193.14:0/3446685470 shutdown_connections 2026-02-24T19:17:29.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.501+0000 7f4a1c5cf640 1 -- 10.20.193.14:0/3446685470 wait complete. 2026-02-24T19:17:29.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.501+0000 7f4a1c5cf640 1 librados: shutdown 2026-02-24T19:17:29.505 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.502+0000 7fbaf6502640 10 librados: watch_flush enter 2026-02-24T19:17:29.505 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.502+0000 7fbaf6502640 10 librados: watch_flush exit 2026-02-24T19:17:29.505 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.502+0000 7fbaf6502640 20 client.4513.objecter shutdown clearing up homeless session... 2026-02-24T19:17:29.505 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.502+0000 7fbaf6502640 10 client.4513.objecter successfully canceled tick 2026-02-24T19:17:29.505 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.502+0000 7fbaf6502640 1 -- 10.20.193.14:0/3377738563 >> v1:10.20.193.14:6800/4014096310 conn(0x7fbac0077e50 legacy=0x7fbac0098300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.506 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.502+0000 7fbaf6502640 10 monclient: shutdown 2026-02-24T19:17:29.506 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.502+0000 7fbaf6502640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:29.506 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.502+0000 7fbaf6502640 1 -- 10.20.193.14:0/3377738563 >> v1:10.20.193.44:6789/0 conn(0x7fbaf0159a70 legacy=0x7fbaf015dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.506 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.502+0000 7fbaf6502640 1 -- 10.20.193.14:0/3377738563 shutdown_connections 2026-02-24T19:17:29.506 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.502+0000 7fbaf6502640 1 -- 10.20.193.14:0/3377738563 >> 10.20.193.14:0/3377738563 conn(0x7fbaf00b7780 msgr2=0x7fbaf00b5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:29.506 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.502+0000 7fbaf6502640 1 -- 10.20.193.14:0/3377738563 shutdown_connections 2026-02-24T19:17:29.506 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.503+0000 7fbaf6502640 1 -- 10.20.193.14:0/3377738563 wait complete. 2026-02-24T19:17:29.506 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.503+0000 7fbaf6502640 1 librados: shutdown 2026-02-24T19:17:29.506 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.504+0000 7feec6ffd640 1 -- 10.20.193.14:0/2287837901 <== mon.1 v1:10.20.193.44:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 778662779) 0x7feed405c350 con 0x7feee00b9f80 2026-02-24T19:17:29.507 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.504+0000 7feec6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-24T19:17:29.507 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.504+0000 7feec6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:29.507 INFO:teuthology.orchestra.run.trial014.stdout:90194313219 2026-02-24T19:17:29.507 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.504+0000 7f2fa6ffd640 1 -- 10.20.193.14:0/1935728667 <== mon.1 v1:10.20.193.44:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 778662779) 0x7f2fb005c6f0 con 0x7f2fc00ba350 2026-02-24T19:17:29.508 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.504+0000 7f2fa6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-24T19:17:29.508 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.504+0000 7f2fa6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:29.508 INFO:teuthology.orchestra.run.trial014.stdout:90194313219 2026-02-24T19:17:29.509 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.507+0000 7f2fc4de0640 10 librados: watch_flush enter 2026-02-24T19:17:29.509 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.507+0000 7f2fc4de0640 10 librados: watch_flush exit 2026-02-24T19:17:29.509 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.507+0000 7f2fc4de0640 20 client.4489.objecter shutdown clearing up homeless session... 2026-02-24T19:17:29.509 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.507+0000 7f2fc4de0640 10 client.4489.objecter successfully canceled tick 2026-02-24T19:17:29.509 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.507+0000 7f2fc4de0640 1 -- 10.20.193.14:0/1935728667 >> v1:10.20.193.14:6800/4014096310 conn(0x7f2f8c077d30 legacy=0x7f2f8c0981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.510 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.507+0000 7f2fc4de0640 10 monclient: shutdown 2026-02-24T19:17:29.510 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.507+0000 7f2fc4de0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:29.510 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.507+0000 7f2fc4de0640 1 -- 10.20.193.14:0/1935728667 >> v1:10.20.193.44:6789/0 conn(0x7f2fc00ba350 legacy=0x7f2fc00b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.510 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.507+0000 7f2fc4de0640 1 -- 10.20.193.14:0/1935728667 shutdown_connections 2026-02-24T19:17:29.510 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.507+0000 7f2fc4de0640 1 -- 10.20.193.14:0/1935728667 >> 10.20.193.14:0/1935728667 conn(0x7f2fc00b7990 msgr2=0x7f2fc00b66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:29.510 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.507+0000 7f2fc4de0640 1 -- 10.20.193.14:0/1935728667 shutdown_connections 2026-02-24T19:17:29.510 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.507+0000 7f2fc4de0640 1 -- 10.20.193.14:0/1935728667 wait complete. 2026-02-24T19:17:29.510 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.507+0000 7f2fc4de0640 1 librados: shutdown 2026-02-24T19:17:29.511 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.508+0000 7feee8533640 10 librados: watch_flush enter 2026-02-24T19:17:29.511 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.508+0000 7feee8533640 10 librados: watch_flush exit 2026-02-24T19:17:29.512 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.508+0000 7feee8533640 20 client.4501.objecter shutdown clearing up homeless session... 2026-02-24T19:17:29.512 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.508+0000 7feee8533640 10 client.4501.objecter successfully canceled tick 2026-02-24T19:17:29.512 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.508+0000 7feee8533640 1 -- 10.20.193.14:0/2287837901 >> v1:10.20.193.14:6800/4014096310 conn(0x7feeb0077e50 legacy=0x7feeb0098300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.512 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.508+0000 7feee8533640 10 monclient: shutdown 2026-02-24T19:17:29.512 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.508+0000 7feee8533640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:29.512 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.508+0000 7feee8533640 1 -- 10.20.193.14:0/2287837901 >> v1:10.20.193.44:6789/0 conn(0x7feee00b9f80 legacy=0x7feee01f9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.512 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.508+0000 7feee8533640 1 -- 10.20.193.14:0/2287837901 shutdown_connections 2026-02-24T19:17:29.512 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.508+0000 7feee8533640 1 -- 10.20.193.14:0/2287837901 >> 10.20.193.14:0/2287837901 conn(0x7feee00b7990 msgr2=0x7feee015b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:29.512 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.508+0000 7feee8533640 1 -- 10.20.193.14:0/2287837901 shutdown_connections 2026-02-24T19:17:29.512 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.508+0000 7feee8533640 1 -- 10.20.193.14:0/2287837901 wait complete. 2026-02-24T19:17:29.512 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.508+0000 7feee8533640 1 librados: shutdown 2026-02-24T19:17:29.513 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.7 2026-02-24T19:17:29.514 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.9 2026-02-24T19:17:29.519 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.4 2026-02-24T19:17:29.520 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.2 2026-02-24T19:17:29.561 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.560+0000 7ffac0ff9640 1 -- 10.20.193.14:0/3233866668 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7ffab001d9f0 con 0x7ffac40b9f80 2026-02-24T19:17:29.562 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.560+0000 7ffac3fff640 10 monclient: get_auth_request con 0x7ffa90077d00 auth_method 0 2026-02-24T19:17:29.562 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.561+0000 7ffac0ff9640 10 client.4575.objecter ms_handle_connect 0x7ffa90077d00 2026-02-24T19:17:29.567 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.566+0000 7ffac0ff9640 1 -- 10.20.193.14:0/3233866668 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7ffab00933b0 con 0x7ffac40b9f80 2026-02-24T19:17:29.567 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.566+0000 7ffac0ff9640 10 client.4575.objecter ms_dispatch2 0x7ffac4000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:29.568 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.566+0000 7ffac0ff9640 3 client.4575.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:29.568 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.566+0000 7ffac0ff9640 3 client.4575.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:29.568 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.566+0000 7ffac0ff9640 20 client.4575.objecter dump_active .. 0 homeless 2026-02-24T19:17:29.568 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.566+0000 7ffac0ff9640 1 -- 10.20.193.14:0/3233866668 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7ffac4159080 con 0x7ffac40b9f80 2026-02-24T19:17:29.568 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.566+0000 7ffac0ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:29.568 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.566+0000 7ffac0ff9640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:29.568 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.567+0000 7f8d0e526640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-24T19:17:29.569 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.567+0000 7f8d0e526640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-24T19:17:29.569 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.567+0000 7f8d0e526640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:29.569 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.567+0000 7f8d0e526640 1 -- 10.20.193.14:0/3643050912 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 12} v 0) -- 0x7f8d08160ad0 con 0x7f8d080b28b0 2026-02-24T19:17:29.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.590+0000 7f9e8e11b640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-24T19:17:29.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.590+0000 7f9e8e11b640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-24T19:17:29.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.590+0000 7f9e8e11b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:29.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.590+0000 7f9e8e11b640 1 -- 10.20.193.14:0/2794771459 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 13} v 0) -- 0x7f9e8815b710 con 0x7f9e880ba350 2026-02-24T19:17:29.594 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.592+0000 7f9e63fff640 1 -- 10.20.193.14:0/2794771459 <== mon.1 v1:10.20.193.44:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 13}]=0 v0) ==== 75+0+12 (unknown 3988744482 0 778662779) 0x7f9e7c05ce20 con 0x7f9e880ba350 2026-02-24T19:17:29.594 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.592+0000 7f9e63fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-24T19:17:29.594 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.592+0000 7f9e63fff640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:29.594 INFO:teuthology.orchestra.run.trial014.stdout:90194313219 2026-02-24T19:17:29.597 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.595+0000 7f9e8e11b640 10 librados: watch_flush enter 2026-02-24T19:17:29.597 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.595+0000 7f9e8e11b640 10 librados: watch_flush exit 2026-02-24T19:17:29.597 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.595+0000 7f9e8e11b640 20 client.4522.objecter shutdown clearing up homeless session... 2026-02-24T19:17:29.597 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.595+0000 7f9e8e11b640 10 client.4522.objecter successfully canceled tick 2026-02-24T19:17:29.597 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.595+0000 7f9e8e11b640 1 -- 10.20.193.14:0/2794771459 >> v1:10.20.193.14:6800/4014096310 conn(0x7f9e58077d90 legacy=0x7f9e58098240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.597 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.595+0000 7f9e8e11b640 10 monclient: shutdown 2026-02-24T19:17:29.597 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.595+0000 7f9e8e11b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:29.597 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.595+0000 7f9e8e11b640 1 -- 10.20.193.14:0/2794771459 >> v1:10.20.193.44:6789/0 conn(0x7f9e880ba350 legacy=0x7f9e881f8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.597 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.595+0000 7f9e8e11b640 1 -- 10.20.193.14:0/2794771459 shutdown_connections 2026-02-24T19:17:29.598 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.595+0000 7f9e8e11b640 1 -- 10.20.193.14:0/2794771459 >> 10.20.193.14:0/2794771459 conn(0x7f9e880b7990 msgr2=0x7f9e880b7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:29.598 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.595+0000 7f9e8e11b640 1 -- 10.20.193.14:0/2794771459 shutdown_connections 2026-02-24T19:17:29.598 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.595+0000 7f9e8e11b640 1 -- 10.20.193.14:0/2794771459 wait complete. 2026-02-24T19:17:29.598 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.595+0000 7f9e8e11b640 1 librados: shutdown 2026-02-24T19:17:29.603 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.602+0000 7f7c3c533640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-24T19:17:29.603 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.602+0000 7f7c3c533640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-24T19:17:29.603 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.602+0000 7f7c3c533640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:29.603 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.602+0000 7f7c3c533640 1 -- 10.20.193.14:0/1089186970 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 15} v 0) -- 0x7f7c3413bcd0 con 0x7f7c340ba350 2026-02-24T19:17:29.605 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.13 2026-02-24T19:17:29.605 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.604+0000 7f7c1affd640 1 -- 10.20.193.14:0/1089186970 <== mon.1 v1:10.20.193.44:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 15}]=0 v0) ==== 75+0+12 (unknown 2221946896 0 778662779) 0x7f7c3005c5f0 con 0x7f7c340ba350 2026-02-24T19:17:29.605 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.604+0000 7f7c1affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-24T19:17:29.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.604+0000 7f7c1affd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:29.606 INFO:teuthology.orchestra.run.trial014.stdout:90194313219 2026-02-24T19:17:29.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.606+0000 7f7c3c533640 10 librados: watch_flush enter 2026-02-24T19:17:29.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.606+0000 7f7c3c533640 10 librados: watch_flush exit 2026-02-24T19:17:29.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.606+0000 7f7c3c533640 20 client.4510.objecter shutdown clearing up homeless session... 2026-02-24T19:17:29.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.606+0000 7f7c3c533640 10 client.4510.objecter successfully canceled tick 2026-02-24T19:17:29.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.606+0000 7f7c3c533640 1 -- 10.20.193.14:0/1089186970 >> v1:10.20.193.14:6800/4014096310 conn(0x7f7c04077fd0 legacy=0x7f7c04098480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.606+0000 7f7c3c533640 10 monclient: shutdown 2026-02-24T19:17:29.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.606+0000 7f7c3c533640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:29.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.606+0000 7f7c3c533640 1 -- 10.20.193.14:0/1089186970 >> v1:10.20.193.44:6789/0 conn(0x7f7c340ba350 legacy=0x7f7c34156970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.606+0000 7f7c3c533640 1 -- 10.20.193.14:0/1089186970 shutdown_connections 2026-02-24T19:17:29.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.606+0000 7f7c3c533640 1 -- 10.20.193.14:0/1089186970 >> 10.20.193.14:0/1089186970 conn(0x7f7c340b7990 msgr2=0x7f7c340b9230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:29.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.606+0000 7f7c3c533640 1 -- 10.20.193.14:0/1089186970 shutdown_connections 2026-02-24T19:17:29.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.606+0000 7f7c3c533640 1 -- 10.20.193.14:0/1089186970 wait complete. 2026-02-24T19:17:29.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.606+0000 7f7c3c533640 1 librados: shutdown 2026-02-24T19:17:29.616 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.15 2026-02-24T19:17:29.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.615+0000 7f570e6b1640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-24T19:17:29.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.615+0000 7f570e6b1640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-24T19:17:29.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.615+0000 7f570e6b1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:29.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.615+0000 7f570e6b1640 1 -- 10.20.193.14:0/38327090 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 14} v 0) -- 0x7f57080b8ef0 con 0x7f57080b9f80 2026-02-24T19:17:29.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.617+0000 7f5704ff9640 1 -- 10.20.193.14:0/38327090 <== mon.1 v1:10.20.193.44:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 14}]=0 v0) ==== 75+0+12 (unknown 2547163239 0 778662779) 0x7f56f805c260 con 0x7f57080b9f80 2026-02-24T19:17:29.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.617+0000 7f5704ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-24T19:17:29.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.617+0000 7f5704ff9640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:29.619 INFO:teuthology.orchestra.run.trial014.stdout:90194313219 2026-02-24T19:17:29.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.619+0000 7f570e6b1640 10 librados: watch_flush enter 2026-02-24T19:17:29.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.619+0000 7f570e6b1640 10 librados: watch_flush exit 2026-02-24T19:17:29.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.619+0000 7f570e6b1640 20 client.4519.objecter shutdown clearing up homeless session... 2026-02-24T19:17:29.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.619+0000 7f570e6b1640 10 client.4519.objecter successfully canceled tick 2026-02-24T19:17:29.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.619+0000 7f570e6b1640 1 -- 10.20.193.14:0/38327090 >> v1:10.20.193.14:6800/4014096310 conn(0x7f56d8077e70 legacy=0x7f56d8098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.619+0000 7f570e6b1640 10 monclient: shutdown 2026-02-24T19:17:29.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.619+0000 7f570e6b1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:29.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.619+0000 7f570e6b1640 1 -- 10.20.193.14:0/38327090 >> v1:10.20.193.44:6789/0 conn(0x7f57080b9f80 legacy=0x7f57081fe4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.620+0000 7f570e6b1640 1 -- 10.20.193.14:0/38327090 shutdown_connections 2026-02-24T19:17:29.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.620+0000 7f570e6b1640 1 -- 10.20.193.14:0/38327090 >> 10.20.193.14:0/38327090 conn(0x7f57080b7990 msgr2=0x7f5708158a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:29.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.620+0000 7f570e6b1640 1 -- 10.20.193.14:0/38327090 shutdown_connections 2026-02-24T19:17:29.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.620+0000 7f570e6b1640 1 -- 10.20.193.14:0/38327090 wait complete. 2026-02-24T19:17:29.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.620+0000 7f570e6b1640 1 librados: shutdown 2026-02-24T19:17:29.630 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.14 2026-02-24T19:17:29.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.676+0000 7f95affff640 1 -- 10.20.193.14:0/2431173474 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f95c0003520 con 0x7f95d40585e0 2026-02-24T19:17:29.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.676+0000 7f95affff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:29.678 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.676+0000 7f95affff640 1 -- 10.20.193.14:0/2431173474 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f95c0003870 con 0x7f95d40585e0 2026-02-24T19:17:29.678 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.676+0000 7f95affff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:29.678 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.676+0000 7f95affff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:29.678 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.676+0000 7f95affff640 10 monclient: dump: 2026-02-24T19:17:29.678 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:29.678 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:29.678 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.678 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:29.678 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:29.678 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:29.678 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:29.679 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:29.679 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:29.679 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:29.679 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.676+0000 7f95d1ffb640 4 set_mon_vals no callback set 2026-02-24T19:17:29.679 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.677+0000 7f95affff640 1 -- 10.20.193.14:0/2431173474 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f95c001c6e0 con 0x7f95d40585e0 2026-02-24T19:17:29.679 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.677+0000 7f95d2ffd640 10 monclient: get_auth_request con 0x7f95a4077ea0 auth_method 0 2026-02-24T19:17:29.680 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.677+0000 7f95affff640 10 client.4581.objecter ms_handle_connect 0x7f95a4077ea0 2026-02-24T19:17:29.681 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.680+0000 7ffacaa4d640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-24T19:17:29.681 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.680+0000 7ffacaa4d640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-24T19:17:29.681 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.680+0000 7ffacaa4d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:29.681 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.680+0000 7ffacaa4d640 1 -- 10.20.193.14:0/3233866668 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ffac415b710 con 0x7ffac40b9f80 2026-02-24T19:17:29.685 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.683+0000 7f95affff640 1 -- 10.20.193.14:0/2431173474 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7f95c0091f10 con 0x7f95d40585e0 2026-02-24T19:17:29.685 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.683+0000 7f95affff640 10 client.4581.objecter ms_dispatch2 0x7f95d4000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:29.685 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.683+0000 7f95affff640 3 client.4581.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:29.685 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.683+0000 7f95affff640 3 client.4581.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:29.685 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.683+0000 7f95affff640 20 client.4581.objecter dump_active .. 0 homeless 2026-02-24T19:17:29.685 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.683+0000 7f95affff640 1 -- 10.20.193.14:0/2431173474 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f95c005c940 con 0x7f95d40585e0 2026-02-24T19:17:29.686 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.684+0000 7f95affff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:29.686 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.684+0000 7f95affff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:29.686 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.684+0000 7f76b17fa640 1 -- 10.20.193.14:0/2224669131 <== mon.0 v1:10.20.193.14:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+12 (unknown 3207554136 0 778662779) 0x7f76bc163930 con 0x7f76bc0ba350 2026-02-24T19:17:29.686 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.684+0000 7f76b17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-24T19:17:29.686 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.684+0000 7f76b17fa640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:29.686 INFO:teuthology.orchestra.run.trial014.stdout:90194313219 2026-02-24T19:17:29.688 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.686+0000 7f76c319b640 10 librados: watch_flush enter 2026-02-24T19:17:29.688 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.686+0000 7f76c319b640 10 librados: watch_flush exit 2026-02-24T19:17:29.688 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.686+0000 7f76c319b640 20 client.4554.objecter shutdown clearing up homeless session... 2026-02-24T19:17:29.688 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.686+0000 7f76c319b640 10 client.4554.objecter successfully canceled tick 2026-02-24T19:17:29.689 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.686+0000 7f76c319b640 1 -- 10.20.193.14:0/2224669131 >> v1:10.20.193.14:6800/4014096310 conn(0x7f768c077f40 legacy=0x7f768c0983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.689 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.686+0000 7f76c319b640 10 monclient: shutdown 2026-02-24T19:17:29.689 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.686+0000 7f76c319b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:29.689 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.686+0000 7f76c319b640 1 -- 10.20.193.14:0/2224669131 >> v1:10.20.193.14:6789/0 conn(0x7f76bc0ba350 legacy=0x7f76bc156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.689 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.686+0000 7f76c319b640 1 -- 10.20.193.14:0/2224669131 shutdown_connections 2026-02-24T19:17:29.689 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.686+0000 7f76c319b640 1 -- 10.20.193.14:0/2224669131 >> 10.20.193.14:0/2224669131 conn(0x7f76bc0b7990 msgr2=0x7f76bc0ad140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:29.689 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.686+0000 7f76c319b640 1 -- 10.20.193.14:0/2224669131 shutdown_connections 2026-02-24T19:17:29.689 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.686+0000 7f76c319b640 1 -- 10.20.193.14:0/2224669131 wait complete. 2026-02-24T19:17:29.689 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.686+0000 7f76c319b640 1 librados: shutdown 2026-02-24T19:17:29.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.8 2026-02-24T19:17:29.698 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.697+0000 7f8d04ff9640 1 -- 10.20.193.14:0/3643050912 <== mon.0 v1:10.20.193.14:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 12}]=0 v0) ==== 75+0+12 (unknown 4263375189 0 778662779) 0x7f8cf005ddf0 con 0x7f8d080b28b0 2026-02-24T19:17:29.699 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.697+0000 7f8d04ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-24T19:17:29.699 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.697+0000 7f8d04ff9640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:29.699 INFO:teuthology.orchestra.run.trial014.stdout:90194313219 2026-02-24T19:17:29.702 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.700+0000 7f8d0e526640 10 librados: watch_flush enter 2026-02-24T19:17:29.702 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.700+0000 7f8d0e526640 10 librados: watch_flush exit 2026-02-24T19:17:29.702 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.700+0000 7f8d0e526640 20 client.4578.objecter shutdown clearing up homeless session... 2026-02-24T19:17:29.702 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.700+0000 7f8d0e526640 10 client.4578.objecter successfully canceled tick 2026-02-24T19:17:29.702 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.700+0000 7f8d0e526640 1 -- 10.20.193.14:0/3643050912 >> v1:10.20.193.14:6800/4014096310 conn(0x7f8cdc077c40 legacy=0x7f8cdc0980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.702 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.700+0000 7f8d0e526640 10 monclient: shutdown 2026-02-24T19:17:29.702 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.700+0000 7f8d0e526640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:29.702 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.700+0000 7f8d0e526640 1 -- 10.20.193.14:0/3643050912 >> v1:10.20.193.14:6789/0 conn(0x7f8d080b28b0 legacy=0x7f8d08134400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.703 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.700+0000 7f8d0e526640 1 -- 10.20.193.14:0/3643050912 shutdown_connections 2026-02-24T19:17:29.703 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.700+0000 7f8d0e526640 1 -- 10.20.193.14:0/3643050912 >> 10.20.193.14:0/3643050912 conn(0x7f8d080b5290 msgr2=0x7f8d080b3090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:29.703 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.700+0000 7f8d0e526640 1 -- 10.20.193.14:0/3643050912 shutdown_connections 2026-02-24T19:17:29.703 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.700+0000 7f8d0e526640 1 -- 10.20.193.14:0/3643050912 wait complete. 2026-02-24T19:17:29.703 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.700+0000 7f8d0e526640 1 librados: shutdown 2026-02-24T19:17:29.705 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.704+0000 7f4f1d7fa640 1 -- 10.20.193.14:0/3332313869 <== mon.0 v1:10.20.193.14:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 778662779) 0x7f4f2812f5f0 con 0x7f4f28056ea0 2026-02-24T19:17:29.705 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.704+0000 7f4f1d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-24T19:17:29.706 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.704+0000 7f4f1d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:29.706 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.704+0000 7f5992ffd640 1 -- 10.20.193.14:0/2339725969 <== mon.0 v1:10.20.193.14:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 778662779) 0x7f59a0065e20 con 0x7f59a80afef0 2026-02-24T19:17:29.706 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.704+0000 7f5992ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-24T19:17:29.706 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.704+0000 7f5992ffd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:29.706 INFO:teuthology.orchestra.run.trial014.stdout:90194313219 2026-02-24T19:17:29.707 INFO:teuthology.orchestra.run.trial014.stdout:90194313219 2026-02-24T19:17:29.707 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.704+0000 7ffac0ff9640 1 -- 10.20.193.14:0/3233866668 <== mon.0 v1:10.20.193.14:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 778662779) 0x7ffab005dde0 con 0x7ffac40b9f80 2026-02-24T19:17:29.707 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.704+0000 7ffac0ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-24T19:17:29.707 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.704+0000 7ffac0ff9640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:29.708 INFO:teuthology.orchestra.run.trial014.stdout:90194313219 2026-02-24T19:17:29.708 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7f4f2f26a640 10 librados: watch_flush enter 2026-02-24T19:17:29.709 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7f4f2f26a640 10 librados: watch_flush exit 2026-02-24T19:17:29.709 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7f4f2f26a640 20 client.4563.objecter shutdown clearing up homeless session... 2026-02-24T19:17:29.709 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7f4f2f26a640 10 client.4563.objecter successfully canceled tick 2026-02-24T19:17:29.709 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7f59b08d0640 10 librados: watch_flush enter 2026-02-24T19:17:29.709 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7f59b08d0640 10 librados: watch_flush exit 2026-02-24T19:17:29.709 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7f59b08d0640 20 client.4569.objecter shutdown clearing up homeless session... 2026-02-24T19:17:29.709 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7f59b08d0640 10 client.4569.objecter successfully canceled tick 2026-02-24T19:17:29.710 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7ffacaa4d640 10 librados: watch_flush enter 2026-02-24T19:17:29.710 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7ffacaa4d640 10 librados: watch_flush exit 2026-02-24T19:17:29.710 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7f4f2f26a640 1 -- 10.20.193.14:0/3332313869 >> v1:10.20.193.14:6800/4014096310 conn(0x7f4ef8077f10 legacy=0x7f4ef80983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.710 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7ffacaa4d640 20 client.4575.objecter shutdown clearing up homeless session... 2026-02-24T19:17:29.711 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7ffacaa4d640 10 client.4575.objecter successfully canceled tick 2026-02-24T19:17:29.711 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7f4f2f26a640 10 monclient: shutdown 2026-02-24T19:17:29.711 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7f4f2f26a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:29.711 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7f4f2f26a640 1 -- 10.20.193.14:0/3332313869 >> v1:10.20.193.14:6789/0 conn(0x7f4f28056ea0 legacy=0x7f4f28165c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.711 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7f59b08d0640 1 -- 10.20.193.14:0/2339725969 >> v1:10.20.193.14:6800/4014096310 conn(0x7f5978077f10 legacy=0x7f59780983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.712 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7f59b08d0640 10 monclient: shutdown 2026-02-24T19:17:29.712 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7f59b08d0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:29.712 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7f59b08d0640 1 -- 10.20.193.14:0/2339725969 >> v1:10.20.193.14:6789/0 conn(0x7f59a80afef0 legacy=0x7f59a816d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.712 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7ffacaa4d640 1 -- 10.20.193.14:0/3233866668 >> v1:10.20.193.14:6800/4014096310 conn(0x7ffa90077d00 legacy=0x7ffa900981b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.712 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7f4f2f26a640 1 -- 10.20.193.14:0/3332313869 shutdown_connections 2026-02-24T19:17:29.713 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7ffacaa4d640 10 monclient: shutdown 2026-02-24T19:17:29.713 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7ffacaa4d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:29.713 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7ffacaa4d640 1 -- 10.20.193.14:0/3233866668 >> v1:10.20.193.14:6789/0 conn(0x7ffac40b9f80 legacy=0x7ffac4155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.713 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7f4f2f26a640 1 -- 10.20.193.14:0/3332313869 >> 10.20.193.14:0/3332313869 conn(0x7f4f280b7470 msgr2=0x7f4f280b59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:29.713 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7f4f2f26a640 1 -- 10.20.193.14:0/3332313869 shutdown_connections 2026-02-24T19:17:29.714 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7f4f2f26a640 1 -- 10.20.193.14:0/3332313869 wait complete. 2026-02-24T19:17:29.714 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7f59b08d0640 1 -- 10.20.193.14:0/2339725969 shutdown_connections 2026-02-24T19:17:29.714 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7f59b08d0640 1 -- 10.20.193.14:0/2339725969 >> 10.20.193.14:0/2339725969 conn(0x7f59a80b7990 msgr2=0x7f59a81332f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:29.715 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7ffacaa4d640 1 -- 10.20.193.14:0/3233866668 shutdown_connections 2026-02-24T19:17:29.715 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7ffacaa4d640 1 -- 10.20.193.14:0/3233866668 >> 10.20.193.14:0/3233866668 conn(0x7ffac40b7990 msgr2=0x7ffac40b7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:29.715 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7f4f2f26a640 1 librados: shutdown 2026-02-24T19:17:29.715 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7f59b08d0640 1 -- 10.20.193.14:0/2339725969 shutdown_connections 2026-02-24T19:17:29.716 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7f59b08d0640 1 -- 10.20.193.14:0/2339725969 wait complete. 2026-02-24T19:17:29.716 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7ffacaa4d640 1 -- 10.20.193.14:0/3233866668 shutdown_connections 2026-02-24T19:17:29.716 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7ffacaa4d640 1 -- 10.20.193.14:0/3233866668 wait complete. 2026-02-24T19:17:29.716 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7f59b08d0640 1 librados: shutdown 2026-02-24T19:17:29.717 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.707+0000 7ffacaa4d640 1 librados: shutdown 2026-02-24T19:17:29.718 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.12 2026-02-24T19:17:29.719 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.3 2026-02-24T19:17:29.719 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.0 2026-02-24T19:17:29.720 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.1 2026-02-24T19:17:29.793 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.792+0000 7f95d9ba2640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-24T19:17:29.793 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.792+0000 7f95d9ba2640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-24T19:17:29.793 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.792+0000 7f95d9ba2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:29.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.792+0000 7f95d9ba2640 1 -- 10.20.193.14:0/2431173474 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f95d40b8ef0 con 0x7f95d40585e0 2026-02-24T19:17:29.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.794+0000 7f95affff640 1 -- 10.20.193.14:0/2431173474 <== mon.0 v1:10.20.193.14:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+12 (unknown 3646472635 0 778662779) 0x7f95c005c240 con 0x7f95d40585e0 2026-02-24T19:17:29.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.794+0000 7f95affff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-24T19:17:29.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.794+0000 7f95affff640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:29.796 INFO:teuthology.orchestra.run.trial014.stdout:90194313219 2026-02-24T19:17:29.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.796+0000 7f95d9ba2640 10 librados: watch_flush enter 2026-02-24T19:17:29.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.796+0000 7f95d9ba2640 10 librados: watch_flush exit 2026-02-24T19:17:29.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.796+0000 7f95d9ba2640 20 client.4581.objecter shutdown clearing up homeless session... 2026-02-24T19:17:29.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.796+0000 7f95d9ba2640 10 client.4581.objecter successfully canceled tick 2026-02-24T19:17:29.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.796+0000 7f95d9ba2640 1 -- 10.20.193.14:0/2431173474 >> v1:10.20.193.14:6800/4014096310 conn(0x7f95a4077ea0 legacy=0x7f95a4098350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.796+0000 7f95d9ba2640 10 monclient: shutdown 2026-02-24T19:17:29.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.796+0000 7f95d9ba2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:29.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.796+0000 7f95d9ba2640 1 -- 10.20.193.14:0/2431173474 >> v1:10.20.193.14:6789/0 conn(0x7f95d40585e0 legacy=0x7f95d40b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:29.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.796+0000 7f95d9ba2640 1 -- 10.20.193.14:0/2431173474 shutdown_connections 2026-02-24T19:17:29.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.796+0000 7f95d9ba2640 1 -- 10.20.193.14:0/2431173474 >> 10.20.193.14:0/2431173474 conn(0x7f95d40b7990 msgr2=0x7f95d4158a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:29.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.796+0000 7f95d9ba2640 1 -- 10.20.193.14:0/2431173474 shutdown_connections 2026-02-24T19:17:29.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.796+0000 7f95d9ba2640 1 -- 10.20.193.14:0/2431173474 wait complete. 2026-02-24T19:17:29.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:29.796+0000 7f95d9ba2640 1 librados: shutdown 2026-02-24T19:17:29.806 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.10 2026-02-24T19:17:30.068 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-24T19:17:30.137 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.135+0000 7fb3ec49f640 10 monclient: get_monmap_and_config 2026-02-24T19:17:30.137 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.135+0000 7fb3ec49f640 10 monclient: build_initial_monmap 2026-02-24T19:17:30.137 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.135+0000 7fb3ec49f640 10 monclient: monmap: 2026-02-24T19:17:30.137 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:30.138 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.138 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:30.136182+0000 2026-02-24T19:17:30.138 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:30.136182+0000 2026-02-24T19:17:30.138 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:30.138 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.138 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:30.138 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:30.138 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:30.138 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.138 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.136+0000 7fb3ec49f640 1 Processor -- start 2026-02-24T19:17:30.138 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.136+0000 7fb3ec49f640 1 -- start start 2026-02-24T19:17:30.139 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.136+0000 7fb3ec49f640 10 monclient: init 2026-02-24T19:17:30.141 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.136+0000 7fb3ec49f640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:30.141 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.136+0000 7fb3ec49f640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:30.141 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.136+0000 7fb3ec49f640 10 monclient(hunting): picked mon.noname-c con 0x7fb3e4157780 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:30.141 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.136+0000 7fb3ec49f640 10 monclient(hunting): picked mon.noname-b con 0x7fb3e4157b50 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:30.141 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.136+0000 7fb3ec49f640 10 monclient(hunting): picked mon.noname-a con 0x7fb3e4164d00 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:30.141 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.136+0000 7fb3ec49f640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3e405de70 con 0x7fb3e4164d00 2026-02-24T19:17:30.141 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.136+0000 7fb3ec49f640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3e4055b20 con 0x7fb3e4157b50 2026-02-24T19:17:30.141 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.136+0000 7fb3ec49f640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3e4055e00 con 0x7fb3e4157780 2026-02-24T19:17:30.141 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.136+0000 7fb3ec49f640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:30.141 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.136+0000 7fb3ec49f640 10 monclient(hunting): authenticate will time out at 3624.817604s 2026-02-24T19:17:30.142 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.137+0000 7fb3ea214640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7fb3e4157780 0x7fb3e4056ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:45284/0 (socket says 10.20.193.14:45284) 2026-02-24T19:17:30.142 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.137+0000 7fb3ea214640 1 -- 10.20.193.14:0/777517800 learned_addr learned my addr 10.20.193.14:0/777517800 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:30.142 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.137+0000 7fb3e9a13640 1 --1- 10.20.193.14:0/777517800 >> v1:10.20.193.44:6789/0 conn(0x7fb3e4157b50 0x7fb3e41645f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:34924/0 (socket says 10.20.193.14:34924) 2026-02-24T19:17:30.142 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.138+0000 7fb3e9212640 1 -- 10.20.193.14:0/777517800 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 215266145 0 0) 0x7fb3e4055e00 con 0x7fb3e4157780 2026-02-24T19:17:30.142 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.138+0000 7fb3e9212640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.142 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.138+0000 7fb3e9212640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.142 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.138+0000 7fb3e9212640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.142 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.138+0000 7fb3e9212640 10 monclient(hunting): my global_id is 4559 2026-02-24T19:17:30.142 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.138+0000 7fb3e9212640 1 -- 10.20.193.14:0/777517800 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3cc003610 con 0x7fb3e4157780 2026-02-24T19:17:30.142 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.138+0000 7fb3e9212640 1 -- 10.20.193.14:0/777517800 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3218115166 0 0) 0x7fb3e405de70 con 0x7fb3e4164d00 2026-02-24T19:17:30.142 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.138+0000 7fb3e9212640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.142 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.138+0000 7fb3e9212640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.143 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.138+0000 7fb3e9212640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.143 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.138+0000 7fb3e9212640 10 monclient(hunting): my global_id is 4584 2026-02-24T19:17:30.143 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.138+0000 7fb3e9212640 1 -- 10.20.193.14:0/777517800 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3e4055e00 con 0x7fb3e4164d00 2026-02-24T19:17:30.143 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.138+0000 7fb3e9212640 1 -- 10.20.193.14:0/777517800 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4212389673 0 0) 0x7fb3e4055b20 con 0x7fb3e4157b50 2026-02-24T19:17:30.143 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.138+0000 7fb3e9212640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.143 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.138+0000 7fb3e9212640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.143 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.138+0000 7fb3e9212640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.143 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.138+0000 7fb3e9212640 10 monclient(hunting): my global_id is 4528 2026-02-24T19:17:30.143 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.138+0000 7fb3e9212640 1 -- 10.20.193.14:0/777517800 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3e405de70 con 0x7fb3e4157b50 2026-02-24T19:17:30.150 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.140+0000 7fb3e9212640 1 -- 10.20.193.14:0/777517800 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1180927344 0 0) 0x7fb3cc003610 con 0x7fb3e4157780 2026-02-24T19:17:30.151 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.140+0000 7fb3e9212640 1 -- 10.20.193.14:0/777517800 >> v1:10.20.193.44:6789/0 conn(0x7fb3e4157b50 legacy=0x7fb3e41645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.151 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.140+0000 7fb3e9212640 1 -- 10.20.193.14:0/777517800 >> v1:10.20.193.14:6789/0 conn(0x7fb3e4164d00 legacy=0x7fb3e41c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.151 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.140+0000 7fb3e9212640 10 monclient: _finish_hunting 0 2026-02-24T19:17:30.151 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.140+0000 7fb3e9212640 1 monclient: found mon.noname-c 2026-02-24T19:17:30.151 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.140+0000 7fb3e9212640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:30.151 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.140+0000 7fb3e9212640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.151 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.140+0000 7fb3e9212640 1 -- 10.20.193.14:0/777517800 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3e40560e0 con 0x7fb3e4157780 2026-02-24T19:17:30.151 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.140+0000 7fb3e9212640 10 monclient: _finish_auth 0 2026-02-24T19:17:30.151 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.140+0000 7fb3e9212640 10 monclient: _check_auth_tickets 2026-02-24T19:17:30.151 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.140+0000 7fb3e9212640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:30.152 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.140+0000 7fb3e9212640 1 -- 10.20.193.14:0/777517800 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fb3d4002df0 con 0x7fb3e4157780 2026-02-24T19:17:30.152 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.140+0000 7fb3e9212640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.152 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.140+0000 7fb3e9212640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:30.152 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.140+0000 7fb3e9212640 10 monclient: dump: 2026-02-24T19:17:30.152 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.152 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.152 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.152 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.152 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.152 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.152 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.152 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.153 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.153 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.153 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.140+0000 7fb3ec49f640 5 monclient: authenticate success, global_id 4559 2026-02-24T19:17:30.153 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.140+0000 7fb3ec49f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:30.153 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.141+0000 7fb3e9212640 1 -- 10.20.193.14:0/777517800 <== mon.2 v1:10.20.193.170:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb3d4002fc0 con 0x7fb3e4157780 2026-02-24T19:17:30.153 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.141+0000 7fb3e9212640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:30.153 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.141+0000 7fb3e9212640 1 -- 10.20.193.14:0/777517800 <== mon.2 v1:10.20.193.170:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fb3d4003400 con 0x7fb3e4157780 2026-02-24T19:17:30.153 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.141+0000 7fb3e9212640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.153 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.141+0000 7fb3e9212640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:30.153 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.141+0000 7fb3e9212640 10 monclient: dump: 2026-02-24T19:17:30.153 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.153 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.154 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.154 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.154 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.154 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.154 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.154 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.154 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.154 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.154 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.141+0000 7fb3ec49f640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:30.154 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.141+0000 7fb3ec49f640 4 set_mon_vals no callback set 2026-02-24T19:17:30.154 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.141+0000 7fb3ec49f640 10 monclient: shutdown 2026-02-24T19:17:30.154 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.141+0000 7fb3ec49f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:30.155 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.141+0000 7fb3ec49f640 1 -- 10.20.193.14:0/777517800 >> v1:10.20.193.170:6789/0 conn(0x7fb3e4157780 legacy=0x7fb3e4056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.155 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.141+0000 7fb3ec49f640 1 -- 10.20.193.14:0/777517800 shutdown_connections 2026-02-24T19:17:30.155 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.141+0000 7fb3ec49f640 1 -- 10.20.193.14:0/777517800 >> 10.20.193.14:0/777517800 conn(0x7fb3e40b2ef0 msgr2=0x7fb3e40b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:30.155 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.141+0000 7fb3ec49f640 1 -- 10.20.193.14:0/777517800 shutdown_connections 2026-02-24T19:17:30.155 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.141+0000 7fb3ec49f640 1 -- 10.20.193.14:0/777517800 wait complete. 2026-02-24T19:17:30.155 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.141+0000 7fb3ec49f640 10 monclient: build_initial_monmap 2026-02-24T19:17:30.155 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.141+0000 7fb3ec49f640 10 monclient: monmap: 2026-02-24T19:17:30.155 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:30.155 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:30.155 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:30.155 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:30.155 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:30.155 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:30.156 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:30.156 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:30.156 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:30.156 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.156 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.142+0000 7fb3ec49f640 1 librados: starting msgr at 2026-02-24T19:17:30.156 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.142+0000 7fb3ec49f640 1 librados: starting objecter 2026-02-24T19:17:30.156 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.142+0000 7fb3ec49f640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:30.156 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.142+0000 7fb3ec49f640 1 Processor -- start 2026-02-24T19:17:30.156 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.142+0000 7fb3ec49f640 1 -- start start 2026-02-24T19:17:30.156 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.142+0000 7fb3ec49f640 1 librados: setting wanted keys 2026-02-24T19:17:30.156 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.142+0000 7fb3ec49f640 1 librados: calling monclient init 2026-02-24T19:17:30.156 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.142+0000 7fb3ec49f640 10 monclient: init 2026-02-24T19:17:30.156 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.142+0000 7fb3ec49f640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:30.157 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.142+0000 7fb3ec49f640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:30.157 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.142+0000 7fb3ec49f640 10 monclient(hunting): picked mon.noname-b con 0x7fb3e4157780 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:30.157 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.142+0000 7fb3ec49f640 10 monclient(hunting): picked mon.noname-c con 0x7fb3e4157b50 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:30.157 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.142+0000 7fb3ec49f640 10 monclient(hunting): picked mon.noname-a con 0x7fb3e4164d00 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:30.157 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.142+0000 7fb3ec49f640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3e4143ea0 con 0x7fb3e4164d00 2026-02-24T19:17:30.157 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.142+0000 7fb3ec49f640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3e4144180 con 0x7fb3e4157780 2026-02-24T19:17:30.157 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.142+0000 7fb3ec49f640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3e4144460 con 0x7fb3e4157b50 2026-02-24T19:17:30.157 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.142+0000 7fb3ec49f640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:30.157 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.142+0000 7fb3ec49f640 10 monclient(hunting): authenticate will time out at 3624.823625s 2026-02-24T19:17:30.157 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.142+0000 7fb3e9a13640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7fb3e4157b50 0x7fb3e413cbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:45298/0 (socket says 10.20.193.14:45298) 2026-02-24T19:17:30.157 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.142+0000 7fb3ea214640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7fb3e4157780 0x7fb3e4145220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:34930/0 (socket says 10.20.193.14:34930) 2026-02-24T19:17:30.157 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.142+0000 7fb3e9a13640 1 -- 10.20.193.14:0/4254005146 learned_addr learned my addr 10.20.193.14:0/4254005146 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:30.157 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.143+0000 7fb3caffd640 10 client.?.objecter ms_handle_connect 0x7fb3e4157b50 2026-02-24T19:17:30.158 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.143+0000 7fb3caffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.158 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.143+0000 7fb3caffd640 10 client.?.objecter ms_handle_connect 0x7fb3e4164d00 2026-02-24T19:17:30.158 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.143+0000 7fb3caffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.158 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.143+0000 7fb3caffd640 10 client.?.objecter ms_handle_connect 0x7fb3e4157780 2026-02-24T19:17:30.158 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.143+0000 7fb3caffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.158 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.144+0000 7fb3caffd640 1 -- 10.20.193.14:0/4254005146 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3082626345 0 0) 0x7fb3e4144460 con 0x7fb3e4157b50 2026-02-24T19:17:30.158 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.144+0000 7fb3caffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.158 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.144+0000 7fb3caffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.158 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.144+0000 7fb3caffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.158 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.144+0000 7fb3caffd640 10 monclient(hunting): my global_id is 4562 2026-02-24T19:17:30.158 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.144+0000 7fb3caffd640 1 -- 10.20.193.14:0/4254005146 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3b4003610 con 0x7fb3e4157b50 2026-02-24T19:17:30.158 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.144+0000 7fb3caffd640 1 -- 10.20.193.14:0/4254005146 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 139816972 0 0) 0x7fb3e4143ea0 con 0x7fb3e4164d00 2026-02-24T19:17:30.159 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.144+0000 7fb3caffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.159 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.144+0000 7fb3caffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.159 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.144+0000 7fb3caffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.159 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.144+0000 7fb3caffd640 10 monclient(hunting): my global_id is 4587 2026-02-24T19:17:30.159 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.144+0000 7fb3caffd640 1 -- 10.20.193.14:0/4254005146 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3e4144460 con 0x7fb3e4164d00 2026-02-24T19:17:30.159 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.144+0000 7fb3caffd640 1 -- 10.20.193.14:0/4254005146 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 944397489 0 0) 0x7fb3e4144180 con 0x7fb3e4157780 2026-02-24T19:17:30.159 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.144+0000 7fb3caffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.159 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.144+0000 7fb3caffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.159 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.144+0000 7fb3caffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.159 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.144+0000 7fb3caffd640 10 monclient(hunting): my global_id is 4531 2026-02-24T19:17:30.159 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.144+0000 7fb3caffd640 1 -- 10.20.193.14:0/4254005146 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3e4143ea0 con 0x7fb3e4157780 2026-02-24T19:17:30.159 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.146+0000 7fb3caffd640 1 -- 10.20.193.14:0/4254005146 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1890294817 0 0) 0x7fb3e4144460 con 0x7fb3e4164d00 2026-02-24T19:17:30.159 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.146+0000 7fb3caffd640 1 -- 10.20.193.14:0/4254005146 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb3e4144180 con 0x7fb3e4164d00 2026-02-24T19:17:30.160 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.146+0000 7fb3caffd640 1 -- 10.20.193.14:0/4254005146 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fb3e0003200 con 0x7fb3e4164d00 2026-02-24T19:17:30.160 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.146+0000 7fb3caffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:30.160 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.146+0000 7fb3caffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:30.160 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.146+0000 7fb3caffd640 10 monclient(hunting): dump: 2026-02-24T19:17:30.160 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.160 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.160 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.160 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.160 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.160 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.160 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.160 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.160 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.161 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.161 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.146+0000 7fb3caffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:30.161 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.146+0000 7fb3caffd640 1 -- 10.20.193.14:0/4254005146 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 395141065 0 0) 0x7fb3b4003610 con 0x7fb3e4157b50 2026-02-24T19:17:30.161 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.146+0000 7fb3caffd640 1 -- 10.20.193.14:0/4254005146 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb3e4144460 con 0x7fb3e4157b50 2026-02-24T19:17:30.161 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.146+0000 7fb3caffd640 1 -- 10.20.193.14:0/4254005146 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fb3d8003110 con 0x7fb3e4157b50 2026-02-24T19:17:30.161 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.146+0000 7fb3caffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:30.161 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.146+0000 7fb3caffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:30.161 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.146+0000 7fb3caffd640 10 monclient(hunting): dump: 2026-02-24T19:17:30.161 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.161 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.161 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.161 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.162 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.162 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.162 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.162 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.162 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.162 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.162 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.147+0000 7fb3caffd640 1 -- 10.20.193.14:0/4254005146 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2788138214 0 0) 0x7fb3e4143ea0 con 0x7fb3e4157780 2026-02-24T19:17:30.162 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.147+0000 7fb3caffd640 1 -- 10.20.193.14:0/4254005146 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb3b4003610 con 0x7fb3e4157780 2026-02-24T19:17:30.162 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.147+0000 7fb3caffd640 1 -- 10.20.193.14:0/4254005146 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fb3d4003310 con 0x7fb3e4157780 2026-02-24T19:17:30.162 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.147+0000 7fb3caffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:30.162 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.147+0000 7fb3caffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:30.162 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.147+0000 7fb3caffd640 10 monclient(hunting): dump: 2026-02-24T19:17:30.162 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.163 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.163 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.163 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.163 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.163 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.163 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.163 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.163 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.163 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.163 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.148+0000 7fb3caffd640 1 -- 10.20.193.14:0/4254005146 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1231316724 0 0) 0x7fb3e4144180 con 0x7fb3e4164d00 2026-02-24T19:17:30.163 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.148+0000 7fb3caffd640 1 -- 10.20.193.14:0/4254005146 >> v1:10.20.193.170:6789/0 conn(0x7fb3e4157b50 legacy=0x7fb3e413cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.163 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.148+0000 7fb3caffd640 1 -- 10.20.193.14:0/4254005146 >> v1:10.20.193.44:6789/0 conn(0x7fb3e4157780 legacy=0x7fb3e4145220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.164 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.148+0000 7fb3caffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:30.164 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.148+0000 7fb3caffd640 1 monclient: found mon.a 2026-02-24T19:17:30.164 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.148+0000 7fb3caffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:30.164 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.148+0000 7fb3caffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:30.164 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.148+0000 7fb3caffd640 1 -- 10.20.193.14:0/4254005146 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3e4144740 con 0x7fb3e4164d00 2026-02-24T19:17:30.164 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.148+0000 7fb3caffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:30.164 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.148+0000 7fb3caffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:30.164 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.148+0000 7fb3caffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:30.164 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.148+0000 7fb3ec49f640 5 monclient: authenticate success, global_id 4587 2026-02-24T19:17:30.164 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.148+0000 7fb3ec49f640 10 monclient: _renew_subs 2026-02-24T19:17:30.164 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.148+0000 7fb3ec49f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:30.164 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.148+0000 7fb3ec49f640 1 -- 10.20.193.14:0/4254005146 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb3e4144a20 con 0x7fb3e4164d00 2026-02-24T19:17:30.164 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.148+0000 7fb3ec49f640 10 client.4587.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:30.165 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.148+0000 7fb3ec49f640 10 monclient: _renew_subs 2026-02-24T19:17:30.165 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.148+0000 7fb3ec49f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:30.165 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.148+0000 7fb3ec49f640 1 -- 10.20.193.14:0/4254005146 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb3e4145930 con 0x7fb3e4164d00 2026-02-24T19:17:30.165 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.148+0000 7fb3ec49f640 1 librados: init done 2026-02-24T19:17:30.165 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.148+0000 7fb3ec49f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.165 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.148+0000 7fb3ec49f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.165 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.148+0000 7fb3ec49f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:30.165 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.148+0000 7fb3ec49f640 1 -- 10.20.193.14:0/4254005146 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3e405e250 con 0x7fb3e4164d00 2026-02-24T19:17:30.167 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-24T19:17:30.233 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.232+0000 7f3106c9f640 10 monclient: get_monmap_and_config 2026-02-24T19:17:30.233 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.232+0000 7f3106c9f640 10 monclient: build_initial_monmap 2026-02-24T19:17:30.234 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.232+0000 7f3106c9f640 10 monclient: monmap: 2026-02-24T19:17:30.234 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:30.234 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.234 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:30.233094+0000 2026-02-24T19:17:30.234 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:30.233094+0000 2026-02-24T19:17:30.234 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:30.234 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.234 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:30.234 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:30.234 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:30.234 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.236 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.232+0000 7f3106c9f640 1 Processor -- start 2026-02-24T19:17:30.237 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.232+0000 7f3106c9f640 1 -- start start 2026-02-24T19:17:30.237 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.232+0000 7f3106c9f640 10 monclient: init 2026-02-24T19:17:30.237 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.233+0000 7f3106c9f640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:30.237 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.233+0000 7f3106c9f640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:30.237 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.233+0000 7f3106c9f640 10 monclient(hunting): picked mon.noname-a con 0x7f3100157780 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:30.237 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.233+0000 7f3106c9f640 10 monclient(hunting): picked mon.noname-c con 0x7f3100157b50 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:30.237 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.233+0000 7f3106c9f640 10 monclient(hunting): picked mon.noname-b con 0x7f3100164d00 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:30.237 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.233+0000 7f3106c9f640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f310005de70 con 0x7f3100157780 2026-02-24T19:17:30.237 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.233+0000 7f3106c9f640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3100055b20 con 0x7f3100164d00 2026-02-24T19:17:30.237 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.233+0000 7f3106c9f640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3100055e00 con 0x7f3100157b50 2026-02-24T19:17:30.237 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.233+0000 7f3106c9f640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:30.238 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.233+0000 7f3106c9f640 10 monclient(hunting): authenticate will time out at 3624.914700s 2026-02-24T19:17:30.238 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.234+0000 7f3105215640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7f3100164d00 0x7f31001c5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:34940/0 (socket says 10.20.193.14:34940) 2026-02-24T19:17:30.238 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.234+0000 7f3105215640 1 -- 10.20.193.14:0/214000521 learned_addr learned my addr 10.20.193.14:0/214000521 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:30.238 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.235+0000 7f30f77fe640 1 -- 10.20.193.14:0/214000521 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4004253933 0 0) 0x7f3100055e00 con 0x7f3100157b50 2026-02-24T19:17:30.238 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.235+0000 7f30f77fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.238 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.235+0000 7f30f77fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.238 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.235+0000 7f30f77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.238 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.235+0000 7f30f77fe640 10 monclient(hunting): my global_id is 4565 2026-02-24T19:17:30.238 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.235+0000 7f30f77fe640 1 -- 10.20.193.14:0/214000521 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30ec003610 con 0x7f3100157b50 2026-02-24T19:17:30.238 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.235+0000 7f30f77fe640 1 -- 10.20.193.14:0/214000521 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 442494151 0 0) 0x7f3100055b20 con 0x7f3100164d00 2026-02-24T19:17:30.238 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.235+0000 7f30f77fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.238 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.235+0000 7f30f77fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.239 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.235+0000 7f30f77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.239 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.235+0000 7f30f77fe640 10 monclient(hunting): my global_id is 4534 2026-02-24T19:17:30.239 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.235+0000 7f30f77fe640 1 -- 10.20.193.14:0/214000521 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3100055e00 con 0x7f3100164d00 2026-02-24T19:17:30.243 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.237+0000 7f30f77fe640 1 -- 10.20.193.14:0/214000521 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1723256182 0 0) 0x7f30ec003610 con 0x7f3100157b50 2026-02-24T19:17:30.243 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.237+0000 7f30f77fe640 1 -- 10.20.193.14:0/214000521 >> v1:10.20.193.44:6789/0 conn(0x7f3100164d00 legacy=0x7f31001c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.243 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.237+0000 7f30f77fe640 1 -- 10.20.193.14:0/214000521 >> v1:10.20.193.14:6789/0 conn(0x7f3100157780 legacy=0x7f3100056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:30.243 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.237+0000 7f30f77fe640 10 monclient: _finish_hunting 0 2026-02-24T19:17:30.243 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.237+0000 7f30f77fe640 1 monclient: found mon.noname-c 2026-02-24T19:17:30.243 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.237+0000 7f30f77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:30.243 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.237+0000 7f30f77fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.243 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.237+0000 7f30f77fe640 1 -- 10.20.193.14:0/214000521 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31000560e0 con 0x7f3100157b50 2026-02-24T19:17:30.243 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.237+0000 7f30f77fe640 10 monclient: _finish_auth 0 2026-02-24T19:17:30.244 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.237+0000 7f30f77fe640 10 monclient: _check_auth_tickets 2026-02-24T19:17:30.244 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.237+0000 7f30f77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:30.244 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.237+0000 7f30f77fe640 1 -- 10.20.193.14:0/214000521 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f30e8002df0 con 0x7f3100157b50 2026-02-24T19:17:30.244 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.237+0000 7f30f77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.244 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.237+0000 7f30f77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:30.244 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.237+0000 7f30f77fe640 10 monclient: dump: 2026-02-24T19:17:30.244 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.244 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.244 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.244 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.244 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.244 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.245 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.245 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.245 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.245 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.245 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.237+0000 7f3106c9f640 5 monclient: authenticate success, global_id 4565 2026-02-24T19:17:30.245 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.237+0000 7f3106c9f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:30.245 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.237+0000 7f30f77fe640 1 -- 10.20.193.14:0/214000521 <== mon.2 v1:10.20.193.170:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f30e8002fc0 con 0x7f3100157b50 2026-02-24T19:17:30.245 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.237+0000 7f30f77fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:30.245 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.237+0000 7f30f77fe640 1 -- 10.20.193.14:0/214000521 <== mon.2 v1:10.20.193.170:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f30e8003400 con 0x7f3100157b50 2026-02-24T19:17:30.245 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.237+0000 7f3106c9f640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:30.245 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.237+0000 7f3106c9f640 4 set_mon_vals no callback set 2026-02-24T19:17:30.245 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.237+0000 7f30f77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.246 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.237+0000 7f30f77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:30.246 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.237+0000 7f30f77fe640 10 monclient: dump: 2026-02-24T19:17:30.246 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.246 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.246 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.246 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.246 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.246 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.246 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.246 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.246 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.246 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.246 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.238+0000 7f3106c9f640 10 monclient: shutdown 2026-02-24T19:17:30.247 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.238+0000 7f3106c9f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:30.247 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.238+0000 7f3106c9f640 1 -- 10.20.193.14:0/214000521 >> v1:10.20.193.170:6789/0 conn(0x7f3100157b50 legacy=0x7f31001645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.247 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.238+0000 7f3106c9f640 1 -- 10.20.193.14:0/214000521 shutdown_connections 2026-02-24T19:17:30.247 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.238+0000 7f3106c9f640 1 -- 10.20.193.14:0/214000521 >> 10.20.193.14:0/214000521 conn(0x7f31000b2ef0 msgr2=0x7f31000b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:30.247 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.238+0000 7f3106c9f640 1 -- 10.20.193.14:0/214000521 shutdown_connections 2026-02-24T19:17:30.247 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.238+0000 7f3106c9f640 1 -- 10.20.193.14:0/214000521 wait complete. 2026-02-24T19:17:30.247 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.238+0000 7f3106c9f640 10 monclient: build_initial_monmap 2026-02-24T19:17:30.247 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.238+0000 7f3106c9f640 10 monclient: monmap: 2026-02-24T19:17:30.247 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:30.247 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:30.247 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:30.247 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:30.247 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:30.248 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:30.248 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:30.248 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:30.248 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:30.248 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.248 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.239+0000 7f3106c9f640 1 librados: starting msgr at 2026-02-24T19:17:30.248 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.239+0000 7f3106c9f640 1 librados: starting objecter 2026-02-24T19:17:30.248 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.239+0000 7f3106c9f640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:30.248 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.239+0000 7f3106c9f640 1 Processor -- start 2026-02-24T19:17:30.248 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.239+0000 7f3106c9f640 1 -- start start 2026-02-24T19:17:30.248 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.239+0000 7f3106c9f640 1 librados: setting wanted keys 2026-02-24T19:17:30.248 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.239+0000 7f3106c9f640 1 librados: calling monclient init 2026-02-24T19:17:30.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.239+0000 7f3106c9f640 10 monclient: init 2026-02-24T19:17:30.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.239+0000 7f3106c9f640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:30.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.239+0000 7f3106c9f640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:30.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.239+0000 7f3106c9f640 10 monclient(hunting): picked mon.noname-a con 0x7f3100157780 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:30.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.239+0000 7f3106c9f640 10 monclient(hunting): picked mon.noname-c con 0x7f3100157b50 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:30.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.239+0000 7f3106c9f640 10 monclient(hunting): picked mon.noname-b con 0x7f3100164d00 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:30.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.239+0000 7f3106c9f640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31000af180 con 0x7f3100157780 2026-02-24T19:17:30.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.239+0000 7f3106c9f640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31000aebc0 con 0x7f3100164d00 2026-02-24T19:17:30.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.239+0000 7f3106c9f640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31000aeea0 con 0x7f3100157b50 2026-02-24T19:17:30.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.239+0000 7f3106c9f640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:30.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.239+0000 7f3106c9f640 10 monclient(hunting): authenticate will time out at 3624.920788s 2026-02-24T19:17:30.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.240+0000 7f3105215640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7f3100164d00 0x7f3100139910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:34956/0 (socket says 10.20.193.14:34956) 2026-02-24T19:17:30.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.240+0000 7f3105215640 1 -- 10.20.193.14:0/233859539 learned_addr learned my addr 10.20.193.14:0/233859539 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:30.250 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.240+0000 7f30f57fa640 10 client.?.objecter ms_handle_connect 0x7f3100164d00 2026-02-24T19:17:30.250 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.240+0000 7f30f57fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.250 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.240+0000 7f30f57fa640 10 client.?.objecter ms_handle_connect 0x7f3100157b50 2026-02-24T19:17:30.250 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.240+0000 7f30f57fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.251 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.241+0000 7fb3caffd640 1 -- 10.20.193.14:0/4254005146 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb3e0003880 con 0x7fb3e4164d00 2026-02-24T19:17:30.251 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.241+0000 7fb3caffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:30.251 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.241+0000 7fb3caffd640 1 -- 10.20.193.14:0/4254005146 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fb3e0003bd0 con 0x7fb3e4164d00 2026-02-24T19:17:30.251 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.241+0000 7fb3caffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.251 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.241+0000 7fb3caffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:30.251 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.241+0000 7fb3caffd640 10 monclient: dump: 2026-02-24T19:17:30.251 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.251 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.251 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.251 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.251 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.252 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.252 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.252 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.252 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.252 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.252 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.241+0000 7fb3e8a11640 4 set_mon_vals no callback set 2026-02-24T19:17:30.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.241+0000 7f30f57fa640 1 -- 10.20.193.14:0/233859539 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2297102621 0 0) 0x7f31000aeea0 con 0x7f3100157b50 2026-02-24T19:17:30.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.241+0000 7f30f57fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.241+0000 7f30f57fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.241+0000 7f30f57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.241+0000 7f30f57fa640 10 monclient(hunting): my global_id is 4568 2026-02-24T19:17:30.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.241+0000 7f30f57fa640 1 -- 10.20.193.14:0/233859539 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30d0003610 con 0x7f3100157b50 2026-02-24T19:17:30.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.241+0000 7f30f57fa640 1 -- 10.20.193.14:0/233859539 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2229263972 0 0) 0x7f31000aebc0 con 0x7f3100164d00 2026-02-24T19:17:30.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.241+0000 7f30f57fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.241+0000 7f30f57fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.254 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.241+0000 7f30f57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.254 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.241+0000 7f30f57fa640 10 monclient(hunting): my global_id is 4537 2026-02-24T19:17:30.254 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.241+0000 7f30f57fa640 1 -- 10.20.193.14:0/233859539 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31000aeea0 con 0x7f3100164d00 2026-02-24T19:17:30.255 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.241+0000 7fb3caffd640 1 -- 10.20.193.14:0/4254005146 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7fb3e001ca40 con 0x7fb3e4164d00 2026-02-24T19:17:30.255 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.242+0000 7fb3ea214640 10 monclient: get_auth_request con 0x7fb3b4077ea0 auth_method 0 2026-02-24T19:17:30.255 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.242+0000 7fb3caffd640 10 client.4587.objecter ms_handle_connect 0x7fb3b4077ea0 2026-02-24T19:17:30.257 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.243+0000 7f30f57fa640 1 -- 10.20.193.14:0/233859539 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1423715334 0 0) 0x7f30d0003610 con 0x7f3100157b50 2026-02-24T19:17:30.257 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.243+0000 7f30f57fa640 1 -- 10.20.193.14:0/233859539 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f31000aebc0 con 0x7f3100157b50 2026-02-24T19:17:30.257 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.243+0000 7f30f57fa640 1 -- 10.20.193.14:0/233859539 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f30e8003310 con 0x7f3100157b50 2026-02-24T19:17:30.257 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.243+0000 7f30f57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:30.257 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.243+0000 7f30f57fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:30.257 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.243+0000 7f30f57fa640 10 monclient(hunting): dump: 2026-02-24T19:17:30.257 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.257 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.258 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.258 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.258 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.258 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.258 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.258 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.258 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.258 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.258 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.243+0000 7f30f57fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:30.258 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.243+0000 7f30f57fa640 1 -- 10.20.193.14:0/233859539 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1290165585 0 0) 0x7f31000aeea0 con 0x7f3100164d00 2026-02-24T19:17:30.258 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.243+0000 7f30f57fa640 1 -- 10.20.193.14:0/233859539 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f30d0003610 con 0x7f3100164d00 2026-02-24T19:17:30.258 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.243+0000 7f30f57fa640 1 -- 10.20.193.14:0/233859539 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f30fc003460 con 0x7f3100164d00 2026-02-24T19:17:30.259 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.243+0000 7f30f57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:30.259 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.243+0000 7f30f57fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:30.259 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.243+0000 7f30f57fa640 10 monclient(hunting): dump: 2026-02-24T19:17:30.259 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.259 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.259 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.259 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.259 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.259 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.259 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.259 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.259 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.259 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.260 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.245+0000 7f30f57fa640 1 -- 10.20.193.14:0/233859539 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3697404650 0 0) 0x7f31000aebc0 con 0x7f3100157b50 2026-02-24T19:17:30.260 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.245+0000 7f30f57fa640 1 -- 10.20.193.14:0/233859539 >> v1:10.20.193.44:6789/0 conn(0x7f3100164d00 legacy=0x7f3100139910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.260 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.245+0000 7f30f57fa640 1 -- 10.20.193.14:0/233859539 >> v1:10.20.193.14:6789/0 conn(0x7f3100157780 legacy=0x7f3100156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.260 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.245+0000 7f30f57fa640 10 monclient: _finish_hunting 0 2026-02-24T19:17:30.260 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.245+0000 7f30f57fa640 1 monclient: found mon.c 2026-02-24T19:17:30.260 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.245+0000 7f30f57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:30.260 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.245+0000 7f30f57fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.260 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.245+0000 7f30f57fa640 1 -- 10.20.193.14:0/233859539 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3100138e30 con 0x7f3100157b50 2026-02-24T19:17:30.260 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.245+0000 7f30f57fa640 10 monclient: _finish_auth 0 2026-02-24T19:17:30.260 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.245+0000 7f30f57fa640 10 monclient: _check_auth_tickets 2026-02-24T19:17:30.260 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.245+0000 7f30f57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:30.260 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.245+0000 7f3106c9f640 5 monclient: authenticate success, global_id 4568 2026-02-24T19:17:30.261 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.245+0000 7f3106c9f640 10 monclient: _renew_subs 2026-02-24T19:17:30.261 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.245+0000 7f3106c9f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.261 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.245+0000 7f3106c9f640 1 -- 10.20.193.14:0/233859539 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3100139110 con 0x7f3100157b50 2026-02-24T19:17:30.261 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.245+0000 7f3106c9f640 10 client.4568.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:30.261 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.245+0000 7f3106c9f640 10 monclient: _renew_subs 2026-02-24T19:17:30.261 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.245+0000 7f3106c9f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.261 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.245+0000 7f3106c9f640 1 -- 10.20.193.14:0/233859539 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f310013a200 con 0x7f3100157b50 2026-02-24T19:17:30.261 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.245+0000 7f3106c9f640 1 librados: init done 2026-02-24T19:17:30.261 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.245+0000 7f3106c9f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.261 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.245+0000 7f3106c9f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.261 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.245+0000 7f3106c9f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.261 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.245+0000 7f3106c9f640 1 -- 10.20.193.14:0/233859539 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f310015ea20 con 0x7f3100157b50 2026-02-24T19:17:30.262 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.246+0000 7fb3caffd640 1 -- 10.20.193.14:0/4254005146 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7fb3e0092170 con 0x7fb3e4164d00 2026-02-24T19:17:30.262 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.246+0000 7fb3caffd640 10 client.4587.objecter ms_dispatch2 0x7fb3e4000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:30.262 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.246+0000 7fb3caffd640 3 client.4587.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:30.262 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.246+0000 7fb3caffd640 3 client.4587.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:30.263 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.246+0000 7fb3caffd640 20 client.4587.objecter dump_active .. 0 homeless 2026-02-24T19:17:30.263 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.246+0000 7fb3caffd640 1 -- 10.20.193.14:0/4254005146 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fb3e405e250 con 0x7fb3e4164d00 2026-02-24T19:17:30.263 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.246+0000 7fb3caffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.263 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.246+0000 7fb3caffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:30.264 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.253+0000 7f30f57fa640 1 -- 10.20.193.14:0/233859539 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f30e8002f70 con 0x7f3100157b50 2026-02-24T19:17:30.264 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.253+0000 7f30f57fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:30.264 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.253+0000 7f30f57fa640 1 -- 10.20.193.14:0/233859539 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f30e8003b00 con 0x7f3100157b50 2026-02-24T19:17:30.264 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.253+0000 7f30f57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.264 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.253+0000 7f30f57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:30.264 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.253+0000 7f30f57fa640 10 monclient: dump: 2026-02-24T19:17:30.264 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.264 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.265 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.265 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.265 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.265 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.265 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.265 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.265 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.265 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.265 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.253+0000 7f30f6ffd640 4 set_mon_vals no callback set 2026-02-24T19:17:30.265 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.254+0000 7f30f57fa640 1 -- 10.20.193.14:0/233859539 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f30e8003ce0 con 0x7f3100157b50 2026-02-24T19:17:30.265 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.255+0000 7f3104a14640 10 monclient: get_auth_request con 0x7f30d0077c40 auth_method 0 2026-02-24T19:17:30.265 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.255+0000 7f30f57fa640 10 client.4568.objecter ms_handle_connect 0x7f30d0077c40 2026-02-24T19:17:30.265 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.256+0000 7f30f57fa640 1 -- 10.20.193.14:0/233859539 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7f30e8092030 con 0x7f3100157b50 2026-02-24T19:17:30.266 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.256+0000 7f30f57fa640 10 client.4568.objecter ms_dispatch2 0x7f3100000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:30.266 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.256+0000 7f30f57fa640 3 client.4568.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:30.266 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.256+0000 7f30f57fa640 3 client.4568.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:30.266 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.256+0000 7f30f57fa640 20 client.4568.objecter dump_active .. 0 homeless 2026-02-24T19:17:30.328 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2026-02-24T19:17:30.342 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.341+0000 7f30f57fa640 1 -- 10.20.193.14:0/233859539 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f30e805ca60 con 0x7f3100157b50 2026-02-24T19:17:30.343 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.341+0000 7f30f57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.343 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.341+0000 7f30f57fa640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:30.354 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.353+0000 7fb3ec49f640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-24T19:17:30.354 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.353+0000 7fb3ec49f640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-24T19:17:30.354 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.353+0000 7fb3ec49f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:30.354 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.353+0000 7fb3ec49f640 1 -- 10.20.193.14:0/4254005146 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fb3e415f9c0 con 0x7fb3e4164d00 2026-02-24T19:17:30.374 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.373+0000 7fb3caffd640 1 -- 10.20.193.14:0/4254005146 <== mon.0 v1:10.20.193.14:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (unknown 1274345170 0 1840568361) 0x7fb3e005cba0 con 0x7fb3e4164d00 2026-02-24T19:17:30.374 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.373+0000 7fb3caffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-24T19:17:30.374 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.373+0000 7fb3caffd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:30.375 INFO:teuthology.orchestra.run.trial014.stdout:90194313222 2026-02-24T19:17:30.377 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.375+0000 7fb3ec49f640 10 librados: watch_flush enter 2026-02-24T19:17:30.378 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.375+0000 7fb3ec49f640 10 librados: watch_flush exit 2026-02-24T19:17:30.378 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.375+0000 7fb3ec49f640 20 client.4587.objecter shutdown clearing up homeless session... 2026-02-24T19:17:30.378 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.375+0000 7fb3ec49f640 10 client.4587.objecter successfully canceled tick 2026-02-24T19:17:30.378 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.375+0000 7fb3ec49f640 1 -- 10.20.193.14:0/4254005146 >> v1:10.20.193.14:6800/4014096310 conn(0x7fb3b4077ea0 legacy=0x7fb3b4098350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.378 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.375+0000 7fb3ec49f640 10 monclient: shutdown 2026-02-24T19:17:30.378 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.375+0000 7fb3ec49f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:30.378 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.375+0000 7fb3ec49f640 1 -- 10.20.193.14:0/4254005146 >> v1:10.20.193.14:6789/0 conn(0x7fb3e4164d00 legacy=0x7fb3e41482a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.378 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.376+0000 7fb3ec49f640 1 -- 10.20.193.14:0/4254005146 shutdown_connections 2026-02-24T19:17:30.378 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.376+0000 7fb3ec49f640 1 -- 10.20.193.14:0/4254005146 >> 10.20.193.14:0/4254005146 conn(0x7fb3e40b2ef0 msgr2=0x7fb3e40b0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:30.378 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.376+0000 7fb3ec49f640 1 -- 10.20.193.14:0/4254005146 shutdown_connections 2026-02-24T19:17:30.378 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.376+0000 7fb3ec49f640 1 -- 10.20.193.14:0/4254005146 wait complete. 2026-02-24T19:17:30.378 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.376+0000 7fb3ec49f640 1 librados: shutdown 2026-02-24T19:17:30.386 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313222 for osd.6 2026-02-24T19:17:30.386 DEBUG:teuthology.parallel:result is None 2026-02-24T19:17:30.398 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.397+0000 7f0094e3c640 10 monclient: get_monmap_and_config 2026-02-24T19:17:30.399 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.397+0000 7f0094e3c640 10 monclient: build_initial_monmap 2026-02-24T19:17:30.399 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.397+0000 7f0094e3c640 10 monclient: monmap: 2026-02-24T19:17:30.399 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:30.399 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.399 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:30.398158+0000 2026-02-24T19:17:30.399 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:30.398158+0000 2026-02-24T19:17:30.399 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:30.399 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.399 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:30.399 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:30.400 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:30.400 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.401 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.398+0000 7f0094e3c640 1 Processor -- start 2026-02-24T19:17:30.401 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.398+0000 7f0094e3c640 1 -- start start 2026-02-24T19:17:30.401 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.398+0000 7f0094e3c640 10 monclient: init 2026-02-24T19:17:30.401 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.398+0000 7f0094e3c640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:30.401 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.398+0000 7f0094e3c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:30.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.398+0000 7f0094e3c640 10 monclient(hunting): picked mon.noname-c con 0x7f00900b9f80 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:30.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.398+0000 7f0094e3c640 10 monclient(hunting): picked mon.noname-a con 0x7f00900ba350 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:30.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.398+0000 7f0094e3c640 10 monclient(hunting): picked mon.noname-b con 0x7f00900585e0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:30.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.398+0000 7f0094e3c640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0090163930 con 0x7f00900ba350 2026-02-24T19:17:30.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.398+0000 7f0094e3c640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0090163bb0 con 0x7f00900585e0 2026-02-24T19:17:30.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.398+0000 7f0094e3c640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0090163e90 con 0x7f00900b9f80 2026-02-24T19:17:30.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.398+0000 7f0094e3c640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:30.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.398+0000 7f0094e3c640 10 monclient(hunting): authenticate will time out at 3625.079696s 2026-02-24T19:17:30.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.398+0000 7f008e575640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7f00900b9f80 0x7f0090163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:45316/0 (socket says 10.20.193.14:45316) 2026-02-24T19:17:30.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.398+0000 7f008e575640 1 -- 10.20.193.14:0/1908100937 learned_addr learned my addr 10.20.193.14:0/1908100937 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:30.440 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.439+0000 7f008d573640 1 -- 10.20.193.14:0/1908100937 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3153362788 0 0) 0x7f0090163bb0 con 0x7f00900585e0 2026-02-24T19:17:30.440 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.439+0000 7f008d573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.440 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.439+0000 7f008d573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.440 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.439+0000 7f008d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.440 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.439+0000 7f008d573640 10 monclient(hunting): my global_id is 4540 2026-02-24T19:17:30.440 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.439+0000 7f008d573640 1 -- 10.20.193.14:0/1908100937 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f007c003610 con 0x7f00900585e0 2026-02-24T19:17:30.441 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.440+0000 7f008d573640 1 -- 10.20.193.14:0/1908100937 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2647022393 0 0) 0x7f0078002910 con 0x7f00900ba350 2026-02-24T19:17:30.441 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.440+0000 7f008d573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.441 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.440+0000 7f008d573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.441 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.440+0000 7f008d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.441 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.440+0000 7f008d573640 10 monclient(hunting): my global_id is 4590 2026-02-24T19:17:30.441 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.440+0000 7f008d573640 1 -- 10.20.193.14:0/1908100937 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0090163bb0 con 0x7f00900ba350 2026-02-24T19:17:30.443 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.440+0000 7f008d573640 1 -- 10.20.193.14:0/1908100937 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4168536065 0 0) 0x7f007c003610 con 0x7f00900585e0 2026-02-24T19:17:30.443 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.440+0000 7f008d573640 1 -- 10.20.193.14:0/1908100937 >> v1:10.20.193.170:6789/0 conn(0x7f00900b9f80 legacy=0x7f0090163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.443 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.440+0000 7f008d573640 1 -- 10.20.193.14:0/1908100937 >> v1:10.20.193.14:6789/0 conn(0x7f00900ba350 legacy=0x7f0090057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.443 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.440+0000 7f008d573640 10 monclient: _finish_hunting 0 2026-02-24T19:17:30.443 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.440+0000 7f008d573640 1 monclient: found mon.noname-b 2026-02-24T19:17:30.443 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.440+0000 7f008d573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:30.443 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.440+0000 7f008d573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.44:6789/0 2026-02-24T19:17:30.443 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.440+0000 7f008d573640 1 -- 10.20.193.14:0/1908100937 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00900573f0 con 0x7f00900585e0 2026-02-24T19:17:30.443 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.440+0000 7f008d573640 10 monclient: _finish_auth 0 2026-02-24T19:17:30.443 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.440+0000 7f008d573640 10 monclient: _check_auth_tickets 2026-02-24T19:17:30.444 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.440+0000 7f008d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:30.444 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.440+0000 7f0094e3c640 5 monclient: authenticate success, global_id 4540 2026-02-24T19:17:30.444 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.440+0000 7f0094e3c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:30.444 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.441+0000 7f008d573640 1 -- 10.20.193.14:0/1908100937 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f0080003170 con 0x7f00900585e0 2026-02-24T19:17:30.444 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.441+0000 7f008d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.444 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.441+0000 7f008d573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:30.444 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.441+0000 7f008d573640 10 monclient: dump: 2026-02-24T19:17:30.444 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.444 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.444 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.444 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.444 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.445 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.445 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.445 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.445 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.445 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.445 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.441+0000 7f0094e3c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:30.448 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.443+0000 7f008d573640 1 -- 10.20.193.14:0/1908100937 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f00800033c0 con 0x7f00900585e0 2026-02-24T19:17:30.449 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.443+0000 7f008d573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:30.449 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.443+0000 7f008d573640 1 -- 10.20.193.14:0/1908100937 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f0080003800 con 0x7f00900585e0 2026-02-24T19:17:30.449 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.443+0000 7f008d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.449 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.443+0000 7f008d573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:30.449 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.443+0000 7f008d573640 10 monclient: dump: 2026-02-24T19:17:30.449 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.449 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.449 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.449 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.449 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.449 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.449 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.450 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.450 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.450 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.450 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.443+0000 7f0094e3c640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:30.450 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.443+0000 7f0094e3c640 4 set_mon_vals no callback set 2026-02-24T19:17:30.450 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.444+0000 7f0094e3c640 10 monclient: shutdown 2026-02-24T19:17:30.450 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.444+0000 7f0094e3c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:30.450 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.444+0000 7f0094e3c640 1 -- 10.20.193.14:0/1908100937 >> v1:10.20.193.44:6789/0 conn(0x7f00900585e0 legacy=0x7f0090166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.450 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.444+0000 7f0094e3c640 1 -- 10.20.193.14:0/1908100937 shutdown_connections 2026-02-24T19:17:30.450 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.444+0000 7f0094e3c640 1 -- 10.20.193.14:0/1908100937 >> 10.20.193.14:0/1908100937 conn(0x7f00900b7990 msgr2=0x7f00900b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:30.450 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.444+0000 7f0094e3c640 1 -- 10.20.193.14:0/1908100937 shutdown_connections 2026-02-24T19:17:30.450 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.444+0000 7f0094e3c640 1 -- 10.20.193.14:0/1908100937 wait complete. 2026-02-24T19:17:30.451 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.444+0000 7f0094e3c640 10 monclient: build_initial_monmap 2026-02-24T19:17:30.451 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.444+0000 7f0094e3c640 10 monclient: monmap: 2026-02-24T19:17:30.451 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:30.451 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:30.451 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:30.451 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:30.451 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:30.451 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:30.451 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:30.451 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:30.451 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:30.451 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.452 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.444+0000 7f0094e3c640 1 librados: starting msgr at 2026-02-24T19:17:30.452 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.444+0000 7f0094e3c640 1 librados: starting objecter 2026-02-24T19:17:30.452 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.444+0000 7f0094e3c640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:30.452 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.444+0000 7f0094e3c640 1 Processor -- start 2026-02-24T19:17:30.452 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.444+0000 7f0094e3c640 1 -- start start 2026-02-24T19:17:30.452 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.444+0000 7f0094e3c640 1 librados: setting wanted keys 2026-02-24T19:17:30.452 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.444+0000 7f0094e3c640 1 librados: calling monclient init 2026-02-24T19:17:30.452 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.444+0000 7f0094e3c640 10 monclient: init 2026-02-24T19:17:30.452 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.445+0000 7f0094e3c640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:30.452 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.445+0000 7f0094e3c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:30.452 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.445+0000 7f0094e3c640 10 monclient(hunting): picked mon.noname-b con 0x7f00900585e0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:30.452 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.445+0000 7f0094e3c640 10 monclient(hunting): picked mon.noname-a con 0x7f00900b9f80 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:30.452 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.445+0000 7f0094e3c640 10 monclient(hunting): picked mon.noname-c con 0x7f00900ba350 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:30.453 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.445+0000 7f0094e3c640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00900b36f0 con 0x7f00900b9f80 2026-02-24T19:17:30.453 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.445+0000 7f0094e3c640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f009013abc0 con 0x7f00900585e0 2026-02-24T19:17:30.453 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.445+0000 7f0094e3c640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0090159d60 con 0x7f00900ba350 2026-02-24T19:17:30.453 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.445+0000 7f0094e3c640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:30.453 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.445+0000 7f0094e3c640 10 monclient(hunting): authenticate will time out at 3625.126331s 2026-02-24T19:17:30.453 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.445+0000 7f008dd74640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f00900b9f80 0x7f00900b4440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:55230/0 (socket says 10.20.193.14:55230) 2026-02-24T19:17:30.453 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.445+0000 7f008dd74640 1 -- 10.20.193.14:0/4280563149 learned_addr learned my addr 10.20.193.14:0/4280563149 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:30.453 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.445+0000 7f0076ffd640 10 client.?.objecter ms_handle_connect 0x7f00900b9f80 2026-02-24T19:17:30.453 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.445+0000 7f0076ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.453 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.446+0000 7f0076ffd640 10 client.?.objecter ms_handle_connect 0x7f00900ba350 2026-02-24T19:17:30.453 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.446+0000 7f0076ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.453 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.446+0000 7f0076ffd640 10 client.?.objecter ms_handle_connect 0x7f00900585e0 2026-02-24T19:17:30.453 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.446+0000 7f0076ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.454 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.446+0000 7f0076ffd640 1 -- 10.20.193.14:0/4280563149 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 533610308 0 0) 0x7f00900b36f0 con 0x7f00900b9f80 2026-02-24T19:17:30.454 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.446+0000 7f0076ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.454 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.446+0000 7f0076ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.454 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.446+0000 7f0076ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.454 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.446+0000 7f0076ffd640 10 monclient(hunting): my global_id is 4593 2026-02-24T19:17:30.454 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.446+0000 7f0076ffd640 1 -- 10.20.193.14:0/4280563149 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f005c003610 con 0x7f00900b9f80 2026-02-24T19:17:30.454 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.447+0000 7f0076ffd640 1 -- 10.20.193.14:0/4280563149 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 188579017 0 0) 0x7f0090159d60 con 0x7f00900ba350 2026-02-24T19:17:30.454 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.447+0000 7f0076ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.454 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.447+0000 7f0076ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.454 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.447+0000 7f0076ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.454 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.447+0000 7f0076ffd640 10 monclient(hunting): my global_id is 4574 2026-02-24T19:17:30.454 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.447+0000 7f0076ffd640 1 -- 10.20.193.14:0/4280563149 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00900b36f0 con 0x7f00900ba350 2026-02-24T19:17:30.455 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.447+0000 7f0076ffd640 1 -- 10.20.193.14:0/4280563149 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3576345238 0 0) 0x7f009013abc0 con 0x7f00900585e0 2026-02-24T19:17:30.455 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.447+0000 7f0076ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.455 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.447+0000 7f0076ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.455 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.447+0000 7f0076ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.455 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.447+0000 7f0076ffd640 10 monclient(hunting): my global_id is 4543 2026-02-24T19:17:30.455 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.447+0000 7f0076ffd640 1 -- 10.20.193.14:0/4280563149 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0090159d60 con 0x7f00900585e0 2026-02-24T19:17:30.458 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.449+0000 7f0076ffd640 1 -- 10.20.193.14:0/4280563149 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1678953499 0 0) 0x7f00900b36f0 con 0x7f00900ba350 2026-02-24T19:17:30.458 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.449+0000 7f0076ffd640 1 -- 10.20.193.14:0/4280563149 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f009013abc0 con 0x7f00900ba350 2026-02-24T19:17:30.458 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.449+0000 7f0076ffd640 1 -- 10.20.193.14:0/4280563149 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f0080003710 con 0x7f00900ba350 2026-02-24T19:17:30.458 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.449+0000 7f0076ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:30.458 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.449+0000 7f0076ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:30.458 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.449+0000 7f0076ffd640 10 monclient(hunting): dump: 2026-02-24T19:17:30.458 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.458 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.458 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.458 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.458 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.459 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.459 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.459 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.459 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.459 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.459 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.449+0000 7f0076ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:30.459 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.449+0000 7f0076ffd640 1 -- 10.20.193.14:0/4280563149 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2015403109 0 0) 0x7f005c003610 con 0x7f00900b9f80 2026-02-24T19:17:30.459 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.449+0000 7f0076ffd640 1 -- 10.20.193.14:0/4280563149 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f00900b36f0 con 0x7f00900b9f80 2026-02-24T19:17:30.459 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.449+0000 7f0076ffd640 1 -- 10.20.193.14:0/4280563149 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f00780031e0 con 0x7f00900b9f80 2026-02-24T19:17:30.459 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.449+0000 7f0076ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:30.459 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.449+0000 7f0076ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:30.459 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.449+0000 7f0076ffd640 10 monclient(hunting): dump: 2026-02-24T19:17:30.460 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.460 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.460 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.460 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.460 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.460 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.460 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.460 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.460 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.460 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.460 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.450+0000 7f0076ffd640 1 -- 10.20.193.14:0/4280563149 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 507222795 0 0) 0x7f0090159d60 con 0x7f00900585e0 2026-02-24T19:17:30.460 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.450+0000 7f0076ffd640 1 -- 10.20.193.14:0/4280563149 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f005c003610 con 0x7f00900585e0 2026-02-24T19:17:30.461 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.450+0000 7f0076ffd640 1 -- 10.20.193.14:0/4280563149 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f0084002fa0 con 0x7f00900585e0 2026-02-24T19:17:30.461 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.450+0000 7f0076ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:30.461 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.450+0000 7f0076ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:30.461 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.450+0000 7f0076ffd640 10 monclient(hunting): dump: 2026-02-24T19:17:30.461 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.461 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.461 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.461 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.461 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.461 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.461 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.461 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.462 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.462 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.462 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.451+0000 7f0076ffd640 1 -- 10.20.193.14:0/4280563149 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3664909111 0 0) 0x7f009013abc0 con 0x7f00900ba350 2026-02-24T19:17:30.462 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.451+0000 7f0076ffd640 1 -- 10.20.193.14:0/4280563149 >> v1:10.20.193.44:6789/0 conn(0x7f00900585e0 legacy=0x7f009013a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.462 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.451+0000 7f0076ffd640 1 -- 10.20.193.14:0/4280563149 >> v1:10.20.193.14:6789/0 conn(0x7f00900b9f80 legacy=0x7f00900b4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.462 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.451+0000 7f0076ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:30.462 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.451+0000 7f0076ffd640 1 monclient: found mon.c 2026-02-24T19:17:30.462 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.451+0000 7f0076ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:30.462 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.451+0000 7f0076ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.462 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.451+0000 7f0076ffd640 1 -- 10.20.193.14:0/4280563149 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f009015a040 con 0x7f00900ba350 2026-02-24T19:17:30.462 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.451+0000 7f0076ffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:30.462 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.451+0000 7f0076ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:30.463 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.451+0000 7f0076ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:30.463 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.451+0000 7f0094e3c640 5 monclient: authenticate success, global_id 4574 2026-02-24T19:17:30.463 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.451+0000 7f0094e3c640 10 monclient: _renew_subs 2026-02-24T19:17:30.463 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.451+0000 7f0094e3c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.463 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.451+0000 7f0094e3c640 1 -- 10.20.193.14:0/4280563149 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f00900b3960 con 0x7f00900ba350 2026-02-24T19:17:30.463 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.451+0000 7f0094e3c640 10 client.4574.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:30.463 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.451+0000 7f0094e3c640 10 monclient: _renew_subs 2026-02-24T19:17:30.463 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.451+0000 7f0094e3c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.463 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.451+0000 7f0094e3c640 1 -- 10.20.193.14:0/4280563149 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f00900b3f20 con 0x7f00900ba350 2026-02-24T19:17:30.463 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.451+0000 7f0094e3c640 1 librados: init done 2026-02-24T19:17:30.463 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.451+0000 7f0094e3c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.463 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.451+0000 7f0094e3c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.463 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.451+0000 7f0094e3c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.463 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.451+0000 7f0094e3c640 1 -- 10.20.193.14:0/4280563149 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00900559f0 con 0x7f00900ba350 2026-02-24T19:17:30.464 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.454+0000 7f3106c9f640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-24T19:17:30.464 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.454+0000 7f3106c9f640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-24T19:17:30.464 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.454+0000 7f3106c9f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.464 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.454+0000 7f3106c9f640 1 -- 10.20.193.14:0/233859539 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f310013bb60 con 0x7f3100157b50 2026-02-24T19:17:30.465 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.456+0000 7f0076ffd640 1 -- 10.20.193.14:0/4280563149 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f00800033c0 con 0x7f00900ba350 2026-02-24T19:17:30.466 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.456+0000 7f0076ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:30.466 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.456+0000 7f0076ffd640 1 -- 10.20.193.14:0/4280563149 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f0080003dd0 con 0x7f00900ba350 2026-02-24T19:17:30.466 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.456+0000 7f0076ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.466 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.456+0000 7f0076ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:30.466 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.456+0000 7f008cd72640 4 set_mon_vals no callback set 2026-02-24T19:17:30.466 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.456+0000 7f0076ffd640 10 monclient: dump: 2026-02-24T19:17:30.466 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.466 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.466 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.466 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.466 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.467 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.467 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.467 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.467 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.467 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.467 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.459+0000 7f0076ffd640 1 -- 10.20.193.14:0/4280563149 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f008001caa0 con 0x7f00900ba350 2026-02-24T19:17:30.467 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.460+0000 7f008e575640 10 monclient: get_auth_request con 0x7f005c077e20 auth_method 0 2026-02-24T19:17:30.467 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.460+0000 7f0076ffd640 10 client.4574.objecter ms_handle_connect 0x7f005c077e20 2026-02-24T19:17:30.467 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.460+0000 7f0076ffd640 1 -- 10.20.193.14:0/4280563149 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7f0080092270 con 0x7f00900ba350 2026-02-24T19:17:30.467 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.460+0000 7f0076ffd640 10 client.4574.objecter ms_dispatch2 0x7f0090000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:30.467 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.460+0000 7f0076ffd640 3 client.4574.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:30.468 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.460+0000 7f0076ffd640 3 client.4574.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:30.468 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.460+0000 7f0076ffd640 20 client.4574.objecter dump_active .. 0 homeless 2026-02-24T19:17:30.468 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.463+0000 7f30f57fa640 1 -- 10.20.193.14:0/233859539 <== mon.2 v1:10.20.193.170:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 1498640560) 0x7f30e805c360 con 0x7f3100157b50 2026-02-24T19:17:30.468 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.463+0000 7f30f57fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-24T19:17:30.468 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.463+0000 7f30f57fa640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:30.469 INFO:teuthology.orchestra.run.trial014.stdout:90194313221 2026-02-24T19:17:30.470 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.465+0000 7f3106c9f640 10 librados: watch_flush enter 2026-02-24T19:17:30.470 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.465+0000 7f3106c9f640 10 librados: watch_flush exit 2026-02-24T19:17:30.470 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.465+0000 7f3106c9f640 20 client.4568.objecter shutdown clearing up homeless session... 2026-02-24T19:17:30.470 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.465+0000 7f3106c9f640 10 client.4568.objecter successfully canceled tick 2026-02-24T19:17:30.470 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.465+0000 7f3106c9f640 1 -- 10.20.193.14:0/233859539 >> v1:10.20.193.14:6800/4014096310 conn(0x7f30d0077c40 legacy=0x7f30d00980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.470 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.465+0000 7f3106c9f640 10 monclient: shutdown 2026-02-24T19:17:30.470 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.465+0000 7f3106c9f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:30.471 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.465+0000 7f3106c9f640 1 -- 10.20.193.14:0/233859539 >> v1:10.20.193.170:6789/0 conn(0x7f3100157b50 legacy=0x7f31000ae280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.471 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.465+0000 7f3106c9f640 1 -- 10.20.193.14:0/233859539 shutdown_connections 2026-02-24T19:17:30.471 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.465+0000 7f3106c9f640 1 -- 10.20.193.14:0/233859539 >> 10.20.193.14:0/233859539 conn(0x7f31000b2ef0 msgr2=0x7f31000b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:30.471 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.465+0000 7f3106c9f640 1 -- 10.20.193.14:0/233859539 shutdown_connections 2026-02-24T19:17:30.471 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.465+0000 7f3106c9f640 1 -- 10.20.193.14:0/233859539 wait complete. 2026-02-24T19:17:30.471 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.465+0000 7f3106c9f640 1 librados: shutdown 2026-02-24T19:17:30.476 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313221 for osd.5 2026-02-24T19:17:30.476 DEBUG:teuthology.parallel:result is None 2026-02-24T19:17:30.514 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-24T19:17:30.515 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-24T19:17:30.519 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-24T19:17:30.521 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-24T19:17:30.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.548+0000 7f0076ffd640 1 -- 10.20.193.14:0/4280563149 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f008005cca0 con 0x7f00900ba350 2026-02-24T19:17:30.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.548+0000 7f0076ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.548+0000 7f0076ffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:30.586 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.585+0000 7f30a1abf640 10 monclient: get_monmap_and_config 2026-02-24T19:17:30.586 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.585+0000 7f30a1abf640 10 monclient: build_initial_monmap 2026-02-24T19:17:30.586 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.585+0000 7f30a1abf640 10 monclient: monmap: 2026-02-24T19:17:30.586 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:30.586 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.586 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:30.585721+0000 2026-02-24T19:17:30.587 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:30.585721+0000 2026-02-24T19:17:30.587 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:30.587 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.587 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:30.587 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:30.587 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:30.587 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.588 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.585+0000 7f30a1abf640 1 Processor -- start 2026-02-24T19:17:30.588 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.585+0000 7f30a1abf640 1 -- start start 2026-02-24T19:17:30.588 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.585+0000 7f30a1abf640 10 monclient: init 2026-02-24T19:17:30.588 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.585+0000 7f445a8e8640 10 monclient: get_monmap_and_config 2026-02-24T19:17:30.588 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.585+0000 7f445a8e8640 10 monclient: build_initial_monmap 2026-02-24T19:17:30.589 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.585+0000 7f445a8e8640 10 monclient: monmap: 2026-02-24T19:17:30.589 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:30.589 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.589 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:30.586462+0000 2026-02-24T19:17:30.589 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:30.586462+0000 2026-02-24T19:17:30.589 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:30.589 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.589 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:30.589 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:30.589 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:30.589 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.590 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.586+0000 7f30a1abf640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:30.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.586+0000 7f30a1abf640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:30.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.586+0000 7f30a1abf640 10 monclient(hunting): picked mon.noname-b con 0x7f309c157780 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:30.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.586+0000 7f30a1abf640 10 monclient(hunting): picked mon.noname-c con 0x7f309c157b50 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:30.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.586+0000 7f30a1abf640 10 monclient(hunting): picked mon.noname-a con 0x7f309c164d00 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:30.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.586+0000 7f30a1abf640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f309c05de70 con 0x7f309c164d00 2026-02-24T19:17:30.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.586+0000 7f30a1abf640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f309c055b20 con 0x7f309c157780 2026-02-24T19:17:30.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.586+0000 7f30a1abf640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f309c055e00 con 0x7f309c157b50 2026-02-24T19:17:30.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.586+0000 7f30a1abf640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:30.591 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.586+0000 7f30a1abf640 10 monclient(hunting): authenticate will time out at 3625.267140s 2026-02-24T19:17:30.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.586+0000 7f445a8e8640 1 Processor -- start 2026-02-24T19:17:30.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.586+0000 7f445a8e8640 1 -- start start 2026-02-24T19:17:30.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.586+0000 7f445a8e8640 10 monclient: init 2026-02-24T19:17:30.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.586+0000 7f309b7fe640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7f309c157780 0x7f309c056ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:34978/0 (socket says 10.20.193.14:34978) 2026-02-24T19:17:30.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.586+0000 7f309b7fe640 1 -- 10.20.193.14:0/4269012735 learned_addr learned my addr 10.20.193.14:0/4269012735 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:30.593 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.586+0000 7f445a8e8640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:30.594 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.586+0000 7f445a8e8640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:30.594 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.586+0000 7f445a8e8640 10 monclient(hunting): picked mon.noname-c con 0x7f44540b9f80 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:30.594 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.586+0000 7f445a8e8640 10 monclient(hunting): picked mon.noname-a con 0x7f44540ba350 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:30.594 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.586+0000 7f445a8e8640 10 monclient(hunting): picked mon.noname-b con 0x7f44540585e0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:30.594 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.586+0000 7f445a8e8640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4454163930 con 0x7f44540ba350 2026-02-24T19:17:30.594 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.586+0000 7f445a8e8640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4454163bb0 con 0x7f44540585e0 2026-02-24T19:17:30.594 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.586+0000 7f445a8e8640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4454163e90 con 0x7f44540b9f80 2026-02-24T19:17:30.594 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.586+0000 7f445a8e8640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:30.594 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.586+0000 7f445a8e8640 10 monclient(hunting): authenticate will time out at 3625.267948s 2026-02-24T19:17:30.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.587+0000 7f309a7fc640 1 -- 10.20.193.14:0/4269012735 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1808359284 0 0) 0x7f309c055e00 con 0x7f309c157b50 2026-02-24T19:17:30.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.587+0000 7f309a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.595 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.587+0000 7f309a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.587+0000 7f309a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.587+0000 7f309a7fc640 10 monclient(hunting): my global_id is 4577 2026-02-24T19:17:30.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.587+0000 7f309a7fc640 1 -- 10.20.193.14:0/4269012735 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3080003610 con 0x7f309c157b50 2026-02-24T19:17:30.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.587+0000 7f309a7fc640 1 -- 10.20.193.14:0/4269012735 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 681526255 0 0) 0x7f309c055b20 con 0x7f309c157780 2026-02-24T19:17:30.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.587+0000 7f309a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.587+0000 7f309a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.587+0000 7f309a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.587+0000 7f309a7fc640 10 monclient(hunting): my global_id is 4546 2026-02-24T19:17:30.596 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.587+0000 7f309a7fc640 1 -- 10.20.193.14:0/4269012735 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f309c055e00 con 0x7f309c157780 2026-02-24T19:17:30.597 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.588+0000 7f4458e5e640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7f44540585e0 0x7f4454166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:34988/0 (socket says 10.20.193.14:34988) 2026-02-24T19:17:30.597 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.588+0000 7f4458e5e640 1 -- 10.20.193.14:0/1502344863 learned_addr learned my addr 10.20.193.14:0/1502344863 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:30.598 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.588+0000 7f309a7fc640 1 -- 10.20.193.14:0/4269012735 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2129387029 0 0) 0x7f309c05de70 con 0x7f309c164d00 2026-02-24T19:17:30.598 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.588+0000 7f309a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.598 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.588+0000 7f309a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.598 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.588+0000 7f309a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.598 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.588+0000 7f309a7fc640 10 monclient(hunting): my global_id is 4596 2026-02-24T19:17:30.599 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.588+0000 7f309a7fc640 1 -- 10.20.193.14:0/4269012735 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f309c055b20 con 0x7f309c164d00 2026-02-24T19:17:30.599 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.590+0000 7f309a7fc640 1 -- 10.20.193.14:0/4269012735 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 70066368 0 0) 0x7f309c055e00 con 0x7f309c157780 2026-02-24T19:17:30.599 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.590+0000 7f309a7fc640 1 -- 10.20.193.14:0/4269012735 >> v1:10.20.193.170:6789/0 conn(0x7f309c157b50 legacy=0x7f309c1645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.599 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.590+0000 7f309a7fc640 1 -- 10.20.193.14:0/4269012735 >> v1:10.20.193.14:6789/0 conn(0x7f309c164d00 legacy=0x7f309c1c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.599 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.590+0000 7f309a7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:30.599 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.590+0000 7f309a7fc640 1 monclient: found mon.noname-b 2026-02-24T19:17:30.599 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.590+0000 7f309a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:30.599 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.590+0000 7f309a7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.44:6789/0 2026-02-24T19:17:30.599 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.590+0000 7f309a7fc640 1 -- 10.20.193.14:0/4269012735 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f309c0560e0 con 0x7f309c157780 2026-02-24T19:17:30.599 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.590+0000 7f309a7fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:30.599 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.590+0000 7f309a7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:30.599 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.590+0000 7f309a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:30.600 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.590+0000 7f309a7fc640 1 -- 10.20.193.14:0/4269012735 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f3088002df0 con 0x7f309c157780 2026-02-24T19:17:30.600 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.590+0000 7f309a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.600 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.590+0000 7f309a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:30.600 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.590+0000 7f309a7fc640 10 monclient: dump: 2026-02-24T19:17:30.600 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.600 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.600 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.600 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.600 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.600 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.600 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.600 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.600 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.601 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.601 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.590+0000 7f30a1abf640 5 monclient: authenticate success, global_id 4546 2026-02-24T19:17:30.601 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.590+0000 7f30a1abf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:30.602 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.591+0000 7f4452ffd640 1 -- 10.20.193.14:0/1502344863 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2229068696 0 0) 0x7f4444002910 con 0x7f44540ba350 2026-02-24T19:17:30.602 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.591+0000 7f4452ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.602 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.591+0000 7f4452ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.602 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.591+0000 7f4452ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.602 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.591+0000 7f4452ffd640 10 monclient(hunting): my global_id is 4599 2026-02-24T19:17:30.602 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.591+0000 7f4452ffd640 1 -- 10.20.193.14:0/1502344863 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4438003610 con 0x7f44540ba350 2026-02-24T19:17:30.602 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.591+0000 7f4452ffd640 1 -- 10.20.193.14:0/1502344863 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2272974799 0 0) 0x7f4454163e90 con 0x7f44540b9f80 2026-02-24T19:17:30.602 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.591+0000 7f4452ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.603 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.591+0000 7f4452ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.603 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.591+0000 7f4452ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.603 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.591+0000 7f4452ffd640 10 monclient(hunting): my global_id is 4580 2026-02-24T19:17:30.603 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.591+0000 7f4452ffd640 1 -- 10.20.193.14:0/1502344863 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4444002910 con 0x7f44540b9f80 2026-02-24T19:17:30.603 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.591+0000 7f4452ffd640 1 -- 10.20.193.14:0/1502344863 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3773464902 0 0) 0x7f4454163bb0 con 0x7f44540585e0 2026-02-24T19:17:30.603 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.591+0000 7f4452ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.603 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.591+0000 7f4452ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.603 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.591+0000 7f4452ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.603 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.591+0000 7f4452ffd640 10 monclient(hunting): my global_id is 4549 2026-02-24T19:17:30.603 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.591+0000 7f4452ffd640 1 -- 10.20.193.14:0/1502344863 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4454163e90 con 0x7f44540585e0 2026-02-24T19:17:30.605 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.591+0000 7f309a7fc640 1 -- 10.20.193.14:0/4269012735 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3088002fc0 con 0x7f309c157780 2026-02-24T19:17:30.605 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.591+0000 7f309a7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:30.605 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.591+0000 7f309a7fc640 1 -- 10.20.193.14:0/4269012735 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f3088003400 con 0x7f309c157780 2026-02-24T19:17:30.605 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.591+0000 7f309a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.605 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.591+0000 7f309a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:30.605 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.591+0000 7f309a7fc640 10 monclient: dump: 2026-02-24T19:17:30.605 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.605 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.606 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.606 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.606 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.606 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.606 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.606 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.606 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.606 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.591+0000 7f30a1abf640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:30.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.591+0000 7f30a1abf640 4 set_mon_vals no callback set 2026-02-24T19:17:30.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.591+0000 7f30a1abf640 10 monclient: shutdown 2026-02-24T19:17:30.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.591+0000 7f30a1abf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:30.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.591+0000 7f30a1abf640 1 -- 10.20.193.14:0/4269012735 >> v1:10.20.193.44:6789/0 conn(0x7f309c157780 legacy=0x7f309c056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.607 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.591+0000 7f30a1abf640 1 -- 10.20.193.14:0/4269012735 shutdown_connections 2026-02-24T19:17:30.607 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.592+0000 7f30a1abf640 1 -- 10.20.193.14:0/4269012735 >> 10.20.193.14:0/4269012735 conn(0x7f309c0b2ef0 msgr2=0x7f309c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:30.607 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.592+0000 7f30a1abf640 1 -- 10.20.193.14:0/4269012735 shutdown_connections 2026-02-24T19:17:30.607 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.592+0000 7f30a1abf640 1 -- 10.20.193.14:0/4269012735 wait complete. 2026-02-24T19:17:30.607 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.592+0000 7f30a1abf640 10 monclient: build_initial_monmap 2026-02-24T19:17:30.607 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.592+0000 7f30a1abf640 10 monclient: monmap: 2026-02-24T19:17:30.607 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:30.607 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:30.607 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:30.607 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:30.607 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:30.607 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:30.608 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:30.608 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:30.608 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:30.608 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.592+0000 7f30a1abf640 1 librados: starting msgr at 2026-02-24T19:17:30.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.592+0000 7f30a1abf640 1 librados: starting objecter 2026-02-24T19:17:30.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.592+0000 7f30a1abf640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:30.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.592+0000 7f30a1abf640 1 Processor -- start 2026-02-24T19:17:30.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.592+0000 7f30a1abf640 1 -- start start 2026-02-24T19:17:30.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.592+0000 7f30a1abf640 1 librados: setting wanted keys 2026-02-24T19:17:30.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.592+0000 7f30a1abf640 1 librados: calling monclient init 2026-02-24T19:17:30.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.592+0000 7f30a1abf640 10 monclient: init 2026-02-24T19:17:30.609 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2026-02-24T19:17:30.610 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.592+0000 7f4452ffd640 1 -- 10.20.193.14:0/1502344863 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3441378172 0 0) 0x7f4444002910 con 0x7f44540b9f80 2026-02-24T19:17:30.610 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.592+0000 7f4452ffd640 1 -- 10.20.193.14:0/1502344863 >> v1:10.20.193.44:6789/0 conn(0x7f44540585e0 legacy=0x7f4454166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.610 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.592+0000 7f4452ffd640 1 -- 10.20.193.14:0/1502344863 >> v1:10.20.193.14:6789/0 conn(0x7f44540ba350 legacy=0x7f4454057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.610 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.592+0000 7f4452ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:30.610 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.592+0000 7f4452ffd640 1 monclient: found mon.noname-c 2026-02-24T19:17:30.610 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.592+0000 7f4452ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:30.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.592+0000 7f4452ffd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.592+0000 7f4452ffd640 1 -- 10.20.193.14:0/1502344863 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44540573f0 con 0x7f44540b9f80 2026-02-24T19:17:30.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.592+0000 7f4452ffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:30.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.592+0000 7f4452ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:30.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.592+0000 7f4452ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:30.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.592+0000 7f4452ffd640 1 -- 10.20.193.14:0/1502344863 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4440002df0 con 0x7f44540b9f80 2026-02-24T19:17:30.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.592+0000 7f4452ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.592+0000 7f4452ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:30.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.592+0000 7f4452ffd640 10 monclient: dump: 2026-02-24T19:17:30.611 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.611 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.612 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.612 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.612 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.612 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.612 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.612 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.612 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.612 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.612 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.592+0000 7f445a8e8640 5 monclient: authenticate success, global_id 4580 2026-02-24T19:17:30.612 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.592+0000 7f445a8e8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:30.613 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.593+0000 7f30a1abf640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:30.613 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.593+0000 7f30a1abf640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:30.614 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.593+0000 7f30a1abf640 10 monclient(hunting): picked mon.noname-b con 0x7f309c157780 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:30.614 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.593+0000 7f30a1abf640 10 monclient(hunting): picked mon.noname-c con 0x7f309c157b50 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:30.614 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.593+0000 7f30a1abf640 10 monclient(hunting): picked mon.noname-a con 0x7f309c164d00 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:30.614 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.593+0000 7f30a1abf640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f309c0af9a0 con 0x7f309c164d00 2026-02-24T19:17:30.614 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.593+0000 7f30a1abf640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f309c13ef90 con 0x7f309c157780 2026-02-24T19:17:30.614 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.593+0000 7f30a1abf640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f309c13f270 con 0x7f309c157b50 2026-02-24T19:17:30.614 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.593+0000 7f30a1abf640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:30.614 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.593+0000 7f30a1abf640 10 monclient(hunting): authenticate will time out at 3625.274299s 2026-02-24T19:17:30.615 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.593+0000 7f4452ffd640 1 -- 10.20.193.14:0/1502344863 <== mon.2 v1:10.20.193.170:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4440002fc0 con 0x7f44540b9f80 2026-02-24T19:17:30.615 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.593+0000 7f4452ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:30.615 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.593+0000 7f4452ffd640 1 -- 10.20.193.14:0/1502344863 <== mon.2 v1:10.20.193.170:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4440003400 con 0x7f44540b9f80 2026-02-24T19:17:30.615 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.593+0000 7f4452ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.615 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.593+0000 7f4452ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:30.615 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.593+0000 7f4452ffd640 10 monclient: dump: 2026-02-24T19:17:30.615 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.615 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.615 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.616 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.616 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.616 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.616 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.616 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.616 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.616 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.616 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.593+0000 7f445a8e8640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:30.616 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.593+0000 7f445a8e8640 4 set_mon_vals no callback set 2026-02-24T19:17:30.616 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.593+0000 7f309b7fe640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7f309c157780 0x7f309c13e780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:34996/0 (socket says 10.20.193.14:34996) 2026-02-24T19:17:30.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.593+0000 7f309b7fe640 1 -- 10.20.193.14:0/3903178311 learned_addr learned my addr 10.20.193.14:0/3903178311 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:30.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.594+0000 7f445a8e8640 10 monclient: shutdown 2026-02-24T19:17:30.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.594+0000 7f445a8e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:30.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.594+0000 7f445a8e8640 1 -- 10.20.193.14:0/1502344863 >> v1:10.20.193.170:6789/0 conn(0x7f44540b9f80 legacy=0x7f4454163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.594+0000 7f445a8e8640 1 -- 10.20.193.14:0/1502344863 shutdown_connections 2026-02-24T19:17:30.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.594+0000 7f445a8e8640 1 -- 10.20.193.14:0/1502344863 >> 10.20.193.14:0/1502344863 conn(0x7f44540b7990 msgr2=0x7f44540b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:30.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.594+0000 7f445a8e8640 1 -- 10.20.193.14:0/1502344863 shutdown_connections 2026-02-24T19:17:30.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.594+0000 7f445a8e8640 1 -- 10.20.193.14:0/1502344863 wait complete. 2026-02-24T19:17:30.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.594+0000 7f3077fff640 10 client.?.objecter ms_handle_connect 0x7f309c157b50 2026-02-24T19:17:30.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.594+0000 7f3077fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.594+0000 7f3077fff640 10 client.?.objecter ms_handle_connect 0x7f309c157780 2026-02-24T19:17:30.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.594+0000 7f3077fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.619 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2026-02-24T19:17:30.620 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.594+0000 7f445a8e8640 10 monclient: build_initial_monmap 2026-02-24T19:17:30.620 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.594+0000 7f445a8e8640 10 monclient: monmap: 2026-02-24T19:17:30.620 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:30.620 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:30.620 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:30.620 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:30.620 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:30.620 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:30.620 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:30.620 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:30.621 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:30.621 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.595+0000 7f445a8e8640 1 librados: starting msgr at 2026-02-24T19:17:30.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.595+0000 7f445a8e8640 1 librados: starting objecter 2026-02-24T19:17:30.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.595+0000 7f445a8e8640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:30.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.595+0000 7f445a8e8640 1 Processor -- start 2026-02-24T19:17:30.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.595+0000 7f3077fff640 10 client.?.objecter ms_handle_connect 0x7f309c164d00 2026-02-24T19:17:30.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.595+0000 7f3077fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.595+0000 7f445a8e8640 1 -- start start 2026-02-24T19:17:30.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.595+0000 7f445a8e8640 1 librados: setting wanted keys 2026-02-24T19:17:30.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.595+0000 7f445a8e8640 1 librados: calling monclient init 2026-02-24T19:17:30.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.595+0000 7f445a8e8640 10 monclient: init 2026-02-24T19:17:30.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.595+0000 7f3077fff640 1 -- 10.20.193.14:0/3903178311 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 585481425 0 0) 0x7f309c13f270 con 0x7f309c157b50 2026-02-24T19:17:30.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.595+0000 7f3077fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.595+0000 7f3077fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.595+0000 7f3077fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.595+0000 7f3077fff640 10 monclient(hunting): my global_id is 4583 2026-02-24T19:17:30.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.595+0000 7f3077fff640 1 -- 10.20.193.14:0/3903178311 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f306c003610 con 0x7f309c157b50 2026-02-24T19:17:30.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.595+0000 7f445a8e8640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:30.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.595+0000 7f445a8e8640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:30.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.595+0000 7f445a8e8640 10 monclient(hunting): picked mon.noname-b con 0x7f44540585e0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:30.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.595+0000 7f445a8e8640 10 monclient(hunting): picked mon.noname-a con 0x7f44540b9f80 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:30.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.595+0000 7f445a8e8640 10 monclient(hunting): picked mon.noname-c con 0x7f44540ba350 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:30.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.595+0000 7f445a8e8640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44540b2bf0 con 0x7f44540b9f80 2026-02-24T19:17:30.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.595+0000 7f445a8e8640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44540b3b00 con 0x7f44540585e0 2026-02-24T19:17:30.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.595+0000 7f445a8e8640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44540b3de0 con 0x7f44540ba350 2026-02-24T19:17:30.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.595+0000 7f445a8e8640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:30.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.595+0000 7f445a8e8640 10 monclient(hunting): authenticate will time out at 3625.276759s 2026-02-24T19:17:30.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.595+0000 7f3077fff640 1 -- 10.20.193.14:0/3903178311 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 954328276 0 0) 0x7f309c13ef90 con 0x7f309c157780 2026-02-24T19:17:30.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.595+0000 7f3077fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.595+0000 7f3077fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.595+0000 7f3077fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.595+0000 7f3077fff640 10 monclient(hunting): my global_id is 4552 2026-02-24T19:17:30.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.595+0000 7f3077fff640 1 -- 10.20.193.14:0/3903178311 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f309c13f270 con 0x7f309c157780 2026-02-24T19:17:30.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.596+0000 7f3077fff640 1 -- 10.20.193.14:0/3903178311 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1024945929 0 0) 0x7f309c0af9a0 con 0x7f309c164d00 2026-02-24T19:17:30.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.596+0000 7f3077fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.596+0000 7f3077fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.596+0000 7f3077fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.596+0000 7f3077fff640 10 monclient(hunting): my global_id is 4602 2026-02-24T19:17:30.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.596+0000 7f4453fff640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7f44540585e0 0x7f44541629d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:34998/0 (socket says 10.20.193.14:34998) 2026-02-24T19:17:30.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.596+0000 7f3077fff640 1 -- 10.20.193.14:0/3903178311 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f309c13ef90 con 0x7f309c164d00 2026-02-24T19:17:30.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.596+0000 7f4453fff640 1 -- 10.20.193.14:0/3515511597 learned_addr learned my addr 10.20.193.14:0/3515511597 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:30.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.596+0000 7f4450ff9640 10 client.?.objecter ms_handle_connect 0x7f44540585e0 2026-02-24T19:17:30.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.596+0000 7f4450ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.598+0000 7f3077fff640 1 -- 10.20.193.14:0/3903178311 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1352482833 0 0) 0x7f306c003610 con 0x7f309c157b50 2026-02-24T19:17:30.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.598+0000 7f3077fff640 1 -- 10.20.193.14:0/3903178311 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f309c0af9a0 con 0x7f309c157b50 2026-02-24T19:17:30.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.598+0000 7f3077fff640 1 -- 10.20.193.14:0/3903178311 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f308c0030b0 con 0x7f309c157b50 2026-02-24T19:17:30.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.598+0000 7f3077fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:30.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.598+0000 7f3077fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:30.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.598+0000 7f3077fff640 10 monclient(hunting): dump: 2026-02-24T19:17:30.627 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.627 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.627 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.627 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.627 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.628 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.628 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.628 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.628 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.628 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.598+0000 7f3077fff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:30.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.599+0000 7f3077fff640 1 -- 10.20.193.14:0/3903178311 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4252297920 0 0) 0x7f309c13f270 con 0x7f309c157780 2026-02-24T19:17:30.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.599+0000 7f3077fff640 1 -- 10.20.193.14:0/3903178311 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f306c003610 con 0x7f309c157780 2026-02-24T19:17:30.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.599+0000 7f4450ff9640 10 client.?.objecter ms_handle_connect 0x7f44540b9f80 2026-02-24T19:17:30.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.599+0000 7f4450ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.599+0000 7f3077fff640 1 -- 10.20.193.14:0/3903178311 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3454442758 0 0) 0x7f309c13ef90 con 0x7f309c164d00 2026-02-24T19:17:30.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.599+0000 7f3077fff640 1 -- 10.20.193.14:0/3903178311 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f309c13f270 con 0x7f309c164d00 2026-02-24T19:17:30.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.599+0000 7f3077fff640 1 -- 10.20.193.14:0/3903178311 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f3090003330 con 0x7f309c164d00 2026-02-24T19:17:30.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.599+0000 7f3077fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:30.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.599+0000 7f3077fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:30.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.599+0000 7f3077fff640 10 monclient(hunting): dump: 2026-02-24T19:17:30.629 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.629 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.629 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.629 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.629 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.629 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.629 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.629 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.629 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.630 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.600+0000 7f4450ff9640 10 client.?.objecter ms_handle_connect 0x7f44540ba350 2026-02-24T19:17:30.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.600+0000 7f4450ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.630 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2026-02-24T19:17:30.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.600+0000 7f3077fff640 1 -- 10.20.193.14:0/3903178311 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f3088003450 con 0x7f309c157780 2026-02-24T19:17:30.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.600+0000 7f3077fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:30.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.600+0000 7f3077fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:30.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.600+0000 7f3077fff640 10 monclient(hunting): dump: 2026-02-24T19:17:30.632 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.632 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.632 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.632 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.632 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.632 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.632 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.632 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.632 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.632 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.600+0000 7f3077fff640 1 -- 10.20.193.14:0/3903178311 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1472709414 0 0) 0x7f309c0af9a0 con 0x7f309c157b50 2026-02-24T19:17:30.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.600+0000 7f3077fff640 1 -- 10.20.193.14:0/3903178311 >> v1:10.20.193.44:6789/0 conn(0x7f309c157780 legacy=0x7f309c13e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.600+0000 7f3077fff640 1 -- 10.20.193.14:0/3903178311 >> v1:10.20.193.14:6789/0 conn(0x7f309c164d00 legacy=0x7f309c13ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.600+0000 7f3077fff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:30.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.600+0000 7f3077fff640 1 monclient: found mon.c 2026-02-24T19:17:30.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.600+0000 7f3077fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:30.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.600+0000 7f3077fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.600+0000 7f3077fff640 1 -- 10.20.193.14:0/3903178311 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f309c0afc10 con 0x7f309c157b50 2026-02-24T19:17:30.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.600+0000 7f3077fff640 10 monclient: _finish_auth 0 2026-02-24T19:17:30.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.600+0000 7f3077fff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:30.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.600+0000 7f3077fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:30.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.600+0000 7f30a1abf640 5 monclient: authenticate success, global_id 4583 2026-02-24T19:17:30.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.600+0000 7f30a1abf640 10 monclient: _renew_subs 2026-02-24T19:17:30.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.600+0000 7f30a1abf640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.600+0000 7f30a1abf640 1 -- 10.20.193.14:0/3903178311 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f309c0afef0 con 0x7f309c157b50 2026-02-24T19:17:30.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.600+0000 7f30a1abf640 10 client.4583.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:30.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.600+0000 7f30a1abf640 10 monclient: _renew_subs 2026-02-24T19:17:30.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.600+0000 7f30a1abf640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.600+0000 7f30a1abf640 1 -- 10.20.193.14:0/3903178311 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f309c058480 con 0x7f309c157b50 2026-02-24T19:17:30.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.600+0000 7f30a1abf640 1 librados: init done 2026-02-24T19:17:30.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.600+0000 7f4450ff9640 1 -- 10.20.193.14:0/3515511597 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 50171288 0 0) 0x7f44540b3b00 con 0x7f44540585e0 2026-02-24T19:17:30.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.600+0000 7f4450ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.600+0000 7f4450ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.600+0000 7f4450ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.600+0000 7f4450ff9640 10 monclient(hunting): my global_id is 4555 2026-02-24T19:17:30.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.600+0000 7f4450ff9640 1 -- 10.20.193.14:0/3515511597 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4424003610 con 0x7f44540585e0 2026-02-24T19:17:30.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.600+0000 7f30a1abf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.600+0000 7f30a1abf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.600+0000 7f30a1abf640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.600+0000 7f30a1abf640 1 -- 10.20.193.14:0/3903178311 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f309c13c7e0 con 0x7f309c157b50 2026-02-24T19:17:30.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.601+0000 7f4450ff9640 1 -- 10.20.193.14:0/3515511597 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 719235548 0 0) 0x7f44540b3de0 con 0x7f44540ba350 2026-02-24T19:17:30.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.601+0000 7f4450ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.601+0000 7f4450ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.601+0000 7f4450ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.601+0000 7f4450ff9640 10 monclient(hunting): my global_id is 4586 2026-02-24T19:17:30.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.601+0000 7f4450ff9640 1 -- 10.20.193.14:0/3515511597 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44540b3b00 con 0x7f44540ba350 2026-02-24T19:17:30.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.601+0000 7f4450ff9640 1 -- 10.20.193.14:0/3515511597 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3544179610 0 0) 0x7f44540b2bf0 con 0x7f44540b9f80 2026-02-24T19:17:30.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.601+0000 7f4450ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.601+0000 7f4450ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.601+0000 7f4450ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.601+0000 7f4450ff9640 10 monclient(hunting): my global_id is 4605 2026-02-24T19:17:30.638 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.601+0000 7f4450ff9640 1 -- 10.20.193.14:0/3515511597 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44540b3de0 con 0x7f44540b9f80 2026-02-24T19:17:30.639 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.604+0000 7f4450ff9640 1 -- 10.20.193.14:0/3515511597 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1410869362 0 0) 0x7f44540b3de0 con 0x7f44540b9f80 2026-02-24T19:17:30.639 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.604+0000 7f4450ff9640 1 -- 10.20.193.14:0/3515511597 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f44540b2bf0 con 0x7f44540b9f80 2026-02-24T19:17:30.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.604+0000 7f4450ff9640 1 -- 10.20.193.14:0/3515511597 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3958887397 0 0) 0x7f4424003610 con 0x7f44540585e0 2026-02-24T19:17:30.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.604+0000 7f4450ff9640 1 -- 10.20.193.14:0/3515511597 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f44540b3de0 con 0x7f44540585e0 2026-02-24T19:17:30.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.604+0000 7f4450ff9640 1 -- 10.20.193.14:0/3515511597 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f44400033d0 con 0x7f44540585e0 2026-02-24T19:17:30.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.604+0000 7f4450ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:30.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.604+0000 7f4450ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:30.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.604+0000 7f4450ff9640 10 monclient(hunting): dump: 2026-02-24T19:17:30.640 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.640 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.640 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.640 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.640 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.640 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.640 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.640 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.640 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.640 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.604+0000 7f4450ff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:30.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.604+0000 7f4450ff9640 1 -- 10.20.193.14:0/3515511597 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f44440030b0 con 0x7f44540b9f80 2026-02-24T19:17:30.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.604+0000 7f4450ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:30.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.604+0000 7f4450ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:30.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.604+0000 7f4450ff9640 10 monclient(hunting): dump: 2026-02-24T19:17:30.641 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.641 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.641 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.641 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.641 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.641 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.641 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.641 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.641 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.641 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.606+0000 7f4450ff9640 1 -- 10.20.193.14:0/3515511597 <== mon.1 v1:10.20.193.44:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3369919203 0 0) 0x7f44540b3de0 con 0x7f44540585e0 2026-02-24T19:17:30.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.606+0000 7f4450ff9640 1 -- 10.20.193.14:0/3515511597 >> v1:10.20.193.170:6789/0 conn(0x7f44540ba350 legacy=0x7f44540b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.606+0000 7f4450ff9640 1 -- 10.20.193.14:0/3515511597 >> v1:10.20.193.14:6789/0 conn(0x7f44540b9f80 legacy=0x7f4454165c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.606+0000 7f4450ff9640 10 monclient: _finish_hunting 0 2026-02-24T19:17:30.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.606+0000 7f4450ff9640 1 monclient: found mon.b 2026-02-24T19:17:30.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.606+0000 7f4450ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:30.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.606+0000 7f4450ff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:30.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.606+0000 7f4450ff9640 1 -- 10.20.193.14:0/3515511597 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44540b40c0 con 0x7f44540585e0 2026-02-24T19:17:30.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.606+0000 7f4450ff9640 10 monclient: _finish_auth 0 2026-02-24T19:17:30.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.606+0000 7f4450ff9640 10 monclient: _check_auth_tickets 2026-02-24T19:17:30.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.606+0000 7f4450ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:30.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.606+0000 7f445a8e8640 5 monclient: authenticate success, global_id 4555 2026-02-24T19:17:30.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.606+0000 7f445a8e8640 10 monclient: _renew_subs 2026-02-24T19:17:30.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.606+0000 7f445a8e8640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:30.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.606+0000 7f445a8e8640 1 -- 10.20.193.14:0/3515511597 --> v1:10.20.193.44:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f44540b43a0 con 0x7f44540585e0 2026-02-24T19:17:30.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.606+0000 7f445a8e8640 10 client.4555.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:30.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.606+0000 7f445a8e8640 10 monclient: _renew_subs 2026-02-24T19:17:30.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.606+0000 7f445a8e8640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:30.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.606+0000 7f445a8e8640 1 -- 10.20.193.14:0/3515511597 --> v1:10.20.193.44:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f44541630e0 con 0x7f44540585e0 2026-02-24T19:17:30.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.606+0000 7f445a8e8640 1 librados: init done 2026-02-24T19:17:30.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.606+0000 7f445a8e8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.606+0000 7f445a8e8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.606+0000 7f445a8e8640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:30.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.606+0000 7f445a8e8640 1 -- 10.20.193.14:0/3515511597 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44540b64c0 con 0x7f44540585e0 2026-02-24T19:17:30.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.614+0000 7f4450ff9640 1 -- 10.20.193.14:0/3515511597 <== mon.1 v1:10.20.193.44:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4440002fc0 con 0x7f44540585e0 2026-02-24T19:17:30.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.614+0000 7f4450ff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:30.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.614+0000 7f4450ff9640 1 -- 10.20.193.14:0/3515511597 <== mon.1 v1:10.20.193.44:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4440003b00 con 0x7f44540585e0 2026-02-24T19:17:30.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.614+0000 7f4450ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.614+0000 7f4450ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:30.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.614+0000 7f44527fc640 4 set_mon_vals no callback set 2026-02-24T19:17:30.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.614+0000 7f4450ff9640 10 monclient: dump: 2026-02-24T19:17:30.642 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.642 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.642 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.642 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.643 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.643 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.643 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.643 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.643 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.643 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.615+0000 7f4450ff9640 1 -- 10.20.193.14:0/3515511597 <== mon.1 v1:10.20.193.44:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f4440003ca0 con 0x7f44540585e0 2026-02-24T19:17:30.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.615+0000 7f44537fe640 10 monclient: get_auth_request con 0x7f4424077d50 auth_method 0 2026-02-24T19:17:30.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.615+0000 7f4450ff9640 10 client.4555.objecter ms_handle_connect 0x7f4424077d50 2026-02-24T19:17:30.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.616+0000 7f4450ff9640 1 -- 10.20.193.14:0/3515511597 <== mon.1 v1:10.20.193.44:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7f4440093280 con 0x7f44540585e0 2026-02-24T19:17:30.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.616+0000 7f4450ff9640 10 client.4555.objecter ms_dispatch2 0x7f4454000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:30.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.616+0000 7f4450ff9640 3 client.4555.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:30.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.616+0000 7f4450ff9640 3 client.4555.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:30.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.616+0000 7f4450ff9640 20 client.4555.objecter dump_active .. 0 homeless 2026-02-24T19:17:30.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.617+0000 7fe7953c3640 10 monclient: get_monmap_and_config 2026-02-24T19:17:30.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.617+0000 7fe7953c3640 10 monclient: build_initial_monmap 2026-02-24T19:17:30.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.617+0000 7fe7953c3640 10 monclient: monmap: 2026-02-24T19:17:30.644 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:30.644 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.644 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:30.617668+0000 2026-02-24T19:17:30.644 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:30.617668+0000 2026-02-24T19:17:30.644 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:30.644 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.644 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:30.644 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:30.644 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:30.644 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.617+0000 7fe7953c3640 1 Processor -- start 2026-02-24T19:17:30.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.617+0000 7fe7953c3640 1 -- start start 2026-02-24T19:17:30.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.617+0000 7fe7953c3640 10 monclient: init 2026-02-24T19:17:30.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.617+0000 7efe78a2b640 10 monclient: get_monmap_and_config 2026-02-24T19:17:30.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.617+0000 7efe78a2b640 10 monclient: build_initial_monmap 2026-02-24T19:17:30.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.617+0000 7efe78a2b640 10 monclient: monmap: 2026-02-24T19:17:30.645 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:30.645 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.645 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:30.618151+0000 2026-02-24T19:17:30.645 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:30.618151+0000 2026-02-24T19:17:30.645 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:30.645 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.645 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:30.645 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:30.645 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:30.645 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.617+0000 7efe78a2b640 1 Processor -- start 2026-02-24T19:17:30.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.618+0000 7fe7953c3640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:30.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.618+0000 7efe78a2b640 1 -- start start 2026-02-24T19:17:30.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.618+0000 7efe78a2b640 10 monclient: init 2026-02-24T19:17:30.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.618+0000 7fe7953c3640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:30.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.618+0000 7fe7953c3640 10 monclient(hunting): picked mon.noname-c con 0x7fe7900b9f80 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:30.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.618+0000 7fe7953c3640 10 monclient(hunting): picked mon.noname-b con 0x7fe7900ba350 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:30.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.618+0000 7fe7953c3640 10 monclient(hunting): picked mon.noname-a con 0x7fe7900585e0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:30.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.618+0000 7fe7953c3640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe790163930 con 0x7fe7900585e0 2026-02-24T19:17:30.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.618+0000 7fe7953c3640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe790163bb0 con 0x7fe7900ba350 2026-02-24T19:17:30.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.618+0000 7fe7953c3640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe790163e90 con 0x7fe7900b9f80 2026-02-24T19:17:30.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.618+0000 7fe7953c3640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:30.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.618+0000 7fe7953c3640 10 monclient(hunting): authenticate will time out at 3625.299095s 2026-02-24T19:17:30.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.618+0000 7fe78f7fe640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7fe7900585e0 0x7fe790166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:55276/0 (socket says 10.20.193.14:55276) 2026-02-24T19:17:30.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.618+0000 7fe78f7fe640 1 -- 10.20.193.14:0/3729875068 learned_addr learned my addr 10.20.193.14:0/3729875068 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:30.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.618+0000 7efe78a2b640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:30.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.618+0000 7efe78a2b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:30.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.618+0000 7efe78a2b640 10 monclient(hunting): picked mon.noname-c con 0x7efe740b9f80 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:30.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.618+0000 7efe78a2b640 10 monclient(hunting): picked mon.noname-b con 0x7efe740ba350 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:30.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.618+0000 7efe78a2b640 10 monclient(hunting): picked mon.noname-a con 0x7efe740585e0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:30.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.618+0000 7efe78a2b640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe74163930 con 0x7efe740585e0 2026-02-24T19:17:30.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.618+0000 7efe78a2b640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe74163bb0 con 0x7efe740ba350 2026-02-24T19:17:30.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.618+0000 7efe78a2b640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe74163e90 con 0x7efe740b9f80 2026-02-24T19:17:30.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.618+0000 7efe78a2b640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:30.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.618+0000 7efe78a2b640 10 monclient(hunting): authenticate will time out at 3625.299561s 2026-02-24T19:17:30.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.619+0000 7efe72d76640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7efe740585e0 0x7efe74166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:55288/0 (socket says 10.20.193.14:55288) 2026-02-24T19:17:30.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.619+0000 7efe72d76640 1 -- 10.20.193.14:0/3082173451 learned_addr learned my addr 10.20.193.14:0/3082173451 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:30.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.620+0000 7fe78dffb640 1 -- 10.20.193.14:0/3729875068 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2306466410 0 0) 0x7fe780002c90 con 0x7fe7900585e0 2026-02-24T19:17:30.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.620+0000 7fe78dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.620+0000 7fe78dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.620+0000 7fe78dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.620+0000 7fe78dffb640 10 monclient(hunting): my global_id is 4608 2026-02-24T19:17:30.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.620+0000 7fe78dffb640 1 -- 10.20.193.14:0/3729875068 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe77c003610 con 0x7fe7900585e0 2026-02-24T19:17:30.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.621+0000 7efe71573640 1 -- 10.20.193.14:0/3082173451 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 821024461 0 0) 0x7efe64002c90 con 0x7efe740585e0 2026-02-24T19:17:30.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.621+0000 7efe71573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.621+0000 7efe71573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.621+0000 7efe71573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.621+0000 7efe71573640 10 monclient(hunting): my global_id is 4611 2026-02-24T19:17:30.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.621+0000 7efe71573640 1 -- 10.20.193.14:0/3082173451 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe60003610 con 0x7efe740585e0 2026-02-24T19:17:30.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.622+0000 7fe78dffb640 1 -- 10.20.193.14:0/3729875068 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1721723715 0 0) 0x7fe77c003610 con 0x7fe7900585e0 2026-02-24T19:17:30.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.622+0000 7fe78dffb640 1 -- 10.20.193.14:0/3729875068 >> v1:10.20.193.170:6789/0 conn(0x7fe7900b9f80 legacy=0x7fe790163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:30.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.623+0000 7fe78dffb640 1 -- 10.20.193.14:0/3729875068 >> v1:10.20.193.44:6789/0 conn(0x7fe7900ba350 legacy=0x7fe790057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:30.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.623+0000 7fe78dffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:30.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.623+0000 7fe78dffb640 1 monclient: found mon.noname-a 2026-02-24T19:17:30.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.623+0000 7fe78dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:30.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.623+0000 7fe78dffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:17:30.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.623+0000 7fe78dffb640 1 -- 10.20.193.14:0/3729875068 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7900573f0 con 0x7fe7900585e0 2026-02-24T19:17:30.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.623+0000 7fe78dffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:30.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.623+0000 7fe78dffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:30.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.623+0000 7fe78dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:30.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.623+0000 7fe78dffb640 1 -- 10.20.193.14:0/3729875068 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fe780003340 con 0x7fe7900585e0 2026-02-24T19:17:30.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.623+0000 7fe78dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.623+0000 7fe78dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:30.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.623+0000 7fe78dffb640 10 monclient: dump: 2026-02-24T19:17:30.650 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.650 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.650 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.650 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.650 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.650 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.650 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.650 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.650 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.650 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.623+0000 7fe7953c3640 5 monclient: authenticate success, global_id 4608 2026-02-24T19:17:30.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.623+0000 7fe7953c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:30.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.624+0000 7efe71573640 1 -- 10.20.193.14:0/3082173451 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3980022146 0 0) 0x7efe60003610 con 0x7efe740585e0 2026-02-24T19:17:30.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.624+0000 7efe71573640 1 -- 10.20.193.14:0/3082173451 >> v1:10.20.193.170:6789/0 conn(0x7efe740b9f80 legacy=0x7efe74163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:30.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.624+0000 7efe71573640 1 -- 10.20.193.14:0/3082173451 >> v1:10.20.193.44:6789/0 conn(0x7efe740ba350 legacy=0x7efe74057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:30.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.624+0000 7efe71573640 10 monclient: _finish_hunting 0 2026-02-24T19:17:30.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.624+0000 7efe71573640 1 monclient: found mon.noname-a 2026-02-24T19:17:30.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.624+0000 7efe71573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:30.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.624+0000 7efe71573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:17:30.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.624+0000 7efe71573640 1 -- 10.20.193.14:0/3082173451 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe740573f0 con 0x7efe740585e0 2026-02-24T19:17:30.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.624+0000 7efe71573640 10 monclient: _finish_auth 0 2026-02-24T19:17:30.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.624+0000 7efe71573640 10 monclient: _check_auth_tickets 2026-02-24T19:17:30.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.624+0000 7efe71573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:30.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.624+0000 7efe71573640 1 -- 10.20.193.14:0/3082173451 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7efe64003340 con 0x7efe740585e0 2026-02-24T19:17:30.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.624+0000 7efe71573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.624+0000 7efe71573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:30.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.624+0000 7efe71573640 10 monclient: dump: 2026-02-24T19:17:30.651 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.651 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.651 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.651 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.652 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.652 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.652 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.652 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.652 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.652 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.652 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.624+0000 7efe78a2b640 5 monclient: authenticate success, global_id 4611 2026-02-24T19:17:30.652 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.624+0000 7efe78a2b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:30.652 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.625+0000 7fe78dffb640 1 -- 10.20.193.14:0/3729875068 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe780003550 con 0x7fe7900585e0 2026-02-24T19:17:30.652 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.625+0000 7fe78dffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:30.652 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.625+0000 7fe78dffb640 1 -- 10.20.193.14:0/3729875068 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fe780004d10 con 0x7fe7900585e0 2026-02-24T19:17:30.652 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.625+0000 7fe78dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.625+0000 7fe78dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:30.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.625+0000 7fe78dffb640 10 monclient: dump: 2026-02-24T19:17:30.653 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.653 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.653 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.653 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.653 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.653 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.653 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.653 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.653 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.653 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.625+0000 7fe7953c3640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:30.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.625+0000 7fe7953c3640 4 set_mon_vals no callback set 2026-02-24T19:17:30.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.625+0000 7fe7953c3640 10 monclient: shutdown 2026-02-24T19:17:30.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.625+0000 7fe7953c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:30.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.625+0000 7fe7953c3640 1 -- 10.20.193.14:0/3729875068 >> v1:10.20.193.14:6789/0 conn(0x7fe7900585e0 legacy=0x7fe790166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.625+0000 7fe7953c3640 1 -- 10.20.193.14:0/3729875068 shutdown_connections 2026-02-24T19:17:30.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.625+0000 7fe7953c3640 1 -- 10.20.193.14:0/3729875068 >> 10.20.193.14:0/3729875068 conn(0x7fe7900b7990 msgr2=0x7fe7900b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:30.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.625+0000 7fe7953c3640 1 -- 10.20.193.14:0/3729875068 shutdown_connections 2026-02-24T19:17:30.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.625+0000 7fe7953c3640 1 -- 10.20.193.14:0/3729875068 wait complete. 2026-02-24T19:17:30.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.626+0000 7fe7953c3640 10 monclient: build_initial_monmap 2026-02-24T19:17:30.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.626+0000 7fe7953c3640 10 monclient: monmap: 2026-02-24T19:17:30.653 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:30.653 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:30.653 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:30.653 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:30.653 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:30.653 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:30.653 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:30.654 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:30.654 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:30.654 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.626+0000 7fe7953c3640 1 librados: starting msgr at 2026-02-24T19:17:30.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.626+0000 7fe7953c3640 1 librados: starting objecter 2026-02-24T19:17:30.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.626+0000 7fe7953c3640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:30.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.626+0000 7efe71573640 1 -- 10.20.193.14:0/3082173451 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efe64003550 con 0x7efe740585e0 2026-02-24T19:17:30.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.626+0000 7efe71573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:30.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.626+0000 7efe71573640 1 -- 10.20.193.14:0/3082173451 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7efe64004d10 con 0x7efe740585e0 2026-02-24T19:17:30.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.626+0000 7efe71573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.626+0000 7efe71573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:30.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.626+0000 7fe7953c3640 1 Processor -- start 2026-02-24T19:17:30.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.626+0000 7efe71573640 10 monclient: dump: 2026-02-24T19:17:30.654 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.654 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.654 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.654 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.654 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.655 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.655 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.655 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.655 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.655 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.655 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.626+0000 7efe78a2b640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:30.655 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.626+0000 7efe78a2b640 4 set_mon_vals no callback set 2026-02-24T19:17:30.655 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.626+0000 7fe7953c3640 1 -- start start 2026-02-24T19:17:30.655 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.626+0000 7fe7953c3640 1 librados: setting wanted keys 2026-02-24T19:17:30.655 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.626+0000 7fe7953c3640 1 librados: calling monclient init 2026-02-24T19:17:30.655 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.626+0000 7fe7953c3640 10 monclient: init 2026-02-24T19:17:30.655 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.626+0000 7efe78a2b640 10 monclient: shutdown 2026-02-24T19:17:30.655 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.626+0000 7efe78a2b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:30.655 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.626+0000 7efe78a2b640 1 -- 10.20.193.14:0/3082173451 >> v1:10.20.193.14:6789/0 conn(0x7efe740585e0 legacy=0x7efe74166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.655 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.626+0000 7efe78a2b640 1 -- 10.20.193.14:0/3082173451 shutdown_connections 2026-02-24T19:17:30.655 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.626+0000 7efe78a2b640 1 -- 10.20.193.14:0/3082173451 >> 10.20.193.14:0/3082173451 conn(0x7efe740b7990 msgr2=0x7efe740b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:30.656 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.626+0000 7fe7953c3640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:30.656 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.626+0000 7efe78a2b640 1 -- 10.20.193.14:0/3082173451 shutdown_connections 2026-02-24T19:17:30.656 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.626+0000 7fe7953c3640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:30.656 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.626+0000 7fe7953c3640 10 monclient(hunting): picked mon.noname-c con 0x7fe7900585e0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:30.656 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.626+0000 7efe78a2b640 1 -- 10.20.193.14:0/3082173451 wait complete. 2026-02-24T19:17:30.656 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.626+0000 7fe7953c3640 10 monclient(hunting): picked mon.noname-b con 0x7fe7900b9f80 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:30.656 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.626+0000 7fe7953c3640 10 monclient(hunting): picked mon.noname-a con 0x7fe7900ba350 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:30.656 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.626+0000 7fe7953c3640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7901febd0 con 0x7fe7900ba350 2026-02-24T19:17:30.656 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.627+0000 7fe7953c3640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7900b3100 con 0x7fe7900b9f80 2026-02-24T19:17:30.656 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.627+0000 7fe7953c3640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7900b33e0 con 0x7fe7900585e0 2026-02-24T19:17:30.656 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.627+0000 7fe7953c3640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:30.656 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.627+0000 7fe7953c3640 10 monclient(hunting): authenticate will time out at 3625.308025s 2026-02-24T19:17:30.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.627+0000 7efe78a2b640 10 monclient: build_initial_monmap 2026-02-24T19:17:30.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.627+0000 7efe78a2b640 10 monclient: monmap: 2026-02-24T19:17:30.657 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:30.657 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:30.657 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:30.657 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:30.657 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:30.657 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:30.657 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:30.657 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:30.657 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:30.657 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.627+0000 7fe78f7fe640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7fe7900ba350 0x7fe790161a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:55294/0 (socket says 10.20.193.14:55294) 2026-02-24T19:17:30.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.627+0000 7fe78f7fe640 1 -- 10.20.193.14:0/3180294831 learned_addr learned my addr 10.20.193.14:0/3180294831 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:30.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.628+0000 7efe78a2b640 1 librados: starting msgr at 2026-02-24T19:17:30.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.628+0000 7efe78a2b640 1 librados: starting objecter 2026-02-24T19:17:30.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.628+0000 7efe78a2b640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:30.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.628+0000 7efe78a2b640 1 Processor -- start 2026-02-24T19:17:30.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.628+0000 7fe76f7fe640 10 client.?.objecter ms_handle_connect 0x7fe7900ba350 2026-02-24T19:17:30.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.628+0000 7fe76f7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.628+0000 7efe78a2b640 1 -- start start 2026-02-24T19:17:30.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.628+0000 7efe78a2b640 1 librados: setting wanted keys 2026-02-24T19:17:30.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.628+0000 7efe78a2b640 1 librados: calling monclient init 2026-02-24T19:17:30.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.628+0000 7efe78a2b640 10 monclient: init 2026-02-24T19:17:30.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.628+0000 7efe78a2b640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:30.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.628+0000 7efe78a2b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:30.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.628+0000 7efe78a2b640 10 monclient(hunting): picked mon.noname-b con 0x7efe740585e0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:30.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.628+0000 7efe78a2b640 10 monclient(hunting): picked mon.noname-a con 0x7efe740b9f80 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:30.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.628+0000 7efe78a2b640 10 monclient(hunting): picked mon.noname-c con 0x7efe740ba350 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:30.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.628+0000 7efe78a2b640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe741febd0 con 0x7efe740b9f80 2026-02-24T19:17:30.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.628+0000 7efe78a2b640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe740b3100 con 0x7efe740585e0 2026-02-24T19:17:30.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.628+0000 7efe78a2b640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe740b33e0 con 0x7efe740ba350 2026-02-24T19:17:30.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.628+0000 7efe78a2b640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:30.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.628+0000 7efe78a2b640 10 monclient(hunting): authenticate will time out at 3625.309847s 2026-02-24T19:17:30.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.629+0000 7fe76f7fe640 1 -- 10.20.193.14:0/3180294831 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3928652835 0 0) 0x7fe7901febd0 con 0x7fe7900ba350 2026-02-24T19:17:30.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.629+0000 7fe76f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.629+0000 7fe76f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.629+0000 7fe76f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.629+0000 7fe76f7fe640 10 monclient(hunting): my global_id is 4614 2026-02-24T19:17:30.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.629+0000 7fe76f7fe640 1 -- 10.20.193.14:0/3180294831 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe75c003610 con 0x7fe7900ba350 2026-02-24T19:17:30.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.629+0000 7efe71d74640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7efe740b9f80 0x7efe741fe4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:55304/0 (socket says 10.20.193.14:55304) 2026-02-24T19:17:30.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.629+0000 7efe71d74640 1 -- 10.20.193.14:0/1987191060 learned_addr learned my addr 10.20.193.14:0/1987191060 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:30.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.630+0000 7efe5affd640 10 client.?.objecter ms_handle_connect 0x7efe740b9f80 2026-02-24T19:17:30.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.630+0000 7efe5affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.632+0000 7fe76f7fe640 1 -- 10.20.193.14:0/3180294831 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2408568176 0 0) 0x7fe75c003610 con 0x7fe7900ba350 2026-02-24T19:17:30.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.632+0000 7fe76f7fe640 1 -- 10.20.193.14:0/3180294831 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe7901febd0 con 0x7fe7900ba350 2026-02-24T19:17:30.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.632+0000 7fe76f7fe640 1 -- 10.20.193.14:0/3180294831 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fe7800030b0 con 0x7fe7900ba350 2026-02-24T19:17:30.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.632+0000 7fe76f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:30.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.632+0000 7fe76f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:30.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.632+0000 7fe76f7fe640 10 monclient(hunting): dump: 2026-02-24T19:17:30.660 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.660 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.660 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.660 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.660 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.660 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.660 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.660 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.660 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.660 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.632+0000 7fe76f7fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:30.661 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.633+0000 7efe5affd640 1 -- 10.20.193.14:0/1987191060 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3595634637 0 0) 0x7efe741febd0 con 0x7efe740b9f80 2026-02-24T19:17:30.661 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.633+0000 7efe5affd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.661 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.633+0000 7efe5affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.661 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.633+0000 7efe5affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.661 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.633+0000 7efe5affd640 10 monclient(hunting): my global_id is 4617 2026-02-24T19:17:30.661 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.633+0000 7efe5affd640 1 -- 10.20.193.14:0/1987191060 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe40003610 con 0x7efe740b9f80 2026-02-24T19:17:30.661 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.634+0000 7fe76f7fe640 1 -- 10.20.193.14:0/3180294831 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 544845700 0 0) 0x7fe7901febd0 con 0x7fe7900ba350 2026-02-24T19:17:30.661 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.634+0000 7fe76f7fe640 1 -- 10.20.193.14:0/3180294831 >> v1:10.20.193.170:6789/0 conn(0x7fe7900585e0 legacy=0x7fe7900b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.661 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.634+0000 7fe76f7fe640 1 -- 10.20.193.14:0/3180294831 >> v1:10.20.193.44:6789/0 conn(0x7fe7900b9f80 legacy=0x7fe7901fe4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.661 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.634+0000 7fe76f7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:17:30.661 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.634+0000 7fe76f7fe640 1 monclient: found mon.a 2026-02-24T19:17:30.661 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.634+0000 7fe76f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:30.661 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.634+0000 7fe76f7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:30.661 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.634+0000 7fe76f7fe640 1 -- 10.20.193.14:0/3180294831 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7900b36c0 con 0x7fe7900ba350 2026-02-24T19:17:30.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.634+0000 7fe76f7fe640 10 monclient: _finish_auth 0 2026-02-24T19:17:30.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.634+0000 7fe76f7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:17:30.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.634+0000 7fe76f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:30.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.634+0000 7fe7953c3640 5 monclient: authenticate success, global_id 4614 2026-02-24T19:17:30.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.634+0000 7fe7953c3640 10 monclient: _renew_subs 2026-02-24T19:17:30.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.634+0000 7fe7953c3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:30.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.634+0000 7fe7953c3640 1 -- 10.20.193.14:0/3180294831 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe790161270 con 0x7fe7900ba350 2026-02-24T19:17:30.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.634+0000 7fe7953c3640 10 client.4614.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:30.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.634+0000 7fe7953c3640 10 monclient: _renew_subs 2026-02-24T19:17:30.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.634+0000 7fe7953c3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:30.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.634+0000 7fe7953c3640 1 -- 10.20.193.14:0/3180294831 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe790162180 con 0x7fe7900ba350 2026-02-24T19:17:30.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.634+0000 7fe7953c3640 1 librados: init done 2026-02-24T19:17:30.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.635+0000 7fe7953c3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.635+0000 7fe7953c3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.635+0000 7fe7953c3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:30.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.635+0000 7fe7953c3640 1 -- 10.20.193.14:0/3180294831 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7900b91d0 con 0x7fe7900ba350 2026-02-24T19:17:30.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.661+0000 7f0094e3c640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-24T19:17:30.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.661+0000 7f0094e3c640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-24T19:17:30.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.661+0000 7f0094e3c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.663 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.661+0000 7f0094e3c640 1 -- 10.20.193.14:0/4280563149 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f0090157680 con 0x7f00900ba350 2026-02-24T19:17:30.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.691+0000 7f3077fff640 1 -- 10.20.193.14:0/3903178311 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f308c003700 con 0x7f309c157b50 2026-02-24T19:17:30.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.692+0000 7f3077fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:30.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.692+0000 7f3077fff640 1 -- 10.20.193.14:0/3903178311 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f308c003a50 con 0x7f309c157b50 2026-02-24T19:17:30.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.692+0000 7f3077fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.692+0000 7f3077fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:30.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.692+0000 7f3077fff640 10 monclient: dump: 2026-02-24T19:17:30.693 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.693 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.693 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.693 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.693 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.693 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.693 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.693 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.693 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.693 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.692+0000 7f3099ffb640 4 set_mon_vals no callback set 2026-02-24T19:17:30.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.692+0000 7f3077fff640 1 -- 10.20.193.14:0/3903178311 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f308c01c8c0 con 0x7f309c157b50 2026-02-24T19:17:30.694 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.693+0000 7f309b7fe640 10 monclient: get_auth_request con 0x7f306c077dd0 auth_method 0 2026-02-24T19:17:30.694 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.693+0000 7f3077fff640 10 client.4583.objecter ms_handle_connect 0x7f306c077dd0 2026-02-24T19:17:30.694 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.693+0000 7f3077fff640 1 -- 10.20.193.14:0/3903178311 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7f308c091fc0 con 0x7f309c157b50 2026-02-24T19:17:30.695 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.693+0000 7f3077fff640 10 client.4583.objecter ms_dispatch2 0x7f309c000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:30.695 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.693+0000 7f3077fff640 3 client.4583.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:30.695 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.693+0000 7f3077fff640 3 client.4583.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:30.695 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.694+0000 7f3077fff640 20 client.4583.objecter dump_active .. 0 homeless 2026-02-24T19:17:30.697 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2026-02-24T19:17:30.698 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.697+0000 7f3077fff640 1 -- 10.20.193.14:0/3903178311 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f308c05c9f0 con 0x7f309c157b50 2026-02-24T19:17:30.698 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.697+0000 7f3077fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.698 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.697+0000 7f3077fff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:30.700 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.699+0000 7efe5affd640 10 client.?.objecter ms_handle_connect 0x7efe740ba350 2026-02-24T19:17:30.700 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.699+0000 7efe5affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.701 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.699+0000 7f4450ff9640 1 -- 10.20.193.14:0/3515511597 <== mon.1 v1:10.20.193.44:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f444005dcb0 con 0x7f44540585e0 2026-02-24T19:17:30.701 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.699+0000 7f4450ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.701 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.699+0000 7f4450ff9640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:30.701 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.700+0000 7f41ffc4e640 10 monclient: get_monmap_and_config 2026-02-24T19:17:30.701 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.700+0000 7f41ffc4e640 10 monclient: build_initial_monmap 2026-02-24T19:17:30.701 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.700+0000 7f41ffc4e640 10 monclient: monmap: 2026-02-24T19:17:30.701 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:30.701 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.701 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:30.701211+0000 2026-02-24T19:17:30.702 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:30.701211+0000 2026-02-24T19:17:30.702 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:30.702 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.702 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:30.702 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:30.702 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:30.702 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.702 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.701+0000 7f41ffc4e640 1 Processor -- start 2026-02-24T19:17:30.702 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.701+0000 7f41ffc4e640 1 -- start start 2026-02-24T19:17:30.702 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.701+0000 7f41ffc4e640 10 monclient: init 2026-02-24T19:17:30.702 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.701+0000 7efe5affd640 10 client.?.objecter ms_handle_connect 0x7efe740585e0 2026-02-24T19:17:30.702 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.701+0000 7efe5affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.703 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.701+0000 7f41ffc4e640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:30.703 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.701+0000 7f41ffc4e640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:30.703 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.701+0000 7f41ffc4e640 10 monclient(hunting): picked mon.noname-a con 0x7f41f8059b90 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:30.703 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.701+0000 7f41ffc4e640 10 monclient(hunting): picked mon.noname-c con 0x7f41f80b27b0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:30.703 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.701+0000 7f41ffc4e640 10 monclient(hunting): picked mon.noname-b con 0x7f41f8159b60 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:30.703 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.701+0000 7f41ffc4e640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41f80b1750 con 0x7f41f8059b90 2026-02-24T19:17:30.703 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.701+0000 7f41ffc4e640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41f80b19f0 con 0x7f41f8159b60 2026-02-24T19:17:30.703 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.701+0000 7f41ffc4e640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41f80b1cd0 con 0x7f41f80b27b0 2026-02-24T19:17:30.704 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.701+0000 7f41ffc4e640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:30.704 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.701+0000 7f41ffc4e640 10 monclient(hunting): authenticate will time out at 3625.382737s 2026-02-24T19:17:30.704 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.703+0000 7efe5affd640 1 -- 10.20.193.14:0/1987191060 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2556809796 0 0) 0x7efe740b3100 con 0x7efe740585e0 2026-02-24T19:17:30.704 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.703+0000 7efe5affd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.704 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.703+0000 7efe5affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.704 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.703+0000 7efe5affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.704 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.703+0000 7efe5affd640 10 monclient(hunting): my global_id is 4558 2026-02-24T19:17:30.704 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.703+0000 7efe5affd640 1 -- 10.20.193.14:0/1987191060 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe741febd0 con 0x7efe740585e0 2026-02-24T19:17:30.704 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.703+0000 7efe5affd640 1 -- 10.20.193.14:0/1987191060 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 434876671 0 0) 0x7efe740b33e0 con 0x7efe740ba350 2026-02-24T19:17:30.704 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.703+0000 7efe5affd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.705 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.703+0000 7efe5affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.705 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.703+0000 7efe5affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.705 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.703+0000 7efe5affd640 10 monclient(hunting): my global_id is 4589 2026-02-24T19:17:30.705 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.703+0000 7efe5affd640 1 -- 10.20.193.14:0/1987191060 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe740b3100 con 0x7efe740ba350 2026-02-24T19:17:30.705 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.704+0000 7f41fd1c2640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7f41f80b27b0 0x7f41f8159450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:45424/0 (socket says 10.20.193.14:45424) 2026-02-24T19:17:30.705 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.704+0000 7f41fd1c2640 1 -- 10.20.193.14:0/552390066 learned_addr learned my addr 10.20.193.14:0/552390066 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:30.705 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.704+0000 7f0076ffd640 1 -- 10.20.193.14:0/4280563149 <== mon.2 v1:10.20.193.170:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+12 (unknown 3405404620 0 1498640560) 0x7f008005c5a0 con 0x7f00900ba350 2026-02-24T19:17:30.705 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.704+0000 7f0076ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-24T19:17:30.705 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.704+0000 7f0076ffd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:30.705 INFO:teuthology.orchestra.run.trial014.stdout:90194313221 2026-02-24T19:17:30.708 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.707+0000 7f0094e3c640 10 librados: watch_flush enter 2026-02-24T19:17:30.708 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.707+0000 7f0094e3c640 10 librados: watch_flush exit 2026-02-24T19:17:30.708 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.707+0000 7f0094e3c640 20 client.4574.objecter shutdown clearing up homeless session... 2026-02-24T19:17:30.708 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.707+0000 7f0094e3c640 10 client.4574.objecter successfully canceled tick 2026-02-24T19:17:30.708 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.707+0000 7f0094e3c640 1 -- 10.20.193.14:0/4280563149 >> v1:10.20.193.14:6800/4014096310 conn(0x7f005c077e20 legacy=0x7f005c0982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.708 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.707+0000 7f0094e3c640 10 monclient: shutdown 2026-02-24T19:17:30.708 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.707+0000 7f0094e3c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:30.708 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.707+0000 7f0094e3c640 1 -- 10.20.193.14:0/4280563149 >> v1:10.20.193.170:6789/0 conn(0x7f00900ba350 legacy=0x7f0090158e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.708 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.707+0000 7f0094e3c640 1 -- 10.20.193.14:0/4280563149 shutdown_connections 2026-02-24T19:17:30.708 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.707+0000 7f0094e3c640 1 -- 10.20.193.14:0/4280563149 >> 10.20.193.14:0/4280563149 conn(0x7f00900b7990 msgr2=0x7f0090166860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:30.709 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.707+0000 7efe5affd640 1 -- 10.20.193.14:0/1987191060 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2440158291 0 0) 0x7efe741febd0 con 0x7efe740585e0 2026-02-24T19:17:30.709 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.707+0000 7f0094e3c640 1 -- 10.20.193.14:0/4280563149 shutdown_connections 2026-02-24T19:17:30.709 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.707+0000 7f0094e3c640 1 -- 10.20.193.14:0/4280563149 wait complete. 2026-02-24T19:17:30.709 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.707+0000 7efe5affd640 1 -- 10.20.193.14:0/1987191060 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efe740b33e0 con 0x7efe740585e0 2026-02-24T19:17:30.709 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.707+0000 7efe5affd640 1 -- 10.20.193.14:0/1987191060 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7efe68002f70 con 0x7efe740585e0 2026-02-24T19:17:30.709 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.707+0000 7efe5affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:30.709 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.707+0000 7efe5affd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:30.709 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.707+0000 7efe5affd640 10 monclient(hunting): dump: 2026-02-24T19:17:30.709 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.709 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.710 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.710 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.710 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.710 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.710 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.710 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.710 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.710 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.710 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.707+0000 7efe5affd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:30.710 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.707+0000 7f0094e3c640 1 librados: shutdown 2026-02-24T19:17:30.710 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.707+0000 7efe5affd640 1 -- 10.20.193.14:0/1987191060 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 668816059 0 0) 0x7efe740b3100 con 0x7efe740ba350 2026-02-24T19:17:30.710 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.707+0000 7efe5affd640 1 -- 10.20.193.14:0/1987191060 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efe741febd0 con 0x7efe740ba350 2026-02-24T19:17:30.711 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.707+0000 7efe5affd640 1 -- 10.20.193.14:0/1987191060 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7efe64002cd0 con 0x7efe740ba350 2026-02-24T19:17:30.711 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.707+0000 7efe5affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:30.711 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.707+0000 7efe5affd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:30.711 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.707+0000 7efe5affd640 10 monclient(hunting): dump: 2026-02-24T19:17:30.711 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.711 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.711 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.711 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.711 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.711 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.711 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.711 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.711 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.711 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.711 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.709+0000 7f41fc9c1640 1 -- 10.20.193.14:0/552390066 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2387565178 0 0) 0x7f41f80b1cd0 con 0x7f41f80b27b0 2026-02-24T19:17:30.712 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.709+0000 7f41fc9c1640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.712 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.709+0000 7f41fc9c1640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.712 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.709+0000 7f41fc9c1640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.712 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.709+0000 7f41fc9c1640 10 monclient(hunting): my global_id is 4592 2026-02-24T19:17:30.712 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.709+0000 7f41fc9c1640 1 -- 10.20.193.14:0/552390066 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41e0003610 con 0x7f41f80b27b0 2026-02-24T19:17:30.712 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.709+0000 7efe5affd640 1 -- 10.20.193.14:0/1987191060 <== mon.1 v1:10.20.193.44:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1417763251 0 0) 0x7efe740b33e0 con 0x7efe740585e0 2026-02-24T19:17:30.712 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.709+0000 7efe5affd640 1 -- 10.20.193.14:0/1987191060 >> v1:10.20.193.170:6789/0 conn(0x7efe740ba350 legacy=0x7efe74161a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.712 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.709+0000 7efe5affd640 1 -- 10.20.193.14:0/1987191060 >> v1:10.20.193.14:6789/0 conn(0x7efe740b9f80 legacy=0x7efe741fe4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.712 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.709+0000 7efe5affd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:30.713 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.709+0000 7efe5affd640 1 monclient: found mon.b 2026-02-24T19:17:30.713 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.709+0000 7efe5affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:30.713 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.709+0000 7efe5affd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:30.713 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.709+0000 7efe5affd640 1 -- 10.20.193.14:0/1987191060 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe740b36c0 con 0x7efe740585e0 2026-02-24T19:17:30.713 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.709+0000 7efe5affd640 10 monclient: _finish_auth 0 2026-02-24T19:17:30.713 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.709+0000 7efe5affd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:30.713 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.709+0000 7efe5affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:30.713 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.709+0000 7efe78a2b640 5 monclient: authenticate success, global_id 4558 2026-02-24T19:17:30.713 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.709+0000 7efe78a2b640 10 monclient: _renew_subs 2026-02-24T19:17:30.713 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.709+0000 7efe78a2b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:30.713 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.709+0000 7efe78a2b640 1 -- 10.20.193.14:0/1987191060 --> v1:10.20.193.44:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efe74161270 con 0x7efe740585e0 2026-02-24T19:17:30.713 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.709+0000 7efe78a2b640 10 client.4558.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:30.713 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.709+0000 7efe78a2b640 10 monclient: _renew_subs 2026-02-24T19:17:30.713 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.709+0000 7efe78a2b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:30.713 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.709+0000 7efe78a2b640 1 -- 10.20.193.14:0/1987191060 --> v1:10.20.193.44:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7efe74162180 con 0x7efe740585e0 2026-02-24T19:17:30.713 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.709+0000 7efe78a2b640 1 librados: init done 2026-02-24T19:17:30.713 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.710+0000 7f41fc9c1640 1 -- 10.20.193.14:0/552390066 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3503667793 0 0) 0x7f41f80b19f0 con 0x7f41f8159b60 2026-02-24T19:17:30.714 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.710+0000 7f41fc9c1640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.714 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.710+0000 7f41fc9c1640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.714 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.710+0000 7f41fc9c1640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.714 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.710+0000 7f41fc9c1640 10 monclient(hunting): my global_id is 4561 2026-02-24T19:17:30.714 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.710+0000 7f41fc9c1640 1 -- 10.20.193.14:0/552390066 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41f80b1cd0 con 0x7f41f8159b60 2026-02-24T19:17:30.714 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.710+0000 7efe78a2b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.714 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.710+0000 7efe78a2b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.714 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.710+0000 7efe78a2b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:30.714 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.710+0000 7efe78a2b640 1 -- 10.20.193.14:0/1987191060 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe740b91d0 con 0x7efe740585e0 2026-02-24T19:17:30.714 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.712+0000 7fb8b363a640 10 monclient: get_monmap_and_config 2026-02-24T19:17:30.715 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.712+0000 7fb8b363a640 10 monclient: build_initial_monmap 2026-02-24T19:17:30.715 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.712+0000 7fb8b363a640 10 monclient: monmap: 2026-02-24T19:17:30.715 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:30.715 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.715 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:30.712949+0000 2026-02-24T19:17:30.715 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:30.712949+0000 2026-02-24T19:17:30.715 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:30.715 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.715 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:30.715 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:30.715 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:30.715 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.715 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.712+0000 7f41fc9c1640 1 -- 10.20.193.14:0/552390066 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2267836119 0 0) 0x7f41e0003610 con 0x7f41f80b27b0 2026-02-24T19:17:30.715 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.712+0000 7f41fc9c1640 1 -- 10.20.193.14:0/552390066 >> v1:10.20.193.44:6789/0 conn(0x7f41f8159b60 legacy=0x7f41f81c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.715 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.712+0000 7f41fc9c1640 1 -- 10.20.193.14:0/552390066 >> v1:10.20.193.14:6789/0 conn(0x7f41f8059b90 legacy=0x7f41f8057620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:30.716 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.712+0000 7f41fc9c1640 10 monclient: _finish_hunting 0 2026-02-24T19:17:30.716 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.712+0000 7f41fc9c1640 1 monclient: found mon.noname-c 2026-02-24T19:17:30.716 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.712+0000 7f41fc9c1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:30.716 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.712+0000 7f41fc9c1640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.716 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.712+0000 7f41fc9c1640 1 -- 10.20.193.14:0/552390066 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f80b1fb0 con 0x7f41f80b27b0 2026-02-24T19:17:30.716 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.712+0000 7f41fc9c1640 10 monclient: _finish_auth 0 2026-02-24T19:17:30.716 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.712+0000 7f41fc9c1640 10 monclient: _check_auth_tickets 2026-02-24T19:17:30.716 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.712+0000 7f41fc9c1640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:30.716 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.712+0000 7fb8b363a640 1 Processor -- start 2026-02-24T19:17:30.716 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.712+0000 7f41ffc4e640 5 monclient: authenticate success, global_id 4592 2026-02-24T19:17:30.716 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.712+0000 7f41ffc4e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:30.716 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.712+0000 7fb8b363a640 1 -- start start 2026-02-24T19:17:30.717 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.712+0000 7fb8b363a640 10 monclient: init 2026-02-24T19:17:30.717 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.712+0000 7f41fc9c1640 1 -- 10.20.193.14:0/552390066 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f41ec002df0 con 0x7f41f80b27b0 2026-02-24T19:17:30.717 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.712+0000 7f41fc9c1640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.717 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.712+0000 7f41fc9c1640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:30.717 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.712+0000 7f41fc9c1640 10 monclient: dump: 2026-02-24T19:17:30.717 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.717 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.717 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.717 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.717 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.717 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.717 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.717 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.717 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.717 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.718 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.712+0000 7f41ffc4e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:30.718 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.713+0000 7fb8b363a640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:30.718 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.713+0000 7fb8b363a640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:30.718 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.713+0000 7fb8b363a640 10 monclient(hunting): picked mon.noname-b con 0x7fb8ac159da0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:30.718 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.713+0000 7fb8b363a640 10 monclient(hunting): picked mon.noname-a con 0x7fb8ac165880 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:30.718 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.713+0000 7fb8b363a640 10 monclient(hunting): picked mon.noname-c con 0x7fb8ac056090 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:30.718 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.713+0000 7fb8b363a640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8ac15a170 con 0x7fb8ac165880 2026-02-24T19:17:30.718 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.713+0000 7fb8b363a640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8ac0b4650 con 0x7fb8ac159da0 2026-02-24T19:17:30.718 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.713+0000 7fb8b363a640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8ac0b4930 con 0x7fb8ac056090 2026-02-24T19:17:30.718 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.713+0000 7fb8b363a640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:30.718 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.713+0000 7fb8b363a640 10 monclient(hunting): authenticate will time out at 3625.394403s 2026-02-24T19:17:30.719 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.714+0000 7f41fc9c1640 1 -- 10.20.193.14:0/552390066 <== mon.2 v1:10.20.193.170:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f41ec003040 con 0x7f41f80b27b0 2026-02-24T19:17:30.719 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.714+0000 7f41fc9c1640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:30.719 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.714+0000 7f41ffc4e640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:30.719 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.714+0000 7f41ffc4e640 4 set_mon_vals no callback set 2026-02-24T19:17:30.719 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.714+0000 7fb8b1bb0640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7fb8ac056090 0x7fb8ac0b3770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:45440/0 (socket says 10.20.193.14:45440) 2026-02-24T19:17:30.719 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.714+0000 7fb8b1bb0640 1 -- 10.20.193.14:0/472967714 learned_addr learned my addr 10.20.193.14:0/472967714 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:30.720 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.714+0000 7f41fc9c1640 1 -- 10.20.193.14:0/552390066 <== mon.2 v1:10.20.193.170:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f41ec003480 con 0x7f41f80b27b0 2026-02-24T19:17:30.720 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.714+0000 7f41fc9c1640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.720 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.714+0000 7f41fc9c1640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:30.720 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.714+0000 7f41fc9c1640 10 monclient: dump: 2026-02-24T19:17:30.720 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.720 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.720 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.720 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.720 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.720 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.720 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.720 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.720 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.720 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.720 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.714+0000 7f41ffc4e640 10 monclient: shutdown 2026-02-24T19:17:30.720 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.714+0000 7f41ffc4e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:30.720 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.714+0000 7f41ffc4e640 1 -- 10.20.193.14:0/552390066 >> v1:10.20.193.170:6789/0 conn(0x7f41f80b27b0 legacy=0x7f41f8159450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.720 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.714+0000 7f41ffc4e640 1 -- 10.20.193.14:0/552390066 shutdown_connections 2026-02-24T19:17:30.720 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.714+0000 7f41ffc4e640 1 -- 10.20.193.14:0/552390066 >> 10.20.193.14:0/552390066 conn(0x7f41f80b7120 msgr2=0x7f41f80b7520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:30.720 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.714+0000 7f41ffc4e640 1 -- 10.20.193.14:0/552390066 shutdown_connections 2026-02-24T19:17:30.720 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.714+0000 7f41ffc4e640 1 -- 10.20.193.14:0/552390066 wait complete. 2026-02-24T19:17:30.720 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.715+0000 7f41ffc4e640 10 monclient: build_initial_monmap 2026-02-24T19:17:30.721 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.715+0000 7f41ffc4e640 10 monclient: monmap: 2026-02-24T19:17:30.721 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:30.721 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:30.721 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:30.721 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:30.721 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:30.721 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:30.721 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:30.721 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:30.721 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:30.721 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.721 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313221 for osd.11 2026-02-24T19:17:30.722 DEBUG:teuthology.parallel:result is None 2026-02-24T19:17:30.722 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.715+0000 7f41ffc4e640 1 librados: starting msgr at 2026-02-24T19:17:30.722 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.715+0000 7f41ffc4e640 1 librados: starting objecter 2026-02-24T19:17:30.722 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.715+0000 7f41ffc4e640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:30.722 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.715+0000 7f41ffc4e640 1 Processor -- start 2026-02-24T19:17:30.722 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.715+0000 7f41ffc4e640 1 -- start start 2026-02-24T19:17:30.722 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.715+0000 7f41ffc4e640 1 librados: setting wanted keys 2026-02-24T19:17:30.722 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.715+0000 7f41ffc4e640 1 librados: calling monclient init 2026-02-24T19:17:30.722 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.715+0000 7f41ffc4e640 10 monclient: init 2026-02-24T19:17:30.723 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.715+0000 7fb89bfff640 1 -- 10.20.193.14:0/472967714 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 30029764 0 0) 0x7fb8ac0b4930 con 0x7fb8ac056090 2026-02-24T19:17:30.723 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.715+0000 7fb89bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.723 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.715+0000 7fb89bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.723 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.715+0000 7fb89bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.723 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.715+0000 7fb89bfff640 10 monclient(hunting): my global_id is 4595 2026-02-24T19:17:30.723 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.715+0000 7fb89bfff640 1 -- 10.20.193.14:0/472967714 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb894003610 con 0x7fb8ac056090 2026-02-24T19:17:30.723 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.716+0000 7f41ffc4e640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:30.723 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.716+0000 7f41ffc4e640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:30.723 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.716+0000 7f41ffc4e640 10 monclient(hunting): picked mon.noname-a con 0x7f41f8059b90 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:30.723 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.716+0000 7f41ffc4e640 10 monclient(hunting): picked mon.noname-b con 0x7f41f80b27b0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:30.723 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.716+0000 7f41ffc4e640 10 monclient(hunting): picked mon.noname-c con 0x7f41f8159b60 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:30.723 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.716+0000 7f41ffc4e640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41f815ad30 con 0x7f41f8059b90 2026-02-24T19:17:30.724 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.716+0000 7f41ffc4e640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41f81fbb10 con 0x7f41f80b27b0 2026-02-24T19:17:30.724 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.716+0000 7f41ffc4e640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41f81fe260 con 0x7f41f8159b60 2026-02-24T19:17:30.724 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.716+0000 7f41ffc4e640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:30.724 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.716+0000 7f41ffc4e640 10 monclient(hunting): authenticate will time out at 3625.397297s 2026-02-24T19:17:30.724 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.717+0000 7fb89bfff640 1 -- 10.20.193.14:0/472967714 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 928164642 0 0) 0x7fb894003610 con 0x7fb8ac056090 2026-02-24T19:17:30.724 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.717+0000 7fb89bfff640 1 -- 10.20.193.14:0/472967714 >> v1:10.20.193.44:6789/0 conn(0x7fb8ac159da0 legacy=0x7fb8ac165170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:30.724 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.717+0000 7fb89bfff640 1 -- 10.20.193.14:0/472967714 >> v1:10.20.193.14:6789/0 conn(0x7fb8ac165880 legacy=0x7fb8ac055980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:30.724 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.717+0000 7fb89bfff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:30.724 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.717+0000 7fb89bfff640 1 monclient: found mon.noname-c 2026-02-24T19:17:30.724 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.717+0000 7fb89bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:30.724 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.717+0000 7fb89bfff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.724 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.717+0000 7fb89bfff640 1 -- 10.20.193.14:0/472967714 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8ac0b4c10 con 0x7fb8ac056090 2026-02-24T19:17:30.724 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.717+0000 7fb89bfff640 10 monclient: _finish_auth 0 2026-02-24T19:17:30.724 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.717+0000 7fb89bfff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:30.724 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.717+0000 7fb89bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:30.724 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.717+0000 7fb89bfff640 1 -- 10.20.193.14:0/472967714 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fb8a8003170 con 0x7fb8ac056090 2026-02-24T19:17:30.724 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.717+0000 7fb8b363a640 5 monclient: authenticate success, global_id 4595 2026-02-24T19:17:30.725 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.717+0000 7fb8b363a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:30.725 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.717+0000 7fb89bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.725 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.717+0000 7fb89bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:30.725 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.717+0000 7fb89bfff640 10 monclient: dump: 2026-02-24T19:17:30.725 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.725 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.725 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.725 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.725 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.725 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.725 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.725 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.725 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.725 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.725 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.717+0000 7fb8b363a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:30.725 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.717+0000 7f41fe1c4640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7f41f8159b60 0x7f41f8152c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:45448/0 (socket says 10.20.193.14:45448) 2026-02-24T19:17:30.725 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.717+0000 7f41fe1c4640 1 -- 10.20.193.14:0/517999795 learned_addr learned my addr 10.20.193.14:0/517999795 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:30.725 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.718+0000 7f41e67fc640 10 client.?.objecter ms_handle_connect 0x7f41f8159b60 2026-02-24T19:17:30.725 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.718+0000 7f41e67fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.726 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2026-02-24T19:17:30.726 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-24T19:17:30.726 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-24T19:17:30.726 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-24T19:17:30.727 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.719+0000 7fb89bfff640 1 -- 10.20.193.14:0/472967714 <== mon.2 v1:10.20.193.170:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb8a8003380 con 0x7fb8ac056090 2026-02-24T19:17:30.727 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.719+0000 7fb89bfff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:30.727 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.719+0000 7fb89bfff640 1 -- 10.20.193.14:0/472967714 <== mon.2 v1:10.20.193.170:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fb8a80037c0 con 0x7fb8ac056090 2026-02-24T19:17:30.727 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.719+0000 7fb89bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.727 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.719+0000 7fb89bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:30.727 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.719+0000 7fb89bfff640 10 monclient: dump: 2026-02-24T19:17:30.727 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.727 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.727 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.727 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.727 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.727 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.727 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.727 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.727 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.727 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.727 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.719+0000 7fb8b363a640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:30.727 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.719+0000 7fb8b363a640 4 set_mon_vals no callback set 2026-02-24T19:17:30.727 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.719+0000 7fb8b363a640 10 monclient: shutdown 2026-02-24T19:17:30.727 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.719+0000 7fb8b363a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:30.727 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.719+0000 7fb8b363a640 1 -- 10.20.193.14:0/472967714 >> v1:10.20.193.170:6789/0 conn(0x7fb8ac056090 legacy=0x7fb8ac0b3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.728 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.719+0000 7fb8b363a640 1 -- 10.20.193.14:0/472967714 shutdown_connections 2026-02-24T19:17:30.728 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.719+0000 7fb8b363a640 1 -- 10.20.193.14:0/472967714 >> 10.20.193.14:0/472967714 conn(0x7fb8ac0b78c0 msgr2=0x7fb8ac0b7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:30.728 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.719+0000 7fb8b363a640 1 -- 10.20.193.14:0/472967714 shutdown_connections 2026-02-24T19:17:30.728 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.719+0000 7fb8b363a640 1 -- 10.20.193.14:0/472967714 wait complete. 2026-02-24T19:17:30.728 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.719+0000 7f41e67fc640 1 -- 10.20.193.14:0/517999795 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 490788052 0 0) 0x7f41f81fe260 con 0x7f41f8159b60 2026-02-24T19:17:30.728 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.719+0000 7f41e67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.728 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.719+0000 7f41e67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.728 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.719+0000 7f41e67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.728 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.719+0000 7f41e67fc640 10 monclient(hunting): my global_id is 4598 2026-02-24T19:17:30.728 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.719+0000 7f41e67fc640 1 -- 10.20.193.14:0/517999795 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41c8003610 con 0x7f41f8159b60 2026-02-24T19:17:30.729 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.720+0000 7fb8b363a640 10 monclient: build_initial_monmap 2026-02-24T19:17:30.729 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.720+0000 7fb8b363a640 10 monclient: monmap: 2026-02-24T19:17:30.729 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:30.729 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:30.729 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:30.729 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:30.729 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:30.729 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:30.729 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:30.729 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:30.729 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:30.729 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.729 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.720+0000 7fb8b363a640 1 librados: starting msgr at 2026-02-24T19:17:30.729 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.720+0000 7fb8b363a640 1 librados: starting objecter 2026-02-24T19:17:30.729 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.720+0000 7fb8b363a640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:30.729 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.720+0000 7fb8b363a640 1 Processor -- start 2026-02-24T19:17:30.729 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.720+0000 7fb8b363a640 1 -- start start 2026-02-24T19:17:30.729 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.720+0000 7fb8b363a640 1 librados: setting wanted keys 2026-02-24T19:17:30.729 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.720+0000 7fb8b363a640 1 librados: calling monclient init 2026-02-24T19:17:30.729 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.720+0000 7fb8b363a640 10 monclient: init 2026-02-24T19:17:30.729 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.720+0000 7fb8b363a640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:30.729 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.720+0000 7fb8b363a640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:30.729 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.720+0000 7fb8b363a640 10 monclient(hunting): picked mon.noname-b con 0x7fb8ac056090 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:30.729 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.720+0000 7fb8b363a640 10 monclient(hunting): picked mon.noname-c con 0x7fb8ac159da0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:30.729 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.720+0000 7fb8b363a640 10 monclient(hunting): picked mon.noname-a con 0x7fb8ac165880 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:30.730 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.720+0000 7fb8b363a640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8ac162f70 con 0x7fb8ac165880 2026-02-24T19:17:30.730 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.720+0000 7fb8b363a640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8ac1fbe20 con 0x7fb8ac056090 2026-02-24T19:17:30.730 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.720+0000 7fb8b363a640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8ac1fc100 con 0x7fb8ac159da0 2026-02-24T19:17:30.730 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.720+0000 7fb8b363a640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:30.730 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.720+0000 7fb8b363a640 10 monclient(hunting): authenticate will time out at 3625.401907s 2026-02-24T19:17:30.730 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.723+0000 7f41e67fc640 1 -- 10.20.193.14:0/517999795 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3180355916 0 0) 0x7f41c8003610 con 0x7f41f8159b60 2026-02-24T19:17:30.730 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.723+0000 7f41e67fc640 1 -- 10.20.193.14:0/517999795 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f41f81fe260 con 0x7f41f8159b60 2026-02-24T19:17:30.730 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.723+0000 7f41e67fc640 1 -- 10.20.193.14:0/517999795 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f41f40033d0 con 0x7f41f8159b60 2026-02-24T19:17:30.730 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.723+0000 7f41e67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:30.730 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.723+0000 7f41e67fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:30.730 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.723+0000 7f41e67fc640 10 monclient(hunting): dump: 2026-02-24T19:17:30.730 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.730 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.730 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.730 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.730 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.730 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.730 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.730 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.730 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.730 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.731 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.723+0000 7f41e67fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:30.731 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.723+0000 7fb8b0bae640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7fb8ac159da0 0x7fb8ac161b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:45458/0 (socket says 10.20.193.14:45458) 2026-02-24T19:17:30.731 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.723+0000 7fb8b0bae640 1 -- 10.20.193.14:0/1100562492 learned_addr learned my addr 10.20.193.14:0/1100562492 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:30.731 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.723+0000 7fb899ffb640 10 client.?.objecter ms_handle_connect 0x7fb8ac159da0 2026-02-24T19:17:30.731 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.723+0000 7fb899ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.732 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.725+0000 7f41e67fc640 1 -- 10.20.193.14:0/517999795 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2182703902 0 0) 0x7f41f81fe260 con 0x7f41f8159b60 2026-02-24T19:17:30.732 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.725+0000 7f41e67fc640 1 -- 10.20.193.14:0/517999795 >> v1:10.20.193.44:6789/0 conn(0x7f41f80b27b0 legacy=0x7f41f814f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.732 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.725+0000 7f41e67fc640 1 -- 10.20.193.14:0/517999795 >> v1:10.20.193.14:6789/0 conn(0x7f41f8059b90 legacy=0x7f41f81fac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.732 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.725+0000 7f41e67fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:30.732 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.725+0000 7f41e67fc640 1 monclient: found mon.c 2026-02-24T19:17:30.732 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.725+0000 7f41e67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:30.732 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.725+0000 7f41e67fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.732 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.725+0000 7f41e67fc640 1 -- 10.20.193.14:0/517999795 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f81fb550 con 0x7f41f8159b60 2026-02-24T19:17:30.732 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.725+0000 7f41e67fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:30.732 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.725+0000 7f41e67fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:30.732 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.725+0000 7f41e67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:30.732 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.725+0000 7f41ffc4e640 5 monclient: authenticate success, global_id 4598 2026-02-24T19:17:30.732 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.725+0000 7f41ffc4e640 10 monclient: _renew_subs 2026-02-24T19:17:30.732 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.725+0000 7f41ffc4e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.732 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.725+0000 7f41ffc4e640 1 -- 10.20.193.14:0/517999795 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f41f81fb830 con 0x7f41f8159b60 2026-02-24T19:17:30.732 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.725+0000 7f41ffc4e640 10 client.4598.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:30.732 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.725+0000 7f41ffc4e640 10 monclient: _renew_subs 2026-02-24T19:17:30.732 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.725+0000 7f41ffc4e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.732 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.725+0000 7f41ffc4e640 1 -- 10.20.193.14:0/517999795 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f41f81fe7e0 con 0x7f41f8159b60 2026-02-24T19:17:30.732 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.725+0000 7f41ffc4e640 1 librados: init done 2026-02-24T19:17:30.732 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.726+0000 7f41ffc4e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.732 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.726+0000 7f41ffc4e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.732 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.726+0000 7f41ffc4e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.733 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.726+0000 7f41ffc4e640 1 -- 10.20.193.14:0/517999795 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41f80b1160 con 0x7f41f8159b60 2026-02-24T19:17:30.733 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.726+0000 7fb899ffb640 1 -- 10.20.193.14:0/1100562492 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3013876263 0 0) 0x7fb8ac1fc100 con 0x7fb8ac159da0 2026-02-24T19:17:30.733 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.726+0000 7fb899ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.733 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.726+0000 7fb899ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.733 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.726+0000 7fb899ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.733 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.726+0000 7fb899ffb640 10 monclient(hunting): my global_id is 4601 2026-02-24T19:17:30.733 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.726+0000 7fb899ffb640 1 -- 10.20.193.14:0/1100562492 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb87c003610 con 0x7fb8ac159da0 2026-02-24T19:17:30.733 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.726+0000 7fe76f7fe640 1 -- 10.20.193.14:0/3180294831 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe7800032c0 con 0x7fe7900ba350 2026-02-24T19:17:30.733 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.727+0000 7fe76f7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:30.733 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.727+0000 7fe78d7fa640 4 set_mon_vals no callback set 2026-02-24T19:17:30.734 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.727+0000 7f9f42e8b640 10 monclient: get_monmap_and_config 2026-02-24T19:17:30.734 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.727+0000 7f9f42e8b640 10 monclient: build_initial_monmap 2026-02-24T19:17:30.734 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.727+0000 7f9f42e8b640 10 monclient: monmap: 2026-02-24T19:17:30.734 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:30.734 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.734 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:30.727781+0000 2026-02-24T19:17:30.734 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:30.727781+0000 2026-02-24T19:17:30.734 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:30.734 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.734 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:30.734 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:30.734 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:30.734 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.734 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.727+0000 7f9f42e8b640 1 Processor -- start 2026-02-24T19:17:30.734 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.727+0000 7f9f42e8b640 1 -- start start 2026-02-24T19:17:30.734 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.727+0000 7f9f42e8b640 10 monclient: init 2026-02-24T19:17:30.734 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.728+0000 7f9f42e8b640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:30.734 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.728+0000 7f9f42e8b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:30.734 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.728+0000 7f9f42e8b640 10 monclient(hunting): picked mon.noname-b con 0x7f9f3c15d3b0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:30.734 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.728+0000 7f9f42e8b640 10 monclient(hunting): picked mon.noname-a con 0x7f9f3c0b4c30 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:30.734 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.728+0000 7f9f42e8b640 10 monclient(hunting): picked mon.noname-c con 0x7f9f3c1a7ac0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:30.734 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.728+0000 7f9f42e8b640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f3c164640 con 0x7f9f3c0b4c30 2026-02-24T19:17:30.734 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.728+0000 7f9f42e8b640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f3c0b1530 con 0x7f9f3c15d3b0 2026-02-24T19:17:30.734 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.728+0000 7f9f42e8b640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f3c0b1810 con 0x7f9f3c1a7ac0 2026-02-24T19:17:30.734 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.728+0000 7f9f42e8b640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:30.734 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.728+0000 7f9f42e8b640 10 monclient(hunting): authenticate will time out at 3625.409318s 2026-02-24T19:17:30.735 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.731+0000 7fe76f7fe640 1 -- 10.20.193.14:0/3180294831 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fe780005200 con 0x7fe7900ba350 2026-02-24T19:17:30.735 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.731+0000 7fe76f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.735 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.731+0000 7fe76f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:30.735 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.731+0000 7fe76f7fe640 10 monclient: dump: 2026-02-24T19:17:30.735 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.735 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.735 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.735 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.735 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.735 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.735 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.735 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.735 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.735 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.736 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.732+0000 7fe76f7fe640 1 -- 10.20.193.14:0/3180294831 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7fe78001e070 con 0x7fe7900ba350 2026-02-24T19:17:30.736 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.732+0000 7fe78effd640 10 monclient: get_auth_request con 0x7fe75c077c60 auth_method 0 2026-02-24T19:17:30.736 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.732+0000 7fe76f7fe640 10 client.4614.objecter ms_handle_connect 0x7fe75c077c60 2026-02-24T19:17:30.737 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.736+0000 7f41e67fc640 1 -- 10.20.193.14:0/517999795 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f41f4003ac0 con 0x7f41f8159b60 2026-02-24T19:17:30.737 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.736+0000 7f41e67fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:30.737 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.736+0000 7f41e67fc640 1 -- 10.20.193.14:0/517999795 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f41f4003ed0 con 0x7f41f8159b60 2026-02-24T19:17:30.737 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.736+0000 7f41e67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.737 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.736+0000 7f41e7fff640 4 set_mon_vals no callback set 2026-02-24T19:17:30.737 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.736+0000 7f41e67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:30.737 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.736+0000 7f41e67fc640 10 monclient: dump: 2026-02-24T19:17:30.737 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.737 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.737 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.737 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.737 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.737 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.737 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.737 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.737 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.737 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.737 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.736+0000 7fb899ffb640 1 -- 10.20.193.14:0/1100562492 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3013870240 0 0) 0x7fb87c003610 con 0x7fb8ac159da0 2026-02-24T19:17:30.738 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.736+0000 7fb899ffb640 1 -- 10.20.193.14:0/1100562492 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb8ac1fc100 con 0x7fb8ac159da0 2026-02-24T19:17:30.738 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.736+0000 7fe76f7fe640 1 -- 10.20.193.14:0/3180294831 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7fe7800937a0 con 0x7fe7900ba350 2026-02-24T19:17:30.738 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.736+0000 7fe76f7fe640 10 client.4614.objecter ms_dispatch2 0x7fe790000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:30.738 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.736+0000 7fe76f7fe640 3 client.4614.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:30.738 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.736+0000 7fe76f7fe640 3 client.4614.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:30.738 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.736+0000 7fe76f7fe640 20 client.4614.objecter dump_active .. 0 homeless 2026-02-24T19:17:30.738 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.736+0000 7fe76f7fe640 1 -- 10.20.193.14:0/3180294831 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fe790163930 con 0x7fe7900ba350 2026-02-24T19:17:30.738 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.736+0000 7fe76f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.738 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.736+0000 7fe76f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:30.738 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.737+0000 7f41e67fc640 1 -- 10.20.193.14:0/517999795 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f41f40040b0 con 0x7f41f8159b60 2026-02-24T19:17:30.738 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.737+0000 7f41fd9c3640 10 monclient: get_auth_request con 0x7f41c8077bf0 auth_method 0 2026-02-24T19:17:30.738 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.737+0000 7f41e67fc640 10 client.4598.objecter ms_handle_connect 0x7f41c8077bf0 2026-02-24T19:17:30.739 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.738+0000 7f9f33fff640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f9f3c0b4c30 0x7f9f3c0af6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:55338/0 (socket says 10.20.193.14:55338) 2026-02-24T19:17:30.739 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.738+0000 7f9f33fff640 1 -- 10.20.193.14:0/661620109 learned_addr learned my addr 10.20.193.14:0/661620109 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:30.740 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.739+0000 7fb899ffb640 10 client.?.objecter ms_handle_connect 0x7fb8ac165880 2026-02-24T19:17:30.740 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.739+0000 7fb899ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.742 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.741+0000 7fb899ffb640 1 -- 10.20.193.14:0/1100562492 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1977692303 0 0) 0x7fb8ac162f70 con 0x7fb8ac165880 2026-02-24T19:17:30.742 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.741+0000 7fb899ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.742 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.741+0000 7fb899ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.742 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.741+0000 7fb899ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.742 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.741+0000 7fb899ffb640 10 monclient(hunting): my global_id is 4620 2026-02-24T19:17:30.742 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.741+0000 7fb899ffb640 1 -- 10.20.193.14:0/1100562492 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb87c003610 con 0x7fb8ac165880 2026-02-24T19:17:30.747 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.746+0000 7fb899ffb640 1 -- 10.20.193.14:0/1100562492 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2911088134 0 0) 0x7fb87c003610 con 0x7fb8ac165880 2026-02-24T19:17:30.747 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.746+0000 7fb899ffb640 1 -- 10.20.193.14:0/1100562492 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb8ac162f70 con 0x7fb8ac165880 2026-02-24T19:17:30.747 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.746+0000 7fb899ffb640 1 -- 10.20.193.14:0/1100562492 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fb8a80036d0 con 0x7fb8ac165880 2026-02-24T19:17:30.747 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.746+0000 7fb899ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:30.747 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.746+0000 7fb899ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:30.747 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.746+0000 7fb899ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:30.747 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.747 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.747 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.748 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.748 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.748 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.748 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.748 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.748 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.748 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.748 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.746+0000 7fb899ffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:30.748 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.746+0000 7f9f337fe640 1 -- 10.20.193.14:0/661620109 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1183781065 0 0) 0x7f9f24002910 con 0x7f9f3c0b4c30 2026-02-24T19:17:30.748 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.746+0000 7f9f337fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.748 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.746+0000 7f9f337fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.748 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.746+0000 7f9f337fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.748 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.746+0000 7f9f337fe640 10 monclient(hunting): my global_id is 4623 2026-02-24T19:17:30.748 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.746+0000 7f9f337fe640 1 -- 10.20.193.14:0/661620109 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f28003610 con 0x7f9f3c0b4c30 2026-02-24T19:17:30.754 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.753+0000 7fb899ffb640 1 -- 10.20.193.14:0/1100562492 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3007474245 0 0) 0x7fb8ac162f70 con 0x7fb8ac165880 2026-02-24T19:17:30.754 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.753+0000 7fb899ffb640 1 -- 10.20.193.14:0/1100562492 >> v1:10.20.193.170:6789/0 conn(0x7fb8ac159da0 legacy=0x7fb8ac161b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.754 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.753+0000 7fb899ffb640 1 -- 10.20.193.14:0/1100562492 >> v1:10.20.193.44:6789/0 conn(0x7fb8ac056090 legacy=0x7fb8ac162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.754 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.753+0000 7fb899ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:30.754 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.753+0000 7fb899ffb640 1 monclient: found mon.a 2026-02-24T19:17:30.754 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.753+0000 7fb899ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:30.755 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.753+0000 7fb899ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:30.755 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.753+0000 7fb899ffb640 1 -- 10.20.193.14:0/1100562492 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8ac1fc3e0 con 0x7fb8ac165880 2026-02-24T19:17:30.755 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.753+0000 7fb899ffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:30.755 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.753+0000 7fb899ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:30.755 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.753+0000 7fb899ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:30.755 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.753+0000 7fb8b363a640 5 monclient: authenticate success, global_id 4620 2026-02-24T19:17:30.755 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.753+0000 7fb8b363a640 10 monclient: _renew_subs 2026-02-24T19:17:30.755 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.753+0000 7fb8b363a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:30.755 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.753+0000 7fb8b363a640 1 -- 10.20.193.14:0/1100562492 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb8ac161330 con 0x7fb8ac165880 2026-02-24T19:17:30.755 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.753+0000 7f9f337fe640 1 -- 10.20.193.14:0/661620109 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1406595050 0 0) 0x7f9f28003610 con 0x7f9f3c0b4c30 2026-02-24T19:17:30.755 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.753+0000 7fb8b363a640 10 client.4620.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:30.755 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.753+0000 7fb8b363a640 10 monclient: _renew_subs 2026-02-24T19:17:30.755 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.753+0000 7fb8b363a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:30.755 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.753+0000 7fb8b363a640 1 -- 10.20.193.14:0/1100562492 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb8ac162240 con 0x7fb8ac165880 2026-02-24T19:17:30.755 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.753+0000 7fb8b363a640 1 librados: init done 2026-02-24T19:17:30.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.753+0000 7f9f337fe640 1 -- 10.20.193.14:0/661620109 >> v1:10.20.193.170:6789/0 conn(0x7f9f3c1a7ac0 legacy=0x7f9f3c1c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:30.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.753+0000 7f9f337fe640 1 -- 10.20.193.14:0/661620109 >> v1:10.20.193.44:6789/0 conn(0x7f9f3c15d3b0 legacy=0x7f9f3c163bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:30.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.753+0000 7f9f337fe640 10 monclient: _finish_hunting 0 2026-02-24T19:17:30.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.753+0000 7f9f337fe640 1 monclient: found mon.noname-a 2026-02-24T19:17:30.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.753+0000 7f9f337fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:30.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.753+0000 7f9f337fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:17:30.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.753+0000 7f9f337fe640 1 -- 10.20.193.14:0/661620109 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f3c0aebd0 con 0x7f9f3c0b4c30 2026-02-24T19:17:30.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.753+0000 7f9f337fe640 10 monclient: _finish_auth 0 2026-02-24T19:17:30.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.753+0000 7f9f337fe640 10 monclient: _check_auth_tickets 2026-02-24T19:17:30.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.753+0000 7f9f337fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:30.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.753+0000 7f9f42e8b640 5 monclient: authenticate success, global_id 4623 2026-02-24T19:17:30.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.753+0000 7f9f42e8b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:30.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.754+0000 7f9f337fe640 1 -- 10.20.193.14:0/661620109 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f9f24002fc0 con 0x7f9f3c0b4c30 2026-02-24T19:17:30.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.754+0000 7f9f337fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.754+0000 7f9f337fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:30.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.754+0000 7f9f337fe640 10 monclient: dump: 2026-02-24T19:17:30.756 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.756 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.756 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.756 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.756 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.756 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.756 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.757 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.757 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.757 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.757 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.754+0000 7f9f42e8b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:30.757 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.754+0000 7fb8b363a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.757 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.754+0000 7fb8b363a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.757 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.754+0000 7fb8b363a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:30.757 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.754+0000 7fb8b363a640 1 -- 10.20.193.14:0/1100562492 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8ac0b2d20 con 0x7fb8ac165880 2026-02-24T19:17:30.765 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.764+0000 7fb899ffb640 1 -- 10.20.193.14:0/1100562492 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb8a8002b10 con 0x7fb8ac165880 2026-02-24T19:17:30.765 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.764+0000 7fb899ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:30.765 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.764+0000 7fb899ffb640 1 -- 10.20.193.14:0/1100562492 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fb8a8005200 con 0x7fb8ac165880 2026-02-24T19:17:30.765 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.764+0000 7fb899ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.765 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.764+0000 7fb899ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:30.765 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.764+0000 7fb899ffb640 10 monclient: dump: 2026-02-24T19:17:30.765 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.765 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.765 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.765 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.766 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.766 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.766 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.766 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.766 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.766 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.766 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.764+0000 7fb89b7fe640 4 set_mon_vals no callback set 2026-02-24T19:17:30.766 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.764+0000 7f9f337fe640 1 -- 10.20.193.14:0/661620109 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9f24003210 con 0x7f9f3c0b4c30 2026-02-24T19:17:30.766 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.764+0000 7f9f337fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:30.766 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.764+0000 7f9f42e8b640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:30.766 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.764+0000 7f9f42e8b640 4 set_mon_vals no callback set 2026-02-24T19:17:30.766 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.765+0000 7f9f42e8b640 10 monclient: shutdown 2026-02-24T19:17:30.766 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.765+0000 7f9f42e8b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:30.766 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.765+0000 7f9f42e8b640 1 -- 10.20.193.14:0/661620109 >> v1:10.20.193.14:6789/0 conn(0x7f9f3c0b4c30 legacy=0x7f9f3c0af6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.767 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.765+0000 7f9f42e8b640 1 -- 10.20.193.14:0/661620109 shutdown_connections 2026-02-24T19:17:30.767 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.765+0000 7f9f42e8b640 1 -- 10.20.193.14:0/661620109 >> 10.20.193.14:0/661620109 conn(0x7f9f3c0b4120 msgr2=0x7f9f3c0b4520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:30.767 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.765+0000 7f9f42e8b640 1 -- 10.20.193.14:0/661620109 shutdown_connections 2026-02-24T19:17:30.767 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.765+0000 7f9f42e8b640 1 -- 10.20.193.14:0/661620109 wait complete. 2026-02-24T19:17:30.767 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.765+0000 7fb899ffb640 1 -- 10.20.193.14:0/1100562492 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7fb8a801e070 con 0x7fb8ac165880 2026-02-24T19:17:30.767 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.766+0000 7fb8b13af640 10 monclient: get_auth_request con 0x7fb87c077ea0 auth_method 0 2026-02-24T19:17:30.767 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.766+0000 7f9f42e8b640 10 monclient: build_initial_monmap 2026-02-24T19:17:30.767 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.766+0000 7f9f42e8b640 10 monclient: monmap: 2026-02-24T19:17:30.767 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:30.767 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:30.767 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:30.767 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:30.767 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:30.767 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:30.767 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:30.767 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:30.768 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:30.768 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.768 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.766+0000 7fb899ffb640 10 client.4620.objecter ms_handle_connect 0x7fb87c077ea0 2026-02-24T19:17:30.768 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.766+0000 7f9f42e8b640 1 librados: starting msgr at 2026-02-24T19:17:30.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.766+0000 7f9f42e8b640 1 librados: starting objecter 2026-02-24T19:17:30.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.766+0000 7f9f42e8b640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:30.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.766+0000 7f9f42e8b640 1 Processor -- start 2026-02-24T19:17:30.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.766+0000 7f9f42e8b640 1 -- start start 2026-02-24T19:17:30.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.766+0000 7f9f42e8b640 1 librados: setting wanted keys 2026-02-24T19:17:30.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.766+0000 7f9f42e8b640 1 librados: calling monclient init 2026-02-24T19:17:30.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.766+0000 7f9f42e8b640 10 monclient: init 2026-02-24T19:17:30.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.767+0000 7f9f42e8b640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:30.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.767+0000 7f9f42e8b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:30.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.767+0000 7f9f42e8b640 10 monclient(hunting): picked mon.noname-c con 0x7f9f3c0b4c30 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:30.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.767+0000 7f9f42e8b640 10 monclient(hunting): picked mon.noname-b con 0x7f9f3c15d3b0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:30.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.767+0000 7f9f42e8b640 10 monclient(hunting): picked mon.noname-a con 0x7f9f3c1a7ac0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:30.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.767+0000 7f9f42e8b640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f3c12a1e0 con 0x7f9f3c1a7ac0 2026-02-24T19:17:30.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.767+0000 7f9f42e8b640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f3c12a490 con 0x7f9f3c15d3b0 2026-02-24T19:17:30.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.767+0000 7f9f42e8b640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f3c1253c0 con 0x7f9f3c0b4c30 2026-02-24T19:17:30.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.767+0000 7f9f42e8b640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:30.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.767+0000 7f9f42e8b640 10 monclient(hunting): authenticate will time out at 3625.448336s 2026-02-24T19:17:30.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.768+0000 7fd844fc0640 10 monclient: get_monmap_and_config 2026-02-24T19:17:30.770 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.768+0000 7fd844fc0640 10 monclient: build_initial_monmap 2026-02-24T19:17:30.770 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.768+0000 7fd844fc0640 10 monclient: monmap: 2026-02-24T19:17:30.770 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:30.770 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.770 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:30.769078+0000 2026-02-24T19:17:30.770 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:30.769078+0000 2026-02-24T19:17:30.770 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:30.770 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.770 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:30.770 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:30.770 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:30.770 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.770 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.768+0000 7fd844fc0640 1 Processor -- start 2026-02-24T19:17:30.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.769+0000 7fd844fc0640 1 -- start start 2026-02-24T19:17:30.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.769+0000 7fd844fc0640 10 monclient: init 2026-02-24T19:17:30.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.769+0000 7fd844fc0640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:30.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.769+0000 7fd844fc0640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:30.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.769+0000 7fd844fc0640 10 monclient(hunting): picked mon.noname-b con 0x7fd840159850 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:30.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.769+0000 7fd844fc0640 10 monclient(hunting): picked mon.noname-c con 0x7fd840159c20 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:30.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.769+0000 7fd844fc0640 10 monclient(hunting): picked mon.noname-a con 0x7fd840059f70 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:30.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.769+0000 7fd844fc0640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8400b17e0 con 0x7fd840059f70 2026-02-24T19:17:30.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.769+0000 7fd844fc0640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8400b1ac0 con 0x7fd840159850 2026-02-24T19:17:30.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.769+0000 7fd844fc0640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8400b1da0 con 0x7fd840159c20 2026-02-24T19:17:30.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.769+0000 7fd844fc0640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:30.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.769+0000 7fd844fc0640 10 monclient(hunting): authenticate will time out at 3625.450711s 2026-02-24T19:17:30.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.800+0000 7fa0099c8640 10 monclient: get_monmap_and_config 2026-02-24T19:17:30.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.800+0000 7fa0099c8640 10 monclient: build_initial_monmap 2026-02-24T19:17:30.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.800+0000 7fa0099c8640 10 monclient: monmap: 2026-02-24T19:17:30.801 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:30.801 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.801 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:30.800907+0000 2026-02-24T19:17:30.801 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:30.800907+0000 2026-02-24T19:17:30.801 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:30.801 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.801 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:30.801 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:30.801 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:30.801 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.800+0000 7f0186074640 10 monclient: get_monmap_and_config 2026-02-24T19:17:30.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.800+0000 7f0186074640 10 monclient: build_initial_monmap 2026-02-24T19:17:30.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.800+0000 7f0186074640 10 monclient: monmap: 2026-02-24T19:17:30.802 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:30.802 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.802 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:30.801177+0000 2026-02-24T19:17:30.802 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:30.801177+0000 2026-02-24T19:17:30.802 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:30.802 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.802 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:30.802 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:30.802 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:30.802 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.800+0000 7f53418bf640 10 monclient: get_monmap_and_config 2026-02-24T19:17:30.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.800+0000 7f53418bf640 10 monclient: build_initial_monmap 2026-02-24T19:17:30.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.800+0000 7f53418bf640 10 monclient: monmap: 2026-02-24T19:17:30.803 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:30.803 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.803 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:30.801193+0000 2026-02-24T19:17:30.803 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:30.801193+0000 2026-02-24T19:17:30.803 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:30.803 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.803 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:30.803 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:30.803 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:30.803 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.800+0000 7fa0099c8640 1 Processor -- start 2026-02-24T19:17:30.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.800+0000 7fa0099c8640 1 -- start start 2026-02-24T19:17:30.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.800+0000 7fa0099c8640 10 monclient: init 2026-02-24T19:17:30.804 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7f0186074640 1 Processor -- start 2026-02-24T19:17:30.804 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7f0186074640 1 -- start start 2026-02-24T19:17:30.804 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7f0186074640 10 monclient: init 2026-02-24T19:17:30.804 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7f53418bf640 1 Processor -- start 2026-02-24T19:17:30.804 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7f53418bf640 1 -- start start 2026-02-24T19:17:30.804 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7f53418bf640 10 monclient: init 2026-02-24T19:17:30.804 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7efe5affd640 1 -- 10.20.193.14:0/1987191060 <== mon.1 v1:10.20.193.44:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efe68003110 con 0x7efe740585e0 2026-02-24T19:17:30.804 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7efe5affd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:30.804 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7efe5affd640 1 -- 10.20.193.14:0/1987191060 <== mon.1 v1:10.20.193.44:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7efe680037d0 con 0x7efe740585e0 2026-02-24T19:17:30.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7efe5affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7efe5affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:30.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7efe5affd640 10 monclient: dump: 2026-02-24T19:17:30.805 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.805 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.805 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.805 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.805 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.805 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.805 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.805 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.805 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.805 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7efe70d72640 4 set_mon_vals no callback set 2026-02-24T19:17:30.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7f0186074640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:30.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7fa0099c8640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:30.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7f0186074640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:30.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7f0186074640 10 monclient(hunting): picked mon.noname-b con 0x7f01800b9f80 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:30.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7fa0099c8640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:30.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7f0186074640 10 monclient(hunting): picked mon.noname-c con 0x7f01800ba350 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:30.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7fa0099c8640 10 monclient(hunting): picked mon.noname-b con 0x7fa00415d070 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:30.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7fa0099c8640 10 monclient(hunting): picked mon.noname-a con 0x7fa00415d440 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:30.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7f0186074640 10 monclient(hunting): picked mon.noname-a con 0x7f01800585e0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:30.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7fa0099c8640 10 monclient(hunting): picked mon.noname-c con 0x7fa004166f60 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:30.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7fa0099c8640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa004164e60 con 0x7fa00415d440 2026-02-24T19:17:30.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7fa0099c8640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0040b1790 con 0x7fa00415d070 2026-02-24T19:17:30.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7f0186074640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0180163930 con 0x7f01800585e0 2026-02-24T19:17:30.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7f0186074640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0180163bb0 con 0x7f01800b9f80 2026-02-24T19:17:30.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7fa0099c8640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0040b1a70 con 0x7fa004166f60 2026-02-24T19:17:30.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7fa0099c8640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:30.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7fa0099c8640 10 monclient(hunting): authenticate will time out at 3625.482723s 2026-02-24T19:17:30.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7f0186074640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0180163e90 con 0x7f01800ba350 2026-02-24T19:17:30.808 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7f0186074640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:30.808 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7f0186074640 10 monclient(hunting): authenticate will time out at 3625.482737s 2026-02-24T19:17:30.808 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7f53418bf640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:30.808 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7f53418bf640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:30.808 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7f53418bf640 10 monclient(hunting): picked mon.noname-c con 0x7f533c0b9f80 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:30.808 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7f53418bf640 10 monclient(hunting): picked mon.noname-a con 0x7f533c0ba350 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:30.808 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7f53418bf640 10 monclient(hunting): picked mon.noname-b con 0x7f533c0585e0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:30.808 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7f53418bf640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f533c163930 con 0x7f533c0ba350 2026-02-24T19:17:30.808 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7f53418bf640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f533c163bb0 con 0x7f533c0585e0 2026-02-24T19:17:30.808 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7f53418bf640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f533c163e90 con 0x7f533c0b9f80 2026-02-24T19:17:30.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7f53418bf640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:30.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.801+0000 7f53418bf640 10 monclient(hunting): authenticate will time out at 3625.482879s 2026-02-24T19:17:30.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.802+0000 7efe5affd640 1 -- 10.20.193.14:0/1987191060 <== mon.1 v1:10.20.193.44:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7efe6801c680 con 0x7efe740585e0 2026-02-24T19:17:30.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.802+0000 7efe71d74640 10 monclient: get_auth_request con 0x7efe40077ca0 auth_method 0 2026-02-24T19:17:30.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.803+0000 7efe5affd640 10 client.4558.objecter ms_handle_connect 0x7efe40077ca0 2026-02-24T19:17:30.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.803+0000 7efe5affd640 1 -- 10.20.193.14:0/1987191060 <== mon.1 v1:10.20.193.44:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7efe680920d0 con 0x7efe740585e0 2026-02-24T19:17:30.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.803+0000 7efe5affd640 10 client.4558.objecter ms_dispatch2 0x7efe74000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:30.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.803+0000 7efe5affd640 3 client.4558.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:30.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.803+0000 7efe5affd640 3 client.4558.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:30.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.804+0000 7efe5affd640 20 client.4558.objecter dump_active .. 0 homeless 2026-02-24T19:17:30.810 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2026-02-24T19:17:30.810 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.804+0000 7fe0cbfac640 10 monclient: get_monmap_and_config 2026-02-24T19:17:30.810 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.804+0000 7fe0cbfac640 10 monclient: build_initial_monmap 2026-02-24T19:17:30.810 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.804+0000 7fe0cbfac640 10 monclient: monmap: 2026-02-24T19:17:30.810 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:30.810 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.810 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:30.805204+0000 2026-02-24T19:17:30.810 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:30.805204+0000 2026-02-24T19:17:30.810 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:30.810 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.810 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:30.811 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:30.811 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:30.811 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.805+0000 7fe0cbfac640 1 Processor -- start 2026-02-24T19:17:30.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.805+0000 7fe0cbfac640 1 -- start start 2026-02-24T19:17:30.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.805+0000 7fe0cbfac640 10 monclient: init 2026-02-24T19:17:30.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.805+0000 7efe5affd640 1 -- 10.20.193.14:0/1987191060 <== mon.1 v1:10.20.193.44:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7efe6805cb00 con 0x7efe740585e0 2026-02-24T19:17:30.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.805+0000 7efe5affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.811 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.805+0000 7efe5affd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:30.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.805+0000 7fe0cbfac640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:30.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.805+0000 7fe0cbfac640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:30.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.805+0000 7fe0cbfac640 10 monclient(hunting): picked mon.noname-c con 0x7fe0c40b9f80 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:30.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.805+0000 7fe0cbfac640 10 monclient(hunting): picked mon.noname-a con 0x7fe0c40ba350 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:30.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.805+0000 7fe0cbfac640 10 monclient(hunting): picked mon.noname-b con 0x7fe0c40585e0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:30.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.805+0000 7fe0cbfac640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c4163930 con 0x7fe0c40ba350 2026-02-24T19:17:30.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.805+0000 7fe0cbfac640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c4163bb0 con 0x7fe0c40585e0 2026-02-24T19:17:30.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.805+0000 7fe0cbfac640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c4163e90 con 0x7fe0c40b9f80 2026-02-24T19:17:30.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.805+0000 7fe0cbfac640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:30.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.805+0000 7fe0cbfac640 10 monclient(hunting): authenticate will time out at 3625.486789s 2026-02-24T19:17:30.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.806+0000 7fa002ffd640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7fa00415d070 0x7fa004164750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:35112/0 (socket says 10.20.193.14:35112) 2026-02-24T19:17:30.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.806+0000 7fa002ffd640 1 -- 10.20.193.14:0/2800149772 learned_addr learned my addr 10.20.193.14:0/2800149772 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:30.813 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.809+0000 7f9f33fff640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7f9f3c15d3b0 0x7f9f3c126460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:35096/0 (socket says 10.20.193.14:35096) 2026-02-24T19:17:30.813 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.809+0000 7f9f33fff640 1 -- 10.20.193.14:0/687193607 learned_addr learned my addr 10.20.193.14:0/687193607 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:30.813 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.809+0000 7fe0ca522640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7fe0c40585e0 0x7fe0c4166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:35144/0 (socket says 10.20.193.14:35144) 2026-02-24T19:17:30.813 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.809+0000 7fe0ca522640 1 -- 10.20.193.14:0/225041779 learned_addr learned my addr 10.20.193.14:0/225041779 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:30.813 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.810+0000 7f9f317fa640 10 client.?.objecter ms_handle_connect 0x7f9f3c15d3b0 2026-02-24T19:17:30.813 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.810+0000 7f9f317fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.813 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.811+0000 7f017f7fe640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7f01800b9f80 0x7f0180163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:35114/0 (socket says 10.20.193.14:35114) 2026-02-24T19:17:30.813 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.811+0000 7f017f7fe640 1 -- 10.20.193.14:0/3519388823 learned_addr learned my addr 10.20.193.14:0/3519388823 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:30.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.811+0000 7fd83e575640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7fd840159850 0x7fd840057620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:35106/0 (socket says 10.20.193.14:35106) 2026-02-24T19:17:30.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.811+0000 7fd83e575640 1 -- 10.20.193.14:0/2860417188 learned_addr learned my addr 10.20.193.14:0/2860417188 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:30.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.812+0000 7fa001ffb640 1 -- 10.20.193.14:0/2800149772 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1036026150 0 0) 0x7fa0040b1790 con 0x7fa00415d070 2026-02-24T19:17:30.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.812+0000 7fa001ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.812+0000 7fa001ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.812+0000 7fa001ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.812+0000 7fa001ffb640 10 monclient(hunting): my global_id is 4564 2026-02-24T19:17:30.814 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.812+0000 7fa001ffb640 1 -- 10.20.193.14:0/2800149772 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ff0003610 con 0x7fa00415d070 2026-02-24T19:17:30.815 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.812+0000 7fe0c8d1f640 1 -- 10.20.193.14:0/225041779 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 858468547 0 0) 0x7fe0c4163bb0 con 0x7fe0c40585e0 2026-02-24T19:17:30.815 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.812+0000 7fe0c8d1f640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.815 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.812+0000 7fe0c8d1f640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.815 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.812+0000 7fe0c8d1f640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.815 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.812+0000 7fe0c8d1f640 10 monclient(hunting): my global_id is 4570 2026-02-24T19:17:30.815 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.812+0000 7fe0c8d1f640 1 -- 10.20.193.14:0/225041779 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0ac003610 con 0x7fe0c40585e0 2026-02-24T19:17:30.816 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.814+0000 7fa001ffb640 1 -- 10.20.193.14:0/2800149772 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1468320779 0 0) 0x7f9ff0003610 con 0x7fa00415d070 2026-02-24T19:17:30.816 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.814+0000 7fa001ffb640 1 -- 10.20.193.14:0/2800149772 >> v1:10.20.193.170:6789/0 conn(0x7fa004166f60 legacy=0x7fa0040b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:30.816 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.814+0000 7fa001ffb640 1 -- 10.20.193.14:0/2800149772 >> v1:10.20.193.14:6789/0 conn(0x7fa00415d440 legacy=0x7fa004166850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:30.816 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.814+0000 7fa001ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:30.816 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.814+0000 7fa001ffb640 1 monclient: found mon.noname-b 2026-02-24T19:17:30.816 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.814+0000 7fa001ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:30.816 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.814+0000 7fa001ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.44:6789/0 2026-02-24T19:17:30.816 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.814+0000 7fa001ffb640 1 -- 10.20.193.14:0/2800149772 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0040b1d50 con 0x7fa00415d070 2026-02-24T19:17:30.816 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.814+0000 7fa001ffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:30.816 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.814+0000 7fa001ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:30.816 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.814+0000 7fa001ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:30.816 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.814+0000 7fa0099c8640 5 monclient: authenticate success, global_id 4564 2026-02-24T19:17:30.816 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.814+0000 7fa0099c8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:30.817 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.815+0000 7fa001ffb640 1 -- 10.20.193.14:0/2800149772 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f9ff8002df0 con 0x7fa00415d070 2026-02-24T19:17:30.817 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.815+0000 7fa001ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.817 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.815+0000 7fa001ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:30.817 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.815+0000 7fa001ffb640 10 monclient: dump: 2026-02-24T19:17:30.817 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.817 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.817 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.817 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.817 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.817 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.817 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.817 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.817 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.817 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.817 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.815+0000 7fa0099c8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:30.817 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.815+0000 7f533b7fe640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7f533c0585e0 0x7f533c166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:35128/0 (socket says 10.20.193.14:35128) 2026-02-24T19:17:30.817 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.815+0000 7f533b7fe640 1 -- 10.20.193.14:0/3185045495 learned_addr learned my addr 10.20.193.14:0/3185045495 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:30.818 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.816+0000 7f445a8e8640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-24T19:17:30.818 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.816+0000 7f445a8e8640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-24T19:17:30.818 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.816+0000 7f445a8e8640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:30.818 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.816+0000 7f445a8e8640 1 -- 10.20.193.14:0/3515511597 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f44540b94f0 con 0x7f44540585e0 2026-02-24T19:17:30.818 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.816+0000 7f30a1abf640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-24T19:17:30.818 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.816+0000 7f30a1abf640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-24T19:17:30.818 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.816+0000 7f30a1abf640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.818 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.816+0000 7f30a1abf640 1 -- 10.20.193.14:0/3903178311 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f309c0b5540 con 0x7f309c157b50 2026-02-24T19:17:30.820 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.819+0000 7f9f317fa640 1 -- 10.20.193.14:0/687193607 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1323580909 0 0) 0x7f9f3c12a490 con 0x7f9f3c15d3b0 2026-02-24T19:17:30.820 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.819+0000 7f9f317fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.820 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.819+0000 7f9f317fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.820 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.819+0000 7f9f317fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.820 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.819+0000 7f9f317fa640 10 monclient(hunting): my global_id is 4567 2026-02-24T19:17:30.820 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.819+0000 7f9f317fa640 1 -- 10.20.193.14:0/687193607 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f0c003610 con 0x7f9f3c15d3b0 2026-02-24T19:17:30.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.819+0000 7f017e7fc640 1 -- 10.20.193.14:0/3519388823 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3400324255 0 0) 0x7f0180163bb0 con 0x7f01800b9f80 2026-02-24T19:17:30.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.819+0000 7f017e7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.819+0000 7f017e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.819+0000 7f017e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.819+0000 7f017e7fc640 10 monclient(hunting): my global_id is 4576 2026-02-24T19:17:30.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.819+0000 7f017e7fc640 1 -- 10.20.193.14:0/3519388823 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0164003610 con 0x7f01800b9f80 2026-02-24T19:17:30.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.819+0000 7fd83d573640 1 -- 10.20.193.14:0/2860417188 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 762710780 0 0) 0x7fd8400b1ac0 con 0x7fd840159850 2026-02-24T19:17:30.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.819+0000 7fd83d573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.819+0000 7fd83d573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.819+0000 7fd83d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.819+0000 7fd83d573640 10 monclient(hunting): my global_id is 4573 2026-02-24T19:17:30.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.819+0000 7fd83d573640 1 -- 10.20.193.14:0/2860417188 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd82c003610 con 0x7fd840159850 2026-02-24T19:17:30.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.820+0000 7fe0c8d1f640 1 -- 10.20.193.14:0/225041779 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1284049283 0 0) 0x7fe0ac003610 con 0x7fe0c40585e0 2026-02-24T19:17:30.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.820+0000 7fe0c8d1f640 1 -- 10.20.193.14:0/225041779 >> v1:10.20.193.170:6789/0 conn(0x7fe0c40b9f80 legacy=0x7fe0c4163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:30.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.820+0000 7fe0c8d1f640 1 -- 10.20.193.14:0/225041779 >> v1:10.20.193.14:6789/0 conn(0x7fe0c40ba350 legacy=0x7fe0c4057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:30.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.820+0000 7fe0c8d1f640 10 monclient: _finish_hunting 0 2026-02-24T19:17:30.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.820+0000 7fe0c8d1f640 1 monclient: found mon.noname-b 2026-02-24T19:17:30.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.820+0000 7fe0c8d1f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:30.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.820+0000 7fe0c8d1f640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.44:6789/0 2026-02-24T19:17:30.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.820+0000 7fe0c8d1f640 1 -- 10.20.193.14:0/225041779 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c40573f0 con 0x7fe0c40585e0 2026-02-24T19:17:30.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.820+0000 7fe0c8d1f640 10 monclient: _finish_auth 0 2026-02-24T19:17:30.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.820+0000 7fe0c8d1f640 10 monclient: _check_auth_tickets 2026-02-24T19:17:30.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.820+0000 7fe0c8d1f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:30.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.820+0000 7fe0c8d1f640 1 -- 10.20.193.14:0/225041779 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fe0c0003170 con 0x7fe0c40585e0 2026-02-24T19:17:30.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.820+0000 7fe0c8d1f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.820+0000 7fe0c8d1f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:30.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.820+0000 7fe0c8d1f640 10 monclient: dump: 2026-02-24T19:17:30.822 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.822 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.822 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.823 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.823 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.823 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.823 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.823 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.823 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.823 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.823 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.820+0000 7fe0cbfac640 5 monclient: authenticate success, global_id 4570 2026-02-24T19:17:30.823 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.820+0000 7fe0cbfac640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:30.823 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.820+0000 7f41e67fc640 1 -- 10.20.193.14:0/517999795 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7f41f40936c0 con 0x7f41f8159b60 2026-02-24T19:17:30.823 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.820+0000 7f41e67fc640 10 client.4598.objecter ms_dispatch2 0x7f41f8000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:30.823 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.820+0000 7f41e67fc640 3 client.4598.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:30.823 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.820+0000 7f41e67fc640 3 client.4598.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:30.823 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.820+0000 7f41e67fc640 20 client.4598.objecter dump_active .. 0 homeless 2026-02-24T19:17:30.823 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.821+0000 7f41e67fc640 1 -- 10.20.193.14:0/517999795 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f41f405e0f0 con 0x7f41f8159b60 2026-02-24T19:17:30.824 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.821+0000 7f41e67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.824 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.821+0000 7f41e67fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:30.826 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.825+0000 7f017e7fc640 1 -- 10.20.193.14:0/3519388823 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3619350670 0 0) 0x7f0164003610 con 0x7f01800b9f80 2026-02-24T19:17:30.826 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.825+0000 7f017e7fc640 1 -- 10.20.193.14:0/3519388823 >> v1:10.20.193.170:6789/0 conn(0x7f01800ba350 legacy=0x7f0180057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:30.826 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.825+0000 7f017e7fc640 1 -- 10.20.193.14:0/3519388823 >> v1:10.20.193.14:6789/0 conn(0x7f01800585e0 legacy=0x7f0180166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:30.826 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.825+0000 7f017e7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:30.826 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.825+0000 7f017e7fc640 1 monclient: found mon.noname-b 2026-02-24T19:17:30.826 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.825+0000 7f017e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:30.826 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.825+0000 7f017e7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.44:6789/0 2026-02-24T19:17:30.826 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.825+0000 7f017e7fc640 1 -- 10.20.193.14:0/3519388823 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01800573f0 con 0x7f01800b9f80 2026-02-24T19:17:30.826 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.825+0000 7f017e7fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:30.826 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.825+0000 7f017e7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:30.826 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.825+0000 7f017e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:30.827 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.825+0000 7f0186074640 5 monclient: authenticate success, global_id 4576 2026-02-24T19:17:30.827 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.825+0000 7f0186074640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:30.827 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.826+0000 7f017e7fc640 1 -- 10.20.193.14:0/3519388823 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f016c002df0 con 0x7f01800b9f80 2026-02-24T19:17:30.827 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.826+0000 7f017e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.827 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.826+0000 7f017e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:30.827 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.826+0000 7f017e7fc640 10 monclient: dump: 2026-02-24T19:17:30.827 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.827 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.827 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.828 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.828 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.828 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.828 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.828 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.828 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.828 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.828 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.826+0000 7f0186074640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:30.828 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.827+0000 7f3077fff640 1 -- 10.20.193.14:0/3903178311 <== mon.2 v1:10.20.193.170:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (unknown 1482059429 0 1498640560) 0x7f308c05c2f0 con 0x7f309c157b50 2026-02-24T19:17:30.828 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.827+0000 7f3077fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-24T19:17:30.828 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.827+0000 7f3077fff640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:30.829 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.827+0000 7fd83d573640 1 -- 10.20.193.14:0/2860417188 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1494928379 0 0) 0x7fd82c003610 con 0x7fd840159850 2026-02-24T19:17:30.829 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.827+0000 7fd83d573640 1 -- 10.20.193.14:0/2860417188 >> v1:10.20.193.170:6789/0 conn(0x7fd840159c20 legacy=0x7fd840059860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.829 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.827+0000 7fd83d573640 1 -- 10.20.193.14:0/2860417188 >> v1:10.20.193.14:6789/0 conn(0x7fd840059f70 legacy=0x7fd8401c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:30.829 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.827+0000 7fd83d573640 10 monclient: _finish_hunting 0 2026-02-24T19:17:30.829 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.827+0000 7fd83d573640 1 monclient: found mon.noname-b 2026-02-24T19:17:30.829 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.827+0000 7fd83d573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:30.829 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.827+0000 7fd83d573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.44:6789/0 2026-02-24T19:17:30.829 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.827+0000 7fd83d573640 1 -- 10.20.193.14:0/2860417188 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8400b2080 con 0x7fd840159850 2026-02-24T19:17:30.829 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.827+0000 7fd83d573640 10 monclient: _finish_auth 0 2026-02-24T19:17:30.829 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.827+0000 7fd83d573640 10 monclient: _check_auth_tickets 2026-02-24T19:17:30.829 INFO:teuthology.orchestra.run.trial014.stdout:90194313221 2026-02-24T19:17:30.829 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.827+0000 7fd83d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:30.829 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.827+0000 7fd83d573640 1 -- 10.20.193.14:0/2860417188 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fd834002df0 con 0x7fd840159850 2026-02-24T19:17:30.830 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.827+0000 7fd83d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.830 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.827+0000 7fd83d573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:30.830 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.827+0000 7fd83d573640 10 monclient: dump: 2026-02-24T19:17:30.830 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.830 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.830 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.830 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.830 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.830 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.830 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.830 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.830 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.830 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.830 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.827+0000 7fd844fc0640 5 monclient: authenticate success, global_id 4573 2026-02-24T19:17:30.830 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.827+0000 7fd844fc0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:30.830 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.828+0000 7f5339ffb640 1 -- 10.20.193.14:0/3185045495 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3855421221 0 0) 0x7f533c163bb0 con 0x7f533c0585e0 2026-02-24T19:17:30.830 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.828+0000 7f5339ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.831 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.828+0000 7f5339ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.831 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.828+0000 7f5339ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.831 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.828+0000 7f5339ffb640 10 monclient(hunting): my global_id is 4579 2026-02-24T19:17:30.831 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.828+0000 7f5339ffb640 1 -- 10.20.193.14:0/3185045495 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5328003610 con 0x7f533c0585e0 2026-02-24T19:17:30.831 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.828+0000 7f9f317fa640 1 -- 10.20.193.14:0/687193607 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4259091730 0 0) 0x7f9f0c003610 con 0x7f9f3c15d3b0 2026-02-24T19:17:30.831 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.828+0000 7f9f317fa640 1 -- 10.20.193.14:0/687193607 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9f3c12a490 con 0x7f9f3c15d3b0 2026-02-24T19:17:30.831 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.828+0000 7f9f317fa640 1 -- 10.20.193.14:0/687193607 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f9f240048d0 con 0x7f9f3c15d3b0 2026-02-24T19:17:30.831 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.828+0000 7f9f317fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:30.831 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.828+0000 7f9f317fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:30.831 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.828+0000 7f9f317fa640 10 monclient(hunting): dump: 2026-02-24T19:17:30.831 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.831 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.831 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.831 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.831 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.832 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.832 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.832 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.832 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.832 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.832 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.828+0000 7f9f317fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:30.832 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7fa001ffb640 1 -- 10.20.193.14:0/2800149772 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9ff8003040 con 0x7fa00415d070 2026-02-24T19:17:30.832 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7fa001ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:30.832 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7fa001ffb640 1 -- 10.20.193.14:0/2800149772 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f9ff8003480 con 0x7fa00415d070 2026-02-24T19:17:30.832 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7fa001ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.832 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7fa001ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:30.832 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7fa001ffb640 10 monclient: dump: 2026-02-24T19:17:30.832 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.832 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.832 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.832 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.832 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.833 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.833 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.833 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.833 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.833 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.833 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7fa0099c8640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:30.833 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7fa0099c8640 4 set_mon_vals no callback set 2026-02-24T19:17:30.833 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7f30a1abf640 10 librados: watch_flush enter 2026-02-24T19:17:30.833 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7f30a1abf640 10 librados: watch_flush exit 2026-02-24T19:17:30.833 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7f30a1abf640 20 client.4583.objecter shutdown clearing up homeless session... 2026-02-24T19:17:30.833 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7f30a1abf640 10 client.4583.objecter successfully canceled tick 2026-02-24T19:17:30.833 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7f4450ff9640 1 -- 10.20.193.14:0/3515511597 <== mon.1 v1:10.20.193.44:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+12 (unknown 2894986287 0 1498640560) 0x7f444005d5b0 con 0x7f44540585e0 2026-02-24T19:17:30.833 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7f4450ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-24T19:17:30.834 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7f4450ff9640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:30.834 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7f30a1abf640 1 -- 10.20.193.14:0/3903178311 >> v1:10.20.193.14:6800/4014096310 conn(0x7f306c077dd0 legacy=0x7f306c098280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.834 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7f30a1abf640 10 monclient: shutdown 2026-02-24T19:17:30.834 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7f30a1abf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:30.834 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7f30a1abf640 1 -- 10.20.193.14:0/3903178311 >> v1:10.20.193.170:6789/0 conn(0x7f309c157b50 legacy=0x7f309c149180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.834 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7f30a1abf640 1 -- 10.20.193.14:0/3903178311 shutdown_connections 2026-02-24T19:17:30.834 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7f30a1abf640 1 -- 10.20.193.14:0/3903178311 >> 10.20.193.14:0/3903178311 conn(0x7f309c0b2ef0 msgr2=0x7f309c0b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:30.834 INFO:teuthology.orchestra.run.trial014.stdout:90194313221 2026-02-24T19:17:30.835 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7f30a1abf640 1 -- 10.20.193.14:0/3903178311 shutdown_connections 2026-02-24T19:17:30.835 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7f30a1abf640 1 -- 10.20.193.14:0/3903178311 wait complete. 2026-02-24T19:17:30.835 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7f30a1abf640 1 librados: shutdown 2026-02-24T19:17:30.835 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7fa0099c8640 10 monclient: shutdown 2026-02-24T19:17:30.835 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7fa0099c8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:30.835 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7fa0099c8640 1 -- 10.20.193.14:0/2800149772 >> v1:10.20.193.44:6789/0 conn(0x7fa00415d070 legacy=0x7fa004164750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.835 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7fa0099c8640 1 -- 10.20.193.14:0/2800149772 shutdown_connections 2026-02-24T19:17:30.835 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7fa0099c8640 1 -- 10.20.193.14:0/2800149772 >> 10.20.193.14:0/2800149772 conn(0x7fa0040b2ef0 msgr2=0x7fa0040b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:30.835 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7fa0099c8640 1 -- 10.20.193.14:0/2800149772 shutdown_connections 2026-02-24T19:17:30.835 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7fa0099c8640 1 -- 10.20.193.14:0/2800149772 wait complete. 2026-02-24T19:17:30.836 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7fe0c8d1f640 1 -- 10.20.193.14:0/225041779 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe0c0003380 con 0x7fe0c40585e0 2026-02-24T19:17:30.836 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7fe0c8d1f640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:30.836 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7fe0c8d1f640 1 -- 10.20.193.14:0/225041779 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fe0c00037c0 con 0x7fe0c40585e0 2026-02-24T19:17:30.836 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7fe0c8d1f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.836 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7fe0c8d1f640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:30.836 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7fe0c8d1f640 10 monclient: dump: 2026-02-24T19:17:30.836 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.836 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.836 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.836 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.836 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.836 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.836 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.836 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.836 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.836 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.836 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7fe0cbfac640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:30.836 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.830+0000 7fe0cbfac640 4 set_mon_vals no callback set 2026-02-24T19:17:30.837 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.831+0000 7fa0099c8640 10 monclient: build_initial_monmap 2026-02-24T19:17:30.837 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.831+0000 7fa0099c8640 10 monclient: monmap: 2026-02-24T19:17:30.837 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:30.837 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:30.837 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:30.837 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:30.837 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:30.837 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:30.837 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:30.837 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:30.837 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:30.837 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.837 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.831+0000 7fe0cbfac640 10 monclient: shutdown 2026-02-24T19:17:30.837 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.831+0000 7fe0cbfac640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:30.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.831+0000 7fe0cbfac640 1 -- 10.20.193.14:0/225041779 >> v1:10.20.193.44:6789/0 conn(0x7fe0c40585e0 legacy=0x7fe0c4166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.831+0000 7fe0cbfac640 1 -- 10.20.193.14:0/225041779 shutdown_connections 2026-02-24T19:17:30.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.831+0000 7fe0cbfac640 1 -- 10.20.193.14:0/225041779 >> 10.20.193.14:0/225041779 conn(0x7fe0c40b7990 msgr2=0x7fe0c40b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:30.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.831+0000 7fe0cbfac640 1 -- 10.20.193.14:0/225041779 shutdown_connections 2026-02-24T19:17:30.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.831+0000 7fe0cbfac640 1 -- 10.20.193.14:0/225041779 wait complete. 2026-02-24T19:17:30.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.831+0000 7fa0099c8640 1 librados: starting msgr at 2026-02-24T19:17:30.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.831+0000 7fa0099c8640 1 librados: starting objecter 2026-02-24T19:17:30.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.831+0000 7fa0099c8640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:30.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.831+0000 7fa0099c8640 1 Processor -- start 2026-02-24T19:17:30.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.831+0000 7fa0099c8640 1 -- start start 2026-02-24T19:17:30.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.831+0000 7fa0099c8640 1 librados: setting wanted keys 2026-02-24T19:17:30.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.831+0000 7fa0099c8640 1 librados: calling monclient init 2026-02-24T19:17:30.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.831+0000 7fa0099c8640 10 monclient: init 2026-02-24T19:17:30.839 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.832+0000 7fe0cbfac640 10 monclient: build_initial_monmap 2026-02-24T19:17:30.839 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.832+0000 7fe0cbfac640 10 monclient: monmap: 2026-02-24T19:17:30.839 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:30.839 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:30.839 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:30.839 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:30.839 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:30.839 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:30.839 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:30.839 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:30.839 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:30.839 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.839 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.832+0000 7fa0099c8640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:30.840 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.832+0000 7fa0099c8640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:30.840 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.832+0000 7fa0099c8640 10 monclient(hunting): picked mon.noname-b con 0x7fa00415d070 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:30.840 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.832+0000 7fa0099c8640 10 monclient(hunting): picked mon.noname-a con 0x7fa00415d440 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:30.840 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.832+0000 7fa0099c8640 10 monclient(hunting): picked mon.noname-c con 0x7fa004166f60 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:30.840 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.832+0000 7fa0099c8640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0040a9bb0 con 0x7fa00415d440 2026-02-24T19:17:30.840 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.832+0000 7fa0099c8640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0041fc820 con 0x7fa00415d070 2026-02-24T19:17:30.840 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.832+0000 7fa0099c8640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0040a8830 con 0x7fa004166f60 2026-02-24T19:17:30.840 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.832+0000 7fa0099c8640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:30.840 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.832+0000 7fa0099c8640 10 monclient(hunting): authenticate will time out at 3625.513288s 2026-02-24T19:17:30.840 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.832+0000 7fe0cbfac640 1 librados: starting msgr at 2026-02-24T19:17:30.840 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.832+0000 7fe0cbfac640 1 librados: starting objecter 2026-02-24T19:17:30.840 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.832+0000 7fe0cbfac640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:30.840 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.832+0000 7fe0cbfac640 1 Processor -- start 2026-02-24T19:17:30.840 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.832+0000 7fe0cbfac640 1 -- start start 2026-02-24T19:17:30.840 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.832+0000 7fe0cbfac640 1 librados: setting wanted keys 2026-02-24T19:17:30.840 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.832+0000 7fe0cbfac640 1 librados: calling monclient init 2026-02-24T19:17:30.840 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.832+0000 7fe0cbfac640 10 monclient: init 2026-02-24T19:17:30.841 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7f017e7fc640 1 -- 10.20.193.14:0/3519388823 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f016c003040 con 0x7f01800b9f80 2026-02-24T19:17:30.841 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7f017e7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:30.841 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7f017e7fc640 1 -- 10.20.193.14:0/3519388823 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f016c003480 con 0x7f01800b9f80 2026-02-24T19:17:30.841 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7f017e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.841 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7f017e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:30.841 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7f017e7fc640 10 monclient: dump: 2026-02-24T19:17:30.841 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.841 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.841 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.841 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.841 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.841 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.841 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.841 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.841 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.841 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.841 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7f0186074640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:30.841 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7f0186074640 4 set_mon_vals no callback set 2026-02-24T19:17:30.842 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7fe0cbfac640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:30.842 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7fe0cbfac640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:30.842 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7fe0cbfac640 10 monclient(hunting): picked mon.noname-c con 0x7fe0c40585e0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:30.842 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7fe0cbfac640 10 monclient(hunting): picked mon.noname-b con 0x7fe0c40b9f80 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:30.842 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7fe0cbfac640 10 monclient(hunting): picked mon.noname-a con 0x7fe0c40ba350 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:30.842 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7fe0cbfac640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c40b1df0 con 0x7fe0c40ba350 2026-02-24T19:17:30.842 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7fe0cbfac640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c40b20d0 con 0x7fe0c40b9f80 2026-02-24T19:17:30.842 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7fe0cbfac640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c40b23b0 con 0x7fe0c40585e0 2026-02-24T19:17:30.842 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7fe0cbfac640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:30.842 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7fe0cbfac640 10 monclient(hunting): authenticate will time out at 3625.514185s 2026-02-24T19:17:30.843 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7f445a8e8640 10 librados: watch_flush enter 2026-02-24T19:17:30.843 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7f445a8e8640 10 librados: watch_flush exit 2026-02-24T19:17:30.843 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7f445a8e8640 20 client.4555.objecter shutdown clearing up homeless session... 2026-02-24T19:17:30.843 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7f445a8e8640 10 client.4555.objecter successfully canceled tick 2026-02-24T19:17:30.843 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7f445a8e8640 1 -- 10.20.193.14:0/3515511597 >> v1:10.20.193.14:6800/4014096310 conn(0x7f4424077d50 legacy=0x7f4424098200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.843 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7f445a8e8640 10 monclient: shutdown 2026-02-24T19:17:30.843 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7f445a8e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:30.843 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7f445a8e8640 1 -- 10.20.193.14:0/3515511597 >> v1:10.20.193.44:6789/0 conn(0x7f44540585e0 legacy=0x7f44541629d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.843 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7f445a8e8640 1 -- 10.20.193.14:0/3515511597 shutdown_connections 2026-02-24T19:17:30.843 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7f445a8e8640 1 -- 10.20.193.14:0/3515511597 >> 10.20.193.14:0/3515511597 conn(0x7f44540b7990 msgr2=0x7f445415acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:30.843 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7f445a8e8640 1 -- 10.20.193.14:0/3515511597 shutdown_connections 2026-02-24T19:17:30.843 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7f445a8e8640 1 -- 10.20.193.14:0/3515511597 wait complete. 2026-02-24T19:17:30.843 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7f445a8e8640 1 librados: shutdown 2026-02-24T19:17:30.843 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7f0186074640 10 monclient: shutdown 2026-02-24T19:17:30.844 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7f0186074640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:30.844 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7f0186074640 1 -- 10.20.193.14:0/3519388823 >> v1:10.20.193.44:6789/0 conn(0x7f01800b9f80 legacy=0x7f0180163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.844 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7f0186074640 1 -- 10.20.193.14:0/3519388823 shutdown_connections 2026-02-24T19:17:30.844 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7f0186074640 1 -- 10.20.193.14:0/3519388823 >> 10.20.193.14:0/3519388823 conn(0x7f01800b7990 msgr2=0x7f01800b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:30.844 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7f0186074640 1 -- 10.20.193.14:0/3519388823 shutdown_connections 2026-02-24T19:17:30.844 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7f0186074640 1 -- 10.20.193.14:0/3519388823 wait complete. 2026-02-24T19:17:30.844 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7f9f317fa640 10 client.?.objecter ms_handle_connect 0x7f9f3c0b4c30 2026-02-24T19:17:30.844 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.833+0000 7f9f317fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.844 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.834+0000 7f0186074640 10 monclient: build_initial_monmap 2026-02-24T19:17:30.845 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.834+0000 7f0186074640 10 monclient: monmap: 2026-02-24T19:17:30.845 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:30.845 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:30.845 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:30.845 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:30.845 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:30.845 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:30.845 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:30.845 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:30.845 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:30.845 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.845 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.834+0000 7f0186074640 1 librados: starting msgr at 2026-02-24T19:17:30.845 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.834+0000 7f0186074640 1 librados: starting objecter 2026-02-24T19:17:30.845 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.834+0000 7f0186074640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:30.845 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.834+0000 7f0186074640 1 Processor -- start 2026-02-24T19:17:30.845 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.834+0000 7f0186074640 1 -- start start 2026-02-24T19:17:30.845 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.834+0000 7f0186074640 1 librados: setting wanted keys 2026-02-24T19:17:30.845 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.834+0000 7f0186074640 1 librados: calling monclient init 2026-02-24T19:17:30.845 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.834+0000 7f0186074640 10 monclient: init 2026-02-24T19:17:30.845 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.834+0000 7f0186074640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:30.845 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.834+0000 7f0186074640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:30.845 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.834+0000 7f0186074640 10 monclient(hunting): picked mon.noname-b con 0x7f01800585e0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:30.845 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.835+0000 7f0186074640 10 monclient(hunting): picked mon.noname-c con 0x7f01800b9f80 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:30.845 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.835+0000 7f0186074640 10 monclient(hunting): picked mon.noname-a con 0x7f01800ba350 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:30.845 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.835+0000 7f0186074640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01801fea30 con 0x7f01800ba350 2026-02-24T19:17:30.845 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.835+0000 7f0186074640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01800b12b0 con 0x7f01800585e0 2026-02-24T19:17:30.845 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.835+0000 7f0186074640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01800b1590 con 0x7f01800b9f80 2026-02-24T19:17:30.846 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.835+0000 7f0186074640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:30.846 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.835+0000 7f0186074640 10 monclient(hunting): authenticate will time out at 3625.516112s 2026-02-24T19:17:30.846 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.835+0000 7fd83d573640 1 -- 10.20.193.14:0/2860417188 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd834003080 con 0x7fd840159850 2026-02-24T19:17:30.846 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.835+0000 7fd83d573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:30.846 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.835+0000 7fd83d573640 1 -- 10.20.193.14:0/2860417188 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fd8340034c0 con 0x7fd840159850 2026-02-24T19:17:30.846 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.835+0000 7fd83d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.846 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.835+0000 7fd83d573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:30.846 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.835+0000 7fd83d573640 10 monclient: dump: 2026-02-24T19:17:30.846 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.846 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.846 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.846 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.846 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.846 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.846 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.846 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.846 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.846 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.846 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.835+0000 7fd844fc0640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:30.846 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.835+0000 7fd844fc0640 4 set_mon_vals no callback set 2026-02-24T19:17:30.846 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.835+0000 7f5339ffb640 1 -- 10.20.193.14:0/3185045495 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2495651623 0 0) 0x7f533c163e90 con 0x7f533c0b9f80 2026-02-24T19:17:30.846 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.835+0000 7f5339ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.847 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.835+0000 7f5339ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.847 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.835+0000 7f5339ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.847 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.835+0000 7f5339ffb640 10 monclient(hunting): my global_id is 4607 2026-02-24T19:17:30.847 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.835+0000 7f5339ffb640 1 -- 10.20.193.14:0/3185045495 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f533c163bb0 con 0x7f533c0b9f80 2026-02-24T19:17:30.847 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.835+0000 7fd844fc0640 10 monclient: shutdown 2026-02-24T19:17:30.847 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.835+0000 7fd844fc0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:30.847 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.836+0000 7fd844fc0640 1 -- 10.20.193.14:0/2860417188 >> v1:10.20.193.44:6789/0 conn(0x7fd840159850 legacy=0x7fd840057620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.847 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.836+0000 7fa002ffd640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7fa00415d070 0x7fa0041fc110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:35148/0 (socket says 10.20.193.14:35148) 2026-02-24T19:17:30.847 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.836+0000 7fa002ffd640 1 -- 10.20.193.14:0/3482287015 learned_addr learned my addr 10.20.193.14:0/3482287015 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:30.847 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.836+0000 7fd844fc0640 1 -- 10.20.193.14:0/2860417188 shutdown_connections 2026-02-24T19:17:30.847 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.836+0000 7fd844fc0640 1 -- 10.20.193.14:0/2860417188 >> 10.20.193.14:0/2860417188 conn(0x7fd8400b7120 msgr2=0x7fd8400b7520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:30.847 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.836+0000 7fd844fc0640 1 -- 10.20.193.14:0/2860417188 shutdown_connections 2026-02-24T19:17:30.847 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.836+0000 7fd844fc0640 1 -- 10.20.193.14:0/2860417188 wait complete. 2026-02-24T19:17:30.848 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.836+0000 7f5339ffb640 1 -- 10.20.193.14:0/3185045495 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4116933033 0 0) 0x7f5328003610 con 0x7f533c0585e0 2026-02-24T19:17:30.848 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.836+0000 7f5339ffb640 1 -- 10.20.193.14:0/3185045495 >> v1:10.20.193.170:6789/0 conn(0x7f533c0b9f80 legacy=0x7f533c163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.848 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.836+0000 7f5339ffb640 1 -- 10.20.193.14:0/3185045495 >> v1:10.20.193.14:6789/0 conn(0x7f533c0ba350 legacy=0x7f533c057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:30.848 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.836+0000 7f5339ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:30.848 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.836+0000 7f5339ffb640 1 monclient: found mon.noname-b 2026-02-24T19:17:30.848 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.836+0000 7f5339ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:30.848 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.836+0000 7f5339ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.44:6789/0 2026-02-24T19:17:30.848 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.836+0000 7f5339ffb640 1 -- 10.20.193.14:0/3185045495 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f533c0573f0 con 0x7f533c0585e0 2026-02-24T19:17:30.848 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.836+0000 7f5339ffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:30.848 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.836+0000 7f5339ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:30.848 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.836+0000 7f5339ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:30.848 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.836+0000 7f5339ffb640 1 -- 10.20.193.14:0/3185045495 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f532c003170 con 0x7f533c0585e0 2026-02-24T19:17:30.848 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.836+0000 7f5339ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.848 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.836+0000 7f5339ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:30.848 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.836+0000 7f5339ffb640 10 monclient: dump: 2026-02-24T19:17:30.848 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.848 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.848 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.848 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.848 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.848 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.848 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.848 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.848 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.848 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.848 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.836+0000 7f53418bf640 5 monclient: authenticate success, global_id 4579 2026-02-24T19:17:30.848 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.836+0000 7f53418bf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:30.849 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.836+0000 7f9fdbfff640 10 client.?.objecter ms_handle_connect 0x7fa00415d070 2026-02-24T19:17:30.849 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.836+0000 7f9fdbfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.849 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.836+0000 7fd844fc0640 10 monclient: build_initial_monmap 2026-02-24T19:17:30.849 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.836+0000 7fd844fc0640 10 monclient: monmap: 2026-02-24T19:17:30.849 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:30.849 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:30.849 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:30.849 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:30.849 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:30.849 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:30.849 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:30.849 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:30.849 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:30.849 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.849 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.837+0000 7fd844fc0640 1 librados: starting msgr at 2026-02-24T19:17:30.849 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.837+0000 7fd844fc0640 1 librados: starting objecter 2026-02-24T19:17:30.849 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.837+0000 7fd844fc0640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:30.849 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.837+0000 7fd844fc0640 1 Processor -- start 2026-02-24T19:17:30.849 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.837+0000 7fd844fc0640 1 -- start start 2026-02-24T19:17:30.850 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.837+0000 7fd844fc0640 1 librados: setting wanted keys 2026-02-24T19:17:30.850 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.837+0000 7fd844fc0640 1 librados: calling monclient init 2026-02-24T19:17:30.850 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.837+0000 7fd844fc0640 10 monclient: init 2026-02-24T19:17:30.850 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.837+0000 7fd844fc0640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:30.850 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.837+0000 7fd844fc0640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:30.850 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.837+0000 7fd844fc0640 10 monclient(hunting): picked mon.noname-a con 0x7fd840059f70 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:30.850 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.837+0000 7fd844fc0640 10 monclient(hunting): picked mon.noname-c con 0x7fd840159850 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:30.850 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.837+0000 7fd844fc0640 10 monclient(hunting): picked mon.noname-b con 0x7fd840159c20 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:30.850 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.837+0000 7fd844fc0640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd84015b9e0 con 0x7fd840059f70 2026-02-24T19:17:30.850 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.837+0000 7fd844fc0640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd84015bcc0 con 0x7fd840159c20 2026-02-24T19:17:30.850 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.837+0000 7fd844fc0640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd84015bfa0 con 0x7fd840159850 2026-02-24T19:17:30.850 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.837+0000 7fd844fc0640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:30.850 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.837+0000 7fd844fc0640 10 monclient(hunting): authenticate will time out at 3625.518545s 2026-02-24T19:17:30.850 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.838+0000 7fe0c9520640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7fe0c40b9f80 0x7fe0c415f230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:35162/0 (socket says 10.20.193.14:35162) 2026-02-24T19:17:30.850 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.838+0000 7fe0c9520640 1 -- 10.20.193.14:0/1510854600 learned_addr learned my addr 10.20.193.14:0/1510854600 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:30.850 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.838+0000 7f9fdbfff640 10 client.?.objecter ms_handle_connect 0x7fa004166f60 2026-02-24T19:17:30.850 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.838+0000 7f9fdbfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.850 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.838+0000 7fd83dd74640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7fd840159850 0x7fd84011b030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:45558/0 (socket says 10.20.193.14:45558) 2026-02-24T19:17:30.850 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.838+0000 7fd83dd74640 1 -- 10.20.193.14:0/799887024 learned_addr learned my addr 10.20.193.14:0/799887024 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:30.851 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.838+0000 7f9f317fa640 1 -- 10.20.193.14:0/687193607 <== mon.1 v1:10.20.193.44:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 716941761 0 0) 0x7f9f3c12a490 con 0x7f9f3c15d3b0 2026-02-24T19:17:30.851 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.838+0000 7f9f317fa640 1 -- 10.20.193.14:0/687193607 >> v1:10.20.193.170:6789/0 conn(0x7f9f3c0b4c30 legacy=0x7f9f3c1a70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.851 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.838+0000 7f9f317fa640 1 -- 10.20.193.14:0/687193607 >> v1:10.20.193.14:6789/0 conn(0x7f9f3c1a7ac0 legacy=0x7f9f3c12a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.851 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.838+0000 7f9f317fa640 10 monclient: _finish_hunting 0 2026-02-24T19:17:30.851 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.838+0000 7f9f317fa640 1 monclient: found mon.b 2026-02-24T19:17:30.851 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.838+0000 7f9f317fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:30.851 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.838+0000 7f9f317fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:30.851 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.838+0000 7f9f317fa640 1 -- 10.20.193.14:0/687193607 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f3c1256a0 con 0x7f9f3c15d3b0 2026-02-24T19:17:30.851 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.838+0000 7f9f317fa640 10 monclient: _finish_auth 0 2026-02-24T19:17:30.851 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.838+0000 7f9f317fa640 10 monclient: _check_auth_tickets 2026-02-24T19:17:30.851 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.838+0000 7f9f317fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:30.851 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.838+0000 7f9f42e8b640 5 monclient: authenticate success, global_id 4567 2026-02-24T19:17:30.851 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.838+0000 7f9f42e8b640 10 monclient: _renew_subs 2026-02-24T19:17:30.851 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.838+0000 7f9f42e8b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:30.851 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.838+0000 7f9f42e8b640 1 -- 10.20.193.14:0/687193607 --> v1:10.20.193.44:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9f3c125980 con 0x7f9f3c15d3b0 2026-02-24T19:17:30.851 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.838+0000 7f9f42e8b640 10 client.4567.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:30.851 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.838+0000 7f9f42e8b640 10 monclient: _renew_subs 2026-02-24T19:17:30.851 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.838+0000 7f9f42e8b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:30.851 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.838+0000 7f9f42e8b640 1 -- 10.20.193.14:0/687193607 --> v1:10.20.193.44:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9f3c1a77b0 con 0x7f9f3c15d3b0 2026-02-24T19:17:30.851 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.838+0000 7f9f42e8b640 1 librados: init done 2026-02-24T19:17:30.851 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.839+0000 7f017f7fe640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7f01800585e0 0x7f01801626d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:35170/0 (socket says 10.20.193.14:35170) 2026-02-24T19:17:30.851 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.839+0000 7f017f7fe640 1 -- 10.20.193.14:0/440919942 learned_addr learned my addr 10.20.193.14:0/440919942 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:30.851 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.839+0000 7fe0b27fc640 10 client.?.objecter ms_handle_connect 0x7fe0c40b9f80 2026-02-24T19:17:30.852 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.839+0000 7fe0b27fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.852 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.839+0000 7f9f42e8b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.852 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.839+0000 7f9f42e8b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.852 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.839+0000 7f9f42e8b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:30.852 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.839+0000 7f9f42e8b640 1 -- 10.20.193.14:0/687193607 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f3c0b2400 con 0x7f9f3c15d3b0 2026-02-24T19:17:30.852 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.839+0000 7f015bfff640 10 client.?.objecter ms_handle_connect 0x7f01800585e0 2026-02-24T19:17:30.852 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.839+0000 7f015bfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.852 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.839+0000 7fe0b27fc640 10 client.?.objecter ms_handle_connect 0x7fe0c40585e0 2026-02-24T19:17:30.853 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313221 for osd.7 2026-02-24T19:17:30.853 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.839+0000 7fe0b27fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.853 DEBUG:teuthology.parallel:result is None 2026-02-24T19:17:30.853 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.839+0000 7fd826ffd640 10 client.?.objecter ms_handle_connect 0x7fd840159850 2026-02-24T19:17:30.853 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.839+0000 7fd826ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.853 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.840+0000 7f015bfff640 10 client.?.objecter ms_handle_connect 0x7f01800b9f80 2026-02-24T19:17:30.853 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.840+0000 7f015bfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.853 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.842+0000 7f9fdbfff640 1 -- 10.20.193.14:0/3482287015 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 835921789 0 0) 0x7fa0041fc820 con 0x7fa00415d070 2026-02-24T19:17:30.853 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.842+0000 7f9fdbfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.853 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.842+0000 7f9fdbfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.853 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.842+0000 7f9fdbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.854 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.842+0000 7f9fdbfff640 10 monclient(hunting): my global_id is 4582 2026-02-24T19:17:30.854 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.842+0000 7f9fdbfff640 1 -- 10.20.193.14:0/3482287015 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9fd4003610 con 0x7fa00415d070 2026-02-24T19:17:30.854 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.842+0000 7f5339ffb640 1 -- 10.20.193.14:0/3185045495 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f532c003380 con 0x7f533c0585e0 2026-02-24T19:17:30.854 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.842+0000 7f5339ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:30.854 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.842+0000 7f5339ffb640 1 -- 10.20.193.14:0/3185045495 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f532c0037c0 con 0x7f533c0585e0 2026-02-24T19:17:30.854 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.842+0000 7f5339ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.854 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.842+0000 7f5339ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:30.854 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.842+0000 7f5339ffb640 10 monclient: dump: 2026-02-24T19:17:30.854 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.854 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.854 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.854 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.854 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.854 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.854 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.854 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.854 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.854 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.854 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.842+0000 7f53418bf640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:30.854 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.842+0000 7f53418bf640 4 set_mon_vals no callback set 2026-02-24T19:17:30.854 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.842+0000 7fe0b27fc640 1 -- 10.20.193.14:0/1510854600 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 131546150 0 0) 0x7fe0c40b20d0 con 0x7fe0c40b9f80 2026-02-24T19:17:30.854 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.842+0000 7fe0b27fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.855 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.842+0000 7fe0b27fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.855 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.842+0000 7fe0b27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.855 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.842+0000 7fe0b27fc640 10 monclient(hunting): my global_id is 4585 2026-02-24T19:17:30.855 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.842+0000 7fe0b27fc640 1 -- 10.20.193.14:0/1510854600 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe094003610 con 0x7fe0c40b9f80 2026-02-24T19:17:30.855 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313221 for osd.9 2026-02-24T19:17:30.855 DEBUG:teuthology.parallel:result is None 2026-02-24T19:17:30.856 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.842+0000 7f53418bf640 10 monclient: shutdown 2026-02-24T19:17:30.856 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.842+0000 7f53418bf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:30.856 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.842+0000 7f53418bf640 1 -- 10.20.193.14:0/3185045495 >> v1:10.20.193.44:6789/0 conn(0x7f533c0585e0 legacy=0x7f533c166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.856 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.843+0000 7f53418bf640 1 -- 10.20.193.14:0/3185045495 shutdown_connections 2026-02-24T19:17:30.856 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.843+0000 7f53418bf640 1 -- 10.20.193.14:0/3185045495 >> 10.20.193.14:0/3185045495 conn(0x7f533c0b7990 msgr2=0x7f533c0b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:30.856 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.843+0000 7f53418bf640 1 -- 10.20.193.14:0/3185045495 shutdown_connections 2026-02-24T19:17:30.856 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.843+0000 7f53418bf640 1 -- 10.20.193.14:0/3185045495 wait complete. 2026-02-24T19:17:30.856 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.843+0000 7f53418bf640 10 monclient: build_initial_monmap 2026-02-24T19:17:30.856 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.843+0000 7f53418bf640 10 monclient: monmap: 2026-02-24T19:17:30.856 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:30.856 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:30.856 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:30.856 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:30.856 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:30.856 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:30.856 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:30.856 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:30.856 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:30.856 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.856 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.843+0000 7f53418bf640 1 librados: starting msgr at 2026-02-24T19:17:30.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.843+0000 7f53418bf640 1 librados: starting objecter 2026-02-24T19:17:30.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.843+0000 7f53418bf640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:30.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.843+0000 7f53418bf640 1 Processor -- start 2026-02-24T19:17:30.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.843+0000 7f53418bf640 1 -- start start 2026-02-24T19:17:30.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.843+0000 7f53418bf640 1 librados: setting wanted keys 2026-02-24T19:17:30.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.843+0000 7f53418bf640 1 librados: calling monclient init 2026-02-24T19:17:30.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.843+0000 7f53418bf640 10 monclient: init 2026-02-24T19:17:30.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.844+0000 7f53418bf640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:30.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.844+0000 7f53418bf640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:30.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.844+0000 7f53418bf640 10 monclient(hunting): picked mon.noname-c con 0x7f533c0585e0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:30.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.844+0000 7f53418bf640 10 monclient(hunting): picked mon.noname-a con 0x7f533c0b9f80 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:30.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.844+0000 7f53418bf640 10 monclient(hunting): picked mon.noname-b con 0x7f533c0ba350 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:30.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.844+0000 7f53418bf640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f533c13acb0 con 0x7f533c0b9f80 2026-02-24T19:17:30.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.844+0000 7f53418bf640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f533c1fb220 con 0x7f533c0ba350 2026-02-24T19:17:30.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.844+0000 7f53418bf640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f533c1fb500 con 0x7f533c0585e0 2026-02-24T19:17:30.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.844+0000 7f53418bf640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:30.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.844+0000 7f53418bf640 10 monclient(hunting): authenticate will time out at 3625.525511s 2026-02-24T19:17:30.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.845+0000 7f9fdbfff640 1 -- 10.20.193.14:0/3482287015 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1864293777 0 0) 0x7fa0040a8830 con 0x7fa004166f60 2026-02-24T19:17:30.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.845+0000 7f9fdbfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.845+0000 7f9fdbfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.845+0000 7f9fdbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.845+0000 7f9fdbfff640 10 monclient(hunting): my global_id is 4613 2026-02-24T19:17:30.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.845+0000 7f9fdbfff640 1 -- 10.20.193.14:0/3482287015 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0041fc820 con 0x7fa004166f60 2026-02-24T19:17:30.857 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.845+0000 7fd826ffd640 1 -- 10.20.193.14:0/799887024 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 866860005 0 0) 0x7fd84015bfa0 con 0x7fd840159850 2026-02-24T19:17:30.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.845+0000 7fd826ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.845+0000 7fd826ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.845+0000 7fd826ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.845+0000 7fd826ffd640 10 monclient(hunting): my global_id is 4622 2026-02-24T19:17:30.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.845+0000 7fd826ffd640 1 -- 10.20.193.14:0/799887024 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd80c003610 con 0x7fd840159850 2026-02-24T19:17:30.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.845+0000 7f015bfff640 1 -- 10.20.193.14:0/440919942 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2099227935 0 0) 0x7f01800b1590 con 0x7f01800b9f80 2026-02-24T19:17:30.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.845+0000 7f015bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.845+0000 7f015bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.845+0000 7f015bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.845+0000 7f015bfff640 10 monclient(hunting): my global_id is 4619 2026-02-24T19:17:30.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.845+0000 7f015bfff640 1 -- 10.20.193.14:0/440919942 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0150003610 con 0x7f01800b9f80 2026-02-24T19:17:30.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.845+0000 7fe0b27fc640 1 -- 10.20.193.14:0/1510854600 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2655488443 0 0) 0x7fe0c40b23b0 con 0x7fe0c40585e0 2026-02-24T19:17:30.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.845+0000 7fe0b27fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.845+0000 7fe0b27fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.845+0000 7fe0b27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.845+0000 7fe0b27fc640 10 monclient(hunting): my global_id is 4616 2026-02-24T19:17:30.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.845+0000 7fe0b27fc640 1 -- 10.20.193.14:0/1510854600 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0c40b20d0 con 0x7fe0c40585e0 2026-02-24T19:17:30.859 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.850+0000 7f533affd640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7f533c0585e0 0x7f533c156b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:45568/0 (socket says 10.20.193.14:45568) 2026-02-24T19:17:30.859 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.850+0000 7f533affd640 1 -- 10.20.193.14:0/404796655 learned_addr learned my addr 10.20.193.14:0/404796655 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:30.859 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.853+0000 7f5313fff640 10 client.?.objecter ms_handle_connect 0x7f533c0585e0 2026-02-24T19:17:30.859 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.853+0000 7f5313fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.859 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.853+0000 7fe7953c3640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-24T19:17:30.859 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.853+0000 7fe7953c3640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-24T19:17:30.859 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.853+0000 7fe7953c3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:30.859 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.853+0000 7fe7953c3640 1 -- 10.20.193.14:0/3180294831 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fe7900b8ef0 con 0x7fe7900ba350 2026-02-24T19:17:30.859 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.854+0000 7fd826ffd640 1 -- 10.20.193.14:0/799887024 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2485055177 0 0) 0x7fd80c003610 con 0x7fd840159850 2026-02-24T19:17:30.859 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.854+0000 7fd826ffd640 1 -- 10.20.193.14:0/799887024 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd84015bfa0 con 0x7fd840159850 2026-02-24T19:17:30.859 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.854+0000 7fd826ffd640 1 -- 10.20.193.14:0/799887024 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fd8280030c0 con 0x7fd840159850 2026-02-24T19:17:30.859 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.854+0000 7fd826ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:30.859 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.854+0000 7fd826ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:30.859 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.854+0000 7fd826ffd640 10 monclient(hunting): dump: 2026-02-24T19:17:30.859 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.859 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.859 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.859 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.859 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.859 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.859 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.860 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.860 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.860 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.854+0000 7fd826ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:30.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.855+0000 7f9fdbfff640 1 -- 10.20.193.14:0/3482287015 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2248934613 0 0) 0x7fa0041fc820 con 0x7fa004166f60 2026-02-24T19:17:30.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.855+0000 7f9fdbfff640 1 -- 10.20.193.14:0/3482287015 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa0040a8830 con 0x7fa004166f60 2026-02-24T19:17:30.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.855+0000 7f9fdbfff640 1 -- 10.20.193.14:0/3482287015 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f9ff4003270 con 0x7fa004166f60 2026-02-24T19:17:30.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.855+0000 7f9fdbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:30.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.855+0000 7f9fdbfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:30.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.855+0000 7f9fdbfff640 10 monclient(hunting): dump: 2026-02-24T19:17:30.860 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.860 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.860 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.860 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.860 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.860 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.860 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.860 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.860 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.860 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.855+0000 7f9fdbfff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:30.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.856+0000 7fe0b27fc640 1 -- 10.20.193.14:0/1510854600 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3726984580 0 0) 0x7fe0c40b20d0 con 0x7fe0c40585e0 2026-02-24T19:17:30.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.856+0000 7fe0b27fc640 1 -- 10.20.193.14:0/1510854600 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe0c40b23b0 con 0x7fe0c40585e0 2026-02-24T19:17:30.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.856+0000 7fe0b27fc640 1 -- 10.20.193.14:0/1510854600 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fe0b4002f70 con 0x7fe0c40585e0 2026-02-24T19:17:30.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.856+0000 7fe0b27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:30.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.856+0000 7fe0b27fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:30.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.856+0000 7fe0b27fc640 10 monclient(hunting): dump: 2026-02-24T19:17:30.861 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.861 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.861 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.861 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.861 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.861 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.861 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.861 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.861 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.861 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.856+0000 7fe0b27fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:30.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.856+0000 7f015bfff640 1 -- 10.20.193.14:0/440919942 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2726011341 0 0) 0x7f0150003610 con 0x7f01800b9f80 2026-02-24T19:17:30.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.856+0000 7f015bfff640 1 -- 10.20.193.14:0/440919942 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f01800b1590 con 0x7f01800b9f80 2026-02-24T19:17:30.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.856+0000 7f015bfff640 1 -- 10.20.193.14:0/440919942 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f0170002ed0 con 0x7f01800b9f80 2026-02-24T19:17:30.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.856+0000 7f015bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:30.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.856+0000 7f015bfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:30.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.856+0000 7f015bfff640 10 monclient(hunting): dump: 2026-02-24T19:17:30.861 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.861 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.861 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.861 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.861 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.861 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.861 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.861 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.861 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.862 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.856+0000 7f015bfff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:30.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.858+0000 7f5313fff640 1 -- 10.20.193.14:0/404796655 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3498494835 0 0) 0x7f533c1fb500 con 0x7f533c0585e0 2026-02-24T19:17:30.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.858+0000 7f5313fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.858+0000 7f5313fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.858+0000 7f5313fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.858+0000 7f5313fff640 10 monclient(hunting): my global_id is 4625 2026-02-24T19:17:30.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.858+0000 7f5313fff640 1 -- 10.20.193.14:0/404796655 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f530c003610 con 0x7f533c0585e0 2026-02-24T19:17:30.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.859+0000 7fb899ffb640 1 -- 10.20.193.14:0/1100562492 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7fb8a8093820 con 0x7fb8ac165880 2026-02-24T19:17:30.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.859+0000 7fb899ffb640 10 client.4620.objecter ms_dispatch2 0x7fb8ac000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:30.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.859+0000 7fb899ffb640 3 client.4620.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:30.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.859+0000 7fb899ffb640 3 client.4620.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:30.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.859+0000 7fb899ffb640 20 client.4620.objecter dump_active .. 0 homeless 2026-02-24T19:17:30.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.859+0000 7fb899ffb640 1 -- 10.20.193.14:0/1100562492 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fb8ac0b2d20 con 0x7fb8ac165880 2026-02-24T19:17:30.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.859+0000 7fb899ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.859+0000 7fb899ffb640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:30.863 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.861+0000 7fd826ffd640 1 -- 10.20.193.14:0/799887024 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2960715788 0 0) 0x7fd84015bfa0 con 0x7fd840159850 2026-02-24T19:17:30.863 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.861+0000 7fd826ffd640 1 -- 10.20.193.14:0/799887024 >> v1:10.20.193.44:6789/0 conn(0x7fd840159c20 legacy=0x7fd84012fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.863 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.861+0000 7fd826ffd640 1 -- 10.20.193.14:0/799887024 >> v1:10.20.193.14:6789/0 conn(0x7fd840059f70 legacy=0x7fd8400b4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.863 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.861+0000 7fd826ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:30.863 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.861+0000 7fd826ffd640 1 monclient: found mon.c 2026-02-24T19:17:30.863 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.861+0000 7fd826ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:30.863 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.861+0000 7fd826ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.863 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.861+0000 7fd826ffd640 1 -- 10.20.193.14:0/799887024 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd84015c280 con 0x7fd840159850 2026-02-24T19:17:30.863 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.861+0000 7fd826ffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:30.863 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.861+0000 7fd826ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:30.863 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.861+0000 7fd826ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:30.863 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.861+0000 7fd844fc0640 5 monclient: authenticate success, global_id 4622 2026-02-24T19:17:30.863 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.861+0000 7fd844fc0640 10 monclient: _renew_subs 2026-02-24T19:17:30.863 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.861+0000 7fd844fc0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.863 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.861+0000 7fd844fc0640 1 -- 10.20.193.14:0/799887024 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd84015c560 con 0x7fd840159850 2026-02-24T19:17:30.863 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.862+0000 7fd844fc0640 10 client.4622.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:30.863 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.862+0000 7fd844fc0640 10 monclient: _renew_subs 2026-02-24T19:17:30.863 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.862+0000 7fd844fc0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.863 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.862+0000 7fd844fc0640 1 -- 10.20.193.14:0/799887024 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd84015cd60 con 0x7fd840159850 2026-02-24T19:17:30.863 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.862+0000 7fd844fc0640 1 librados: init done 2026-02-24T19:17:30.863 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.862+0000 7fd844fc0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.863 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.862+0000 7fd844fc0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.864 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.862+0000 7fd844fc0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.864 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.862+0000 7fd844fc0640 1 -- 10.20.193.14:0/799887024 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8400b1160 con 0x7fd840159850 2026-02-24T19:17:30.864 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.862+0000 7f9fdbfff640 1 -- 10.20.193.14:0/3482287015 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1903618471 0 0) 0x7fa0040a8830 con 0x7fa004166f60 2026-02-24T19:17:30.864 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.862+0000 7f9fdbfff640 1 -- 10.20.193.14:0/3482287015 >> v1:10.20.193.44:6789/0 conn(0x7fa00415d070 legacy=0x7fa0041fc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.864 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.862+0000 7f9fdbfff640 1 -- 10.20.193.14:0/3482287015 >> v1:10.20.193.14:6789/0 conn(0x7fa00415d440 legacy=0x7fa0041fb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.864 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.862+0000 7f9fdbfff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:30.864 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.862+0000 7f9fdbfff640 1 monclient: found mon.c 2026-02-24T19:17:30.864 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.862+0000 7f9fdbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:30.864 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.862+0000 7f9fdbfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.864 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.862+0000 7f9fdbfff640 1 -- 10.20.193.14:0/3482287015 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0040a8b10 con 0x7fa004166f60 2026-02-24T19:17:30.864 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.862+0000 7f9fdbfff640 10 monclient: _finish_auth 0 2026-02-24T19:17:30.864 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.862+0000 7f9fdbfff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:30.864 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.862+0000 7f9fdbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:30.864 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.862+0000 7fa0099c8640 5 monclient: authenticate success, global_id 4613 2026-02-24T19:17:30.864 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.862+0000 7fa0099c8640 10 monclient: _renew_subs 2026-02-24T19:17:30.864 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.862+0000 7fa0099c8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.864 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.862+0000 7fa0099c8640 1 -- 10.20.193.14:0/3482287015 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa0040a8df0 con 0x7fa004166f60 2026-02-24T19:17:30.864 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7fa0099c8640 10 client.4613.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:30.864 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7fa0099c8640 10 monclient: _renew_subs 2026-02-24T19:17:30.864 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7fa0099c8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.864 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7fa0099c8640 1 -- 10.20.193.14:0/3482287015 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa0040a93b0 con 0x7fa004166f60 2026-02-24T19:17:30.864 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7fa0099c8640 1 librados: init done 2026-02-24T19:17:30.865 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7fe0b27fc640 1 -- 10.20.193.14:0/1510854600 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1348075269 0 0) 0x7fe0c40b23b0 con 0x7fe0c40585e0 2026-02-24T19:17:30.865 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7fe0b27fc640 1 -- 10.20.193.14:0/1510854600 >> v1:10.20.193.44:6789/0 conn(0x7fe0c40b9f80 legacy=0x7fe0c415f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.865 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7fe0b27fc640 1 -- 10.20.193.14:0/1510854600 >> v1:10.20.193.14:6789/0 conn(0x7fe0c40ba350 legacy=0x7fe0c4162030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.865 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7fe0b27fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:30.865 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7fe0b27fc640 1 monclient: found mon.c 2026-02-24T19:17:30.865 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7fe0b27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:30.865 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7fe0b27fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.865 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7fe0b27fc640 1 -- 10.20.193.14:0/1510854600 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c40b2690 con 0x7fe0c40585e0 2026-02-24T19:17:30.865 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7fe0b27fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:30.865 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7fe0b27fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:30.865 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7fe0b27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:30.865 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7fe0cbfac640 5 monclient: authenticate success, global_id 4616 2026-02-24T19:17:30.865 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7fe0cbfac640 10 monclient: _renew_subs 2026-02-24T19:17:30.865 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7fe0cbfac640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.865 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7fe0cbfac640 1 -- 10.20.193.14:0/1510854600 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe0c40b2970 con 0x7fe0c40585e0 2026-02-24T19:17:30.865 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7fe0cbfac640 10 client.4616.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:30.865 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7fe0cbfac640 10 monclient: _renew_subs 2026-02-24T19:17:30.865 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7fe0cbfac640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.865 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7fe0cbfac640 1 -- 10.20.193.14:0/1510854600 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe0c415ea30 con 0x7fe0c40585e0 2026-02-24T19:17:30.865 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7fe0cbfac640 1 librados: init done 2026-02-24T19:17:30.865 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7fa0099c8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.865 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7fa0099c8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.865 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7fa0099c8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.865 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7fa0099c8640 1 -- 10.20.193.14:0/3482287015 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0040b1200 con 0x7fa004166f60 2026-02-24T19:17:30.866 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7f015bfff640 1 -- 10.20.193.14:0/440919942 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3462402941 0 0) 0x7f01800b1590 con 0x7f01800b9f80 2026-02-24T19:17:30.866 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7f015bfff640 1 -- 10.20.193.14:0/440919942 >> v1:10.20.193.44:6789/0 conn(0x7f01800585e0 legacy=0x7f01801626d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.866 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7f015bfff640 1 -- 10.20.193.14:0/440919942 >> v1:10.20.193.14:6789/0 conn(0x7f01800ba350 legacy=0x7f0180165080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.866 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7f015bfff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:30.866 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7f015bfff640 1 monclient: found mon.c 2026-02-24T19:17:30.866 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7f015bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:30.866 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7f015bfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.866 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7f015bfff640 1 -- 10.20.193.14:0/440919942 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01800b1870 con 0x7f01800b9f80 2026-02-24T19:17:30.866 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7f015bfff640 10 monclient: _finish_auth 0 2026-02-24T19:17:30.866 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7f015bfff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:30.866 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7f015bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:30.866 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7f0186074640 5 monclient: authenticate success, global_id 4619 2026-02-24T19:17:30.866 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7f0186074640 10 monclient: _renew_subs 2026-02-24T19:17:30.866 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7f0186074640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.866 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7f0186074640 1 -- 10.20.193.14:0/440919942 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f01801645a0 con 0x7f01800b9f80 2026-02-24T19:17:30.866 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7f0186074640 10 client.4619.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:30.866 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7f0186074640 10 monclient: _renew_subs 2026-02-24T19:17:30.866 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7f0186074640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.866 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7f0186074640 1 -- 10.20.193.14:0/440919942 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0180164b60 con 0x7f01800b9f80 2026-02-24T19:17:30.866 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7f0186074640 1 librados: init done 2026-02-24T19:17:30.866 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7fe0cbfac640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.866 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7fe0cbfac640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.866 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7fe0cbfac640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.867 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.863+0000 7fe0cbfac640 1 -- 10.20.193.14:0/1510854600 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0c41678f0 con 0x7fe0c40585e0 2026-02-24T19:17:30.867 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.864+0000 7f0186074640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.867 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.864+0000 7f0186074640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.867 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.864+0000 7f0186074640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.867 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.864+0000 7f0186074640 1 -- 10.20.193.14:0/440919942 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01800b64c0 con 0x7f01800b9f80 2026-02-24T19:17:30.867 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.865+0000 7fe76f7fe640 1 -- 10.20.193.14:0/3180294831 <== mon.0 v1:10.20.193.14:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 1498640560) 0x7fe78005e1d0 con 0x7fe7900ba350 2026-02-24T19:17:30.867 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.865+0000 7fe76f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-24T19:17:30.867 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.865+0000 7fe76f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:30.867 INFO:teuthology.orchestra.run.trial014.stdout:90194313221 2026-02-24T19:17:30.869 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.868+0000 7fe7953c3640 10 librados: watch_flush enter 2026-02-24T19:17:30.869 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.868+0000 7fe7953c3640 10 librados: watch_flush exit 2026-02-24T19:17:30.869 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.868+0000 7fe7953c3640 20 client.4614.objecter shutdown clearing up homeless session... 2026-02-24T19:17:30.869 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.868+0000 7fe7953c3640 10 client.4614.objecter successfully canceled tick 2026-02-24T19:17:30.869 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.868+0000 7fe7953c3640 1 -- 10.20.193.14:0/3180294831 >> v1:10.20.193.14:6800/4014096310 conn(0x7fe75c077c60 legacy=0x7fe75c098110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.869 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.868+0000 7fe7953c3640 10 monclient: shutdown 2026-02-24T19:17:30.869 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.868+0000 7fe7953c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:30.869 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.868+0000 7fe7953c3640 1 -- 10.20.193.14:0/3180294831 >> v1:10.20.193.14:6789/0 conn(0x7fe7900ba350 legacy=0x7fe790161a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.869 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.868+0000 7fe7953c3640 1 -- 10.20.193.14:0/3180294831 shutdown_connections 2026-02-24T19:17:30.869 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.868+0000 7fe7953c3640 1 -- 10.20.193.14:0/3180294831 >> 10.20.193.14:0/3180294831 conn(0x7fe7900b7990 msgr2=0x7fe790158a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:30.869 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.868+0000 7fe7953c3640 1 -- 10.20.193.14:0/3180294831 shutdown_connections 2026-02-24T19:17:30.869 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.868+0000 7fe7953c3640 1 -- 10.20.193.14:0/3180294831 wait complete. 2026-02-24T19:17:30.869 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.868+0000 7fe7953c3640 1 librados: shutdown 2026-02-24T19:17:30.874 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.873+0000 7f5313fff640 10 client.?.objecter ms_handle_connect 0x7f533c0b9f80 2026-02-24T19:17:30.874 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.873+0000 7f5313fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.877 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313221 for osd.2 2026-02-24T19:17:30.877 DEBUG:teuthology.parallel:result is None 2026-02-24T19:17:30.877 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.876+0000 7f5313fff640 1 -- 10.20.193.14:0/404796655 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1085074770 0 0) 0x7f533c13acb0 con 0x7f533c0b9f80 2026-02-24T19:17:30.877 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.876+0000 7f5313fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.877 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.876+0000 7f5313fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.878 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.876+0000 7f5313fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.878 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.876+0000 7f5313fff640 10 monclient(hunting): my global_id is 4626 2026-02-24T19:17:30.878 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.876+0000 7f5313fff640 1 -- 10.20.193.14:0/404796655 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f533c1fb500 con 0x7f533c0b9f80 2026-02-24T19:17:30.880 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.879+0000 7f5313fff640 1 -- 10.20.193.14:0/404796655 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1750755248 0 0) 0x7f533c1fb500 con 0x7f533c0b9f80 2026-02-24T19:17:30.881 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.879+0000 7f5313fff640 1 -- 10.20.193.14:0/404796655 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f533c13acb0 con 0x7f533c0b9f80 2026-02-24T19:17:30.881 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.879+0000 7f5313fff640 1 -- 10.20.193.14:0/404796655 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5324002ed0 con 0x7f533c0b9f80 2026-02-24T19:17:30.881 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.879+0000 7f5313fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:30.881 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.879+0000 7f5313fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:30.881 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.879+0000 7f5313fff640 10 monclient(hunting): dump: 2026-02-24T19:17:30.881 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.881 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.881 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.881 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.881 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.881 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.881 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.881 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.881 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.881 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.881 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.879+0000 7f5313fff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:30.883 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.881+0000 7f5313fff640 1 -- 10.20.193.14:0/404796655 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2529927935 0 0) 0x7f533c13acb0 con 0x7f533c0b9f80 2026-02-24T19:17:30.883 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.881+0000 7f5313fff640 1 -- 10.20.193.14:0/404796655 >> v1:10.20.193.170:6789/0 conn(0x7f533c0585e0 legacy=0x7f533c156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.883 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.881+0000 7f5313fff640 1 -- 10.20.193.14:0/404796655 >> v1:10.20.193.44:6789/0 conn(0x7f533c0ba350 legacy=0x7f533c1fe580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.883 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.881+0000 7f5313fff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:30.883 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.881+0000 7f5313fff640 1 monclient: found mon.a 2026-02-24T19:17:30.883 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.881+0000 7f5313fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:30.883 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.881+0000 7f5313fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:30.883 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.881+0000 7f5313fff640 1 -- 10.20.193.14:0/404796655 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f533c1fb7e0 con 0x7f533c0b9f80 2026-02-24T19:17:30.883 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.881+0000 7f5313fff640 10 monclient: _finish_auth 0 2026-02-24T19:17:30.883 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.881+0000 7f5313fff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:30.883 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.881+0000 7f5313fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:30.883 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.881+0000 7f53418bf640 5 monclient: authenticate success, global_id 4626 2026-02-24T19:17:30.883 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.881+0000 7f53418bf640 10 monclient: _renew_subs 2026-02-24T19:17:30.883 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.881+0000 7f53418bf640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:30.883 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.881+0000 7f53418bf640 1 -- 10.20.193.14:0/404796655 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f533c1fbac0 con 0x7f533c0b9f80 2026-02-24T19:17:30.883 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.882+0000 7f53418bf640 10 client.4626.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:30.883 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.882+0000 7f53418bf640 10 monclient: _renew_subs 2026-02-24T19:17:30.883 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.882+0000 7f53418bf640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:30.883 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.882+0000 7f53418bf640 1 -- 10.20.193.14:0/404796655 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f533c164d20 con 0x7f533c0b9f80 2026-02-24T19:17:30.883 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.882+0000 7f53418bf640 1 librados: init done 2026-02-24T19:17:30.883 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.882+0000 7f53418bf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.883 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.882+0000 7f53418bf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.883 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.882+0000 7f53418bf640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:30.883 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.882+0000 7f53418bf640 1 -- 10.20.193.14:0/404796655 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f533c055260 con 0x7f533c0b9f80 2026-02-24T19:17:30.885 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.884+0000 7efcbd67b640 10 monclient: get_monmap_and_config 2026-02-24T19:17:30.885 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.884+0000 7efcbd67b640 10 monclient: build_initial_monmap 2026-02-24T19:17:30.885 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.884+0000 7efcbd67b640 10 monclient: monmap: 2026-02-24T19:17:30.885 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:30.885 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.885 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:30.884646+0000 2026-02-24T19:17:30.885 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:30.884646+0000 2026-02-24T19:17:30.885 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:30.885 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.885 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:30.885 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:30.885 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:30.885 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.885 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.884+0000 7efcbd67b640 1 Processor -- start 2026-02-24T19:17:30.885 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.884+0000 7efcbd67b640 1 -- start start 2026-02-24T19:17:30.885 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.884+0000 7efcbd67b640 10 monclient: init 2026-02-24T19:17:30.886 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.885+0000 7efcbd67b640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:30.886 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.885+0000 7efcbd67b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:30.886 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.885+0000 7efcbd67b640 10 monclient(hunting): picked mon.noname-c con 0x7efcb80b9f80 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:30.886 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.885+0000 7efcbd67b640 10 monclient(hunting): picked mon.noname-b con 0x7efcb80ba350 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:30.886 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.885+0000 7efcbd67b640 10 monclient(hunting): picked mon.noname-a con 0x7efcb80585e0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:30.886 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.885+0000 7efcbd67b640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcb8163930 con 0x7efcb80585e0 2026-02-24T19:17:30.886 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.885+0000 7efcbd67b640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcb8163bb0 con 0x7efcb80ba350 2026-02-24T19:17:30.886 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.885+0000 7efcbd67b640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcb8163e90 con 0x7efcb80b9f80 2026-02-24T19:17:30.886 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.885+0000 7efcbd67b640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:30.886 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.885+0000 7efcbd67b640 10 monclient(hunting): authenticate will time out at 3625.566150s 2026-02-24T19:17:30.919 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.918+0000 7efe78a2b640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-24T19:17:30.919 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.918+0000 7efe78a2b640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-24T19:17:30.919 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.918+0000 7efe78a2b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:30.919 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.918+0000 7efe78a2b640 1 -- 10.20.193.14:0/1987191060 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7efe740b8ef0 con 0x7efe740585e0 2026-02-24T19:17:30.935 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.934+0000 7f9f317fa640 1 -- 10.20.193.14:0/687193607 <== mon.1 v1:10.20.193.44:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9f240031c0 con 0x7f9f3c15d3b0 2026-02-24T19:17:30.935 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.934+0000 7f9f317fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:30.935 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.934+0000 7f9f317fa640 1 -- 10.20.193.14:0/687193607 <== mon.1 v1:10.20.193.44:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f9f24004f40 con 0x7f9f3c15d3b0 2026-02-24T19:17:30.935 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.934+0000 7f9f317fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.935 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.934+0000 7f9f317fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:30.935 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.934+0000 7f9f317fa640 10 monclient: dump: 2026-02-24T19:17:30.935 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.935 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.935 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.935 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.935 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.935 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.935 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.935 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.935 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.935 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.935 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.934+0000 7f9f32ffd640 4 set_mon_vals no callback set 2026-02-24T19:17:30.936 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.935+0000 7f9f317fa640 1 -- 10.20.193.14:0/687193607 <== mon.1 v1:10.20.193.44:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f9f24005120 con 0x7f9f3c15d3b0 2026-02-24T19:17:30.936 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.935+0000 7f9f40c00640 10 monclient: get_auth_request con 0x7f9f0c077ae0 auth_method 0 2026-02-24T19:17:30.936 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.935+0000 7f9f317fa640 10 client.4567.objecter ms_handle_connect 0x7f9f0c077ae0 2026-02-24T19:17:30.937 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.936+0000 7f9f317fa640 1 -- 10.20.193.14:0/687193607 <== mon.1 v1:10.20.193.44:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7f9f24093520 con 0x7f9f3c15d3b0 2026-02-24T19:17:30.937 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.936+0000 7f9f317fa640 10 client.4567.objecter ms_dispatch2 0x7f9f3c000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:30.937 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.936+0000 7f9f317fa640 3 client.4567.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:30.938 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.936+0000 7f9f317fa640 3 client.4567.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:30.938 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.936+0000 7f9f317fa640 20 client.4567.objecter dump_active .. 0 homeless 2026-02-24T19:17:30.938 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.937+0000 7f41ffc4e640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-24T19:17:30.939 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.937+0000 7f41ffc4e640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-24T19:17:30.939 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.937+0000 7f41ffc4e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:30.939 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.937+0000 7f41ffc4e640 1 -- 10.20.193.14:0/517999795 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 13} v 0) -- 0x7f41f805dbf0 con 0x7f41f8159b60 2026-02-24T19:17:30.939 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.938+0000 7f9f317fa640 1 -- 10.20.193.14:0/687193607 <== mon.1 v1:10.20.193.44:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f9f3c0b2400 con 0x7f9f3c15d3b0 2026-02-24T19:17:30.939 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.938+0000 7f9f317fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.939 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.938+0000 7f9f317fa640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:30.942 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.940+0000 7efe5affd640 1 -- 10.20.193.14:0/1987191060 <== mon.1 v1:10.20.193.44:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 1498640560) 0x7efe6805c400 con 0x7efe740585e0 2026-02-24T19:17:30.942 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.940+0000 7efe5affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-24T19:17:30.942 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.940+0000 7efe5affd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:30.942 INFO:teuthology.orchestra.run.trial014.stdout:90194313221 2026-02-24T19:17:30.942 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.941+0000 7efcb67fc640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7efcb80ba350 0x7efcb8057ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:35198/0 (socket says 10.20.193.14:35198) 2026-02-24T19:17:30.943 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.941+0000 7efcb67fc640 1 -- 10.20.193.14:0/2239686943 learned_addr learned my addr 10.20.193.14:0/2239686943 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:30.945 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.943+0000 7efe78a2b640 10 librados: watch_flush enter 2026-02-24T19:17:30.945 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.943+0000 7efe78a2b640 10 librados: watch_flush exit 2026-02-24T19:17:30.945 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.943+0000 7efe78a2b640 20 client.4558.objecter shutdown clearing up homeless session... 2026-02-24T19:17:30.945 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.943+0000 7efe78a2b640 10 client.4558.objecter successfully canceled tick 2026-02-24T19:17:30.945 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.943+0000 7efe78a2b640 1 -- 10.20.193.14:0/1987191060 >> v1:10.20.193.14:6800/4014096310 conn(0x7efe40077ca0 legacy=0x7efe40098150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.945 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.943+0000 7efe78a2b640 10 monclient: shutdown 2026-02-24T19:17:30.945 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.943+0000 7efe78a2b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:30.946 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.943+0000 7efe78a2b640 1 -- 10.20.193.14:0/1987191060 >> v1:10.20.193.44:6789/0 conn(0x7efe740585e0 legacy=0x7efe740b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.946 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.943+0000 7efe78a2b640 1 -- 10.20.193.14:0/1987191060 shutdown_connections 2026-02-24T19:17:30.946 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.943+0000 7efe78a2b640 1 -- 10.20.193.14:0/1987191060 >> 10.20.193.14:0/1987191060 conn(0x7efe740b7990 msgr2=0x7efe74158a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:30.946 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.943+0000 7efe78a2b640 1 -- 10.20.193.14:0/1987191060 shutdown_connections 2026-02-24T19:17:30.946 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.943+0000 7efe78a2b640 1 -- 10.20.193.14:0/1987191060 wait complete. 2026-02-24T19:17:30.946 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.943+0000 7efe78a2b640 1 librados: shutdown 2026-02-24T19:17:30.946 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.944+0000 7efcb5ffb640 1 -- 10.20.193.14:0/2239686943 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4171050037 0 0) 0x7efcb8163bb0 con 0x7efcb80ba350 2026-02-24T19:17:30.946 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.944+0000 7efcb5ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.946 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.944+0000 7efcb5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.946 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.944+0000 7efcb5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.947 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.944+0000 7efcb5ffb640 10 monclient(hunting): my global_id is 4591 2026-02-24T19:17:30.947 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.944+0000 7efcb5ffb640 1 -- 10.20.193.14:0/2239686943 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efca4003610 con 0x7efcb80ba350 2026-02-24T19:17:30.947 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.946+0000 7efcb5ffb640 1 -- 10.20.193.14:0/2239686943 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3037251647 0 0) 0x7efca4003610 con 0x7efcb80ba350 2026-02-24T19:17:30.948 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.946+0000 7efcb5ffb640 1 -- 10.20.193.14:0/2239686943 >> v1:10.20.193.170:6789/0 conn(0x7efcb80b9f80 legacy=0x7efcb8163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:30.948 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.946+0000 7efcb5ffb640 1 -- 10.20.193.14:0/2239686943 >> v1:10.20.193.14:6789/0 conn(0x7efcb80585e0 legacy=0x7efcb8166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:30.948 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.946+0000 7efcb5ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:30.948 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.946+0000 7efcb5ffb640 1 monclient: found mon.noname-b 2026-02-24T19:17:30.948 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.946+0000 7efcb5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:30.948 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.946+0000 7efcb5ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.44:6789/0 2026-02-24T19:17:30.948 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.946+0000 7efcb5ffb640 1 -- 10.20.193.14:0/2239686943 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb80573f0 con 0x7efcb80ba350 2026-02-24T19:17:30.948 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.946+0000 7efcb5ffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:30.948 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.946+0000 7efcb5ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:30.948 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.946+0000 7efcb5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:30.948 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.946+0000 7efcb5ffb640 1 -- 10.20.193.14:0/2239686943 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7efca0002df0 con 0x7efcb80ba350 2026-02-24T19:17:30.948 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.946+0000 7efcbd67b640 5 monclient: authenticate success, global_id 4591 2026-02-24T19:17:30.948 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.946+0000 7efcbd67b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:30.948 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.946+0000 7efcb5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.949 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.946+0000 7efcb5ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:30.949 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.946+0000 7efcb5ffb640 10 monclient: dump: 2026-02-24T19:17:30.949 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.949 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.949 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.949 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.949 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.949 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.949 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.949 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.949 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.949 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.949 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.946+0000 7efcbd67b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:30.951 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.947+0000 7efcb5ffb640 1 -- 10.20.193.14:0/2239686943 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efca0003000 con 0x7efcb80ba350 2026-02-24T19:17:30.952 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.947+0000 7efcb5ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:30.952 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.947+0000 7efcb5ffb640 1 -- 10.20.193.14:0/2239686943 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7efca0003440 con 0x7efcb80ba350 2026-02-24T19:17:30.952 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.947+0000 7efcbd67b640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:30.952 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.947+0000 7efcb5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.952 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.947+0000 7efcbd67b640 4 set_mon_vals no callback set 2026-02-24T19:17:30.952 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.947+0000 7efcb5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:30.952 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.947+0000 7efcb5ffb640 10 monclient: dump: 2026-02-24T19:17:30.952 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.952 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.952 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.952 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.952 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.952 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.953 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.953 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.953 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.953 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.953 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.947+0000 7efcbd67b640 10 monclient: shutdown 2026-02-24T19:17:30.953 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.947+0000 7efcbd67b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:30.953 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.947+0000 7efcbd67b640 1 -- 10.20.193.14:0/2239686943 >> v1:10.20.193.44:6789/0 conn(0x7efcb80ba350 legacy=0x7efcb8057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.953 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.947+0000 7efcbd67b640 1 -- 10.20.193.14:0/2239686943 shutdown_connections 2026-02-24T19:17:30.953 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.947+0000 7efcbd67b640 1 -- 10.20.193.14:0/2239686943 >> 10.20.193.14:0/2239686943 conn(0x7efcb80b7990 msgr2=0x7efcb80b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:30.953 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.947+0000 7efcbd67b640 1 -- 10.20.193.14:0/2239686943 shutdown_connections 2026-02-24T19:17:30.953 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.947+0000 7efcbd67b640 1 -- 10.20.193.14:0/2239686943 wait complete. 2026-02-24T19:17:30.953 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.948+0000 7efcbd67b640 10 monclient: build_initial_monmap 2026-02-24T19:17:30.953 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.948+0000 7efcbd67b640 10 monclient: monmap: 2026-02-24T19:17:30.953 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:30.953 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:30.954 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:30.954 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:30.954 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:30.954 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:30.954 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:30.954 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:30.954 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:30.954 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.954 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.948+0000 7efcbd67b640 1 librados: starting msgr at 2026-02-24T19:17:30.954 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.948+0000 7efcbd67b640 1 librados: starting objecter 2026-02-24T19:17:30.954 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.948+0000 7efcbd67b640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:30.954 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.948+0000 7efcbd67b640 1 Processor -- start 2026-02-24T19:17:30.954 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.948+0000 7efcbd67b640 1 -- start start 2026-02-24T19:17:30.954 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.948+0000 7efcbd67b640 1 librados: setting wanted keys 2026-02-24T19:17:30.954 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.948+0000 7efcbd67b640 1 librados: calling monclient init 2026-02-24T19:17:30.954 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.948+0000 7efcbd67b640 10 monclient: init 2026-02-24T19:17:30.954 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.948+0000 7efcbd67b640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:30.955 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.948+0000 7efcbd67b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:30.955 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.948+0000 7efcbd67b640 10 monclient(hunting): picked mon.noname-c con 0x7efcb80585e0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:30.955 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.948+0000 7efcbd67b640 10 monclient(hunting): picked mon.noname-b con 0x7efcb80b9f80 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:30.955 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.948+0000 7efcbd67b640 10 monclient(hunting): picked mon.noname-a con 0x7efcb80ba350 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:30.955 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.948+0000 7efcbd67b640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcb8155cc0 con 0x7efcb80ba350 2026-02-24T19:17:30.955 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.948+0000 7efcbd67b640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcb8160de0 con 0x7efcb80b9f80 2026-02-24T19:17:30.955 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.948+0000 7efcbd67b640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcb81652d0 con 0x7efcb80585e0 2026-02-24T19:17:30.955 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.948+0000 7efcbd67b640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:30.955 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.948+0000 7efcbd67b640 10 monclient(hunting): authenticate will time out at 3625.629889s 2026-02-24T19:17:30.955 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.949+0000 7efcb67fc640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7efcb80b9f80 0x7efcb8162130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:35206/0 (socket says 10.20.193.14:35206) 2026-02-24T19:17:30.955 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.949+0000 7efcb67fc640 1 -- 10.20.193.14:0/4111804241 learned_addr learned my addr 10.20.193.14:0/4111804241 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:30.955 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.949+0000 7efc977fe640 10 client.?.objecter ms_handle_connect 0x7efcb80b9f80 2026-02-24T19:17:30.955 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.949+0000 7efc977fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.955 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.950+0000 7efc977fe640 1 -- 10.20.193.14:0/4111804241 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1956855240 0 0) 0x7efcb8160de0 con 0x7efcb80b9f80 2026-02-24T19:17:30.955 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.950+0000 7efc977fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.955 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.950+0000 7efc977fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.955 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.950+0000 7efc977fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.955 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.950+0000 7efc977fe640 10 monclient(hunting): my global_id is 4594 2026-02-24T19:17:30.956 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.950+0000 7efc977fe640 1 -- 10.20.193.14:0/4111804241 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc84003610 con 0x7efcb80b9f80 2026-02-24T19:17:30.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313221 for osd.4 2026-02-24T19:17:30.957 DEBUG:teuthology.parallel:result is None 2026-02-24T19:17:30.958 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.952+0000 7efc977fe640 1 -- 10.20.193.14:0/4111804241 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2809235013 0 0) 0x7efc84003610 con 0x7efcb80b9f80 2026-02-24T19:17:30.958 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.952+0000 7efc977fe640 1 -- 10.20.193.14:0/4111804241 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efcb8160de0 con 0x7efcb80b9f80 2026-02-24T19:17:30.958 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.952+0000 7efc977fe640 1 -- 10.20.193.14:0/4111804241 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7efca0003410 con 0x7efcb80b9f80 2026-02-24T19:17:30.958 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.952+0000 7efc977fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:30.958 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.952+0000 7efc977fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:30.958 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.952+0000 7efc977fe640 10 monclient(hunting): dump: 2026-02-24T19:17:30.958 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.958 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.958 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.958 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.958 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.958 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.959 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.959 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.959 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.959 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.959 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.952+0000 7efc977fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:30.959 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.954+0000 7efc977fe640 1 -- 10.20.193.14:0/4111804241 <== mon.1 v1:10.20.193.44:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2842241165 0 0) 0x7efcb8160de0 con 0x7efcb80b9f80 2026-02-24T19:17:30.959 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.954+0000 7efc977fe640 1 -- 10.20.193.14:0/4111804241 >> v1:10.20.193.170:6789/0 conn(0x7efcb80585e0 legacy=0x7efcb81550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.959 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.954+0000 7efc977fe640 1 -- 10.20.193.14:0/4111804241 >> v1:10.20.193.14:6789/0 conn(0x7efcb80ba350 legacy=0x7efcb81645a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.959 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.954+0000 7efc977fe640 10 monclient: _finish_hunting 0 2026-02-24T19:17:30.959 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.954+0000 7efc977fe640 1 monclient: found mon.b 2026-02-24T19:17:30.959 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.954+0000 7efc977fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:30.959 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.954+0000 7efc977fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:30.959 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.954+0000 7efc977fe640 1 -- 10.20.193.14:0/4111804241 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb8165860 con 0x7efcb80b9f80 2026-02-24T19:17:30.959 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.954+0000 7efc977fe640 10 monclient: _finish_auth 0 2026-02-24T19:17:30.959 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.954+0000 7efc977fe640 10 monclient: _check_auth_tickets 2026-02-24T19:17:30.959 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.954+0000 7efc977fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:30.959 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.954+0000 7efcbd67b640 5 monclient: authenticate success, global_id 4594 2026-02-24T19:17:30.959 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.954+0000 7efcbd67b640 10 monclient: _renew_subs 2026-02-24T19:17:30.960 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.954+0000 7efcbd67b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:30.960 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.954+0000 7efcbd67b640 1 -- 10.20.193.14:0/4111804241 --> v1:10.20.193.44:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efcb8165b40 con 0x7efcb80b9f80 2026-02-24T19:17:30.960 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.954+0000 7efcbd67b640 10 client.4594.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:30.960 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.954+0000 7efcbd67b640 10 monclient: _renew_subs 2026-02-24T19:17:30.960 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.954+0000 7efcbd67b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:30.960 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.954+0000 7efcbd67b640 1 -- 10.20.193.14:0/4111804241 --> v1:10.20.193.44:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7efcb8166100 con 0x7efcb80b9f80 2026-02-24T19:17:30.960 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.954+0000 7efcbd67b640 1 librados: init done 2026-02-24T19:17:30.960 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.955+0000 7efcbd67b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.960 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.955+0000 7efcbd67b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.960 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.955+0000 7efcbd67b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:30.960 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.955+0000 7efcbd67b640 1 -- 10.20.193.14:0/4111804241 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcb80b8e70 con 0x7efcb80b9f80 2026-02-24T19:17:30.963 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.962+0000 7efc977fe640 1 -- 10.20.193.14:0/4111804241 <== mon.1 v1:10.20.193.44:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efca0004bc0 con 0x7efcb80b9f80 2026-02-24T19:17:30.963 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.962+0000 7efc977fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:30.963 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.962+0000 7efc977fe640 1 -- 10.20.193.14:0/4111804241 <== mon.1 v1:10.20.193.44:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7efca0004fd0 con 0x7efcb80b9f80 2026-02-24T19:17:30.963 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.962+0000 7efc977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.964 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.962+0000 7efc977fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:30.964 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.962+0000 7efc977fe640 10 monclient: dump: 2026-02-24T19:17:30.964 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.964 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.964 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.964 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.964 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.964 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.964 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.964 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.964 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.964 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.964 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.962+0000 7efcb57fa640 4 set_mon_vals no callback set 2026-02-24T19:17:30.965 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.963+0000 7efc977fe640 1 -- 10.20.193.14:0/4111804241 <== mon.1 v1:10.20.193.44:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7efca00051b0 con 0x7efcb80b9f80 2026-02-24T19:17:30.965 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.963+0000 7efcb6ffd640 10 monclient: get_auth_request con 0x7efc84077d00 auth_method 0 2026-02-24T19:17:30.965 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.963+0000 7efc977fe640 10 client.4594.objecter ms_handle_connect 0x7efc84077d00 2026-02-24T19:17:30.966 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.964+0000 7efc977fe640 1 -- 10.20.193.14:0/4111804241 <== mon.1 v1:10.20.193.44:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7efca00933c0 con 0x7efcb80b9f80 2026-02-24T19:17:30.966 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.964+0000 7efc977fe640 10 client.4594.objecter ms_dispatch2 0x7efcb8000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:30.966 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.964+0000 7efc977fe640 3 client.4594.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:30.966 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.964+0000 7efc977fe640 3 client.4594.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:30.966 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.965+0000 7efc977fe640 20 client.4594.objecter dump_active .. 0 homeless 2026-02-24T19:17:30.971 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.969+0000 7fb8b363a640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-24T19:17:30.971 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.969+0000 7fb8b363a640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-24T19:17:30.971 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.969+0000 7fb8b363a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:30.971 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.969+0000 7fb8b363a640 1 -- 10.20.193.14:0/1100562492 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 15} v 0) -- 0x7fb8ac0b7d20 con 0x7fb8ac165880 2026-02-24T19:17:30.977 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.976+0000 7f5313fff640 1 -- 10.20.193.14:0/404796655 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5324003590 con 0x7f533c0b9f80 2026-02-24T19:17:30.977 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.976+0000 7f5313fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:30.977 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.976+0000 7f5313fff640 1 -- 10.20.193.14:0/404796655 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f53240038e0 con 0x7f533c0b9f80 2026-02-24T19:17:30.977 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.976+0000 7f5313fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.977 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.976+0000 7f5313fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:30.977 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.976+0000 7f5313fff640 10 monclient: dump: 2026-02-24T19:17:30.977 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:30.977 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:30.977 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.977 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:30.977 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.977 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:30.977 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:30.978 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:30.978 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:30.978 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:30.978 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.976+0000 7f53397fa640 4 set_mon_vals no callback set 2026-02-24T19:17:30.978 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.976+0000 7f5313fff640 1 -- 10.20.193.14:0/404796655 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f532401c750 con 0x7f533c0b9f80 2026-02-24T19:17:30.978 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.977+0000 7f533affd640 10 monclient: get_auth_request con 0x7f530c077c20 auth_method 0 2026-02-24T19:17:30.979 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.977+0000 7f5313fff640 10 client.4626.objecter ms_handle_connect 0x7f530c077c20 2026-02-24T19:17:30.981 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.980+0000 7f5313fff640 1 -- 10.20.193.14:0/404796655 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7f5324092100 con 0x7f533c0b9f80 2026-02-24T19:17:30.981 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.980+0000 7f5313fff640 10 client.4626.objecter ms_dispatch2 0x7f533c000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:30.981 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.980+0000 7f5313fff640 3 client.4626.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:30.981 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.980+0000 7f5313fff640 3 client.4626.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:30.981 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.980+0000 7f5313fff640 20 client.4626.objecter dump_active .. 0 homeless 2026-02-24T19:17:30.981 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.980+0000 7f5313fff640 1 -- 10.20.193.14:0/404796655 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f533c055260 con 0x7f533c0b9f80 2026-02-24T19:17:30.981 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.980+0000 7f5313fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.982 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.980+0000 7f5313fff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:30.985 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.984+0000 7fb899ffb640 1 -- 10.20.193.14:0/1100562492 <== mon.0 v1:10.20.193.14:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 15}]=0 v0) ==== 75+0+12 (unknown 2221946896 0 1498640560) 0x7fb8a805e250 con 0x7fb8ac165880 2026-02-24T19:17:30.985 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.984+0000 7fb899ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-24T19:17:30.985 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.984+0000 7fb899ffb640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:30.986 INFO:teuthology.orchestra.run.trial014.stdout:90194313221 2026-02-24T19:17:30.988 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.986+0000 7fb8b363a640 10 librados: watch_flush enter 2026-02-24T19:17:30.988 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.986+0000 7fb8b363a640 10 librados: watch_flush exit 2026-02-24T19:17:30.988 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.986+0000 7fb8b363a640 20 client.4620.objecter shutdown clearing up homeless session... 2026-02-24T19:17:30.988 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.986+0000 7fb8b363a640 10 client.4620.objecter successfully canceled tick 2026-02-24T19:17:30.988 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.986+0000 7fb8b363a640 1 -- 10.20.193.14:0/1100562492 >> v1:10.20.193.14:6800/4014096310 conn(0x7fb87c077ea0 legacy=0x7fb87c098350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.988 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.986+0000 7fb8b363a640 10 monclient: shutdown 2026-02-24T19:17:30.989 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.986+0000 7fb8b363a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:30.989 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.986+0000 7fb8b363a640 1 -- 10.20.193.14:0/1100562492 >> v1:10.20.193.14:6789/0 conn(0x7fb8ac165880 legacy=0x7fb8ac152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.989 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.986+0000 7fb8b363a640 1 -- 10.20.193.14:0/1100562492 shutdown_connections 2026-02-24T19:17:30.989 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.986+0000 7fb8b363a640 1 -- 10.20.193.14:0/1100562492 >> 10.20.193.14:0/1100562492 conn(0x7fb8ac0b78c0 msgr2=0x7fb8ac156520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:30.989 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.986+0000 7fb8b363a640 1 -- 10.20.193.14:0/1100562492 shutdown_connections 2026-02-24T19:17:30.989 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.986+0000 7fb8b363a640 1 -- 10.20.193.14:0/1100562492 wait complete. 2026-02-24T19:17:30.989 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:30.986+0000 7fb8b363a640 1 librados: shutdown 2026-02-24T19:17:30.996 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313221 for osd.15 2026-02-24T19:17:30.996 DEBUG:teuthology.parallel:result is None 2026-02-24T19:17:31.047 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.046+0000 7f9f42e8b640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-24T19:17:31.047 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.046+0000 7f9f42e8b640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-24T19:17:31.048 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.046+0000 7f9f42e8b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:31.048 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.046+0000 7f9f42e8b640 1 -- 10.20.193.14:0/687193607 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 14} v 0) -- 0x7f9f3c055260 con 0x7f9f3c15d3b0 2026-02-24T19:17:31.050 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.049+0000 7efc977fe640 1 -- 10.20.193.14:0/4111804241 <== mon.1 v1:10.20.193.44:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7efcb80b8e70 con 0x7efcb80b9f80 2026-02-24T19:17:31.051 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.049+0000 7efc977fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:31.051 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.049+0000 7efc977fe640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:31.052 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.051+0000 7f9f317fa640 1 -- 10.20.193.14:0/687193607 <== mon.1 v1:10.20.193.44:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 14}]=0 v0) ==== 75+0+12 (unknown 2547163239 0 1498640560) 0x7f9f3c055260 con 0x7f9f3c15d3b0 2026-02-24T19:17:31.052 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.051+0000 7f9f317fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-24T19:17:31.052 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.051+0000 7f9f317fa640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:31.052 INFO:teuthology.orchestra.run.trial014.stdout:90194313221 2026-02-24T19:17:31.055 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.053+0000 7f9f42e8b640 10 librados: watch_flush enter 2026-02-24T19:17:31.055 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.053+0000 7f9f42e8b640 10 librados: watch_flush exit 2026-02-24T19:17:31.055 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.053+0000 7f9f42e8b640 20 client.4567.objecter shutdown clearing up homeless session... 2026-02-24T19:17:31.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.053+0000 7f9f42e8b640 10 client.4567.objecter successfully canceled tick 2026-02-24T19:17:31.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.053+0000 7f9f42e8b640 1 -- 10.20.193.14:0/687193607 >> v1:10.20.193.14:6800/4014096310 conn(0x7f9f0c077ae0 legacy=0x7f9f0c097f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:31.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.053+0000 7f9f42e8b640 10 monclient: shutdown 2026-02-24T19:17:31.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.053+0000 7f9f42e8b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:31.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.053+0000 7f9f42e8b640 1 -- 10.20.193.14:0/687193607 >> v1:10.20.193.44:6789/0 conn(0x7f9f3c15d3b0 legacy=0x7f9f3c126460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:31.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.053+0000 7f9f42e8b640 1 -- 10.20.193.14:0/687193607 shutdown_connections 2026-02-24T19:17:31.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.053+0000 7f9f42e8b640 1 -- 10.20.193.14:0/687193607 >> 10.20.193.14:0/687193607 conn(0x7f9f3c0b4120 msgr2=0x7f9f3c0b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:31.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.053+0000 7f9f42e8b640 1 -- 10.20.193.14:0/687193607 shutdown_connections 2026-02-24T19:17:31.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.053+0000 7f9f42e8b640 1 -- 10.20.193.14:0/687193607 wait complete. 2026-02-24T19:17:31.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.054+0000 7f9f42e8b640 1 librados: shutdown 2026-02-24T19:17:31.064 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313221 for osd.14 2026-02-24T19:17:31.064 DEBUG:teuthology.parallel:result is None 2026-02-24T19:17:31.073 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.071+0000 7fd826ffd640 1 -- 10.20.193.14:0/799887024 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd828003470 con 0x7fd840159850 2026-02-24T19:17:31.073 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.071+0000 7fd826ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:31.073 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.071+0000 7fd83cd72640 4 set_mon_vals no callback set 2026-02-24T19:17:31.092 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.091+0000 7f53418bf640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-24T19:17:31.092 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.091+0000 7f53418bf640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-24T19:17:31.092 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.091+0000 7f53418bf640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:17:31.092 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.091+0000 7f53418bf640 1 -- 10.20.193.14:0/404796655 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f533c13bf00 con 0x7f533c0b9f80 2026-02-24T19:17:31.095 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.094+0000 7f5313fff640 1 -- 10.20.193.14:0/404796655 <== mon.0 v1:10.20.193.14:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 1498640560) 0x7f533c13bf00 con 0x7f533c0b9f80 2026-02-24T19:17:31.095 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.094+0000 7f5313fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-24T19:17:31.095 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.094+0000 7f5313fff640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:31.095 INFO:teuthology.orchestra.run.trial014.stdout:90194313221 2026-02-24T19:17:31.098 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.096+0000 7f53418bf640 10 librados: watch_flush enter 2026-02-24T19:17:31.098 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.096+0000 7f53418bf640 10 librados: watch_flush exit 2026-02-24T19:17:31.098 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.096+0000 7f53418bf640 20 client.4626.objecter shutdown clearing up homeless session... 2026-02-24T19:17:31.098 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.096+0000 7f53418bf640 10 client.4626.objecter successfully canceled tick 2026-02-24T19:17:31.098 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.096+0000 7f53418bf640 1 -- 10.20.193.14:0/404796655 >> v1:10.20.193.14:6800/4014096310 conn(0x7f530c077c20 legacy=0x7f530c0980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:31.098 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.096+0000 7f53418bf640 10 monclient: shutdown 2026-02-24T19:17:31.098 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.096+0000 7f53418bf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:31.098 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.096+0000 7f53418bf640 1 -- 10.20.193.14:0/404796655 >> v1:10.20.193.14:6789/0 conn(0x7f533c0b9f80 legacy=0x7f533c13b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:31.099 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.096+0000 7f53418bf640 1 -- 10.20.193.14:0/404796655 shutdown_connections 2026-02-24T19:17:31.099 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.096+0000 7f53418bf640 1 -- 10.20.193.14:0/404796655 >> 10.20.193.14:0/404796655 conn(0x7f533c0b7990 msgr2=0x7f533c15acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:31.099 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.096+0000 7f53418bf640 1 -- 10.20.193.14:0/404796655 shutdown_connections 2026-02-24T19:17:31.099 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.096+0000 7f53418bf640 1 -- 10.20.193.14:0/404796655 wait complete. 2026-02-24T19:17:31.099 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.096+0000 7f53418bf640 1 librados: shutdown 2026-02-24T19:17:31.106 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313221 for osd.3 2026-02-24T19:17:31.106 DEBUG:teuthology.parallel:result is None 2026-02-24T19:17:31.131 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.130+0000 7fd826ffd640 1 -- 10.20.193.14:0/799887024 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fd828003b90 con 0x7fd840159850 2026-02-24T19:17:31.131 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.130+0000 7fd826ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:31.131 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.130+0000 7fd826ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:31.131 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.130+0000 7fd826ffd640 10 monclient: dump: 2026-02-24T19:17:31.131 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:31.131 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:31.131 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:31.132 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:31.132 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:31.132 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:31.132 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:31.132 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:31.132 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:31.132 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:31.133 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.130+0000 7fd826ffd640 1 -- 10.20.193.14:0/799887024 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7fd828003db0 con 0x7fd840159850 2026-02-24T19:17:31.133 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.131+0000 7fd83e575640 10 monclient: get_auth_request con 0x7fd80c077c60 auth_method 0 2026-02-24T19:17:31.133 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.131+0000 7fd826ffd640 10 client.4622.objecter ms_handle_connect 0x7fd80c077c60 2026-02-24T19:17:31.133 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.132+0000 7fd826ffd640 1 -- 10.20.193.14:0/799887024 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7fd828093430 con 0x7fd840159850 2026-02-24T19:17:31.134 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.132+0000 7fd826ffd640 10 client.4622.objecter ms_dispatch2 0x7fd840000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:31.134 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.132+0000 7fd826ffd640 3 client.4622.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:31.134 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.132+0000 7fd826ffd640 3 client.4622.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:31.134 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.132+0000 7fd826ffd640 20 client.4622.objecter dump_active .. 0 homeless 2026-02-24T19:17:31.138 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.137+0000 7f9fdbfff640 1 -- 10.20.193.14:0/3482287015 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9ff4003930 con 0x7fa004166f60 2026-02-24T19:17:31.138 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.137+0000 7f9fdbfff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:31.138 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.137+0000 7f9fdbfff640 1 -- 10.20.193.14:0/3482287015 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f9ff4003c80 con 0x7fa004166f60 2026-02-24T19:17:31.138 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.137+0000 7f9fdbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:31.138 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.137+0000 7f9fdbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:31.138 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.137+0000 7f9fdbfff640 10 monclient: dump: 2026-02-24T19:17:31.138 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:31.139 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:31.139 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:31.139 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:31.139 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:31.139 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:31.139 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:31.139 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:31.139 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:31.139 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:31.139 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.137+0000 7fa0017fa640 4 set_mon_vals no callback set 2026-02-24T19:17:31.140 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.138+0000 7f9fdbfff640 1 -- 10.20.193.14:0/3482287015 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f9ff401caf0 con 0x7fa004166f60 2026-02-24T19:17:31.140 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.138+0000 7fa002ffd640 10 monclient: get_auth_request con 0x7f9fd4077cb0 auth_method 0 2026-02-24T19:17:31.140 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.138+0000 7f9fdbfff640 10 client.4613.objecter ms_handle_connect 0x7f9fd4077cb0 2026-02-24T19:17:31.160 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.158+0000 7efcbd67b640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-24T19:17:31.160 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.158+0000 7efcbd67b640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-24T19:17:31.160 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.158+0000 7efcbd67b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:31.160 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.158+0000 7efcbd67b640 1 -- 10.20.193.14:0/4111804241 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7efcb8056df0 con 0x7efcb80b9f80 2026-02-24T19:17:31.162 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.161+0000 7efc977fe640 1 -- 10.20.193.14:0/4111804241 <== mon.1 v1:10.20.193.44:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+12 (unknown 3646472635 0 1498640560) 0x7efca005ddf0 con 0x7efcb80b9f80 2026-02-24T19:17:31.162 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.161+0000 7efc977fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-24T19:17:31.162 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.161+0000 7efc977fe640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:31.162 INFO:teuthology.orchestra.run.trial014.stdout:90194313221 2026-02-24T19:17:31.165 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.163+0000 7efcbd67b640 10 librados: watch_flush enter 2026-02-24T19:17:31.165 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.163+0000 7efcbd67b640 10 librados: watch_flush exit 2026-02-24T19:17:31.165 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.163+0000 7efcbd67b640 20 client.4594.objecter shutdown clearing up homeless session... 2026-02-24T19:17:31.165 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.163+0000 7efcbd67b640 10 client.4594.objecter successfully canceled tick 2026-02-24T19:17:31.165 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.163+0000 7efcbd67b640 1 -- 10.20.193.14:0/4111804241 >> v1:10.20.193.14:6800/4014096310 conn(0x7efc84077d00 legacy=0x7efc840981b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:31.165 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.163+0000 7efcbd67b640 10 monclient: shutdown 2026-02-24T19:17:31.165 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.163+0000 7efcbd67b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:31.165 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.163+0000 7efcbd67b640 1 -- 10.20.193.14:0/4111804241 >> v1:10.20.193.44:6789/0 conn(0x7efcb80b9f80 legacy=0x7efcb8162130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:31.165 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.163+0000 7efcbd67b640 1 -- 10.20.193.14:0/4111804241 shutdown_connections 2026-02-24T19:17:31.165 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.163+0000 7efcbd67b640 1 -- 10.20.193.14:0/4111804241 >> 10.20.193.14:0/4111804241 conn(0x7efcb80b7990 msgr2=0x7efcb8157e60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:31.166 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.163+0000 7efcbd67b640 1 -- 10.20.193.14:0/4111804241 shutdown_connections 2026-02-24T19:17:31.166 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.163+0000 7efcbd67b640 1 -- 10.20.193.14:0/4111804241 wait complete. 2026-02-24T19:17:31.166 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.163+0000 7efcbd67b640 1 librados: shutdown 2026-02-24T19:17:31.174 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313221 for osd.10 2026-02-24T19:17:31.174 DEBUG:teuthology.parallel:result is None 2026-02-24T19:17:31.229 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.228+0000 7fd826ffd640 1 -- 10.20.193.14:0/799887024 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fd82805de60 con 0x7fd840159850 2026-02-24T19:17:31.229 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.228+0000 7fd826ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:31.229 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.228+0000 7fd826ffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:31.233 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.231+0000 7f9fdbfff640 1 -- 10.20.193.14:0/3482287015 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7f9ff4092480 con 0x7fa004166f60 2026-02-24T19:17:31.233 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.231+0000 7f9fdbfff640 10 client.4613.objecter ms_dispatch2 0x7fa004000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:31.233 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.231+0000 7f9fdbfff640 3 client.4613.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:31.233 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.231+0000 7f9fdbfff640 3 client.4613.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:31.233 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.231+0000 7f9fdbfff640 20 client.4613.objecter dump_active .. 0 homeless 2026-02-24T19:17:31.234 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.233+0000 7f9fdbfff640 1 -- 10.20.193.14:0/3482287015 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f9ff405ceb0 con 0x7fa004166f60 2026-02-24T19:17:31.234 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.233+0000 7f9fdbfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:31.234 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.233+0000 7f9fdbfff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:31.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.239+0000 7fe0b27fc640 1 -- 10.20.193.14:0/1510854600 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe0b40035f0 con 0x7fe0c40585e0 2026-02-24T19:17:31.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.239+0000 7fe0b27fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:31.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.239+0000 7fe0b27fc640 1 -- 10.20.193.14:0/1510854600 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fe0b4003940 con 0x7fe0c40585e0 2026-02-24T19:17:31.241 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.239+0000 7fe0b27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:31.241 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.239+0000 7fe0b27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:31.241 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.239+0000 7fe0b27fc640 10 monclient: dump: 2026-02-24T19:17:31.241 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:31.241 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:31.241 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:31.241 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:31.241 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:31.241 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:31.241 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:31.241 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:31.241 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:31.242 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:31.242 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.239+0000 7fe0b3fff640 4 set_mon_vals no callback set 2026-02-24T19:17:31.242 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.240+0000 7fe0b27fc640 1 -- 10.20.193.14:0/1510854600 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7fe0b401c7b0 con 0x7fe0c40585e0 2026-02-24T19:17:31.242 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.240+0000 7fe0c9520640 10 monclient: get_auth_request con 0x7fe094077d30 auth_method 0 2026-02-24T19:17:31.242 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.240+0000 7fe0b27fc640 10 client.4616.objecter ms_handle_connect 0x7fe094077d30 2026-02-24T19:17:31.243 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.242+0000 7fe0b27fc640 1 -- 10.20.193.14:0/1510854600 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7fe0b4092040 con 0x7fe0c40585e0 2026-02-24T19:17:31.243 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.242+0000 7fe0b27fc640 10 client.4616.objecter ms_dispatch2 0x7fe0c4000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:31.244 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.242+0000 7fe0b27fc640 3 client.4616.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:31.244 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.242+0000 7fe0b27fc640 3 client.4616.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:31.244 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.242+0000 7fe0b27fc640 20 client.4616.objecter dump_active .. 0 homeless 2026-02-24T19:17:31.245 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.244+0000 7f41e67fc640 1 -- 10.20.193.14:0/517999795 <== mon.2 v1:10.20.193.170:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 13}]=0 v0) ==== 75+0+12 (unknown 3988744482 0 1498640560) 0x7f41f405d9f0 con 0x7f41f8159b60 2026-02-24T19:17:31.245 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.244+0000 7f41e67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-24T19:17:31.245 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.244+0000 7f41e67fc640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:31.246 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.244+0000 7fe0b27fc640 1 -- 10.20.193.14:0/1510854600 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fe0c41678f0 con 0x7fe0c40585e0 2026-02-24T19:17:31.246 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.244+0000 7fe0b27fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:31.246 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.244+0000 7fe0b27fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:31.246 INFO:teuthology.orchestra.run.trial014.stdout:90194313221 2026-02-24T19:17:31.248 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.247+0000 7f41ffc4e640 10 librados: watch_flush enter 2026-02-24T19:17:31.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.247+0000 7f41ffc4e640 10 librados: watch_flush exit 2026-02-24T19:17:31.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.247+0000 7f41ffc4e640 20 client.4598.objecter shutdown clearing up homeless session... 2026-02-24T19:17:31.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.247+0000 7f41ffc4e640 10 client.4598.objecter successfully canceled tick 2026-02-24T19:17:31.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.247+0000 7f41ffc4e640 1 -- 10.20.193.14:0/517999795 >> v1:10.20.193.14:6800/4014096310 conn(0x7f41c8077bf0 legacy=0x7f41c80980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:31.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.247+0000 7f41ffc4e640 10 monclient: shutdown 2026-02-24T19:17:31.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.247+0000 7f41ffc4e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:31.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.247+0000 7f41ffc4e640 1 -- 10.20.193.14:0/517999795 >> v1:10.20.193.170:6789/0 conn(0x7f41f8159b60 legacy=0x7f41f8152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:31.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.247+0000 7f41ffc4e640 1 -- 10.20.193.14:0/517999795 shutdown_connections 2026-02-24T19:17:31.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.247+0000 7f41ffc4e640 1 -- 10.20.193.14:0/517999795 >> 10.20.193.14:0/517999795 conn(0x7f41f80b7120 msgr2=0x7f41f8156ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:31.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.247+0000 7f41ffc4e640 1 -- 10.20.193.14:0/517999795 shutdown_connections 2026-02-24T19:17:31.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.247+0000 7f41ffc4e640 1 -- 10.20.193.14:0/517999795 wait complete. 2026-02-24T19:17:31.250 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.247+0000 7f41ffc4e640 1 librados: shutdown 2026-02-24T19:17:31.250 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.248+0000 7f015bfff640 1 -- 10.20.193.14:0/440919942 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0170003590 con 0x7f01800b9f80 2026-02-24T19:17:31.250 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.248+0000 7f015bfff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:31.250 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.248+0000 7f015bfff640 1 -- 10.20.193.14:0/440919942 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f01700038e0 con 0x7f01800b9f80 2026-02-24T19:17:31.251 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.248+0000 7f015bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:31.251 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.248+0000 7f015bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:31.251 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.248+0000 7f015bfff640 10 monclient: dump: 2026-02-24T19:17:31.251 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:31.251 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:31.251 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:31.251 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:31.251 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:31.251 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:31.251 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:31.251 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:31.252 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:31.252 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:31.252 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.248+0000 7f017dffb640 4 set_mon_vals no callback set 2026-02-24T19:17:31.252 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.249+0000 7f015bfff640 1 -- 10.20.193.14:0/440919942 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f017001c750 con 0x7f01800b9f80 2026-02-24T19:17:31.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.250+0000 7f017f7fe640 10 monclient: get_auth_request con 0x7f0150077cd0 auth_method 0 2026-02-24T19:17:31.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.250+0000 7f015bfff640 10 client.4619.objecter ms_handle_connect 0x7f0150077cd0 2026-02-24T19:17:31.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.250+0000 7f015bfff640 1 -- 10.20.193.14:0/440919942 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7f0170092080 con 0x7f01800b9f80 2026-02-24T19:17:31.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.250+0000 7f015bfff640 10 client.4619.objecter ms_dispatch2 0x7f0180000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:31.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.250+0000 7f015bfff640 3 client.4619.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:31.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.250+0000 7f015bfff640 3 client.4619.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:31.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.250+0000 7f015bfff640 20 client.4619.objecter dump_active .. 0 homeless 2026-02-24T19:17:31.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.252+0000 7f015bfff640 1 -- 10.20.193.14:0/440919942 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f017005cab0 con 0x7f01800b9f80 2026-02-24T19:17:31.254 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.252+0000 7f015bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:31.254 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.252+0000 7f015bfff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:31.257 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313221 for osd.13 2026-02-24T19:17:31.257 DEBUG:teuthology.parallel:result is None 2026-02-24T19:17:31.340 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.339+0000 7fd844fc0640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-24T19:17:31.340 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.339+0000 7fd844fc0640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-24T19:17:31.340 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.339+0000 7fd844fc0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:31.340 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.339+0000 7fd844fc0640 1 -- 10.20.193.14:0/799887024 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fd8401313c0 con 0x7fd840159850 2026-02-24T19:17:31.343 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.342+0000 7fd826ffd640 1 -- 10.20.193.14:0/799887024 <== mon.2 v1:10.20.193.170:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+12 (unknown 3207554136 0 1498640560) 0x7fd82805d760 con 0x7fd840159850 2026-02-24T19:17:31.343 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.342+0000 7fd826ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-24T19:17:31.343 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.342+0000 7fd826ffd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:31.343 INFO:teuthology.orchestra.run.trial014.stdout:90194313221 2026-02-24T19:17:31.344 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.343+0000 7fa0099c8640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-24T19:17:31.345 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.343+0000 7fa0099c8640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-24T19:17:31.345 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.343+0000 7fa0099c8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:31.345 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.343+0000 7fa0099c8640 1 -- 10.20.193.14:0/3482287015 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fa0040b0f20 con 0x7fa004166f60 2026-02-24T19:17:31.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.344+0000 7fd844fc0640 10 librados: watch_flush enter 2026-02-24T19:17:31.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.344+0000 7fd844fc0640 10 librados: watch_flush exit 2026-02-24T19:17:31.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.344+0000 7fd844fc0640 20 client.4622.objecter shutdown clearing up homeless session... 2026-02-24T19:17:31.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.344+0000 7fd844fc0640 10 client.4622.objecter successfully canceled tick 2026-02-24T19:17:31.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.344+0000 7fd844fc0640 1 -- 10.20.193.14:0/799887024 >> v1:10.20.193.14:6800/4014096310 conn(0x7fd80c077c60 legacy=0x7fd80c098110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:31.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.344+0000 7fd844fc0640 10 monclient: shutdown 2026-02-24T19:17:31.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.344+0000 7fd844fc0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:31.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.344+0000 7fd844fc0640 1 -- 10.20.193.14:0/799887024 >> v1:10.20.193.170:6789/0 conn(0x7fd840159850 legacy=0x7fd84011b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:31.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.344+0000 7fd844fc0640 1 -- 10.20.193.14:0/799887024 shutdown_connections 2026-02-24T19:17:31.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.344+0000 7fd844fc0640 1 -- 10.20.193.14:0/799887024 >> 10.20.193.14:0/799887024 conn(0x7fd8400b7120 msgr2=0x7fd840059860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:31.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.344+0000 7fd844fc0640 1 -- 10.20.193.14:0/799887024 shutdown_connections 2026-02-24T19:17:31.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.344+0000 7fd844fc0640 1 -- 10.20.193.14:0/799887024 wait complete. 2026-02-24T19:17:31.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.344+0000 7fd844fc0640 1 librados: shutdown 2026-02-24T19:17:31.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.346+0000 7f9fdbfff640 1 -- 10.20.193.14:0/3482287015 <== mon.2 v1:10.20.193.170:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 1498640560) 0x7f9ff405c7b0 con 0x7fa004166f60 2026-02-24T19:17:31.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.346+0000 7f9fdbfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-24T19:17:31.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.346+0000 7f9fdbfff640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:31.348 INFO:teuthology.orchestra.run.trial014.stdout:90194313221 2026-02-24T19:17:31.350 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.348+0000 7fa0099c8640 10 librados: watch_flush enter 2026-02-24T19:17:31.351 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.348+0000 7fa0099c8640 10 librados: watch_flush exit 2026-02-24T19:17:31.351 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.348+0000 7fa0099c8640 20 client.4613.objecter shutdown clearing up homeless session... 2026-02-24T19:17:31.351 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.348+0000 7fa0099c8640 10 client.4613.objecter successfully canceled tick 2026-02-24T19:17:31.351 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.348+0000 7fa0099c8640 1 -- 10.20.193.14:0/3482287015 >> v1:10.20.193.14:6800/4014096310 conn(0x7f9fd4077cb0 legacy=0x7f9fd4098160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:31.351 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.348+0000 7fa0099c8640 10 monclient: shutdown 2026-02-24T19:17:31.351 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.348+0000 7fa0099c8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:31.351 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.348+0000 7fa0099c8640 1 -- 10.20.193.14:0/3482287015 >> v1:10.20.193.170:6789/0 conn(0x7fa004166f60 legacy=0x7fa00405cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:31.351 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.349+0000 7fa0099c8640 1 -- 10.20.193.14:0/3482287015 shutdown_connections 2026-02-24T19:17:31.351 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.349+0000 7fa0099c8640 1 -- 10.20.193.14:0/3482287015 >> 10.20.193.14:0/3482287015 conn(0x7fa0040b2ef0 msgr2=0x7fa0040568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:31.351 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.349+0000 7fa0099c8640 1 -- 10.20.193.14:0/3482287015 shutdown_connections 2026-02-24T19:17:31.351 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.349+0000 7fa0099c8640 1 -- 10.20.193.14:0/3482287015 wait complete. 2026-02-24T19:17:31.352 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.349+0000 7fa0099c8640 1 librados: shutdown 2026-02-24T19:17:31.355 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313221 for osd.8 2026-02-24T19:17:31.355 DEBUG:teuthology.parallel:result is None 2026-02-24T19:17:31.355 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.354+0000 7fe0cbfac640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-24T19:17:31.356 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.354+0000 7fe0cbfac640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-24T19:17:31.356 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.354+0000 7fe0cbfac640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:31.356 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.354+0000 7fe0cbfac640 1 -- 10.20.193.14:0/1510854600 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fe0c40b6c80 con 0x7fe0c40585e0 2026-02-24T19:17:31.357 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.356+0000 7fe0b27fc640 1 -- 10.20.193.14:0/1510854600 <== mon.2 v1:10.20.193.170:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 1498640560) 0x7fe0b405ca70 con 0x7fe0c40585e0 2026-02-24T19:17:31.357 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.356+0000 7fe0b27fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-24T19:17:31.357 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.356+0000 7fe0b27fc640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:31.357 INFO:teuthology.orchestra.run.trial014.stdout:90194313221 2026-02-24T19:17:31.359 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313221 for osd.0 2026-02-24T19:17:31.360 DEBUG:teuthology.parallel:result is None 2026-02-24T19:17:31.361 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.358+0000 7fe0cbfac640 10 librados: watch_flush enter 2026-02-24T19:17:31.361 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.358+0000 7fe0cbfac640 10 librados: watch_flush exit 2026-02-24T19:17:31.361 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.358+0000 7fe0cbfac640 20 client.4616.objecter shutdown clearing up homeless session... 2026-02-24T19:17:31.361 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.358+0000 7fe0cbfac640 10 client.4616.objecter successfully canceled tick 2026-02-24T19:17:31.361 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.358+0000 7fe0cbfac640 1 -- 10.20.193.14:0/1510854600 >> v1:10.20.193.14:6800/4014096310 conn(0x7fe094077d30 legacy=0x7fe0940981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:31.361 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.358+0000 7fe0cbfac640 10 monclient: shutdown 2026-02-24T19:17:31.361 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.358+0000 7fe0cbfac640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:31.362 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.358+0000 7fe0cbfac640 1 -- 10.20.193.14:0/1510854600 >> v1:10.20.193.170:6789/0 conn(0x7fe0c40585e0 legacy=0x7fe0c41580d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:31.362 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.358+0000 7fe0cbfac640 1 -- 10.20.193.14:0/1510854600 shutdown_connections 2026-02-24T19:17:31.362 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.358+0000 7fe0cbfac640 1 -- 10.20.193.14:0/1510854600 >> 10.20.193.14:0/1510854600 conn(0x7fe0c40b7990 msgr2=0x7fe0c40b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:31.362 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.358+0000 7fe0cbfac640 1 -- 10.20.193.14:0/1510854600 shutdown_connections 2026-02-24T19:17:31.362 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.358+0000 7fe0cbfac640 1 -- 10.20.193.14:0/1510854600 wait complete. 2026-02-24T19:17:31.362 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.358+0000 7fe0cbfac640 1 librados: shutdown 2026-02-24T19:17:31.363 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.361+0000 7f0186074640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-24T19:17:31.363 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.361+0000 7f0186074640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-24T19:17:31.363 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.361+0000 7f0186074640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:31.363 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.361+0000 7f0186074640 1 -- 10.20.193.14:0/440919942 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 12} v 0) -- 0x7f018015ad90 con 0x7f01800b9f80 2026-02-24T19:17:31.364 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.363+0000 7f015bfff640 1 -- 10.20.193.14:0/440919942 <== mon.2 v1:10.20.193.170:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 12}]=0 v0) ==== 75+0+12 (unknown 4263375189 0 1498640560) 0x7f017005c3b0 con 0x7f01800b9f80 2026-02-24T19:17:31.364 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.363+0000 7f015bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-24T19:17:31.365 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.363+0000 7f015bfff640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:31.365 INFO:teuthology.orchestra.run.trial014.stdout:90194313221 2026-02-24T19:17:31.368 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.365+0000 7f0186074640 10 librados: watch_flush enter 2026-02-24T19:17:31.368 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.365+0000 7f0186074640 10 librados: watch_flush exit 2026-02-24T19:17:31.368 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.365+0000 7f0186074640 20 client.4619.objecter shutdown clearing up homeless session... 2026-02-24T19:17:31.368 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.365+0000 7f0186074640 10 client.4619.objecter successfully canceled tick 2026-02-24T19:17:31.368 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.366+0000 7f0186074640 1 -- 10.20.193.14:0/440919942 >> v1:10.20.193.14:6800/4014096310 conn(0x7f0150077cd0 legacy=0x7f0150098180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:31.368 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.366+0000 7f0186074640 10 monclient: shutdown 2026-02-24T19:17:31.368 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.366+0000 7f0186074640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:31.368 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.366+0000 7f0186074640 1 -- 10.20.193.14:0/440919942 >> v1:10.20.193.170:6789/0 conn(0x7f01800b9f80 legacy=0x7f01801fe320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:31.368 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.366+0000 7f0186074640 1 -- 10.20.193.14:0/440919942 shutdown_connections 2026-02-24T19:17:31.368 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.366+0000 7f0186074640 1 -- 10.20.193.14:0/440919942 >> 10.20.193.14:0/440919942 conn(0x7f01800b7990 msgr2=0x7f01800b66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:31.368 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.366+0000 7f0186074640 1 -- 10.20.193.14:0/440919942 shutdown_connections 2026-02-24T19:17:31.369 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.366+0000 7f0186074640 1 -- 10.20.193.14:0/440919942 wait complete. 2026-02-24T19:17:31.369 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.366+0000 7f0186074640 1 librados: shutdown 2026-02-24T19:17:31.369 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313221 for osd.1 2026-02-24T19:17:31.370 DEBUG:teuthology.parallel:result is None 2026-02-24T19:17:31.377 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313221 for osd.12 2026-02-24T19:17:31.377 DEBUG:teuthology.parallel:result is None 2026-02-24T19:17:31.377 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-24T19:17:31.378 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T19:17:31.487 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.485+0000 7f95868e8640 10 monclient: get_monmap_and_config 2026-02-24T19:17:31.487 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.485+0000 7f95868e8640 10 monclient: build_initial_monmap 2026-02-24T19:17:31.487 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.485+0000 7f95868e8640 10 monclient: monmap: 2026-02-24T19:17:31.487 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:31.487 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:31.487 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:31.486368+0000 2026-02-24T19:17:31.487 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:31.486368+0000 2026-02-24T19:17:31.487 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:31.487 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:31.488 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:31.488 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:31.488 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:31.488 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:31.490 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.486+0000 7f95868e8640 1 Processor -- start 2026-02-24T19:17:31.490 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.486+0000 7f95868e8640 1 -- start start 2026-02-24T19:17:31.490 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.486+0000 7f95868e8640 10 monclient: init 2026-02-24T19:17:31.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.487+0000 7f95868e8640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:31.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.487+0000 7f95868e8640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:31.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.487+0000 7f95868e8640 10 monclient(hunting): picked mon.noname-c con 0x7f9580055bf0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:31.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.487+0000 7f95868e8640 10 monclient(hunting): picked mon.noname-b con 0x7f9580164040 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:31.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.487+0000 7f95868e8640 10 monclient(hunting): picked mon.noname-a con 0x7f9580055fc0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:31.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.487+0000 7f95868e8640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95800b3a00 con 0x7f9580055fc0 2026-02-24T19:17:31.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.487+0000 7f95868e8640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95800b3c70 con 0x7f9580164040 2026-02-24T19:17:31.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.487+0000 7f95868e8640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95800b3f50 con 0x7f9580055bf0 2026-02-24T19:17:31.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.487+0000 7f95868e8640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:31.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.487+0000 7f95868e8640 10 monclient(hunting): authenticate will time out at 3626.168150s 2026-02-24T19:17:31.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.487+0000 7f9584e5e640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f9580055fc0 0x7f95800b5480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:55466/0 (socket says 10.20.193.14:55466) 2026-02-24T19:17:31.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.487+0000 7f9584e5e640 1 -- 10.20.193.14:0/2868541399 learned_addr learned my addr 10.20.193.14:0/2868541399 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:31.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.488+0000 7f957effd640 1 -- 10.20.193.14:0/2868541399 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2316479777 0 0) 0x7f95800b3a00 con 0x7f9580055fc0 2026-02-24T19:17:31.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.488+0000 7f957effd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:31.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.488+0000 7f957effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:31.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.488+0000 7f957effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:31.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.488+0000 7f957effd640 10 monclient(hunting): my global_id is 4629 2026-02-24T19:17:31.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.488+0000 7f957effd640 1 -- 10.20.193.14:0/2868541399 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9564003610 con 0x7f9580055fc0 2026-02-24T19:17:31.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.488+0000 7f957effd640 1 -- 10.20.193.14:0/2868541399 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3597147987 0 0) 0x7f95800b3f50 con 0x7f9580055bf0 2026-02-24T19:17:31.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.488+0000 7f957effd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:31.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.488+0000 7f957effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:31.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.488+0000 7f957effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:31.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.488+0000 7f957effd640 10 monclient(hunting): my global_id is 4628 2026-02-24T19:17:31.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.488+0000 7f957effd640 1 -- 10.20.193.14:0/2868541399 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95800b3a00 con 0x7f9580055bf0 2026-02-24T19:17:31.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.488+0000 7f957effd640 1 -- 10.20.193.14:0/2868541399 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3344962481 0 0) 0x7f95800b3c70 con 0x7f9580164040 2026-02-24T19:17:31.493 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.488+0000 7f957effd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:31.493 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.488+0000 7f957effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:31.493 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.488+0000 7f957effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:31.493 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.488+0000 7f957effd640 10 monclient(hunting): my global_id is 4597 2026-02-24T19:17:31.493 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.488+0000 7f957effd640 1 -- 10.20.193.14:0/2868541399 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95800b3f50 con 0x7f9580164040 2026-02-24T19:17:31.500 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.490+0000 7f957effd640 1 -- 10.20.193.14:0/2868541399 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1286048244 0 0) 0x7f95800b3a00 con 0x7f9580055bf0 2026-02-24T19:17:31.500 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.490+0000 7f957effd640 1 -- 10.20.193.14:0/2868541399 >> v1:10.20.193.44:6789/0 conn(0x7f9580164040 legacy=0x7f9580056690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:31.500 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.490+0000 7f957effd640 1 -- 10.20.193.14:0/2868541399 >> v1:10.20.193.14:6789/0 conn(0x7f9580055fc0 legacy=0x7f95800b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:31.500 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.490+0000 7f957effd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:31.501 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.490+0000 7f957effd640 1 monclient: found mon.noname-c 2026-02-24T19:17:31.501 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.490+0000 7f957effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:31.501 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.490+0000 7f957effd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.170:6789/0 2026-02-24T19:17:31.501 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.490+0000 7f957effd640 1 -- 10.20.193.14:0/2868541399 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95800b4230 con 0x7f9580055bf0 2026-02-24T19:17:31.501 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.490+0000 7f957effd640 10 monclient: _finish_auth 0 2026-02-24T19:17:31.501 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.490+0000 7f957effd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:31.501 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.490+0000 7f957effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:31.501 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.490+0000 7f957effd640 1 -- 10.20.193.14:0/2868541399 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f956c002df0 con 0x7f9580055bf0 2026-02-24T19:17:31.501 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.490+0000 7f957effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:31.501 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.490+0000 7f957effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:31.501 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.490+0000 7f957effd640 10 monclient: dump: 2026-02-24T19:17:31.502 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:31.502 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:31.502 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:31.502 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:31.502 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:31.502 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:31.502 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:31.502 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:31.502 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:31.502 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:31.502 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.490+0000 7f95868e8640 5 monclient: authenticate success, global_id 4628 2026-02-24T19:17:31.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.490+0000 7f95868e8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:31.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.491+0000 7f957effd640 1 -- 10.20.193.14:0/2868541399 <== mon.2 v1:10.20.193.170:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f956c002fc0 con 0x7f9580055bf0 2026-02-24T19:17:31.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.491+0000 7f957effd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:31.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.491+0000 7f957effd640 1 -- 10.20.193.14:0/2868541399 <== mon.2 v1:10.20.193.170:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f956c003400 con 0x7f9580055bf0 2026-02-24T19:17:31.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.491+0000 7f95868e8640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:31.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.491+0000 7f957effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:31.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.491+0000 7f95868e8640 4 set_mon_vals no callback set 2026-02-24T19:17:31.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.491+0000 7f957effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:31.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.491+0000 7f957effd640 10 monclient: dump: 2026-02-24T19:17:31.503 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:31.503 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:31.503 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:31.503 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:31.504 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:31.504 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:31.504 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:31.504 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:31.504 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:31.504 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:31.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.491+0000 7f95868e8640 10 monclient: shutdown 2026-02-24T19:17:31.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.491+0000 7f95868e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:31.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.491+0000 7f95868e8640 1 -- 10.20.193.14:0/2868541399 >> v1:10.20.193.170:6789/0 conn(0x7f9580055bf0 legacy=0x7f95800b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:31.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.491+0000 7f95868e8640 1 -- 10.20.193.14:0/2868541399 shutdown_connections 2026-02-24T19:17:31.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.491+0000 7f95868e8640 1 -- 10.20.193.14:0/2868541399 >> 10.20.193.14:0/2868541399 conn(0x7f95800b7bb0 msgr2=0x7f95800b7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:31.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.491+0000 7f95868e8640 1 -- 10.20.193.14:0/2868541399 shutdown_connections 2026-02-24T19:17:31.505 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.491+0000 7f95868e8640 1 -- 10.20.193.14:0/2868541399 wait complete. 2026-02-24T19:17:31.505 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.492+0000 7f95868e8640 10 monclient: build_initial_monmap 2026-02-24T19:17:31.505 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.492+0000 7f95868e8640 10 monclient: monmap: 2026-02-24T19:17:31.505 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:31.505 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:31.505 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:31.505 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:31.505 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:31.505 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:31.505 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:31.505 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:31.505 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:31.505 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:31.506 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.492+0000 7f95868e8640 1 librados: starting msgr at 2026-02-24T19:17:31.506 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.492+0000 7f95868e8640 1 librados: starting objecter 2026-02-24T19:17:31.506 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.492+0000 7f95868e8640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:31.506 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.492+0000 7f95868e8640 1 Processor -- start 2026-02-24T19:17:31.506 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.492+0000 7f95868e8640 1 -- start start 2026-02-24T19:17:31.506 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.492+0000 7f95868e8640 1 librados: setting wanted keys 2026-02-24T19:17:31.506 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.492+0000 7f95868e8640 1 librados: calling monclient init 2026-02-24T19:17:31.506 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.492+0000 7f95868e8640 10 monclient: init 2026-02-24T19:17:31.506 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.492+0000 7f95868e8640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:31.506 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.492+0000 7f95868e8640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:31.506 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.492+0000 7f95868e8640 10 monclient(hunting): picked mon.noname-c con 0x7f9580055bf0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:31.506 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.492+0000 7f95868e8640 10 monclient(hunting): picked mon.noname-b con 0x7f9580055fc0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:31.506 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.492+0000 7f95868e8640 10 monclient(hunting): picked mon.noname-a con 0x7f9580164040 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:31.507 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.492+0000 7f95868e8640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f958012ffc0 con 0x7f9580164040 2026-02-24T19:17:31.507 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.492+0000 7f95868e8640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95801302a0 con 0x7f9580055fc0 2026-02-24T19:17:31.507 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.492+0000 7f95868e8640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9580130580 con 0x7f9580055bf0 2026-02-24T19:17:31.507 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.492+0000 7f95868e8640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:31.507 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.492+0000 7f95868e8640 10 monclient(hunting): authenticate will time out at 3626.173748s 2026-02-24T19:17:31.507 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.493+0000 7f957f7fe640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7f9580055fc0 0x7f9580162ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:35220/0 (socket says 10.20.193.14:35220) 2026-02-24T19:17:31.507 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.493+0000 7f957ffff640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7f9580055bf0 0x7f958012f7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:45612/0 (socket says 10.20.193.14:45612) 2026-02-24T19:17:31.507 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.493+0000 7f957f7fe640 1 -- 10.20.193.14:0/950716472 learned_addr learned my addr 10.20.193.14:0/950716472 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:31.507 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.493+0000 7f957cff9640 10 client.?.objecter ms_handle_connect 0x7f9580055bf0 2026-02-24T19:17:31.507 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.493+0000 7f957cff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:31.507 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.493+0000 7f957cff9640 10 client.?.objecter ms_handle_connect 0x7f9580055fc0 2026-02-24T19:17:31.507 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.493+0000 7f957cff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:31.508 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.493+0000 7f957cff9640 10 client.?.objecter ms_handle_connect 0x7f9580164040 2026-02-24T19:17:31.508 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.493+0000 7f957cff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:31.508 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.494+0000 7f957cff9640 1 -- 10.20.193.14:0/950716472 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1823244779 0 0) 0x7f9580130580 con 0x7f9580055bf0 2026-02-24T19:17:31.508 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.494+0000 7f957cff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:31.508 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.494+0000 7f957cff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:31.508 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.494+0000 7f957cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:31.508 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.494+0000 7f957cff9640 10 monclient(hunting): my global_id is 4631 2026-02-24T19:17:31.508 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.494+0000 7f957cff9640 1 -- 10.20.193.14:0/950716472 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9550003610 con 0x7f9580055bf0 2026-02-24T19:17:31.508 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.494+0000 7f957cff9640 1 -- 10.20.193.14:0/950716472 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2664847257 0 0) 0x7f95801302a0 con 0x7f9580055fc0 2026-02-24T19:17:31.508 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.494+0000 7f957cff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:31.508 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.494+0000 7f957cff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:31.508 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.494+0000 7f957cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:31.509 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.494+0000 7f957cff9640 10 monclient(hunting): my global_id is 4600 2026-02-24T19:17:31.509 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.494+0000 7f957cff9640 1 -- 10.20.193.14:0/950716472 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9580130580 con 0x7f9580055fc0 2026-02-24T19:17:31.509 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.494+0000 7f957cff9640 1 -- 10.20.193.14:0/950716472 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4264632299 0 0) 0x7f958012ffc0 con 0x7f9580164040 2026-02-24T19:17:31.509 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.494+0000 7f957cff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:31.509 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.494+0000 7f957cff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:31.509 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.494+0000 7f957cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:31.509 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.494+0000 7f957cff9640 10 monclient(hunting): my global_id is 4632 2026-02-24T19:17:31.509 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.494+0000 7f957cff9640 1 -- 10.20.193.14:0/950716472 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95801302a0 con 0x7f9580164040 2026-02-24T19:17:31.509 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.496+0000 7f957cff9640 1 -- 10.20.193.14:0/950716472 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4294283643 0 0) 0x7f9550003610 con 0x7f9580055bf0 2026-02-24T19:17:31.509 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.496+0000 7f957cff9640 1 -- 10.20.193.14:0/950716472 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f958012ffc0 con 0x7f9580055bf0 2026-02-24T19:17:31.509 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.496+0000 7f957cff9640 1 -- 10.20.193.14:0/950716472 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f956c003310 con 0x7f9580055bf0 2026-02-24T19:17:31.509 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.496+0000 7f957cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:31.509 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.496+0000 7f957cff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:31.510 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.496+0000 7f957cff9640 10 monclient(hunting): dump: 2026-02-24T19:17:31.510 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:31.510 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:31.510 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:31.510 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:31.510 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:31.510 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:31.510 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:31.510 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:31.510 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:31.510 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:31.510 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.496+0000 7f957cff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:31.511 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.496+0000 7f957cff9640 1 -- 10.20.193.14:0/950716472 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1694194003 0 0) 0x7f95801302a0 con 0x7f9580164040 2026-02-24T19:17:31.511 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.496+0000 7f957cff9640 1 -- 10.20.193.14:0/950716472 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9550003610 con 0x7f9580164040 2026-02-24T19:17:31.511 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.496+0000 7f957cff9640 1 -- 10.20.193.14:0/950716472 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f9574003430 con 0x7f9580164040 2026-02-24T19:17:31.511 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.496+0000 7f957cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:31.511 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.496+0000 7f957cff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:31.511 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.496+0000 7f957cff9640 10 monclient(hunting): dump: 2026-02-24T19:17:31.511 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:31.511 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:31.511 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:31.511 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:31.511 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:31.511 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:31.511 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:31.512 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:31.512 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:31.512 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:31.512 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.496+0000 7f957cff9640 1 -- 10.20.193.14:0/950716472 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2894223127 0 0) 0x7f9580130580 con 0x7f9580055fc0 2026-02-24T19:17:31.512 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.496+0000 7f957cff9640 1 -- 10.20.193.14:0/950716472 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f95801302a0 con 0x7f9580055fc0 2026-02-24T19:17:31.512 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.496+0000 7f957cff9640 1 -- 10.20.193.14:0/950716472 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f95700030c0 con 0x7f9580055fc0 2026-02-24T19:17:31.512 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.496+0000 7f957cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:31.512 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.496+0000 7f957cff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:31.512 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.496+0000 7f957cff9640 10 monclient(hunting): dump: 2026-02-24T19:17:31.512 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:31.512 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:31.512 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:31.512 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:31.513 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:31.513 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:31.513 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:31.513 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:31.513 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:31.513 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:31.513 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.498+0000 7f957cff9640 1 -- 10.20.193.14:0/950716472 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4158591571 0 0) 0x7f958012ffc0 con 0x7f9580055bf0 2026-02-24T19:17:31.513 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.498+0000 7f957cff9640 1 -- 10.20.193.14:0/950716472 >> v1:10.20.193.44:6789/0 conn(0x7f9580055fc0 legacy=0x7f9580162ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:31.513 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.498+0000 7f957cff9640 1 -- 10.20.193.14:0/950716472 >> v1:10.20.193.14:6789/0 conn(0x7f9580164040 legacy=0x7f958012beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:31.513 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.498+0000 7f957cff9640 10 monclient: _finish_hunting 0 2026-02-24T19:17:31.513 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.498+0000 7f957cff9640 1 monclient: found mon.c 2026-02-24T19:17:31.513 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.498+0000 7f957cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:31.514 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.498+0000 7f957cff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:31.514 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.498+0000 7f957cff9640 1 -- 10.20.193.14:0/950716472 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f958012b3d0 con 0x7f9580055bf0 2026-02-24T19:17:31.514 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.498+0000 7f957cff9640 10 monclient: _finish_auth 0 2026-02-24T19:17:31.514 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.498+0000 7f957cff9640 10 monclient: _check_auth_tickets 2026-02-24T19:17:31.514 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.498+0000 7f957cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:31.514 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.498+0000 7f95868e8640 5 monclient: authenticate success, global_id 4631 2026-02-24T19:17:31.514 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.498+0000 7f95868e8640 10 monclient: _renew_subs 2026-02-24T19:17:31.514 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.498+0000 7f95868e8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:31.514 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.498+0000 7f95868e8640 1 -- 10.20.193.14:0/950716472 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f958012b6b0 con 0x7f9580055bf0 2026-02-24T19:17:31.514 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.498+0000 7f95868e8640 10 client.4631.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:31.514 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.498+0000 7f95868e8640 10 monclient: _renew_subs 2026-02-24T19:17:31.514 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.498+0000 7f95868e8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:31.514 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.498+0000 7f95868e8640 1 -- 10.20.193.14:0/950716472 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9580161630 con 0x7f9580055bf0 2026-02-24T19:17:31.515 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.498+0000 7f95868e8640 1 librados: init done 2026-02-24T19:17:31.515 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.498+0000 7f95868e8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:31.515 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.498+0000 7f95868e8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:31.515 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.498+0000 7f95868e8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:31.515 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.498+0000 7f95868e8640 1 -- 10.20.193.14:0/950716472 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9580131900 con 0x7f9580055bf0 2026-02-24T19:17:31.516 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.505+0000 7f957cff9640 1 -- 10.20.193.14:0/950716472 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f956c002f80 con 0x7f9580055bf0 2026-02-24T19:17:31.516 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.505+0000 7f957cff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:31.517 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.505+0000 7f957cff9640 1 -- 10.20.193.14:0/950716472 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f956c003b00 con 0x7f9580055bf0 2026-02-24T19:17:31.517 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.505+0000 7f957cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:31.517 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.505+0000 7f957cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:31.517 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.505+0000 7f957cff9640 10 monclient: dump: 2026-02-24T19:17:31.517 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:31.517 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:31.517 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:31.517 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:31.517 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:31.517 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:31.517 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:31.518 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:31.518 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:31.518 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:31.518 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.505+0000 7f957e7fc640 4 set_mon_vals no callback set 2026-02-24T19:17:31.518 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.506+0000 7f957cff9640 1 -- 10.20.193.14:0/950716472 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f956c003b00 con 0x7f9580055bf0 2026-02-24T19:17:31.518 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.507+0000 7f957f7fe640 10 monclient: get_auth_request con 0x7f9550077ed0 auth_method 0 2026-02-24T19:17:31.518 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.507+0000 7f957cff9640 10 client.4631.objecter ms_handle_connect 0x7f9550077ed0 2026-02-24T19:17:31.518 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.507+0000 7f957cff9640 1 -- 10.20.193.14:0/950716472 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7f956c093050 con 0x7f9580055bf0 2026-02-24T19:17:31.518 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.507+0000 7f957cff9640 10 client.4631.objecter ms_dispatch2 0x7f9580000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:31.518 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.507+0000 7f957cff9640 3 client.4631.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:31.518 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.507+0000 7f957cff9640 3 client.4631.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:31.518 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.507+0000 7f957cff9640 20 client.4631.objecter dump_active .. 0 homeless 2026-02-24T19:17:31.592 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.591+0000 7f957cff9640 1 -- 10.20.193.14:0/950716472 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f9580131900 con 0x7f9580055bf0 2026-02-24T19:17:31.593 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.591+0000 7f957cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:31.593 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.591+0000 7f957cff9640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:31.697 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.696+0000 7f95868e8640 1 -- 10.20.193.14:0/950716472 --> v1:10.20.193.14:6800/4014096310 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f95800b3810 con 0x7f9550077ed0 2026-02-24T19:17:31.698 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.696+0000 7f957cff9640 1 -- 10.20.193.14:0/950716472 <== mgr.4110 v1:10.20.193.14:6800/4014096310 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+42842 (unknown 2965378022 0 2038877000) 0x7f95800b3810 con 0x7f9550077ed0 2026-02-24T19:17:31.699 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:17:31.700 INFO:teuthology.orchestra.run.trial014.stderr:dumped all 2026-02-24T19:17:31.700 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.697+0000 7f95868e8640 10 librados: watch_flush enter 2026-02-24T19:17:31.700 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.697+0000 7f95868e8640 10 librados: watch_flush exit 2026-02-24T19:17:31.701 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.697+0000 7f95868e8640 20 client.4631.objecter shutdown clearing up homeless session... 2026-02-24T19:17:31.701 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.697+0000 7f95868e8640 10 client.4631.objecter successfully canceled tick 2026-02-24T19:17:31.701 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.697+0000 7f95868e8640 1 -- 10.20.193.14:0/950716472 >> v1:10.20.193.14:6800/4014096310 conn(0x7f9550077ed0 legacy=0x7f9550098380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:31.701 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.697+0000 7f95868e8640 10 monclient: shutdown 2026-02-24T19:17:31.701 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.697+0000 7f95868e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:31.701 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.697+0000 7f95868e8640 1 -- 10.20.193.14:0/950716472 >> v1:10.20.193.170:6789/0 conn(0x7f9580055bf0 legacy=0x7f958012f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:31.701 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.698+0000 7f95868e8640 1 -- 10.20.193.14:0/950716472 shutdown_connections 2026-02-24T19:17:31.701 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.698+0000 7f95868e8640 1 -- 10.20.193.14:0/950716472 >> 10.20.193.14:0/950716472 conn(0x7f95800b7bb0 msgr2=0x7f95800b7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:31.701 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.698+0000 7f95868e8640 1 -- 10.20.193.14:0/950716472 shutdown_connections 2026-02-24T19:17:31.701 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.698+0000 7f95868e8640 1 -- 10.20.193.14:0/950716472 wait complete. 2026-02-24T19:17:31.701 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.698+0000 7f95868e8640 1 librados: shutdown 2026-02-24T19:17:31.708 INFO:teuthology.orchestra.run.trial014.stdout:{"pg_ready":true,"pg_map":{"version":43,"stamp":"2026-02-24T19:17:31.503806+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":12,"kb":1509949440,"kb_used":437016,"kb_used_data":5656,"kb_used_omap":149,"kb_used_meta":430954,"kb_avail":1509512424,"statfs":{"total":1546188226560,"available":1545740722176,"internally_reserved":0,"allocated":5791744,"data_stored":3073334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":153395,"internal_metadata":441297101},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":131107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":18,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.760473"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T19:17:26.954688+0000","last_change":"2026-02-24T19:17:26.965063+0000","last_active":"2026-02-24T19:17:26.954688+0000","last_peered":"2026-02-24T19:17:26.954688+0000","last_clean":"2026-02-24T19:17:26.954688+0000","last_became_active":"2026-02-24T19:17:25.636961+0000","last_became_peered":"2026-02-24T19:17:25.636961+0000","last_unstale":"2026-02-24T19:17:26.954688+0000","last_undegraded":"2026-02-24T19:17:26.954688+0000","last_fullsized":"2026-02-24T19:17:26.954688+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:42:49.532270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.076701065999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,0],"acting":[15,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T19:17:27.075450+0000","last_change":"2026-02-24T19:17:27.096285+0000","last_active":"2026-02-24T19:17:27.075450+0000","last_peered":"2026-02-24T19:17:27.075450+0000","last_clean":"2026-02-24T19:17:27.075450+0000","last_became_active":"2026-02-24T19:17:24.847985+0000","last_became_peered":"2026-02-24T19:17:24.847985+0000","last_unstale":"2026-02-24T19:17:27.075450+0000","last_undegraded":"2026-02-24T19:17:27.075450+0000","last_fullsized":"2026-02-24T19:17:27.075450+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:50:14.116609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032556177999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,7],"acting":[14,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T19:17:26.895637+0000","last_change":"2026-02-24T19:17:26.898110+0000","last_active":"2026-02-24T19:17:26.895637+0000","last_peered":"2026-02-24T19:17:26.895637+0000","last_clean":"2026-02-24T19:17:26.895637+0000","last_became_active":"2026-02-24T19:17:24.821876+0000","last_became_peered":"2026-02-24T19:17:24.821876+0000","last_unstale":"2026-02-24T19:17:26.895637+0000","last_undegraded":"2026-02-24T19:17:26.895637+0000","last_fullsized":"2026-02-24T19:17:26.895637+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:00:08.087971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.044624814999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T19:17:26.867774+0000","last_change":"2026-02-24T19:17:26.891122+0000","last_active":"2026-02-24T19:17:26.867774+0000","last_peered":"2026-02-24T19:17:26.867774+0000","last_clean":"2026-02-24T19:17:26.867774+0000","last_became_active":"2026-02-24T19:17:23.991081+0000","last_became_peered":"2026-02-24T19:17:23.991081+0000","last_unstale":"2026-02-24T19:17:26.867774+0000","last_undegraded":"2026-02-24T19:17:26.867774+0000","last_fullsized":"2026-02-24T19:17:26.867774+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:10:30.161691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.042145786999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"31'2","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T19:17:26.948217+0000","last_change":"2026-02-24T19:17:26.948217+0000","last_active":"2026-02-24T19:17:26.948217+0000","last_peered":"2026-02-24T19:17:26.948217+0000","last_clean":"2026-02-24T19:17:26.948217+0000","last_became_active":"2026-02-24T19:17:25.045520+0000","last_became_peered":"2026-02-24T19:17:25.045520+0000","last_unstale":"2026-02-24T19:17:26.948217+0000","last_undegraded":"2026-02-24T19:17:26.948217+0000","last_fullsized":"2026-02-24T19:17:26.948217+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:32:11.642822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.069045234999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,10],"acting":[15,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T19:17:27.097293+0000","last_change":"2026-02-24T19:17:27.119087+0000","last_active":"2026-02-24T19:17:27.097293+0000","last_peered":"2026-02-24T19:17:27.097293+0000","last_clean":"2026-02-24T19:17:27.097293+0000","last_became_active":"2026-02-24T19:17:24.834035+0000","last_became_peered":"2026-02-24T19:17:24.834035+0000","last_unstale":"2026-02-24T19:17:27.097293+0000","last_undegraded":"2026-02-24T19:17:27.097293+0000","last_fullsized":"2026-02-24T19:17:27.097293+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:29:27.582878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036343514,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T19:17:27.076869+0000","last_change":"2026-02-24T19:17:27.099921+0000","last_active":"2026-02-24T19:17:27.076869+0000","last_peered":"2026-02-24T19:17:27.076869+0000","last_clean":"2026-02-24T19:17:27.076869+0000","last_became_active":"2026-02-24T19:17:24.560197+0000","last_became_peered":"2026-02-24T19:17:24.560197+0000","last_unstale":"2026-02-24T19:17:27.076869+0000","last_undegraded":"2026-02-24T19:17:27.076869+0000","last_fullsized":"2026-02-24T19:17:27.076869+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:28:40.195905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038521284000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"29'1","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T19:17:26.951051+0000","last_change":"2026-02-24T19:17:26.955767+0000","last_active":"2026-02-24T19:17:26.951051+0000","last_peered":"2026-02-24T19:17:26.951051+0000","last_clean":"2026-02-24T19:17:26.951051+0000","last_became_active":"2026-02-24T19:17:24.838239+0000","last_became_peered":"2026-02-24T19:17:24.838239+0000","last_unstale":"2026-02-24T19:17:26.951051+0000","last_undegraded":"2026-02-24T19:17:26.951051+0000","last_fullsized":"2026-02-24T19:17:26.951051+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:54:28.324309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070474251000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"29'32","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T19:17:27.543560+0000","last_change":"2026-02-24T19:17:18.365341+0000","last_active":"2026-02-24T19:17:27.543560+0000","last_peered":"2026-02-24T19:17:27.543560+0000","last_clean":"2026-02-24T19:17:27.543560+0000","last_became_active":"2026-02-24T19:17:18.351934+0000","last_became_peered":"2026-02-24T19:17:18.351934+0000","last_unstale":"2026-02-24T19:17:27.543560+0000","last_undegraded":"2026-02-24T19:17:27.543560+0000","last_fullsized":"2026-02-24T19:17:27.543560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:15.908436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:15.908436+0000","last_clean_scrub_stamp":"2026-02-24T19:17:15.908436+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:23:17.271649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":21,"seq":90194313221,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":308,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":315392,"data_stored":142370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10074,"internal_metadata":27580582},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":304,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":311296,"data_stored":142351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10074,"internal_metadata":27580582},"hb_peers":[1,2,3,5,6,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":304,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":311296,"data_stored":142351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10075,"internal_metadata":27580581},"hb_peers":[1,2,3,4,5,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":304,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":311296,"data_stored":142351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7474,"internal_metadata":27583182},"hb_peers":[1,2,4,5,7,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":304,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":311296,"data_stored":142351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7475,"internal_metadata":27583181},"hb_peers":[0,2,3,4,5,6,8,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":696,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":712704,"data_stored":540191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[1,3,4,5,7,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313221,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":304,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":311296,"data_stored":142351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10073,"internal_metadata":27580583},"hb_peers":[0,1,2,4,5,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27264,"kb_used_data":304,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":311296,"data_stored":142351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10075,"internal_metadata":27580581},"hb_peers":[1,2,3,5,7,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27264,"kb_used_data":304,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":311296,"data_stored":142351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7475,"internal_metadata":27583181},"hb_peers":[0,1,2,3,4,6,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":21,"seq":90194313222,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":304,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":311296,"data_stored":142351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10074,"internal_metadata":27580582},"hb_peers":[0,3,4,5,7,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":21,"seq":90194313221,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":696,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":712704,"data_stored":540191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10067,"internal_metadata":27580589},"hb_peers":[1,2,3,4,5,6,8,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27264,"kb_used_data":304,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":311296,"data_stored":142351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10075,"internal_metadata":27580581},"hb_peers":[0,2,4,5,6,7,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":304,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":311296,"data_stored":142351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10079,"internal_metadata":27580577},"hb_peers":[0,1,2,3,4,6,7,8,10,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":21,"seq":90194313221,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":308,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":315392,"data_stored":142370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10080,"internal_metadata":27580576},"hb_peers":[0,1,2,3,5,6,7,8,9,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313221,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":304,"kb_used_omap":10,"kb_used_meta":26933,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":311296,"data_stored":142351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10726,"internal_metadata":27579930},"hb_peers":[0,1,2,3,4,5,6,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27264,"kb_used_data":304,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":311296,"data_stored":142351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10074,"internal_metadata":27580582},"hb_peers":[0,1,2,3,4,5,7,8,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T19:17:31.710 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T19:17:31.778 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.777+0000 7f2f63804640 10 monclient: get_monmap_and_config 2026-02-24T19:17:31.778 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.777+0000 7f2f63804640 10 monclient: build_initial_monmap 2026-02-24T19:17:31.779 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.777+0000 7f2f63804640 10 monclient: monmap: 2026-02-24T19:17:31.779 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:31.779 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:31.779 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:31.778130+0000 2026-02-24T19:17:31.779 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:31.778130+0000 2026-02-24T19:17:31.779 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:31.779 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:31.779 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:31.779 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:31.779 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:31.780 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:31.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.777+0000 7f2f63804640 1 Processor -- start 2026-02-24T19:17:31.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.777+0000 7f2f63804640 1 -- start start 2026-02-24T19:17:31.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.777+0000 7f2f63804640 10 monclient: init 2026-02-24T19:17:31.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.778+0000 7f2f63804640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:31.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.778+0000 7f2f63804640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:31.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.778+0000 7f2f63804640 10 monclient(hunting): picked mon.noname-b con 0x7f2f5c058da0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:31.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.778+0000 7f2f63804640 10 monclient(hunting): picked mon.noname-a con 0x7f2f5c0b0410 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:31.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.778+0000 7f2f63804640 10 monclient(hunting): picked mon.noname-c con 0x7f2f5c1626a0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:31.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.778+0000 7f2f63804640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f5c1655c0 con 0x7f2f5c0b0410 2026-02-24T19:17:31.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.778+0000 7f2f63804640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f5c0b12b0 con 0x7f2f5c058da0 2026-02-24T19:17:31.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.778+0000 7f2f63804640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f5c0b1590 con 0x7f2f5c1626a0 2026-02-24T19:17:31.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.778+0000 7f2f63804640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:31.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.778+0000 7f2f63804640 10 monclient(hunting): authenticate will time out at 3626.459546s 2026-02-24T19:17:31.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.778+0000 7f2f60d78640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f2f5c0b0410 0x7f2f5c164eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:55484/0 (socket says 10.20.193.14:55484) 2026-02-24T19:17:31.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.778+0000 7f2f60d78640 1 -- 10.20.193.14:0/251980719 learned_addr learned my addr 10.20.193.14:0/251980719 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:31.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.780+0000 7f2f4bfff640 1 -- 10.20.193.14:0/251980719 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3691450030 0 0) 0x7f2f5c0b1590 con 0x7f2f5c1626a0 2026-02-24T19:17:31.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.780+0000 7f2f4bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:31.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.780+0000 7f2f4bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:31.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.780+0000 7f2f4bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:31.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.780+0000 7f2f4bfff640 10 monclient(hunting): my global_id is 4634 2026-02-24T19:17:31.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.780+0000 7f2f4bfff640 1 -- 10.20.193.14:0/251980719 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f44003610 con 0x7f2f5c1626a0 2026-02-24T19:17:31.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.780+0000 7f2f4bfff640 1 -- 10.20.193.14:0/251980719 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3224035990 0 0) 0x7f2f5c0b12b0 con 0x7f2f5c058da0 2026-02-24T19:17:31.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.780+0000 7f2f4bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:31.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.780+0000 7f2f4bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:31.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.780+0000 7f2f4bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:31.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.780+0000 7f2f4bfff640 10 monclient(hunting): my global_id is 4603 2026-02-24T19:17:31.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.780+0000 7f2f4bfff640 1 -- 10.20.193.14:0/251980719 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f5c0b1590 con 0x7f2f5c058da0 2026-02-24T19:17:31.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.780+0000 7f2f4bfff640 1 -- 10.20.193.14:0/251980719 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2351611161 0 0) 0x7f2f5c1655c0 con 0x7f2f5c0b0410 2026-02-24T19:17:31.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.780+0000 7f2f4bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:31.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.780+0000 7f2f4bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:31.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.780+0000 7f2f4bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:31.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.780+0000 7f2f4bfff640 10 monclient(hunting): my global_id is 4635 2026-02-24T19:17:31.785 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.780+0000 7f2f4bfff640 1 -- 10.20.193.14:0/251980719 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f5c0b12b0 con 0x7f2f5c0b0410 2026-02-24T19:17:31.790 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.781+0000 7f2f4bfff640 1 -- 10.20.193.14:0/251980719 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2255955487 0 0) 0x7f2f44003610 con 0x7f2f5c1626a0 2026-02-24T19:17:31.790 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.781+0000 7f2f4bfff640 1 -- 10.20.193.14:0/251980719 >> v1:10.20.193.44:6789/0 conn(0x7f2f5c058da0 legacy=0x7f2f5c1647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:31.790 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.781+0000 7f2f4bfff640 1 -- 10.20.193.14:0/251980719 >> v1:10.20.193.14:6789/0 conn(0x7f2f5c0b0410 legacy=0x7f2f5c164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:31.790 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.781+0000 7f2f4bfff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:31.790 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.781+0000 7f2f4bfff640 1 monclient: found mon.noname-c 2026-02-24T19:17:31.791 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.781+0000 7f2f4bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:31.791 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.781+0000 7f2f4bfff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.170:6789/0 2026-02-24T19:17:31.791 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.781+0000 7f2f4bfff640 1 -- 10.20.193.14:0/251980719 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5c0b1870 con 0x7f2f5c1626a0 2026-02-24T19:17:31.791 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.781+0000 7f2f4bfff640 10 monclient: _finish_auth 0 2026-02-24T19:17:31.791 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.781+0000 7f2f4bfff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:31.791 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.781+0000 7f2f4bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:31.791 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.781+0000 7f2f4bfff640 1 -- 10.20.193.14:0/251980719 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f2f58003170 con 0x7f2f5c1626a0 2026-02-24T19:17:31.791 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.781+0000 7f2f4bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:31.791 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.781+0000 7f2f4bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:31.791 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.781+0000 7f2f4bfff640 10 monclient: dump: 2026-02-24T19:17:31.791 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:31.792 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:31.792 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:31.792 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:31.792 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:31.792 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:31.792 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:31.792 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:31.792 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:31.792 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:31.792 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.781+0000 7f2f63804640 5 monclient: authenticate success, global_id 4634 2026-02-24T19:17:31.792 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.781+0000 7f2f63804640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:31.792 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.782+0000 7f2f4bfff640 1 -- 10.20.193.14:0/251980719 <== mon.2 v1:10.20.193.170:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2f58003340 con 0x7f2f5c1626a0 2026-02-24T19:17:31.793 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.782+0000 7f2f4bfff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:31.793 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.782+0000 7f2f4bfff640 1 -- 10.20.193.14:0/251980719 <== mon.2 v1:10.20.193.170:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f2f58003780 con 0x7f2f5c1626a0 2026-02-24T19:17:31.793 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.782+0000 7f2f4bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:31.793 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.782+0000 7f2f4bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:31.793 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.782+0000 7f2f4bfff640 10 monclient: dump: 2026-02-24T19:17:31.793 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:31.793 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:31.793 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:31.793 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:31.793 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:31.793 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:31.793 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:31.793 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:31.794 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:31.794 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:31.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.782+0000 7f2f63804640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:31.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.782+0000 7f2f63804640 4 set_mon_vals no callback set 2026-02-24T19:17:31.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.782+0000 7f2f63804640 10 monclient: shutdown 2026-02-24T19:17:31.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.782+0000 7f2f63804640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:31.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.782+0000 7f2f63804640 1 -- 10.20.193.14:0/251980719 >> v1:10.20.193.170:6789/0 conn(0x7f2f5c1626a0 legacy=0x7f2f5c1c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:31.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.782+0000 7f2f63804640 1 -- 10.20.193.14:0/251980719 shutdown_connections 2026-02-24T19:17:31.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.782+0000 7f2f63804640 1 -- 10.20.193.14:0/251980719 >> 10.20.193.14:0/251980719 conn(0x7f2f5c0b65f0 msgr2=0x7f2f5c0b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:31.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.782+0000 7f2f63804640 1 -- 10.20.193.14:0/251980719 shutdown_connections 2026-02-24T19:17:31.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.782+0000 7f2f63804640 1 -- 10.20.193.14:0/251980719 wait complete. 2026-02-24T19:17:31.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.783+0000 7f2f63804640 10 monclient: build_initial_monmap 2026-02-24T19:17:31.795 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.783+0000 7f2f63804640 10 monclient: monmap: 2026-02-24T19:17:31.795 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:31.795 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:31.795 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:31.795 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:31.795 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:31.795 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:31.795 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:31.795 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:31.795 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:31.795 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:31.795 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.783+0000 7f2f63804640 1 librados: starting msgr at 2026-02-24T19:17:31.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.783+0000 7f2f63804640 1 librados: starting objecter 2026-02-24T19:17:31.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.783+0000 7f2f63804640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:31.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.783+0000 7f2f63804640 1 Processor -- start 2026-02-24T19:17:31.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.783+0000 7f2f63804640 1 -- start start 2026-02-24T19:17:31.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.783+0000 7f2f63804640 1 librados: setting wanted keys 2026-02-24T19:17:31.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.783+0000 7f2f63804640 1 librados: calling monclient init 2026-02-24T19:17:31.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.783+0000 7f2f63804640 10 monclient: init 2026-02-24T19:17:31.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.784+0000 7f2f63804640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:31.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.784+0000 7f2f63804640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:31.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.784+0000 7f2f63804640 10 monclient(hunting): picked mon.noname-b con 0x7f2f5c058da0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:31.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.784+0000 7f2f63804640 10 monclient(hunting): picked mon.noname-a con 0x7f2f5c0b0410 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:31.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.784+0000 7f2f63804640 10 monclient(hunting): picked mon.noname-c con 0x7f2f5c1626a0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:31.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.784+0000 7f2f63804640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f5c164db0 con 0x7f2f5c0b0410 2026-02-24T19:17:31.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.784+0000 7f2f63804640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f5c13e850 con 0x7f2f5c058da0 2026-02-24T19:17:31.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.784+0000 7f2f63804640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f5c13eb30 con 0x7f2f5c1626a0 2026-02-24T19:17:31.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.784+0000 7f2f63804640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:31.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.784+0000 7f2f63804640 10 monclient(hunting): authenticate will time out at 3626.465121s 2026-02-24T19:17:31.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.784+0000 7f2f60d78640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f2f5c0b0410 0x7f2f5c13fbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:55492/0 (socket says 10.20.193.14:55492) 2026-02-24T19:17:31.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.784+0000 7f2f60d78640 1 -- 10.20.193.14:0/1024838534 learned_addr learned my addr 10.20.193.14:0/1024838534 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:31.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.784+0000 7f2f49ffb640 10 client.?.objecter ms_handle_connect 0x7f2f5c0b0410 2026-02-24T19:17:31.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.784+0000 7f2f49ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:31.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.784+0000 7f2f49ffb640 10 client.?.objecter ms_handle_connect 0x7f2f5c1626a0 2026-02-24T19:17:31.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.784+0000 7f2f49ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:31.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.785+0000 7f2f49ffb640 10 client.?.objecter ms_handle_connect 0x7f2f5c058da0 2026-02-24T19:17:31.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.785+0000 7f2f49ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:31.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.785+0000 7f2f49ffb640 1 -- 10.20.193.14:0/1024838534 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2024584005 0 0) 0x7f2f5c13eb30 con 0x7f2f5c1626a0 2026-02-24T19:17:31.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.785+0000 7f2f49ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:31.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.785+0000 7f2f49ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:31.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.785+0000 7f2f49ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:31.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.785+0000 7f2f49ffb640 10 monclient(hunting): my global_id is 4637 2026-02-24T19:17:31.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.785+0000 7f2f49ffb640 1 -- 10.20.193.14:0/1024838534 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f2c003610 con 0x7f2f5c1626a0 2026-02-24T19:17:31.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.785+0000 7f2f49ffb640 1 -- 10.20.193.14:0/1024838534 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1104650229 0 0) 0x7f2f5c164db0 con 0x7f2f5c0b0410 2026-02-24T19:17:31.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.785+0000 7f2f49ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:31.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.785+0000 7f2f49ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:31.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.785+0000 7f2f49ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:31.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.785+0000 7f2f49ffb640 10 monclient(hunting): my global_id is 4638 2026-02-24T19:17:31.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.785+0000 7f2f49ffb640 1 -- 10.20.193.14:0/1024838534 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f5c13eb30 con 0x7f2f5c0b0410 2026-02-24T19:17:31.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.786+0000 7f2f49ffb640 1 -- 10.20.193.14:0/1024838534 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1668105926 0 0) 0x7f2f5c13e850 con 0x7f2f5c058da0 2026-02-24T19:17:31.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.786+0000 7f2f49ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:31.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.786+0000 7f2f49ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:31.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.786+0000 7f2f49ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:31.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.786+0000 7f2f49ffb640 10 monclient(hunting): my global_id is 4606 2026-02-24T19:17:31.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.786+0000 7f2f49ffb640 1 -- 10.20.193.14:0/1024838534 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f5c164db0 con 0x7f2f5c058da0 2026-02-24T19:17:31.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.788+0000 7f2f49ffb640 1 -- 10.20.193.14:0/1024838534 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1450787047 0 0) 0x7f2f2c003610 con 0x7f2f5c1626a0 2026-02-24T19:17:31.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.788+0000 7f2f49ffb640 1 -- 10.20.193.14:0/1024838534 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2f5c13e850 con 0x7f2f5c1626a0 2026-02-24T19:17:31.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.788+0000 7f2f49ffb640 1 -- 10.20.193.14:0/1024838534 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3634017254 0 0) 0x7f2f5c13eb30 con 0x7f2f5c0b0410 2026-02-24T19:17:31.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.788+0000 7f2f49ffb640 1 -- 10.20.193.14:0/1024838534 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2f2c003610 con 0x7f2f5c0b0410 2026-02-24T19:17:31.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.788+0000 7f2f49ffb640 1 -- 10.20.193.14:0/1024838534 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f2f50003060 con 0x7f2f5c0b0410 2026-02-24T19:17:31.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.788+0000 7f2f49ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:31.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.788+0000 7f2f49ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:31.800 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.788+0000 7f2f49ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:31.800 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:31.800 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:31.800 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:31.800 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:31.800 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:31.800 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:31.800 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:31.800 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:31.800 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:31.800 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:31.800 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.788+0000 7f2f49ffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:31.800 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.788+0000 7f2f49ffb640 1 -- 10.20.193.14:0/1024838534 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f2f58003690 con 0x7f2f5c1626a0 2026-02-24T19:17:31.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.788+0000 7f2f49ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:31.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.788+0000 7f2f49ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:31.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.788+0000 7f2f49ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:31.801 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:31.801 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:31.801 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:31.801 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:31.801 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:31.801 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:31.801 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:31.801 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:31.801 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:31.801 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:31.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.789+0000 7f2f49ffb640 1 -- 10.20.193.14:0/1024838534 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 525671402 0 0) 0x7f2f5c164db0 con 0x7f2f5c058da0 2026-02-24T19:17:31.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.789+0000 7f2f49ffb640 1 -- 10.20.193.14:0/1024838534 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2f5c13eb30 con 0x7f2f5c058da0 2026-02-24T19:17:31.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.789+0000 7f2f49ffb640 1 -- 10.20.193.14:0/1024838534 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f2f4c003070 con 0x7f2f5c058da0 2026-02-24T19:17:31.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.789+0000 7f2f49ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:31.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.789+0000 7f2f49ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:31.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.789+0000 7f2f49ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:31.802 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:31.802 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:31.802 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:31.802 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:31.802 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:31.802 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:31.803 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:31.803 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:31.803 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:31.803 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:31.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.790+0000 7f2f49ffb640 1 -- 10.20.193.14:0/1024838534 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1142638688 0 0) 0x7f2f5c13e850 con 0x7f2f5c1626a0 2026-02-24T19:17:31.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.790+0000 7f2f49ffb640 1 -- 10.20.193.14:0/1024838534 >> v1:10.20.193.44:6789/0 conn(0x7f2f5c058da0 legacy=0x7f2f5c1646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:31.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.790+0000 7f2f49ffb640 1 -- 10.20.193.14:0/1024838534 >> v1:10.20.193.14:6789/0 conn(0x7f2f5c0b0410 legacy=0x7f2f5c13fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:31.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.790+0000 7f2f49ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:31.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.790+0000 7f2f49ffb640 1 monclient: found mon.c 2026-02-24T19:17:31.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.790+0000 7f2f49ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:31.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.790+0000 7f2f49ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:31.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.790+0000 7f2f49ffb640 1 -- 10.20.193.14:0/1024838534 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5c13ee10 con 0x7f2f5c1626a0 2026-02-24T19:17:31.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.790+0000 7f2f49ffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:31.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.790+0000 7f2f49ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:31.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.790+0000 7f2f49ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:31.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.790+0000 7f2f63804640 5 monclient: authenticate success, global_id 4637 2026-02-24T19:17:31.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.790+0000 7f2f63804640 10 monclient: _renew_subs 2026-02-24T19:17:31.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.790+0000 7f2f63804640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:31.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.790+0000 7f2f63804640 1 -- 10.20.193.14:0/1024838534 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2f5c13f0f0 con 0x7f2f5c1626a0 2026-02-24T19:17:31.806 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.790+0000 7f2f63804640 10 client.4637.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:31.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.790+0000 7f2f63804640 10 monclient: _renew_subs 2026-02-24T19:17:31.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.790+0000 7f2f63804640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:31.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.790+0000 7f2f63804640 1 -- 10.20.193.14:0/1024838534 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2f5c13f6b0 con 0x7f2f5c1626a0 2026-02-24T19:17:31.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.790+0000 7f2f63804640 1 librados: init done 2026-02-24T19:17:31.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.790+0000 7f2f63804640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:31.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.790+0000 7f2f63804640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:31.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.790+0000 7f2f63804640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:31.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.790+0000 7f2f63804640 1 -- 10.20.193.14:0/1024838534 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f5c0b6e40 con 0x7f2f5c1626a0 2026-02-24T19:17:31.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.797+0000 7f2f49ffb640 1 -- 10.20.193.14:0/1024838534 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2f58003340 con 0x7f2f5c1626a0 2026-02-24T19:17:31.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.797+0000 7f2f49ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:31.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.797+0000 7f2f49ffb640 1 -- 10.20.193.14:0/1024838534 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f2f58003c80 con 0x7f2f5c1626a0 2026-02-24T19:17:31.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.797+0000 7f2f49ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:31.807 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.797+0000 7f2f49ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:31.808 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.797+0000 7f2f49ffb640 10 monclient: dump: 2026-02-24T19:17:31.808 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:31.808 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:31.808 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:31.808 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:31.808 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:31.808 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:31.808 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:31.808 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:31.808 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:31.808 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:31.808 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.797+0000 7f2f4b7fe640 4 set_mon_vals no callback set 2026-02-24T19:17:31.808 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.798+0000 7f2f49ffb640 1 -- 10.20.193.14:0/1024838534 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f2f5801caf0 con 0x7f2f5c1626a0 2026-02-24T19:17:31.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.799+0000 7f2f61579640 10 monclient: get_auth_request con 0x7f2f2c077f20 auth_method 0 2026-02-24T19:17:31.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.799+0000 7f2f49ffb640 10 client.4637.objecter ms_handle_connect 0x7f2f2c077f20 2026-02-24T19:17:31.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.799+0000 7f2f49ffb640 1 -- 10.20.193.14:0/1024838534 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7f2f580920c0 con 0x7f2f5c1626a0 2026-02-24T19:17:31.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.799+0000 7f2f49ffb640 10 client.4637.objecter ms_dispatch2 0x7f2f5c000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:31.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.799+0000 7f2f49ffb640 3 client.4637.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:31.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.799+0000 7f2f49ffb640 3 client.4637.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:31.809 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.799+0000 7f2f49ffb640 20 client.4637.objecter dump_active .. 0 homeless 2026-02-24T19:17:31.884 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.883+0000 7f2f49ffb640 1 -- 10.20.193.14:0/1024838534 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f2f5805caf0 con 0x7f2f5c1626a0 2026-02-24T19:17:31.884 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.883+0000 7f2f49ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:31.885 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.883+0000 7f2f49ffb640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:31.988 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.987+0000 7f2f63804640 1 -- 10.20.193.14:0/1024838534 --> v1:10.20.193.14:6800/4014096310 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2f5c0b6b60 con 0x7f2f2c077f20 2026-02-24T19:17:31.989 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.987+0000 7f2f49ffb640 1 -- 10.20.193.14:0/1024838534 <== mgr.4110 v1:10.20.193.14:6800/4014096310 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+42842 (unknown 2965378022 0 2038877000) 0x7f2f5c0b6b60 con 0x7f2f2c077f20 2026-02-24T19:17:31.989 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:17:31.991 INFO:teuthology.orchestra.run.trial014.stderr:dumped all 2026-02-24T19:17:31.991 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.988+0000 7f2f63804640 10 librados: watch_flush enter 2026-02-24T19:17:31.991 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.988+0000 7f2f63804640 10 librados: watch_flush exit 2026-02-24T19:17:31.991 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.988+0000 7f2f63804640 20 client.4637.objecter shutdown clearing up homeless session... 2026-02-24T19:17:31.991 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.988+0000 7f2f63804640 10 client.4637.objecter successfully canceled tick 2026-02-24T19:17:31.991 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.988+0000 7f2f63804640 1 -- 10.20.193.14:0/1024838534 >> v1:10.20.193.14:6800/4014096310 conn(0x7f2f2c077f20 legacy=0x7f2f2c0983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:31.991 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.988+0000 7f2f63804640 10 monclient: shutdown 2026-02-24T19:17:31.991 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.988+0000 7f2f63804640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:31.992 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.988+0000 7f2f63804640 1 -- 10.20.193.14:0/1024838534 >> v1:10.20.193.170:6789/0 conn(0x7f2f5c1626a0 legacy=0x7f2f5c1fb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:31.992 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.988+0000 7f2f63804640 1 -- 10.20.193.14:0/1024838534 shutdown_connections 2026-02-24T19:17:31.992 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.988+0000 7f2f63804640 1 -- 10.20.193.14:0/1024838534 >> 10.20.193.14:0/1024838534 conn(0x7f2f5c0b65f0 msgr2=0x7f2f5c0a8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:31.992 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.988+0000 7f2f63804640 1 -- 10.20.193.14:0/1024838534 shutdown_connections 2026-02-24T19:17:31.992 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.988+0000 7f2f63804640 1 -- 10.20.193.14:0/1024838534 wait complete. 2026-02-24T19:17:31.992 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:31.988+0000 7f2f63804640 1 librados: shutdown 2026-02-24T19:17:31.998 INFO:teuthology.orchestra.run.trial014.stdout:{"pg_ready":true,"pg_map":{"version":43,"stamp":"2026-02-24T19:17:31.503806+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":12,"kb":1509949440,"kb_used":437016,"kb_used_data":5656,"kb_used_omap":149,"kb_used_meta":430954,"kb_avail":1509512424,"statfs":{"total":1546188226560,"available":1545740722176,"internally_reserved":0,"allocated":5791744,"data_stored":3073334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":153395,"internal_metadata":441297101},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":131107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":18,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.760473"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T19:17:26.954688+0000","last_change":"2026-02-24T19:17:26.965063+0000","last_active":"2026-02-24T19:17:26.954688+0000","last_peered":"2026-02-24T19:17:26.954688+0000","last_clean":"2026-02-24T19:17:26.954688+0000","last_became_active":"2026-02-24T19:17:25.636961+0000","last_became_peered":"2026-02-24T19:17:25.636961+0000","last_unstale":"2026-02-24T19:17:26.954688+0000","last_undegraded":"2026-02-24T19:17:26.954688+0000","last_fullsized":"2026-02-24T19:17:26.954688+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:42:49.532270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.076701065999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,0],"acting":[15,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T19:17:27.075450+0000","last_change":"2026-02-24T19:17:27.096285+0000","last_active":"2026-02-24T19:17:27.075450+0000","last_peered":"2026-02-24T19:17:27.075450+0000","last_clean":"2026-02-24T19:17:27.075450+0000","last_became_active":"2026-02-24T19:17:24.847985+0000","last_became_peered":"2026-02-24T19:17:24.847985+0000","last_unstale":"2026-02-24T19:17:27.075450+0000","last_undegraded":"2026-02-24T19:17:27.075450+0000","last_fullsized":"2026-02-24T19:17:27.075450+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:50:14.116609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032556177999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,7],"acting":[14,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T19:17:26.895637+0000","last_change":"2026-02-24T19:17:26.898110+0000","last_active":"2026-02-24T19:17:26.895637+0000","last_peered":"2026-02-24T19:17:26.895637+0000","last_clean":"2026-02-24T19:17:26.895637+0000","last_became_active":"2026-02-24T19:17:24.821876+0000","last_became_peered":"2026-02-24T19:17:24.821876+0000","last_unstale":"2026-02-24T19:17:26.895637+0000","last_undegraded":"2026-02-24T19:17:26.895637+0000","last_fullsized":"2026-02-24T19:17:26.895637+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:00:08.087971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.044624814999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T19:17:26.867774+0000","last_change":"2026-02-24T19:17:26.891122+0000","last_active":"2026-02-24T19:17:26.867774+0000","last_peered":"2026-02-24T19:17:26.867774+0000","last_clean":"2026-02-24T19:17:26.867774+0000","last_became_active":"2026-02-24T19:17:23.991081+0000","last_became_peered":"2026-02-24T19:17:23.991081+0000","last_unstale":"2026-02-24T19:17:26.867774+0000","last_undegraded":"2026-02-24T19:17:26.867774+0000","last_fullsized":"2026-02-24T19:17:26.867774+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:10:30.161691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.042145786999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"31'2","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T19:17:26.948217+0000","last_change":"2026-02-24T19:17:26.948217+0000","last_active":"2026-02-24T19:17:26.948217+0000","last_peered":"2026-02-24T19:17:26.948217+0000","last_clean":"2026-02-24T19:17:26.948217+0000","last_became_active":"2026-02-24T19:17:25.045520+0000","last_became_peered":"2026-02-24T19:17:25.045520+0000","last_unstale":"2026-02-24T19:17:26.948217+0000","last_undegraded":"2026-02-24T19:17:26.948217+0000","last_fullsized":"2026-02-24T19:17:26.948217+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:32:11.642822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.069045234999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,10],"acting":[15,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T19:17:27.097293+0000","last_change":"2026-02-24T19:17:27.119087+0000","last_active":"2026-02-24T19:17:27.097293+0000","last_peered":"2026-02-24T19:17:27.097293+0000","last_clean":"2026-02-24T19:17:27.097293+0000","last_became_active":"2026-02-24T19:17:24.834035+0000","last_became_peered":"2026-02-24T19:17:24.834035+0000","last_unstale":"2026-02-24T19:17:27.097293+0000","last_undegraded":"2026-02-24T19:17:27.097293+0000","last_fullsized":"2026-02-24T19:17:27.097293+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:29:27.582878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036343514,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T19:17:27.076869+0000","last_change":"2026-02-24T19:17:27.099921+0000","last_active":"2026-02-24T19:17:27.076869+0000","last_peered":"2026-02-24T19:17:27.076869+0000","last_clean":"2026-02-24T19:17:27.076869+0000","last_became_active":"2026-02-24T19:17:24.560197+0000","last_became_peered":"2026-02-24T19:17:24.560197+0000","last_unstale":"2026-02-24T19:17:27.076869+0000","last_undegraded":"2026-02-24T19:17:27.076869+0000","last_fullsized":"2026-02-24T19:17:27.076869+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:28:40.195905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038521284000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"29'1","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T19:17:26.951051+0000","last_change":"2026-02-24T19:17:26.955767+0000","last_active":"2026-02-24T19:17:26.951051+0000","last_peered":"2026-02-24T19:17:26.951051+0000","last_clean":"2026-02-24T19:17:26.951051+0000","last_became_active":"2026-02-24T19:17:24.838239+0000","last_became_peered":"2026-02-24T19:17:24.838239+0000","last_unstale":"2026-02-24T19:17:26.951051+0000","last_undegraded":"2026-02-24T19:17:26.951051+0000","last_fullsized":"2026-02-24T19:17:26.951051+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:54:28.324309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070474251000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"29'32","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2026-02-24T19:17:27.543560+0000","last_change":"2026-02-24T19:17:18.365341+0000","last_active":"2026-02-24T19:17:27.543560+0000","last_peered":"2026-02-24T19:17:27.543560+0000","last_clean":"2026-02-24T19:17:27.543560+0000","last_became_active":"2026-02-24T19:17:18.351934+0000","last_became_peered":"2026-02-24T19:17:18.351934+0000","last_unstale":"2026-02-24T19:17:27.543560+0000","last_undegraded":"2026-02-24T19:17:27.543560+0000","last_fullsized":"2026-02-24T19:17:27.543560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:15.908436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:15.908436+0000","last_clean_scrub_stamp":"2026-02-24T19:17:15.908436+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:23:17.271649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":21,"seq":90194313221,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":308,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":315392,"data_stored":142370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10074,"internal_metadata":27580582},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":304,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":311296,"data_stored":142351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10074,"internal_metadata":27580582},"hb_peers":[1,2,3,5,6,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":304,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":311296,"data_stored":142351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10075,"internal_metadata":27580581},"hb_peers":[1,2,3,4,5,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":304,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":311296,"data_stored":142351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7474,"internal_metadata":27583182},"hb_peers":[1,2,4,5,7,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":304,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":311296,"data_stored":142351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7475,"internal_metadata":27583181},"hb_peers":[0,2,3,4,5,6,8,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":696,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":712704,"data_stored":540191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[1,3,4,5,7,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313221,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":304,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":311296,"data_stored":142351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10073,"internal_metadata":27580583},"hb_peers":[0,1,2,4,5,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27264,"kb_used_data":304,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":311296,"data_stored":142351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10075,"internal_metadata":27580581},"hb_peers":[1,2,3,5,7,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27264,"kb_used_data":304,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":311296,"data_stored":142351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7475,"internal_metadata":27583181},"hb_peers":[0,1,2,3,4,6,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":21,"seq":90194313222,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":304,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":311296,"data_stored":142351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10074,"internal_metadata":27580582},"hb_peers":[0,3,4,5,7,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":21,"seq":90194313221,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":696,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":712704,"data_stored":540191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10067,"internal_metadata":27580589},"hb_peers":[1,2,3,4,5,6,8,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27264,"kb_used_data":304,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":311296,"data_stored":142351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10075,"internal_metadata":27580581},"hb_peers":[0,2,4,5,6,7,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":304,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":311296,"data_stored":142351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10079,"internal_metadata":27580577},"hb_peers":[0,1,2,3,4,6,7,8,10,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":21,"seq":90194313221,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":308,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":315392,"data_stored":142370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10080,"internal_metadata":27580576},"hb_peers":[0,1,2,3,5,6,7,8,9,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313221,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":304,"kb_used_omap":10,"kb_used_meta":26933,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":311296,"data_stored":142351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10726,"internal_metadata":27579930},"hb_peers":[0,1,2,3,4,5,6,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27264,"kb_used_data":304,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":311296,"data_stored":142351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10074,"internal_metadata":27580582},"hb_peers":[0,1,2,3,4,5,7,8,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T19:17:32.000 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-24T19:17:32.000 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-24T19:17:32.000 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-24T19:17:32.000 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-24T19:17:32.067 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.066+0000 7f7b98c4d640 10 monclient: get_monmap_and_config 2026-02-24T19:17:32.067 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.066+0000 7f7b98c4d640 10 monclient: build_initial_monmap 2026-02-24T19:17:32.067 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.066+0000 7f7b98c4d640 10 monclient: monmap: 2026-02-24T19:17:32.067 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:32.067 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:32.067 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:17:32.066703+0000 2026-02-24T19:17:32.068 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:17:32.066703+0000 2026-02-24T19:17:32.068 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:32.068 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:32.068 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:32.068 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:32.068 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:32.068 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:32.070 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.066+0000 7f7b98c4d640 1 Processor -- start 2026-02-24T19:17:32.071 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.066+0000 7f7b98c4d640 1 -- start start 2026-02-24T19:17:32.071 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.066+0000 7f7b98c4d640 10 monclient: init 2026-02-24T19:17:32.071 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.067+0000 7f7b98c4d640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:32.071 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.067+0000 7f7b98c4d640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:32.071 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.067+0000 7f7b98c4d640 10 monclient(hunting): picked mon.noname-b con 0x7f7b94058da0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:32.071 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.067+0000 7f7b98c4d640 10 monclient(hunting): picked mon.noname-a con 0x7f7b940b0410 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:32.071 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.067+0000 7f7b98c4d640 10 monclient(hunting): picked mon.noname-c con 0x7f7b941626a0 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:32.071 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.067+0000 7f7b98c4d640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b941655c0 con 0x7f7b940b0410 2026-02-24T19:17:32.071 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.067+0000 7f7b98c4d640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b940b12b0 con 0x7f7b94058da0 2026-02-24T19:17:32.071 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.067+0000 7f7b98c4d640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b940b1590 con 0x7f7b941626a0 2026-02-24T19:17:32.072 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.067+0000 7f7b98c4d640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:32.072 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.067+0000 7f7b98c4d640 10 monclient(hunting): authenticate will time out at 3626.748243s 2026-02-24T19:17:32.072 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.067+0000 7f7b92d76640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7f7b941626a0 0x7f7b941c6d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:45638/0 (socket says 10.20.193.14:45638) 2026-02-24T19:17:32.072 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.067+0000 7f7b92d76640 1 -- 10.20.193.14:0/960336105 learned_addr learned my addr 10.20.193.14:0/960336105 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:32.072 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.069+0000 7f7b91573640 1 -- 10.20.193.14:0/960336105 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2519326460 0 0) 0x7f7b940b12b0 con 0x7f7b94058da0 2026-02-24T19:17:32.072 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.069+0000 7f7b91573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:32.072 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.069+0000 7f7b91573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:32.072 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.069+0000 7f7b91573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:32.072 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.069+0000 7f7b91573640 10 monclient(hunting): my global_id is 4609 2026-02-24T19:17:32.072 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.069+0000 7f7b91573640 1 -- 10.20.193.14:0/960336105 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b80003610 con 0x7f7b94058da0 2026-02-24T19:17:32.072 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.069+0000 7f7b91573640 1 -- 10.20.193.14:0/960336105 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1348740058 0 0) 0x7f7b940b1590 con 0x7f7b941626a0 2026-02-24T19:17:32.072 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.069+0000 7f7b91573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:32.073 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.069+0000 7f7b91573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:32.073 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.069+0000 7f7b91573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:32.073 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.069+0000 7f7b91573640 10 monclient(hunting): my global_id is 4640 2026-02-24T19:17:32.073 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.069+0000 7f7b91573640 1 -- 10.20.193.14:0/960336105 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b940b12b0 con 0x7f7b941626a0 2026-02-24T19:17:32.073 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.069+0000 7f7b91573640 1 -- 10.20.193.14:0/960336105 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 19059763 0 0) 0x7f7b941655c0 con 0x7f7b940b0410 2026-02-24T19:17:32.073 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.069+0000 7f7b91573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:32.073 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.069+0000 7f7b91573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:32.073 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.069+0000 7f7b91573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:32.073 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.069+0000 7f7b91573640 10 monclient(hunting): my global_id is 4641 2026-02-24T19:17:32.073 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.069+0000 7f7b91573640 1 -- 10.20.193.14:0/960336105 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b940b1590 con 0x7f7b940b0410 2026-02-24T19:17:32.077 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.070+0000 7f7b91573640 1 -- 10.20.193.14:0/960336105 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2063366135 0 0) 0x7f7b940b12b0 con 0x7f7b941626a0 2026-02-24T19:17:32.077 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.070+0000 7f7b91573640 1 -- 10.20.193.14:0/960336105 >> v1:10.20.193.44:6789/0 conn(0x7f7b94058da0 legacy=0x7f7b941647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:32.077 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.070+0000 7f7b91573640 1 -- 10.20.193.14:0/960336105 >> v1:10.20.193.14:6789/0 conn(0x7f7b940b0410 legacy=0x7f7b94164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:32.077 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.070+0000 7f7b91573640 10 monclient: _finish_hunting 0 2026-02-24T19:17:32.077 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.070+0000 7f7b91573640 1 monclient: found mon.noname-c 2026-02-24T19:17:32.078 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.070+0000 7f7b91573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:32.078 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.070+0000 7f7b91573640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.170:6789/0 2026-02-24T19:17:32.078 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.070+0000 7f7b91573640 1 -- 10.20.193.14:0/960336105 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b940b1870 con 0x7f7b941626a0 2026-02-24T19:17:32.078 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.070+0000 7f7b91573640 10 monclient: _finish_auth 0 2026-02-24T19:17:32.078 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.070+0000 7f7b91573640 10 monclient: _check_auth_tickets 2026-02-24T19:17:32.078 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.070+0000 7f7b91573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:32.078 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.070+0000 7f7b91573640 1 -- 10.20.193.14:0/960336105 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7b84003170 con 0x7f7b941626a0 2026-02-24T19:17:32.078 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.070+0000 7f7b91573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:32.078 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.070+0000 7f7b91573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:32.078 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.070+0000 7f7b91573640 10 monclient: dump: 2026-02-24T19:17:32.078 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:32.078 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:32.079 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:32.079 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:32.079 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:32.079 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:32.079 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:32.079 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:32.079 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:32.079 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:32.079 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.070+0000 7f7b98c4d640 5 monclient: authenticate success, global_id 4640 2026-02-24T19:17:32.079 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.070+0000 7f7b98c4d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:32.079 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.071+0000 7f7b91573640 1 -- 10.20.193.14:0/960336105 <== mon.2 v1:10.20.193.170:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7b84003340 con 0x7f7b941626a0 2026-02-24T19:17:32.079 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.071+0000 7f7b91573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:32.080 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.071+0000 7f7b91573640 1 -- 10.20.193.14:0/960336105 <== mon.2 v1:10.20.193.170:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7b84003780 con 0x7f7b941626a0 2026-02-24T19:17:32.080 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.071+0000 7f7b91573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:32.080 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.071+0000 7f7b91573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:32.080 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.071+0000 7f7b91573640 10 monclient: dump: 2026-02-24T19:17:32.080 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:32.080 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:32.080 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:32.080 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:32.080 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:32.080 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:32.080 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:32.080 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:32.081 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:32.081 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:32.081 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.071+0000 7f7b98c4d640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:32.081 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.071+0000 7f7b98c4d640 4 set_mon_vals no callback set 2026-02-24T19:17:32.081 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.071+0000 7f7b98c4d640 10 monclient: shutdown 2026-02-24T19:17:32.081 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.071+0000 7f7b98c4d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:32.081 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.071+0000 7f7b98c4d640 1 -- 10.20.193.14:0/960336105 >> v1:10.20.193.170:6789/0 conn(0x7f7b941626a0 legacy=0x7f7b941c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:32.081 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.071+0000 7f7b98c4d640 1 -- 10.20.193.14:0/960336105 shutdown_connections 2026-02-24T19:17:32.081 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.071+0000 7f7b98c4d640 1 -- 10.20.193.14:0/960336105 >> 10.20.193.14:0/960336105 conn(0x7f7b940b65f0 msgr2=0x7f7b940b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:32.081 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.071+0000 7f7b98c4d640 1 -- 10.20.193.14:0/960336105 shutdown_connections 2026-02-24T19:17:32.081 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.071+0000 7f7b98c4d640 1 -- 10.20.193.14:0/960336105 wait complete. 2026-02-24T19:17:32.081 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.072+0000 7f7b98c4d640 10 monclient: build_initial_monmap 2026-02-24T19:17:32.081 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.072+0000 7f7b98c4d640 10 monclient: monmap: 2026-02-24T19:17:32.082 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:17:32.082 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:32.082 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:17:32.082 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:17:32.082 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:32.082 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:17:32.082 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:32.082 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:32.082 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:32.082 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:32.082 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.072+0000 7f7b98c4d640 1 librados: starting msgr at 2026-02-24T19:17:32.082 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.072+0000 7f7b98c4d640 1 librados: starting objecter 2026-02-24T19:17:32.083 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.072+0000 7f7b98c4d640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:32.083 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.072+0000 7f7b98c4d640 1 Processor -- start 2026-02-24T19:17:32.083 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.072+0000 7f7b98c4d640 1 -- start start 2026-02-24T19:17:32.083 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.072+0000 7f7b98c4d640 1 librados: setting wanted keys 2026-02-24T19:17:32.083 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.072+0000 7f7b98c4d640 1 librados: calling monclient init 2026-02-24T19:17:32.083 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.072+0000 7f7b98c4d640 10 monclient: init 2026-02-24T19:17:32.083 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.073+0000 7f7b98c4d640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:32.083 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.073+0000 7f7b98c4d640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:32.083 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.073+0000 7f7b98c4d640 10 monclient(hunting): picked mon.noname-b con 0x7f7b94058da0 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:32.083 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.073+0000 7f7b98c4d640 10 monclient(hunting): picked mon.noname-c con 0x7f7b940b0410 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:32.083 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.073+0000 7f7b98c4d640 10 monclient(hunting): picked mon.noname-a con 0x7f7b941626a0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:32.083 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.073+0000 7f7b98c4d640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b940571f0 con 0x7f7b941626a0 2026-02-24T19:17:32.083 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.073+0000 7f7b98c4d640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b9413fe20 con 0x7f7b94058da0 2026-02-24T19:17:32.084 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.073+0000 7f7b98c4d640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b94140100 con 0x7f7b940b0410 2026-02-24T19:17:32.084 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.073+0000 7f7b98c4d640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:32.084 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.073+0000 7f7b98c4d640 10 monclient(hunting): authenticate will time out at 3626.754277s 2026-02-24T19:17:32.084 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.073+0000 7f7b92d76640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f7b941626a0 0x7f7b9413ee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:55514/0 (socket says 10.20.193.14:55514) 2026-02-24T19:17:32.084 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.073+0000 7f7b92d76640 1 -- 10.20.193.14:0/1647618817 learned_addr learned my addr 10.20.193.14:0/1647618817 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:17:32.084 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.073+0000 7f7b7affd640 10 client.?.objecter ms_handle_connect 0x7f7b941626a0 2026-02-24T19:17:32.084 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.073+0000 7f7b7affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:32.084 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.073+0000 7f7b7affd640 10 client.?.objecter ms_handle_connect 0x7f7b940b0410 2026-02-24T19:17:32.084 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.073+0000 7f7b7affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:32.084 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.074+0000 7f7b7affd640 10 client.?.objecter ms_handle_connect 0x7f7b94058da0 2026-02-24T19:17:32.084 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.074+0000 7f7b7affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:32.084 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.074+0000 7f7b7affd640 1 -- 10.20.193.14:0/1647618817 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3878981104 0 0) 0x7f7b940571f0 con 0x7f7b941626a0 2026-02-24T19:17:32.084 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.074+0000 7f7b7affd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:32.085 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.074+0000 7f7b7affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:32.085 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.074+0000 7f7b7affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:32.085 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.074+0000 7f7b7affd640 10 monclient(hunting): my global_id is 4644 2026-02-24T19:17:32.085 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.074+0000 7f7b7affd640 1 -- 10.20.193.14:0/1647618817 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b60003610 con 0x7f7b941626a0 2026-02-24T19:17:32.085 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.074+0000 7f7b7affd640 1 -- 10.20.193.14:0/1647618817 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2744248910 0 0) 0x7f7b94140100 con 0x7f7b940b0410 2026-02-24T19:17:32.085 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.074+0000 7f7b7affd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:32.085 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.074+0000 7f7b7affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:32.085 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.074+0000 7f7b7affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:32.085 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.074+0000 7f7b7affd640 10 monclient(hunting): my global_id is 4643 2026-02-24T19:17:32.085 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.074+0000 7f7b7affd640 1 -- 10.20.193.14:0/1647618817 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b940571f0 con 0x7f7b940b0410 2026-02-24T19:17:32.085 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.075+0000 7f7b7affd640 1 -- 10.20.193.14:0/1647618817 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3246181833 0 0) 0x7f7b9413fe20 con 0x7f7b94058da0 2026-02-24T19:17:32.085 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.075+0000 7f7b7affd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:32.086 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.075+0000 7f7b7affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:32.086 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.075+0000 7f7b7affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:32.086 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.075+0000 7f7b7affd640 10 monclient(hunting): my global_id is 4612 2026-02-24T19:17:32.086 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.075+0000 7f7b7affd640 1 -- 10.20.193.14:0/1647618817 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b94140100 con 0x7f7b94058da0 2026-02-24T19:17:32.088 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.077+0000 7f7b7affd640 1 -- 10.20.193.14:0/1647618817 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2340120941 0 0) 0x7f7b940571f0 con 0x7f7b940b0410 2026-02-24T19:17:32.088 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.077+0000 7f7b7affd640 1 -- 10.20.193.14:0/1647618817 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7b9413fe20 con 0x7f7b940b0410 2026-02-24T19:17:32.088 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.077+0000 7f7b7affd640 1 -- 10.20.193.14:0/1647618817 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7b7c003060 con 0x7f7b940b0410 2026-02-24T19:17:32.088 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.077+0000 7f7b7affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:32.088 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.077+0000 7f7b7affd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:32.089 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.077+0000 7f7b7affd640 10 monclient(hunting): dump: 2026-02-24T19:17:32.089 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:32.089 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:32.089 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:32.089 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:32.089 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:32.089 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:32.089 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:32.089 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:32.089 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:32.089 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:32.089 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.077+0000 7f7b7affd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:32.090 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.077+0000 7f7b7affd640 1 -- 10.20.193.14:0/1647618817 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3588201653 0 0) 0x7f7b60003610 con 0x7f7b941626a0 2026-02-24T19:17:32.090 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.077+0000 7f7b7affd640 1 -- 10.20.193.14:0/1647618817 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7b940571f0 con 0x7f7b941626a0 2026-02-24T19:17:32.090 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.077+0000 7f7b7affd640 1 -- 10.20.193.14:0/1647618817 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7b84003690 con 0x7f7b941626a0 2026-02-24T19:17:32.090 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.077+0000 7f7b7affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:32.090 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.077+0000 7f7b7affd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:32.090 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.077+0000 7f7b7affd640 10 monclient(hunting): dump: 2026-02-24T19:17:32.090 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:32.090 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:32.090 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:32.090 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:32.090 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:32.090 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:32.091 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:32.091 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:32.091 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:32.091 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:32.091 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.077+0000 7f7b7affd640 1 -- 10.20.193.14:0/1647618817 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2422451148 0 0) 0x7f7b94140100 con 0x7f7b94058da0 2026-02-24T19:17:32.091 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.077+0000 7f7b7affd640 1 -- 10.20.193.14:0/1647618817 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7b60003610 con 0x7f7b94058da0 2026-02-24T19:17:32.091 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.077+0000 7f7b7affd640 1 -- 10.20.193.14:0/1647618817 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7b880030b0 con 0x7f7b94058da0 2026-02-24T19:17:32.091 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.077+0000 7f7b7affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:32.091 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.077+0000 7f7b7affd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:32.091 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.077+0000 7f7b7affd640 10 monclient(hunting): dump: 2026-02-24T19:17:32.091 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:32.091 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:32.091 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:32.092 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:32.092 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:32.092 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:32.092 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:32.092 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:32.092 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:32.092 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:32.092 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.079+0000 7f7b7affd640 1 -- 10.20.193.14:0/1647618817 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1462067639 0 0) 0x7f7b9413fe20 con 0x7f7b940b0410 2026-02-24T19:17:32.092 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.079+0000 7f7b7affd640 1 -- 10.20.193.14:0/1647618817 >> v1:10.20.193.44:6789/0 conn(0x7f7b94058da0 legacy=0x7f7b94056ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:32.092 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.079+0000 7f7b7affd640 1 -- 10.20.193.14:0/1647618817 >> v1:10.20.193.14:6789/0 conn(0x7f7b941626a0 legacy=0x7f7b9413ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:32.092 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.079+0000 7f7b7affd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:32.092 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.079+0000 7f7b7affd640 1 monclient: found mon.c 2026-02-24T19:17:32.093 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.079+0000 7f7b7affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:32.093 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.079+0000 7f7b7affd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:32.093 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.079+0000 7f7b7affd640 1 -- 10.20.193.14:0/1647618817 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b940a7ae0 con 0x7f7b940b0410 2026-02-24T19:17:32.093 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.079+0000 7f7b7affd640 10 monclient: _finish_auth 0 2026-02-24T19:17:32.093 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.079+0000 7f7b7affd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:32.093 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.079+0000 7f7b7affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:32.093 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.079+0000 7f7b98c4d640 5 monclient: authenticate success, global_id 4643 2026-02-24T19:17:32.093 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.079+0000 7f7b98c4d640 10 monclient: _renew_subs 2026-02-24T19:17:32.093 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.079+0000 7f7b98c4d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:32.093 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.079+0000 7f7b98c4d640 1 -- 10.20.193.14:0/1647618817 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7b940a7dc0 con 0x7f7b940b0410 2026-02-24T19:17:32.093 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.079+0000 7f7b98c4d640 10 client.4643.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:32.093 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.079+0000 7f7b98c4d640 10 monclient: _renew_subs 2026-02-24T19:17:32.093 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.079+0000 7f7b98c4d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:32.094 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.079+0000 7f7b98c4d640 1 -- 10.20.193.14:0/1647618817 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7b940a8380 con 0x7f7b940b0410 2026-02-24T19:17:32.094 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.079+0000 7f7b98c4d640 1 librados: init done 2026-02-24T19:17:32.094 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.079+0000 7f7b98c4d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:32.094 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.079+0000 7f7b98c4d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:32.094 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.079+0000 7f7b98c4d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:32.094 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.079+0000 7f7b98c4d640 1 -- 10.20.193.14:0/1647618817 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b940b6d00 con 0x7f7b940b0410 2026-02-24T19:17:32.172 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.170+0000 7f7b7affd640 1 -- 10.20.193.14:0/1647618817 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7b7c003200 con 0x7f7b940b0410 2026-02-24T19:17:32.172 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.170+0000 7f7b7affd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:32.172 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.170+0000 7f7b7affd640 1 -- 10.20.193.14:0/1647618817 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7b7c003920 con 0x7f7b940b0410 2026-02-24T19:17:32.172 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.170+0000 7f7b7affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:32.172 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.170+0000 7f7b7affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:32.172 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.170+0000 7f7b90d72640 4 set_mon_vals no callback set 2026-02-24T19:17:32.172 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.170+0000 7f7b7affd640 10 monclient: dump: 2026-02-24T19:17:32.172 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:17:32.172 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:32.172 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:32.173 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:32.173 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:32.173 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:17:32.173 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:32.173 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:32.173 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:32.173 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:17:32.174 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.171+0000 7f7b7affd640 1 -- 10.20.193.14:0/1647618817 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f7b7c01c790 con 0x7f7b940b0410 2026-02-24T19:17:32.174 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.172+0000 7f7b92575640 10 monclient: get_auth_request con 0x7f7b60077eb0 auth_method 0 2026-02-24T19:17:32.174 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.172+0000 7f7b7affd640 10 client.4643.objecter ms_handle_connect 0x7f7b60077eb0 2026-02-24T19:17:32.174 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.172+0000 7f7b7affd640 1 -- 10.20.193.14:0/1647618817 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(31..31 src has 1..31) ==== 8169+0+0 (unknown 105642608 0 0) 0x7f7b7c091fb0 con 0x7f7b940b0410 2026-02-24T19:17:32.174 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.172+0000 7f7b7affd640 10 client.4643.objecter ms_dispatch2 0x7f7b94000b90 osd_map(31..31 src has 1..31) 2026-02-24T19:17:32.174 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.172+0000 7f7b7affd640 3 client.4643.objecter handle_osd_map got epochs [31,31] > 0 2026-02-24T19:17:32.174 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.172+0000 7f7b7affd640 3 client.4643.objecter handle_osd_map decoding full epoch 31 2026-02-24T19:17:32.175 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.172+0000 7f7b7affd640 20 client.4643.objecter dump_active .. 0 homeless 2026-02-24T19:17:32.175 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.174+0000 7f7b7affd640 1 -- 10.20.193.14:0/1647618817 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f7b7c05c9e0 con 0x7f7b940b0410 2026-02-24T19:17:32.176 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.174+0000 7f7b7affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:32.176 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.174+0000 7f7b7affd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:32.309 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.308+0000 7f7b98c4d640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-24T19:17:32.309 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.308+0000 7f7b98c4d640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-24T19:17:32.310 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.308+0000 7f7b98c4d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:17:32.310 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.308+0000 7f7b98c4d640 1 -- 10.20.193.14:0/1647618817 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7b94052450 con 0x7f7b940b0410 2026-02-24T19:17:32.314 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.313+0000 7f7b7affd640 1 -- 10.20.193.14:0/1647618817 <== mon.2 v1:10.20.193.170:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (unknown 3730786198 0 4185958460) 0x7f7b7c05c2e0 con 0x7f7b940b0410 2026-02-24T19:17:32.315 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.313+0000 7f7b7affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-24T19:17:32.315 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.313+0000 7f7b7affd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:32.315 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:17:32.315 INFO:teuthology.orchestra.run.trial014.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-24T19:17:32.317 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.315+0000 7f7b98c4d640 10 librados: watch_flush enter 2026-02-24T19:17:32.317 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.315+0000 7f7b98c4d640 10 librados: watch_flush exit 2026-02-24T19:17:32.317 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.315+0000 7f7b98c4d640 20 client.4643.objecter shutdown clearing up homeless session... 2026-02-24T19:17:32.317 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.315+0000 7f7b98c4d640 10 client.4643.objecter successfully canceled tick 2026-02-24T19:17:32.317 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.315+0000 7f7b98c4d640 1 -- 10.20.193.14:0/1647618817 >> v1:10.20.193.14:6800/4014096310 conn(0x7f7b60077eb0 legacy=0x7f7b60098360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:32.317 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.315+0000 7f7b98c4d640 10 monclient: shutdown 2026-02-24T19:17:32.318 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.315+0000 7f7b98c4d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:32.318 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.315+0000 7f7b98c4d640 1 -- 10.20.193.14:0/1647618817 >> v1:10.20.193.170:6789/0 conn(0x7f7b940b0410 legacy=0x7f7b940a88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:32.318 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.315+0000 7f7b98c4d640 1 -- 10.20.193.14:0/1647618817 shutdown_connections 2026-02-24T19:17:32.318 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.315+0000 7f7b98c4d640 1 -- 10.20.193.14:0/1647618817 >> 10.20.193.14:0/1647618817 conn(0x7f7b940b65f0 msgr2=0x7f7b94165280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:32.318 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.315+0000 7f7b98c4d640 1 -- 10.20.193.14:0/1647618817 shutdown_connections 2026-02-24T19:17:32.318 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.315+0000 7f7b98c4d640 1 -- 10.20.193.14:0/1647618817 wait complete. 2026-02-24T19:17:32.318 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:17:32.315+0000 7f7b98c4d640 1 librados: shutdown 2026-02-24T19:17:32.326 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-24T19:17:32.326 INFO:teuthology.run_tasks:Running task workunit... 2026-02-24T19:17:32.349 INFO:tasks.workunit:Pulling workunits from ref 36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-24T19:17:32.350 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-24T19:17:32.350 DEBUG:teuthology.orchestra.run.trial195:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-24T19:17:32.368 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T19:17:32.369 INFO:teuthology.orchestra.run.trial195.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-24T19:17:32.369 DEBUG:teuthology.orchestra.run.trial195:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-24T19:17:32.425 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-24T19:17:32.426 DEBUG:teuthology.orchestra.run.trial195:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-24T19:17:32.481 INFO:tasks.workunit:timeout=6h 2026-02-24T19:17:32.482 INFO:tasks.workunit:cleanup=True 2026-02-24T19:17:32.482 DEBUG:teuthology.orchestra.run.trial195:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-24T19:17:32.544 INFO:tasks.workunit.client.0.trial195.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-24T19:17:34.760 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:01:09.022 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:34.813 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:01:09.075 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:34.833 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:01:09.092 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:34.843 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:01:09.065 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:34.860 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:01:09.119 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:34.869 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:01:09.091 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:34.935 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:01:09.197 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:34.982 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:01:09.241 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:34.995 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:01:09.217 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:54.749 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:01:29.010 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:54.751 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:01:29.013 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:54.768 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:01:29.030 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:54.777 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:01:28.999 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:54.778 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:01:29.038 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:54.779 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:01:29.001 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:54.780 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:01:29.039 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:54.797 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:01:29.019 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:54.799 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:01:29.058 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:58.866 INFO:tasks.workunit.client.0.trial195.stderr:Note: switching to '36d388f27052dd940bdbaf543bb05bdba0acc155'. 2026-02-24T19:17:58.866 INFO:tasks.workunit.client.0.trial195.stderr: 2026-02-24T19:17:58.866 INFO:tasks.workunit.client.0.trial195.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-24T19:17:58.866 INFO:tasks.workunit.client.0.trial195.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-24T19:17:58.866 INFO:tasks.workunit.client.0.trial195.stderr:state without impacting any branches by switching back to a branch. 2026-02-24T19:17:58.866 INFO:tasks.workunit.client.0.trial195.stderr: 2026-02-24T19:17:58.866 INFO:tasks.workunit.client.0.trial195.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-24T19:17:58.866 INFO:tasks.workunit.client.0.trial195.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-24T19:17:58.867 INFO:tasks.workunit.client.0.trial195.stderr: 2026-02-24T19:17:58.867 INFO:tasks.workunit.client.0.trial195.stderr: git switch -c 2026-02-24T19:17:58.867 INFO:tasks.workunit.client.0.trial195.stderr: 2026-02-24T19:17:58.867 INFO:tasks.workunit.client.0.trial195.stderr:Or undo this operation with: 2026-02-24T19:17:58.867 INFO:tasks.workunit.client.0.trial195.stderr: 2026-02-24T19:17:58.867 INFO:tasks.workunit.client.0.trial195.stderr: git switch - 2026-02-24T19:17:58.867 INFO:tasks.workunit.client.0.trial195.stderr: 2026-02-24T19:17:58.867 INFO:tasks.workunit.client.0.trial195.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-24T19:17:58.867 INFO:tasks.workunit.client.0.trial195.stderr: 2026-02-24T19:17:58.867 INFO:tasks.workunit.client.0.trial195.stderr:HEAD is now at 36d388f2705 Merge branch 'aclamk-rocksdb-binned-cache-perf-counters-tentacle' of https://github.com/aclamk/ceph into wip-yuri3-testing-2026-02-19-1610-tentacle 2026-02-24T19:17:58.874 DEBUG:teuthology.orchestra.run.trial195:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-24T19:17:58.932 INFO:tasks.workunit.client.0.trial195.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-24T19:17:58.933 INFO:tasks.workunit.client.0.trial195.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-24T19:17:58.934 INFO:tasks.workunit.client.0.trial195.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-24T19:17:59.024 INFO:tasks.workunit.client.0.trial195.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-24T19:17:59.055 INFO:tasks.workunit.client.0.trial195.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-24T19:17:59.080 INFO:tasks.workunit.client.0.trial195.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-24T19:17:59.081 INFO:tasks.workunit.client.0.trial195.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-24T19:17:59.082 INFO:tasks.workunit.client.0.trial195.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-24T19:17:59.106 INFO:tasks.workunit.client.0.trial195.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-24T19:17:59.110 DEBUG:teuthology.orchestra.run.trial195:> set -ex 2026-02-24T19:17:59.110 DEBUG:teuthology.orchestra.run.trial195:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-24T19:17:59.167 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2026-02-24T19:17:59.169 INFO:tasks.workunit:Running workunit rados/test.sh... 2026-02-24T19:17:59.169 DEBUG:teuthology.orchestra.run.trial195:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=36d388f27052dd940bdbaf543bb05bdba0acc155 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2026-02-24T19:17:59.228 INFO:tasks.workunit.client.0.trial195.stderr:+ parallel=1 2026-02-24T19:17:59.228 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' '' = --serial ']' 2026-02-24T19:17:59.228 INFO:tasks.workunit.client.0.trial195.stderr:+ crimson=0 2026-02-24T19:17:59.228 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' '' = --crimson ']' 2026-02-24T19:17:59.228 INFO:tasks.workunit.client.0.trial195.stderr:+ color= 2026-02-24T19:17:59.228 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -t 1 ']' 2026-02-24T19:17:59.228 INFO:tasks.workunit.client.0.trial195.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2026-02-24T19:17:59.228 INFO:tasks.workunit.client.0.trial195.stderr:+ GTEST_OUTPUT_DIR=/home/ubuntu/cephtest/archive/unit_test_xml_report 2026-02-24T19:17:59.228 INFO:tasks.workunit.client.0.trial195.stderr:+ mkdir -p /home/ubuntu/cephtest/archive/unit_test_xml_report 2026-02-24T19:17:59.229 INFO:tasks.workunit.client.0.trial195.stderr:+ declare -A pids 2026-02-24T19:17:59.229 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:17:59.230 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.230 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s api_aio 2026-02-24T19:17:59.230 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' api_aio' 2026-02-24T19:17:59.230 INFO:tasks.workunit.client.0.trial195.stderr:++ echo api_aio 2026-02-24T19:17:59.230 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.231 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=api_aio 2026-02-24T19:17:59.231 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=48808 2026-02-24T19:17:59.231 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test api_aio on pid 48808' 2026-02-24T19:17:59.231 INFO:tasks.workunit.client.0.trial195.stdout:test api_aio on pid 48808 2026-02-24T19:17:59.233 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=48808 2026-02-24T19:17:59.233 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:17:59.233 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.233 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio.xml 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2026-02-24T19:17:59.234 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.234 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.234 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.234 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.234 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.234 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.234 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s api_aio_pp 2026-02-24T19:17:59.234 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.234 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' api_aio_pp' 2026-02-24T19:17:59.234 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.234 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.234 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.234 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.234 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.235 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.235 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.235 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.235 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.235 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.235 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.235 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.235 INFO:tasks.workunit.client.0.trial195.stderr:++ echo api_aio_pp 2026-02-24T19:17:59.235 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.236 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=api_aio_pp 2026-02-24T19:17:59.236 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=48816 2026-02-24T19:17:59.236 INFO:tasks.workunit.client.0.trial195.stdout:test api_aio_pp on pid 48816 2026-02-24T19:17:59.239 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test api_aio_pp on pid 48816' 2026-02-24T19:17:59.240 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=48816 2026-02-24T19:17:59.240 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:17:59.240 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.240 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.240 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.240 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.240 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.240 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.240 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio_pp.xml 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2026-02-24T19:17:59.240 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.240 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.240 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.240 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.241 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.241 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.241 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.241 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.241 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.241 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.241 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.241 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.241 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.241 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.241 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.241 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s api_io 2026-02-24T19:17:59.241 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' api_io' 2026-02-24T19:17:59.241 INFO:tasks.workunit.client.0.trial195.stderr:++ echo api_io 2026-02-24T19:17:59.242 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.242 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.242 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.242 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.242 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.242 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.242 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.242 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.242 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.242 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.242 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.242 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.242 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.242 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.242 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.243 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.243 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.243 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.243 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.243 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.243 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.243 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.243 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.243 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.243 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.243 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.243 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.243 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.243 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.244 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=api_io 2026-02-24T19:17:59.244 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=48826 2026-02-24T19:17:59.244 INFO:tasks.workunit.client.0.trial195.stdout:test api_io on pid 48826 2026-02-24T19:17:59.248 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test api_io on pid 48826' 2026-02-24T19:17:59.249 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=48826 2026-02-24T19:17:59.249 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:17:59.249 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.249 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io.xml 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2026-02-24T19:17:59.249 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s api_io_pp 2026-02-24T19:17:59.249 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' api_io_pp' 2026-02-24T19:17:59.249 INFO:tasks.workunit.client.0.trial195.stderr:++ echo api_io_pp 2026-02-24T19:17:59.249 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.249 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.249 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.249 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.249 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.249 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.250 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.250 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.250 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.250 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.250 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.250 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.250 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.250 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.250 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.250 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.250 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.250 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.250 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.250 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.251 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.251 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.251 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.251 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.251 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.251 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.251 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.251 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.251 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.251 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.251 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.251 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.251 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.251 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.251 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.252 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.252 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.252 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.252 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.252 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.252 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.252 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.252 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.252 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.252 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.252 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.252 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.252 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.252 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.252 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.253 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.253 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.253 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.253 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.253 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.253 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.253 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.253 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.253 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.253 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.253 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.253 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=api_io_pp 2026-02-24T19:17:59.253 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=48840 2026-02-24T19:17:59.254 INFO:tasks.workunit.client.0.trial195.stdout:test api_io_pp on pid 48840 2026-02-24T19:17:59.258 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test api_io_pp on pid 48840' 2026-02-24T19:17:59.259 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=48840 2026-02-24T19:17:59.259 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:17:59.259 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.259 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io_pp.xml 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2026-02-24T19:17:59.259 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s api_asio 2026-02-24T19:17:59.259 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' api_asio' 2026-02-24T19:17:59.259 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.259 INFO:tasks.workunit.client.0.trial195.stderr:++ echo api_asio 2026-02-24T19:17:59.259 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.259 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.259 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.259 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.260 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.260 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.260 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.260 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.260 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.260 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.260 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.260 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.260 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.260 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.260 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.260 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.260 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.260 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.260 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.261 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.261 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.261 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.261 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.261 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.261 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.261 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.261 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.261 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.261 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.261 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.261 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.261 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.261 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.262 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.262 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.262 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.262 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.262 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.262 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.262 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.262 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.262 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.262 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.262 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.262 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.262 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.262 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.262 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.263 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.263 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.263 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.263 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.263 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.263 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.263 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.263 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.263 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.263 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.263 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.263 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.263 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.263 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.263 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.263 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.264 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.264 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.264 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.264 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.264 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.264 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=api_asio 2026-02-24T19:17:59.264 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.264 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.264 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.264 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.264 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.264 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/48808/exe ']' 2026-02-24T19:17:59.264 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=48852 2026-02-24T19:17:59.264 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test api_asio on pid 48852' 2026-02-24T19:17:59.265 INFO:tasks.workunit.client.0.trial195.stdout:test api_asio on pid 48852 2026-02-24T19:17:59.269 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=48852 2026-02-24T19:17:59.269 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:17:59.269 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.270 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_asio.xml 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2026-02-24T19:17:59.270 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s api_list 2026-02-24T19:17:59.270 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/48808/exe 2026-02-24T19:17:59.270 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' api_list' 2026-02-24T19:17:59.270 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.270 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.270 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.270 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.270 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.270 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.270 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.270 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.270 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.270 INFO:tasks.workunit.client.0.trial195.stderr:++ echo api_list 2026-02-24T19:17:59.270 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.270 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.270 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.271 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.271 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.271 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.271 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.271 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.271 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.271 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.271 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.271 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.271 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.271 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.271 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.271 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.271 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.271 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.271 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.271 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.271 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.271 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.272 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.272 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.272 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.272 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.272 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.272 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.272 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.272 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.272 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.272 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.272 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.272 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.272 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.272 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.272 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.272 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.272 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.272 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.272 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.272 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.273 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.273 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.273 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.273 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.273 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.273 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.273 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.273 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.273 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.273 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.273 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.273 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.273 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.273 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.273 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.273 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.273 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.273 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.273 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.274 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.274 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.274 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.274 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.274 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.274 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.274 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.274 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.274 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.274 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.274 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.274 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.274 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.274 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.274 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.274 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio.xml 2026-02-24T19:17:59.274 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.274 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.274 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.274 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_rados_api_aio.log 2026-02-24T19:17:59.275 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ api_aio: /' 2026-02-24T19:17:59.275 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.275 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=api_list 2026-02-24T19:17:59.275 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=48871 2026-02-24T19:17:59.275 INFO:tasks.workunit.client.0.trial195.stdout:test api_list on pid 48871 2026-02-24T19:17:59.279 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test api_list on pid 48871' 2026-02-24T19:17:59.279 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=48871 2026-02-24T19:17:59.279 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:17:59.279 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.279 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_list.xml 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2026-02-24T19:17:59.279 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.279 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.279 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s api_lock 2026-02-24T19:17:59.279 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.279 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.279 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.279 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.280 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.280 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.280 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.280 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.280 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.280 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.280 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.280 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.280 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.280 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.280 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.280 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.280 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.280 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' api_lock' 2026-02-24T19:17:59.280 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.280 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.280 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.280 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.280 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.280 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.280 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.280 INFO:tasks.workunit.client.0.trial195.stderr:++ echo api_lock 2026-02-24T19:17:59.280 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.280 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.281 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.281 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.281 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.281 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.281 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.281 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.281 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.281 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.281 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.281 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.281 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.281 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.281 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.281 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.281 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/48816/exe ']' 2026-02-24T19:17:59.281 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.281 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.281 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.281 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.281 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.281 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.281 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.281 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.281 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.282 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.282 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.282 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.282 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.282 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.282 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.282 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.282 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/48816/exe 2026-02-24T19:17:59.282 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.282 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.282 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.282 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.282 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.282 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.282 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.282 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.282 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.282 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.282 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.282 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.282 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.282 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.282 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.282 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.282 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.283 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.283 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.283 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.283 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.283 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.283 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.283 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.283 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.283 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.283 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.283 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.283 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.283 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.283 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.283 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.283 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.283 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.283 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.283 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.283 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.283 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.283 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.283 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=api_lock 2026-02-24T19:17:59.283 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=48887 2026-02-24T19:17:59.284 INFO:tasks.workunit.client.0.trial195.stdout:test api_lock on pid 48887 2026-02-24T19:17:59.287 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test api_lock on pid 48887' 2026-02-24T19:17:59.287 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=48887 2026-02-24T19:17:59.287 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:17:59.287 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.287 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock.xml 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2026-02-24T19:17:59.288 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s api_lock_pp 2026-02-24T19:17:59.288 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' api_lock_pp' 2026-02-24T19:17:59.288 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.288 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.288 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.288 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.288 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.288 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.288 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.288 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.288 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.288 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.288 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.288 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.288 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.288 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.288 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.288 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.288 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.288 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.288 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.288 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.288 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.288 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.288 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.288 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.288 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.289 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.289 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.289 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.289 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.289 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/48826/exe ']' 2026-02-24T19:17:59.289 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.289 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.289 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.289 INFO:tasks.workunit.client.0.trial195.stderr:++ echo api_lock_pp 2026-02-24T19:17:59.289 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.289 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio_pp.xml 2026-02-24T19:17:59.289 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_rados_api_aio_pp.log 2026-02-24T19:17:59.289 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.289 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.289 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/48826/exe 2026-02-24T19:17:59.289 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.289 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.289 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.289 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.289 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ api_aio_pp: /' 2026-02-24T19:17:59.289 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.289 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.289 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.289 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.289 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.289 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.289 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.289 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.290 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.290 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.290 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.290 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.290 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.290 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.290 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.290 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.290 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.290 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.290 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.290 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.290 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.290 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.290 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.290 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.290 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.290 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.290 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.290 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.290 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.290 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.290 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.290 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.290 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.290 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.290 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.290 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.290 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.290 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.291 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.291 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.291 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.291 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.291 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.291 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.291 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.291 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.291 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.291 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.291 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.291 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.291 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.291 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.291 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.291 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.291 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.291 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.291 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.291 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.291 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.291 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.291 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.291 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.291 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.291 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.291 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=api_lock_pp 2026-02-24T19:17:59.291 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=48906 2026-02-24T19:17:59.291 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.292 INFO:tasks.workunit.client.0.trial195.stdout:test api_lock_pp on pid 48906 2026-02-24T19:17:59.295 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test api_lock_pp on pid 48906' 2026-02-24T19:17:59.295 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=48906 2026-02-24T19:17:59.295 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:17:59.295 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.295 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.295 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.295 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.295 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.295 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.295 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock_pp.xml 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2026-02-24T19:17:59.295 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.295 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.295 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.295 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.295 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.295 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.295 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.295 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.295 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.295 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.295 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.295 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s api_misc 2026-02-24T19:17:59.295 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io.xml 2026-02-24T19:17:59.295 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' api_misc' 2026-02-24T19:17:59.295 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_rados_api_io.log 2026-02-24T19:17:59.295 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.295 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ api_io: /' 2026-02-24T19:17:59.295 INFO:tasks.workunit.client.0.trial195.stderr:++ echo api_misc 2026-02-24T19:17:59.296 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.296 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.296 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.296 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.296 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.296 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.296 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.296 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.296 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.296 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.296 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.296 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.296 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.296 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.296 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.296 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.296 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.296 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.296 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.296 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.296 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.296 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.296 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.296 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.296 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.296 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.296 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.296 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.296 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.296 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.296 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.296 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.296 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.297 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.297 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.297 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.297 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.297 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.297 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.297 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.297 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.297 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.297 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.297 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.297 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.297 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.297 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.297 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.297 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.297 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.297 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.297 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.297 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.297 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.297 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.297 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.297 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.297 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.297 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.297 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.297 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.297 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.297 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.297 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.297 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.297 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.297 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.298 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.298 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.298 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.298 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.298 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.298 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.298 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.298 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.298 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.298 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.298 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.298 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.298 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.298 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.298 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.298 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.298 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.298 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.298 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.298 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.298 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.298 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.298 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.298 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/48840/exe ']' 2026-02-24T19:17:59.298 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/48840/exe 2026-02-24T19:17:59.298 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.298 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=api_misc 2026-02-24T19:17:59.298 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.298 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.298 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.298 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.298 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=48927 2026-02-24T19:17:59.298 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test api_misc on pid 48927' 2026-02-24T19:17:59.299 INFO:tasks.workunit.client.0.trial195.stdout:test api_misc on pid 48927 2026-02-24T19:17:59.301 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=48927 2026-02-24T19:17:59.301 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:17:59.301 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.301 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc.xml 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2026-02-24T19:17:59.301 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.301 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s api_misc_pp 2026-02-24T19:17:59.301 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.301 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' api_misc_pp' 2026-02-24T19:17:59.301 INFO:tasks.workunit.client.0.trial195.stderr:++ echo api_misc_pp 2026-02-24T19:17:59.301 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.301 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.301 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.301 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.301 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.301 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.302 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.302 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.302 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.302 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.302 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.302 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.302 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.302 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.302 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.302 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.302 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.302 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.302 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.302 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.302 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.302 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.302 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.302 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.302 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.302 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.302 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.302 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.302 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.302 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.302 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.302 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.302 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.302 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.302 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.302 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.302 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.302 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.302 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.302 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.302 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.302 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.303 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.303 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.303 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.303 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.303 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.303 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.303 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.303 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.303 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.303 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.303 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.303 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.303 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.303 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.303 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.303 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.303 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.303 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.303 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.303 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.303 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.303 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.303 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.303 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.303 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.303 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.303 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.303 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.303 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.303 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.303 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.303 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.303 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.303 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.303 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.303 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.303 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.304 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/48852/exe ']' 2026-02-24T19:17:59.304 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.304 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.304 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.304 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.304 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.304 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.304 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.304 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.304 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.304 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io_pp.xml 2026-02-24T19:17:59.304 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.304 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.304 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.304 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.304 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.304 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.304 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.304 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.304 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.304 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.304 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.304 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.304 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.304 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.304 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_rados_api_io_pp.log 2026-02-24T19:17:59.304 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ api_io_pp: /' 2026-02-24T19:17:59.304 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/48852/exe 2026-02-24T19:17:59.304 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=api_misc_pp 2026-02-24T19:17:59.304 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.304 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=48947 2026-02-24T19:17:59.304 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test api_misc_pp on pid 48947' 2026-02-24T19:17:59.304 INFO:tasks.workunit.client.0.trial195.stdout:test api_misc_pp on pid 48947 2026-02-24T19:17:59.307 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=48947 2026-02-24T19:17:59.307 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.307 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:17:59.307 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.307 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.307 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc_pp.xml 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2026-02-24T19:17:59.307 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.307 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.307 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s api_pool 2026-02-24T19:17:59.307 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.307 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' api_pool' 2026-02-24T19:17:59.307 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.307 INFO:tasks.workunit.client.0.trial195.stderr:++ echo api_pool 2026-02-24T19:17:59.307 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.307 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.307 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.307 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.307 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.307 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.307 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.307 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.307 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.307 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.307 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.307 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.307 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.307 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.307 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.307 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.307 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.307 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.307 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.307 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.308 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_asio.xml 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.309 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.310 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.310 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/48871/exe ']' 2026-02-24T19:17:59.310 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_rados_api_asio.log 2026-02-24T19:17:59.310 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ api_asio: /' 2026-02-24T19:17:59.310 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/48871/exe 2026-02-24T19:17:59.310 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=api_pool 2026-02-24T19:17:59.310 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.310 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=48968 2026-02-24T19:17:59.310 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.310 INFO:tasks.workunit.client.0.trial195.stdout:test api_pool on pid 48968 2026-02-24T19:17:59.312 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test api_pool on pid 48968' 2026-02-24T19:17:59.312 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=48968 2026-02-24T19:17:59.312 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:17:59.312 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.312 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.312 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.312 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.312 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_pool.xml 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2026-02-24T19:17:59.312 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.312 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s api_snapshots 2026-02-24T19:17:59.312 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.312 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' api_snapshots' 2026-02-24T19:17:59.312 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.312 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.312 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.312 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.312 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.312 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.312 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.312 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.312 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.312 INFO:tasks.workunit.client.0.trial195.stderr:++ echo api_snapshots 2026-02-24T19:17:59.312 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.313 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/48887/exe ']' 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.314 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.315 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.315 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.315 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.315 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.315 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.315 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.315 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/48887/exe 2026-02-24T19:17:59.315 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_list.xml 2026-02-24T19:17:59.315 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_rados_api_list.log 2026-02-24T19:17:59.315 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ api_list: /' 2026-02-24T19:17:59.315 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.315 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.315 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.315 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.315 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.315 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.315 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=api_snapshots 2026-02-24T19:17:59.315 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=48990 2026-02-24T19:17:59.315 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.315 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test api_snapshots on pid 48990' 2026-02-24T19:17:59.315 INFO:tasks.workunit.client.0.trial195.stdout:test api_snapshots on pid 48990 2026-02-24T19:17:59.317 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=48990 2026-02-24T19:17:59.317 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:17:59.317 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.317 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.317 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.317 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots.xml 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s api_snapshots_pp 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' api_snapshots_pp' 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock.xml 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.318 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_rados_api_lock.log 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ api_lock: /' 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:++ echo api_snapshots_pp 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.319 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.320 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/48906/exe ']' 2026-02-24T19:17:59.320 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.320 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.320 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.320 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.320 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.320 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.320 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.320 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.320 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.320 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.320 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.320 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.320 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.320 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.320 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.320 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.320 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.320 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.320 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/48906/exe 2026-02-24T19:17:59.320 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.320 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=api_snapshots_pp 2026-02-24T19:17:59.320 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.320 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.320 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.320 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.320 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.320 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.320 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.320 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.320 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.320 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49017 2026-02-24T19:17:59.320 INFO:tasks.workunit.client.0.trial195.stdout:test api_snapshots_pp on pid 49017 2026-02-24T19:17:59.323 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test api_snapshots_pp on pid 49017' 2026-02-24T19:17:59.323 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=49017 2026-02-24T19:17:59.323 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:17:59.323 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.323 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots_pp.xml 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2026-02-24T19:17:59.323 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.323 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.323 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.323 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.323 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.323 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.323 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.323 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.323 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s api_stat 2026-02-24T19:17:59.323 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.323 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.323 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.323 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.323 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.323 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.323 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.323 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.323 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/48927/exe ']' 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' api_stat' 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:++ echo api_stat 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/48927/exe 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock_pp.xml 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_rados_api_lock_pp.log 2026-02-24T19:17:59.324 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ api_lock_pp: /' 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.325 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.326 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.326 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.326 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.326 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.326 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.326 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.326 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.326 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.326 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.326 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.326 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.326 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.326 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.326 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.326 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.326 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.326 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.326 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.326 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.326 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.326 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.326 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.326 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.326 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.326 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.326 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.326 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.326 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=api_stat 2026-02-24T19:17:59.326 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc.xml 2026-02-24T19:17:59.326 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_rados_api_misc.log 2026-02-24T19:17:59.326 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49049 2026-02-24T19:17:59.326 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test api_stat on pid 49049' 2026-02-24T19:17:59.326 INFO:tasks.workunit.client.0.trial195.stdout:test api_stat on pid 49049 2026-02-24T19:17:59.329 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=49049 2026-02-24T19:17:59.329 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:17:59.329 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.329 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ api_misc: /' 2026-02-24T19:17:59.329 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat.xml 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2026-02-24T19:17:59.329 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.329 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.329 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.329 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.329 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.329 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.329 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.329 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.329 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.329 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.329 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.329 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.329 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.329 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.329 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.329 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.329 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.329 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.329 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.329 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.329 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.329 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.329 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.329 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.329 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/48947/exe ']' 2026-02-24T19:17:59.329 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.329 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s api_stat_pp 2026-02-24T19:17:59.329 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.329 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' api_stat_pp' 2026-02-24T19:17:59.329 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.329 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/48947/exe 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:++ echo api_stat_pp 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.330 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/48968/exe ']' 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/48968/exe 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=api_stat_pp 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49075 2026-02-24T19:17:59.331 INFO:tasks.workunit.client.0.trial195.stdout:test api_stat_pp on pid 49075 2026-02-24T19:17:59.333 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test api_stat_pp on pid 49075' 2026-02-24T19:17:59.333 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=49075 2026-02-24T19:17:59.333 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:17:59.333 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.333 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat_pp.xml 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2026-02-24T19:17:59.333 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc_pp.xml 2026-02-24T19:17:59.333 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.333 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.333 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.333 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_rados_api_misc_pp.log 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s api_watch_notify 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ api_misc_pp: /' 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' api_watch_notify' 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:++ echo api_watch_notify 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.334 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_pool.xml 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_rados_api_pool.log 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ api_pool: /' 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.335 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.336 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=api_watch_notify 2026-02-24T19:17:59.336 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49116 2026-02-24T19:17:59.336 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test api_watch_notify on pid 49116' 2026-02-24T19:17:59.336 INFO:tasks.workunit.client.0.trial195.stdout:test api_watch_notify on pid 49116 2026-02-24T19:17:59.337 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=49116 2026-02-24T19:17:59.337 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.337 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:17:59.337 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.337 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify.xml 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s api_watch_notify_pp 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' api_watch_notify_pp' 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.338 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/48990/exe ']' 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:++ echo api_watch_notify_pp 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/48990/exe 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.339 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.340 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.340 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.340 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.340 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.340 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.340 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.340 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.340 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=api_watch_notify_pp 2026-02-24T19:17:59.340 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.340 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49137 2026-02-24T19:17:59.340 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test api_watch_notify_pp on pid 49137' 2026-02-24T19:17:59.340 INFO:tasks.workunit.client.0.trial195.stdout:test api_watch_notify_pp on pid 49137 2026-02-24T19:17:59.342 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=49137 2026-02-24T19:17:59.342 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.342 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.342 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:17:59.342 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.342 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.342 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.342 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.342 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.342 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify_pp.xml 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2026-02-24T19:17:59.342 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.342 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.342 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.342 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.342 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.342 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.342 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.342 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.342 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.342 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.342 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.342 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.342 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.342 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.342 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s api_cmd 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots.xml 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/49017/exe ']' 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_rados_api_snapshots.log 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' api_cmd' 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ api_snapshots: /' 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/49017/exe 2026-02-24T19:17:59.343 INFO:tasks.workunit.client.0.trial195.stderr:++ echo api_cmd 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.344 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.345 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.345 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.345 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.345 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.345 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.345 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.345 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.345 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.345 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=api_cmd 2026-02-24T19:17:59.345 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.345 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.345 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.345 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49163 2026-02-24T19:17:59.345 INFO:tasks.workunit.client.0.trial195.stdout:test api_cmd on pid 49163 2026-02-24T19:17:59.347 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test api_cmd on pid 49163' 2026-02-24T19:17:59.347 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=49163 2026-02-24T19:17:59.347 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:17:59.347 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.347 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd.xml 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2026-02-24T19:17:59.347 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots_pp.xml 2026-02-24T19:17:59.347 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.347 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2026-02-24T19:17:59.347 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s api_cmd_pp 2026-02-24T19:17:59.347 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.347 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.347 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.347 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.347 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.347 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.347 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.347 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ api_snapshots_pp: /' 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' api_cmd_pp' 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/49049/exe ']' 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.348 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:++ echo api_cmd_pp 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/49049/exe 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.349 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.350 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.350 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.350 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.350 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.350 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.350 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.350 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.350 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.350 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.350 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.350 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.350 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.350 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=api_cmd_pp 2026-02-24T19:17:59.350 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.350 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.350 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.350 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.350 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.350 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.350 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.350 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.350 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.350 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.350 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49214 2026-02-24T19:17:59.350 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.350 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.350 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.350 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.350 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.350 INFO:tasks.workunit.client.0.trial195.stdout:test api_cmd_pp on pid 49214 2026-02-24T19:17:59.352 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test api_cmd_pp on pid 49214' 2026-02-24T19:17:59.352 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=49214 2026-02-24T19:17:59.352 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:17:59.352 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.352 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat.xml 2026-02-24T19:17:59.352 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.352 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.352 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.352 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd_pp.xml 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2026-02-24T19:17:59.352 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.352 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.352 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.352 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.352 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.352 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s api_service 2026-02-24T19:17:59.352 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.352 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.352 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ api_stat: /' 2026-02-24T19:17:59.352 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.352 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.352 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.352 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.352 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.352 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.352 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.352 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.352 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' api_service' 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/49075/exe ']' 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:++ echo api_service 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/49075/exe 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_rados_api_stat.log 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.353 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.354 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.354 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.354 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.354 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.354 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.354 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.354 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.354 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.354 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.354 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.354 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.354 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.354 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.354 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.354 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.354 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.354 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.354 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.354 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.354 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.354 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.354 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.354 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=api_service 2026-02-24T19:17:59.354 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.354 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.354 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.354 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.354 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.354 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.354 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49236 2026-02-24T19:17:59.354 INFO:tasks.workunit.client.0.trial195.stdout:test api_service on pid 49236 2026-02-24T19:17:59.356 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test api_service on pid 49236' 2026-02-24T19:17:59.356 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=49236 2026-02-24T19:17:59.356 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.356 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.356 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:17:59.356 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.356 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.356 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service.xml 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2026-02-24T19:17:59.356 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.356 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.356 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.356 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s api_service_pp 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat_pp.xml 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_rados_api_stat_pp.log 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' api_service_pp' 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ api_stat_pp: /' 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/49116/exe ']' 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.357 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:++ echo api_service_pp 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/49116/exe 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.358 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.359 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.359 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.359 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.359 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.359 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.359 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.359 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.359 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.359 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.359 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.359 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.359 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=api_service_pp 2026-02-24T19:17:59.359 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.359 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.359 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.359 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.359 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.359 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.359 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49265 2026-02-24T19:17:59.359 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test api_service_pp on pid 49265' 2026-02-24T19:17:59.359 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.359 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.359 INFO:tasks.workunit.client.0.trial195.stdout:test api_service_pp on pid 49265 2026-02-24T19:17:59.361 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=49265 2026-02-24T19:17:59.361 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.361 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:17:59.361 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.361 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service_pp.xml 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2026-02-24T19:17:59.361 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.361 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.361 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.361 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s api_c_write_operations 2026-02-24T19:17:59.361 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.361 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.361 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.361 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.361 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.361 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.361 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.361 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify.xml 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' api_c_write_operations' 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/49137/exe ']' 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_rados_api_watch_notify.log 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ api_watch_notify: /' 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/49137/exe 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:++ echo api_c_write_operations 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.362 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.363 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.364 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.364 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.364 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.364 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.364 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.364 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.364 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.364 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.364 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.364 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.364 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.364 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.364 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.364 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify_pp.xml 2026-02-24T19:17:59.364 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=api_c_write_operations 2026-02-24T19:17:59.364 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49289 2026-02-24T19:17:59.364 INFO:tasks.workunit.client.0.trial195.stdout:test api_c_write_operations on pid 49289 2026-02-24T19:17:59.366 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test api_c_write_operations on pid 49289' 2026-02-24T19:17:59.366 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=49289 2026-02-24T19:17:59.366 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:17:59.366 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.366 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2026-02-24T19:17:59.366 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_write_operations.xml 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2026-02-24T19:17:59.366 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2026-02-24T19:17:59.366 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.366 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.366 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.366 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.366 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.366 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.366 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.366 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.366 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s api_c_read_operations 2026-02-24T19:17:59.366 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.366 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.366 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.366 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.366 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' api_c_read_operations' 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/49163/exe ']' 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/49163/exe 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:++ echo api_c_read_operations 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.367 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.368 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.369 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.369 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.369 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.369 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.369 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.369 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.369 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=api_c_read_operations 2026-02-24T19:17:59.369 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49328 2026-02-24T19:17:59.369 INFO:tasks.workunit.client.0.trial195.stdout:test api_c_read_operations on pid 49328 2026-02-24T19:17:59.370 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test api_c_read_operations on pid 49328' 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=49328 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd.xml 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_read_operations.xml 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_rados_api_cmd.log 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ api_cmd: /' 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s list_parallel 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/49214/exe ']' 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.371 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' list_parallel' 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/49214/exe 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:++ echo list_parallel 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.372 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.373 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.373 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.373 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.373 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.373 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.373 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.373 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.373 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.373 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.373 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.373 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.373 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.373 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.373 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.373 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.373 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.373 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.373 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=list_parallel 2026-02-24T19:17:59.373 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49347 2026-02-24T19:17:59.373 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.373 INFO:tasks.workunit.client.0.trial195.stdout:test list_parallel on pid 49347 2026-02-24T19:17:59.375 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test list_parallel on pid 49347' 2026-02-24T19:17:59.375 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=49347 2026-02-24T19:17:59.375 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.375 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.375 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:17:59.375 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.375 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.375 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.375 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/list_parallel.xml 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2026-02-24T19:17:59.375 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.375 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.375 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.375 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.375 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.375 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.375 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.375 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.375 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.375 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.375 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s open_pools_parallel 2026-02-24T19:17:59.375 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.375 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/49236/exe ']' 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' open_pools_parallel' 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/49236/exe 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:++ echo open_pools_parallel 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd_pp.xml 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ api_cmd_pp: /' 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.376 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=open_pools_parallel 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.377 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.378 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.378 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.378 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.378 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.378 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.378 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49369 2026-02-24T19:17:59.378 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test open_pools_parallel on pid 49369' 2026-02-24T19:17:59.378 INFO:tasks.workunit.client.0.trial195.stdout:test open_pools_parallel on pid 49369 2026-02-24T19:17:59.379 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=49369 2026-02-24T19:17:59.379 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.379 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:17:59.379 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.379 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/open_pools_parallel.xml 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2026-02-24T19:17:59.379 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.379 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s delete_pools_parallel 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service.xml 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_rados_api_service.log 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' delete_pools_parallel' 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ api_service: /' 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:++ echo delete_pools_parallel 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.380 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=delete_pools_parallel 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49397 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test delete_pools_parallel on pid 49397' 2026-02-24T19:17:59.381 INFO:tasks.workunit.client.0.trial195.stdout:test delete_pools_parallel on pid 49397 2026-02-24T19:17:59.383 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/delete_pools_parallel.xml 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2026-02-24T19:17:59.383 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=49397 2026-02-24T19:17:59.383 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:17:59.383 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.383 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s cls 2026-02-24T19:17:59.383 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' cls' 2026-02-24T19:17:59.383 INFO:tasks.workunit.client.0.trial195.stderr:++ echo cls 2026-02-24T19:17:59.383 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.383 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.383 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.383 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.383 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.383 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.383 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.383 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/49265/exe ']' 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.384 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/49265/exe 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=cls 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49431 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test cls on pid 49431' 2026-02-24T19:17:59.385 INFO:tasks.workunit.client.0.trial195.stdout:test cls on pid 49431 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=49431 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cls 2>&1 | tee ceph_test_neorados_cls.log | sed "s/^/ cls: /"' 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s cmd 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' cmd' 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:++ echo cmd 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service_pp.xml 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.388 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_rados_api_service_pp.log 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ api_service_pp: /' 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.389 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/49289/exe ']' 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/49289/exe 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=cmd 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49464 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test cmd on pid 49464' 2026-02-24T19:17:59.390 INFO:tasks.workunit.client.0.trial195.stdout:test cmd on pid 49464 2026-02-24T19:17:59.393 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=49464 2026-02-24T19:17:59.393 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:17:59.393 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cmd 2>&1 | tee ceph_test_neorados_cmd.log | sed "s/^/ cmd: /"' 2026-02-24T19:17:59.393 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.393 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.393 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.393 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.393 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.393 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.393 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s handler_error 2026-02-24T19:17:59.393 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.393 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.393 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' handler_error' 2026-02-24T19:17:59.393 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.393 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.393 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.393 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/49328/exe ']' 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:++ echo handler_error 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.394 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/49328/exe 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_write_operations.xml 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.395 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/49347/exe ']' 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ api_c_write_operations: /' 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/49347/exe 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=handler_error 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.396 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.397 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.397 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.397 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.397 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.397 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49500 2026-02-24T19:17:59.397 INFO:tasks.workunit.client.0.trial195.stdout:test handler_error on pid 49500 2026-02-24T19:17:59.399 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test handler_error on pid 49500' 2026-02-24T19:17:59.399 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=49500 2026-02-24T19:17:59.399 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:17:59.399 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_handler_error 2>&1 | tee ceph_test_neorados_handler_error.log | sed "s/^/ handler_error: /"' 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_read_operations.xml 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ api_c_read_operations: /' 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/list_parallel.xml 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s io 2026-02-24T19:17:59.400 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_rados_list_parallel.log 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ list_parallel: /' 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' io' 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/49369/exe ']' 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.401 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:++ echo io 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/49369/exe 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.402 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.403 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=io 2026-02-24T19:17:59.403 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.403 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.403 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49529 2026-02-24T19:17:59.403 INFO:tasks.workunit.client.0.trial195.stdout:test io on pid 49529 2026-02-24T19:17:59.405 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test io on pid 49529' 2026-02-24T19:17:59.405 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=49529 2026-02-24T19:17:59.405 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:17:59.405 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.405 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_io 2>&1 | tee ceph_test_neorados_io.log | sed "s/^/ io: /"' 2026-02-24T19:17:59.405 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/open_pools_parallel.xml 2026-02-24T19:17:59.405 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2026-02-24T19:17:59.405 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s ec_io 2026-02-24T19:17:59.405 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.405 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ open_pools_parallel: /' 2026-02-24T19:17:59.405 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.405 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.405 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.405 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.405 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.405 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.405 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.405 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.405 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.405 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.405 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.405 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.405 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.405 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.405 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.405 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.405 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.405 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.405 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.405 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.405 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.405 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.405 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.405 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' ec_io' 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/49397/exe ']' 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:++ echo ec_io 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/49397/exe 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.406 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=ec_io 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49555 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test ec_io on pid 49555' 2026-02-24T19:17:59.407 INFO:tasks.workunit.client.0.trial195.stdout:test ec_io on pid 49555 2026-02-24T19:17:59.410 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=49555 2026-02-24T19:17:59.410 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:17:59.410 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.410 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.410 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_io 2>&1 | tee ceph_test_neorados_ec_io.log | sed "s/^/ ec_io: /"' 2026-02-24T19:17:59.410 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.410 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.410 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.410 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.410 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.410 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.410 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.410 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.410 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.410 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.410 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.410 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.410 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.410 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s list 2026-02-24T19:17:59.410 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.410 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.410 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.410 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.410 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.410 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.410 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.410 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.410 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' list' 2026-02-24T19:17:59.410 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/delete_pools_parallel.xml 2026-02-24T19:17:59.410 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2026-02-24T19:17:59.410 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ delete_pools_parallel: /' 2026-02-24T19:17:59.410 INFO:tasks.workunit.client.0.trial195.stderr:++ echo list 2026-02-24T19:17:59.410 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/49431/exe ']' 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.411 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/49431/exe 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=list 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.412 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.413 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.413 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49575 2026-02-24T19:17:59.413 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.413 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.413 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.413 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test list on pid 49575' 2026-02-24T19:17:59.413 INFO:tasks.workunit.client.0.trial195.stdout:test list on pid 49575 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=49575 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_list 2>&1 | tee ceph_test_neorados_list.log | sed "s/^/ list: /"' 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/49464/exe ']' 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s ec_list 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' ec_list' 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/49464/exe 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:++ echo ec_list 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.415 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_neorados_cls 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_neorados_cls.log 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ cls: /' 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.416 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.417 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.417 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.417 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.417 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.417 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.417 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.417 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.417 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.417 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.417 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.417 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.417 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.417 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.417 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=ec_list 2026-02-24T19:17:59.417 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_neorados_cmd 2026-02-24T19:17:59.417 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49609 2026-02-24T19:17:59.417 INFO:tasks.workunit.client.0.trial195.stdout:test ec_list on pid 49609 2026-02-24T19:17:59.419 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test ec_list on pid 49609' 2026-02-24T19:17:59.419 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=49609 2026-02-24T19:17:59.419 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:17:59.419 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.419 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_list 2>&1 | tee ceph_test_neorados_ec_list.log | sed "s/^/ ec_list: /"' 2026-02-24T19:17:59.419 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_neorados_cmd.log 2026-02-24T19:17:59.419 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.419 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.419 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.419 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ cmd: /' 2026-02-24T19:17:59.419 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.419 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.419 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.419 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.419 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.419 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.419 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.419 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s misc 2026-02-24T19:17:59.419 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.419 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.419 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.419 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.419 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.419 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/49500/exe ']' 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' misc' 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:++ echo misc 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/49500/exe 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.420 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=misc 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49629 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test misc on pid 49629' 2026-02-24T19:17:59.421 INFO:tasks.workunit.client.0.trial195.stdout:test misc on pid 49629 2026-02-24T19:17:59.423 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.423 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=49629 2026-02-24T19:17:59.423 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.423 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.423 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:17:59.423 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.423 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.423 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_misc 2>&1 | tee ceph_test_neorados_misc.log | sed "s/^/ misc: /"' 2026-02-24T19:17:59.423 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.423 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.423 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.423 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.423 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.423 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.423 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.423 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.423 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.423 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.423 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.423 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.423 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.423 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.423 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s pool 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' pool' 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_neorados_handler_error 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_neorados_handler_error.log 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ handler_error: /' 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:++ echo pool 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.424 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.425 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.425 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.425 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.425 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.425 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.425 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.425 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.425 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.425 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.425 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.425 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.425 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.425 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.425 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.425 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.425 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.425 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.425 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.425 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.425 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.425 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.425 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.425 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.425 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=pool 2026-02-24T19:17:59.425 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.425 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.425 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.425 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.425 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49657 2026-02-24T19:17:59.425 INFO:tasks.workunit.client.0.trial195.stdout:test pool on pid 49657 2026-02-24T19:17:59.427 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test pool on pid 49657' 2026-02-24T19:17:59.427 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.427 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=49657 2026-02-24T19:17:59.427 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.427 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:17:59.427 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.427 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.427 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.427 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_pool 2>&1 | tee ceph_test_neorados_pool.log | sed "s/^/ pool: /"' 2026-02-24T19:17:59.427 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.427 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.427 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.427 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.427 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.427 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.427 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.427 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s read_operations 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' read_operations' 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/49529/exe ']' 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:++ echo read_operations 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/49529/exe 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.428 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.429 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.430 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [==========] Running 29 tests from 1 test suite. 2026-02-24T19:17:59.430 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [----------] Global test environment set-up. 2026-02-24T19:17:59.430 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [----------] 29 tests from AsioRados 2026-02-24T19:17:59.430 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.297+0000 7f556b38f880 10 monclient: get_monmap_and_config 2026-02-24T19:17:59.430 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.297+0000 7f556b38f880 10 monclient: build_initial_monmap 2026-02-24T19:17:59.430 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.297+0000 7f556b38f880 10 monclient: monmap: 2026-02-24T19:17:59.430 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: epoch 0 2026-02-24T19:17:59.430 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:59.430 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: last_changed 0.000000 2026-02-24T19:17:59.430 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: created 0.000000 2026-02-24T19:17:59.430 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: min_mon_release 0 (unknown) 2026-02-24T19:17:59.430 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: election_strategy: 1 2026-02-24T19:17:59.430 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:59.430 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:59.430 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:59.430 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.430 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.297+0000 7f556b38f880 1 Processor -- start 2026-02-24T19:17:59.430 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.297+0000 7f556b38f880 1 -- start start 2026-02-24T19:17:59.430 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.297+0000 7f556b38f880 10 monclient: init 2026-02-24T19:17:59.430 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.297+0000 7f556b38f880 10 monclient: _reopen_session rank -1 2026-02-24T19:17:59.430 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.297+0000 7f556b38f880 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:59.430 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.297+0000 7f556b38f880 10 monclient(hunting): picked mon.noname-c con 0x56539e06ac10 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:59.430 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.297+0000 7f556b38f880 10 monclient(hunting): picked mon.noname-b con 0x56539e08bb90 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:59.430 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.297+0000 7f556b38f880 10 monclient(hunting): picked mon.noname-a con 0x56539e0ad6c0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:59.430 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.297+0000 7f556b38f880 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x56539e073410 con 0x56539e0ad6c0 2026-02-24T19:17:59.430 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.297+0000 7f556b38f880 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x56539e067ff0 con 0x56539e08bb90 2026-02-24T19:17:59.430 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.297+0000 7f556b38f880 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x56539e0691d0 con 0x56539e06ac10 2026-02-24T19:17:59.430 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.297+0000 7f556b38f880 10 monclient(hunting): _renew_subs 2026-02-24T19:17:59.430 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.297+0000 7f556b38f880 10 monclient(hunting): authenticate will time out at 3647.933716s 2026-02-24T19:17:59.430 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.310+0000 7f5563fff640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x56539e08bb90 0x56539e0acf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.195:46496/0 (socket says 10.20.193.195:46496) 2026-02-24T19:17:59.430 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.310+0000 7f5563fff640 1 -- 10.20.193.195:0/594806045 learned_addr learned my addr 10.20.193.195:0/594806045 (peer_addr_for_me v1:10.20.193.195:0/0) 2026-02-24T19:17:59.430 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.323+0000 7f5562ffd640 1 -- 10.20.193.195:0/594806045 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1643241194 0 0) 0x56539e067ff0 con 0x56539e08bb90 2026-02-24T19:17:59.430 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.323+0000 7f5562ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:59.430 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.323+0000 7f5562ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:59.430 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.323+0000 7f5562ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:59.430 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.323+0000 7f5562ffd640 10 monclient(hunting): my global_id is 4666 2026-02-24T19:17:59.431 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.431 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.431 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.431 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.431 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.431 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.431 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.431 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.431 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.431 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.431 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.431 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.431 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.431 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.431 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.431 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/49555/exe ']' 2026-02-24T19:17:59.431 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/49555/exe 2026-02-24T19:17:59.431 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=read_operations 2026-02-24T19:17:59.431 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.431 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.431 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.431 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.431 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.431 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.431 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49702 2026-02-24T19:17:59.431 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.432 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.432 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.432 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.323+0000 7f5562ffd640 1 -- 10.20.193.195:0/594806045 --> v1:10.20.1test read_operations on pid 49702 2026-02-24T19:17:59.434 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.434 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test read_operations on pid 49702' 2026-02-24T19:17:59.434 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_read_operations 2>&1 | tee ceph_test_neorados_read_operations.log | sed "s/^/ read_operations: /"' 2026-02-24T19:17:59.434 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=49702 2026-02-24T19:17:59.434 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:17:59.434 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.434 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.434 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.434 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.434 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.434 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.434 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s snapshots 2026-02-24T19:17:59.434 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.434 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.434 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.434 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.434 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' snapshots' 2026-02-24T19:17:59.434 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.434 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.434 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.434 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_neorados_io 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_neorados_io.log 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:++ echo snapshots 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ io: /' 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.435 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/49575/exe ']' 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.436 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_neorados_ec_io 2026-02-24T19:17:59.437 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.437 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.437 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.437 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.437 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.437 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.437 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.437 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/49575/exe 2026-02-24T19:17:59.437 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_neorados_ec_io.log 2026-02-24T19:17:59.437 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ ec_io: /' 2026-02-24T19:17:59.437 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.437 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.437 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.437 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.437 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.437 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.437 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=snapshots 2026-02-24T19:17:59.437 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49731 2026-02-24T19:17:59.437 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test snapshots on pid 49731' 2026-02-24T19:17:59.437 INFO:tasks.workunit.client.0.trial195.stdout:test snapshots on pid 49731 2026-02-24T19:17:59.439 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=49731 2026-02-24T19:17:59.439 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_snapshots 2>&1 | tee ceph_test_neorados_snapshots.log | sed "s/^/ snapshots: /"' 2026-02-24T19:17:59.439 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.439 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:17:59.439 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.439 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s watch_notify 2026-02-24T19:17:59.439 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.439 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.439 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.439 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.439 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' watch_notify' 2026-02-24T19:17:59.439 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.439 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.439 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.439 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.439 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.439 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.439 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.439 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.439 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_neorados_list 2026-02-24T19:17:59.439 INFO:tasks.workunit.client.0.trial195.stderr:++ echo watch_notify 2026-02-24T19:17:59.439 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.439 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.439 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_neorados_list.log 2026-02-24T19:17:59.439 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.439 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.439 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.439 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.439 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ list: /' 2026-02-24T19:17:59.439 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.439 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.440 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/49609/exe ']' 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/49609/exe 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=watch_notify 2026-02-24T19:17:59.441 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49770 2026-02-24T19:17:59.442 INFO:tasks.workunit.client.0.trial195.stdout:test watch_notify on pid 49770 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test watch_notify on pid 49770' 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=49770 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_watch_notify 2>&1 | tee ceph_test_neorados_watch_notify.log | sed "s/^/ watch_notify: /"' 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:++ printf %25s write_operations 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:+ r=' write_operations' 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_neorados_ec_list 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:++ echo write_operations 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:++ awk '{print $1}' 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_neorados_ec_list.log 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.444 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ ec_list: /' 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.445 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.446 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.446 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.446 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.446 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.446 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.446 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.446 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.446 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.446 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.446 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.446 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.446 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.446 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.446 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.446 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.446 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.446 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.446 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.446 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.446 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.446 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.446 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.446 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.446 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/49629/exe ']' 2026-02-24T19:17:59.446 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.446 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.446 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.446 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.446 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.446 INFO:tasks.workunit.client.0.trial195.stderr:+ ff=write_operations 2026-02-24T19:17:59.446 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.446 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49821 2026-02-24T19:17:59.446 INFO:tasks.workunit.client.0.trial195.stderr:+ echo 'test write_operations on pid 49821' 2026-02-24T19:17:59.446 INFO:tasks.workunit.client.0.trial195.stdout:test write_operations on pid 49821 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:+ pids[$f]=49821 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_write_operations 2>&1 | tee ceph_test_neorados_write_operations.log | sed "s/^/ write_operations: /"' 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:+ ret=0 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/49629/exe 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=48852 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 48852 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:+ . /etc/bashrc 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.454 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -z '' ']' 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:++ shopt -q login_shell 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/49657/exe ']' 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:+++ umask 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/49657/exe 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.455 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:++ SHELL=/bin/bash 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_neorados_misc 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_neorados_misc.log 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ misc: /' 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.456 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_neorados_pool 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_neorados_pool.log 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ pool: /' 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.457 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/49702/exe ']' 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:+++ return 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:+++ export S_COLORS=auto 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:+++ S_COLORS=auto 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/49702/exe 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.458 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_neorados_read_operations 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_neorados_read_operations.log 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ read_operations: /' 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.459 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/49731/exe ']' 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/49731/exe 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:+++ prefix=/usr 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset prefix 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/locale 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.460 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_neorados_snapshots 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_neorados_snapshots.log 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ snapshots: /' 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/49770/exe ']' 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/49770/exe 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:+++ unset LANG_backup config 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n '' ']' 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:17:59.461 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:++ '[' '' ']' 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:+++ '[' -r /proc/49821/exe ']' 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:+++++ readlink /proc/49821/exe 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:++++ basename /usr/bin/bash 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_neorados_watch_notify 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_neorados_watch_notify.log 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ watch_notify: /' 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:+++ SHELLNAME=bash 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_declare='declare -f' 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:+++ which_opt=-f 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:+++ export which_declare 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:+++ export -f which 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:++ unset i 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:++ unset -f pathmunge 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:+ export PATH 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:+ unset rc 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:+ ceph_test_neorados_write_operations 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:+ tee ceph_test_neorados_write_operations.log 2026-02-24T19:17:59.462 INFO:tasks.workunit.client.0.trial195.stderr:+ sed 's/^/ write_operations: /' 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout:93.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5550001e10 con 0x56539e08bb90 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.333+0000 7f5562ffd640 1 -- 10.20.193.195:0/594806045 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 589436761 0 0) 0x7f5550001e10 con 0x56539e08bb90 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.333+0000 7f5562ffd640 1 -- 10.20.193.195:0/594806045 >> v1:10.20.193.170:6789/0 conn(0x56539e06ac10 legacy=0x56539e072960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.333+0000 7f5562ffd640 1 -- 10.20.193.195:0/594806045 >> v1:10.20.193.14:6789/0 conn(0x56539e0ad6c0 legacy=0x56539e0658c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.333+0000 7f5562ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.333+0000 7f5562ffd640 1 monclient: found mon.noname-b 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.333+0000 7f5562ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.333+0000 7f5562ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.44:6789/0 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.333+0000 7f5562ffd640 1 -- 10.20.193.195:0/594806045 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56539e06a3b0 con 0x56539e08bb90 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.333+0000 7f5562ffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.333+0000 7f5562ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.333+0000 7f5562ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.333+0000 7f5562ffd640 1 -- 10.20.193.195:0/594806045 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5558001750 con 0x56539e08bb90 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.333+0000 7f5562ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.333+0000 7f5562ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.333+0000 7f5562ffd640 10 monclient: dump: 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: epoch 1 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: election_strategy: 3 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.333+0000 7f556b38f880 5 monclient: authenticate success, global_id 4666 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.333+0000 7f556b38f880 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.365+0000 7f5562ffd640 1 -- 10.20.193.195:0/594806045 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f55580019d0 con 0x56539e08bb90 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.365+0000 7f5562ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.365+0000 7f5562ffd640 1 -- 10.20.193.195:0/594806045 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5558001f00 con 0x56539e08bb90 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.365+0000 7f5562ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.365+0000 7f5562ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.365+0000 7f5562ffd640 10 monclient: dump: 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: epoch 1 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: election_strategy: 3 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:59.463 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:59.464 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:59.464 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.464 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.365+0000 7f556b38f880 10 monclient: get_monmap_and_config success 2026-02-24T19:17:59.464 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.365+0000 7f556b38f880 4 set_mon_vals no callback set 2026-02-24T19:17:59.464 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.365+0000 7f556b38f880 10 monclient: shutdown 2026-02-24T19:17:59.464 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.365+0000 7f556b38f880 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:59.464 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.365+0000 7f556b38f880 1 -- 10.20.193.195:0/594806045 >> v1:10.20.193.44:6789/0 conn(0x56539e08bb90 legacy=0x56539e0acf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:59.464 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.365+0000 7f556b38f880 1 -- 10.20.193.195:0/594806045 shutdown_connections 2026-02-24T19:17:59.464 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.365+0000 7f556b38f880 1 -- 10.20.193.195:0/594806045 >> 10.20.193.195:0/594806045 conn(0x56539dfbaa70 msgr2=0x56539e0cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:59.464 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.365+0000 7f556b38f880 1 -- 10.20.193.195:0/594806045 shutdown_connections 2026-02-24T19:17:59.464 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.365+0000 7f556b38f880 1 -- 10.20.193.195:0/594806045 wait complete. 2026-02-24T19:17:59.464 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.366+0000 7f556b38f880 10 monclient: build_initial_monmap 2026-02-24T19:17:59.464 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.366+0000 7f556b38f880 10 monclient: monmap: 2026-02-24T19:17:59.464 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: epoch 0 2026-02-24T19:17:59.464 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:59.464 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: last_changed 0.000000 2026-02-24T19:17:59.464 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: created 0.000000 2026-02-24T19:17:59.464 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: min_mon_release 0 (unknown) 2026-02-24T19:17:59.464 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: election_strategy: 1 2026-02-24T19:17:59.464 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:17:59.464 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:17:59.464 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:17:59.464 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.464 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.366+0000 7f556b38f880 1 librados: starting msgr at 2026-02-24T19:17:59.464 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.366+0000 7f556b38f880 1 librados: starting objecter 2026-02-24T19:17:59.464 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.366+0000 7f556b38f880 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:59.464 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.366+0000 7f556b38f880 1 Processor -- start 2026-02-24T19:17:59.464 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.366+0000 7f556b38f880 1 -- start start 2026-02-24T19:17:59.464 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.366+0000 7f556b38f880 1 librados: setting wanted keys 2026-02-24T19:17:59.464 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.366+0000 7f556b38f880 1 librados: calling monclient init 2026-02-24T19:17:59.464 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.366+0000 7f556b38f880 10 monclient: init 2026-02-24T19:17:59.464 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.366+0000 7f556b38f880 10 monclient: _reopen_session rank -1 2026-02-24T19:17:59.464 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.366+0000 7f556b38f880 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:59.464 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.366+0000 7f556b38f880 10 monclient(hunting): picked mon.noname-b con 0x56539e06ac10 addr v1:10.20.193.44:6789/0 2026-02-24T19:17:59.464 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.366+0000 7f556b38f880 10 monclient(hunting): picked mon.noname-c con 0x56539e08bb90 addr v1:10.20.193.170:6789/0 2026-02-24T19:17:59.464 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.366+0000 7f556b38f880 10 monclient(hunting): picked mon.noname-a con 0x56539e0ad6c0 addr v1:10.20.193.14:6789/0 2026-02-24T19:17:59.472 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.366+0000 7f556b38f880 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x56539e078820 con 0x56539e0ad6c0 2026-02-24T19:17:59.472 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.366+0000 7f556b38f880 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x56539e07ace0 con 0x56539e06ac10 2026-02-24T19:17:59.472 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.366+0000 7f556b38f880 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x56539e07bec0 con 0x56539e08bb90 2026-02-24T19:17:59.472 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.366+0000 7f556b38f880 10 monclient(hunting): _renew_subs 2026-02-24T19:17:59.472 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.366+0000 7f556b38f880 10 monclient(hunting): authenticate will time out at 3648.002402s 2026-02-24T19:17:59.472 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.401+0000 7f5568e45640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x56539e06ac10 0x56539e077d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.195:46870/0 (socket says 10.20.193.195:46870) 2026-02-24T19:17:59.472 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.401+0000 7f5568e45640 1 -- 10.20.193.195:0/3789380477 learned_addr learned my addr 10.20.193.195:0/3789380477 (peer_addr_for_me v1:10.20.193.195:0/0) 2026-02-24T19:17:59.472 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.403+0000 7f5561ffb640 10 client.?.objecter ms_handle_connect 0x56539e06ac10 2026-02-24T19:17:59.472 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.403+0000 7f5561ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:59.472 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.404+0000 7f5561ffb640 10 client.?.objecter ms_handle_connect 0x56539e08bb90 2026-02-24T19:17:59.472 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.404+0000 7f5561ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:59.472 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.431+0000 7f5561ffb640 1 -- 10.20.193.195:0/3789380477 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1469110718 0 0) 0x56539e07bec0 con 0x56539e08bb90 2026-02-24T19:17:59.472 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.431+0000 7f5561ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:59.472 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.431+0000 7f5561ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:59.472 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.431+0000 7f5561ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:59.472 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.431+0000 7f5561ffb640 10 monclient(hunting): my global_id is 4796 2026-02-24T19:17:59.472 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.431+0000 7f5561ffb640 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5550001df0 con 0x56539e08bb90 2026-02-24T19:17:59.472 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.434+0000 7f5561ffb640 10 client.?.objecter ms_handle_connect 0x56539e0ad6c0 2026-02-24T19:17:59.472 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.434+0000 7f5561ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:59.472 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.439+0000 7f5561ffb640 1 -- 10.20.193.195:0/3789380477 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 124228390 0 0) 0x56539e07ace0 con 0x56539e06ac10 2026-02-24T19:17:59.472 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.439+0000 7f5561ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:59.472 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.439+0000 7f5561ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:59.472 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.439+0000 7f5561ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:59.472 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.439+0000 7f5561ffb640 10 monclient(hunting): my global_id is 4777 2026-02-24T19:17:59.472 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.439+0000 7f5561ffb640 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x56539e07bec0 con 0x56539e06ac10 2026-02-24T19:17:59.472 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.470+0000 7f5561ffb640 1 -- 10.20.193.195:0/3789380477 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4057491294 0 0) 0x56539e078820 con 0x56539e0ad6c0 2026-02-24T19:17:59.472 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.470+0000 7f5561ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:59.472 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.470+0000 7f5561ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:59.536 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.470+0000 7f5561ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:59.536 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.470+0000 7f5561ffb640 10 monclient(hunting): my global_id is 4809 2026-02-24T19:17:59.536 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.470+0000 7f5561ffb640 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x56539e07ace0 con 0x56539e0ad6c0 2026-02-24T19:17:59.536 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.482+0000 7f5561ffb640 1 -- 10.20.193.195:0/3789380477 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1950702138 0 0) 0x7f5550001df0 con 0x56539e08bb90 2026-02-24T19:17:59.536 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.482+0000 7f5561ffb640 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x56539e078820 con 0x56539e08bb90 2026-02-24T19:17:59.536 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.482+0000 7f5561ffb640 1 -- 10.20.193.195:0/3789380477 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5558001a80 con 0x56539e08bb90 2026-02-24T19:17:59.536 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.482+0000 7f5561ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:59.536 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.482+0000 7f5561ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:59.536 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.482+0000 7f5561ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:59.536 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: epoch 1 2026-02-24T19:17:59.536 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:59.536 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:59.536 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:59.536 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-24T19:17:59.536 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: election_strategy: 3 2026-02-24T19:17:59.536 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:59.536 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:59.536 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:59.536 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.536 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.482+0000 7f5561ffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:59.536 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.495+0000 7f5561ffb640 1 -- 10.20.193.195:0/3789380477 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3215995544 0 0) 0x56539e07bec0 con 0x56539e06ac10 2026-02-24T19:17:59.536 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.495+0000 7f5561ffb640 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5550001df0 con 0x56539e06ac10 2026-02-24T19:17:59.536 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.495+0000 7f5561ffb640 1 -- 10.20.193.195:0/3789380477 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5554001cd0 con 0x56539e06ac10 2026-02-24T19:17:59.536 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.495+0000 7f5561ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:59.536 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.495+0000 7f5561ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:59.536 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.495+0000 7f5561ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:59.536 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: epoch 1 2026-02-24T19:17:59.536 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:59.536 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:59.536 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:59.536 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-24T19:17:59.536 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: election_strategy: 3 2026-02-24T19:17:59.536 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:59.536 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:59.536 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:59.536 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.537 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.534+0000 7f5561ffb640 1 -- 10.20.193.195:0/3789380477 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2612041361 0 0) 0x56539e07ace0 con 0x56539e0ad6c0 2026-02-24T19:17:59.540 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.534+0000 7f5561ffb640 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x56539e07bec0 con 0x56539e0ad6c0 2026-02-24T19:17:59.540 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.534+0000 7f5561ffb640 1 -- 10.20.193.195:0/3789380477 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f555c001830 con 0x56539e0ad6c0 2026-02-24T19:17:59.540 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.534+0000 7f5561ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:59.540 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.534+0000 7f5561ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:59.540 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.534+0000 7f5561ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:59.540 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: epoch 1 2026-02-24T19:17:59.540 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:59.540 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:59.540 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:59.540 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-24T19:17:59.540 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: election_strategy: 3 2026-02-24T19:17:59.540 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:59.540 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:59.540 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:59.540 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.541 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.538+0000 7f5561ffb640 1 -- 10.20.193.195:0/3789380477 <== mon.1 v1:10.20.193.44:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4070743618 0 0) 0x7f5550001df0 con 0x56539e06ac10 2026-02-24T19:17:59.541 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.538+0000 7f5561ffb640 1 -- 10.20.193.195:0/3789380477 >> v1:10.20.193.170:6789/0 conn(0x56539e08bb90 legacy=0x56539e0abf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:59.541 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.538+0000 7f5561ffb640 1 -- 10.20.193.195:0/3789380477 >> v1:10.20.193.14:6789/0 conn(0x56539e0ad6c0 legacy=0x56539e0648b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:59.541 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.538+0000 7f5561ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:59.541 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.538+0000 7f5561ffb640 1 monclient: found mon.b 2026-02-24T19:17:59.541 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.538+0000 7f5561ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:59.541 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.538+0000 7f5561ffb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:59.541 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.538+0000 7f5561ffb640 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56539e07d140 con 0x56539e06ac10 2026-02-24T19:17:59.541 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.538+0000 7f5561ffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:59.541 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.538+0000 7f5561ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:59.541 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.538+0000 7f5561ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:59.541 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.538+0000 7f556b38f880 5 monclient: authenticate success, global_id 4777 2026-02-24T19:17:59.541 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.538+0000 7f556b38f880 10 monclient: _renew_subs 2026-02-24T19:17:59.541 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.538+0000 7f556b38f880 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:59.541 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.538+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.44:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x56539e07c0f0 con 0x56539e06ac10 2026-02-24T19:17:59.541 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.538+0000 7f556b38f880 10 client.4777.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:59.541 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.538+0000 7f556b38f880 10 monclient: _renew_subs 2026-02-24T19:17:59.541 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.538+0000 7f556b38f880 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:59.541 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.538+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.44:6789/0 -- mon_subscribe({osdmap=0}) -- 0x56539e07c5c0 con 0x56539e06ac10 2026-02-24T19:17:59.663 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.538+0000 7f556b38f880 1 librados: init done 2026-02-24T19:17:59.663 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.538+0000 7f556b38f880 10 librados: wait_for_osdmap waiting 2026-02-24T19:17:59.663 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.596+0000 7f5561ffb640 1 -- 10.20.193.195:0/3789380477 <== mon.1 v1:10.20.193.44:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5554002320 con 0x56539e06ac10 2026-02-24T19:17:59.663 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.596+0000 7f5561ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:59.663 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.596+0000 7f5561ffb640 1 -- 10.20.193.195:0/3789380477 <== mon.1 v1:10.20.193.44:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f55540026f0 con 0x56539e06ac10 2026-02-24T19:17:59.663 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.596+0000 7f5561ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:59.664 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.596+0000 7f5561ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:59.664 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.596+0000 7f5561ffb640 10 monclient: dump: 2026-02-24T19:17:59.664 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: epoch 1 2026-02-24T19:17:59.664 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:17:59.664 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:59.664 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:17:59.664 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-24T19:17:59.664 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: election_strategy: 3 2026-02-24T19:17:59.664 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:17:59.664 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:17:59.664 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:17:59.664 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.664 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.596+0000 7f55627fc640 4 set_mon_vals no callback set 2026-02-24T19:17:59.665 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.596+0000 7f5561ffb640 1 -- 10.20.193.195:0/3789380477 <== mon.1 v1:10.20.193.44:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f55540028c0 con 0x56539e06ac10 2026-02-24T19:17:59.665 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.597+0000 7f5563fff640 10 monclient: get_auth_request con 0x7f5550076a50 auth_method 0 2026-02-24T19:17:59.665 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.597+0000 7f5561ffb640 10 client.4777.objecter ms_handle_connect 0x7f5550076a50 2026-02-24T19:17:59.665 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.599+0000 7f5561ffb640 1 -- 10.20.193.195:0/3789380477 <== mon.1 v1:10.20.193.44:6789/0 8 ==== osd_map(32..32 src has 1..32) ==== 8141+0+0 (unknown 3407568767 0 0) 0x7f5554091d50 con 0x56539e06ac10 2026-02-24T19:17:59.665 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.599+0000 7f5561ffb640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_map(32..32 src has 1..32) 2026-02-24T19:17:59.665 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.599+0000 7f5561ffb640 3 client.4777.objecter handle_osd_map got epochs [32,32] > 0 2026-02-24T19:17:59.665 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.599+0000 7f5561ffb640 3 client.4777.objecter handle_osd_map decoding full epoch 32 2026-02-24T19:17:59.665 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.599+0000 7f5561ffb640 20 client.4777.objecter dump_active .. 0 homeless 2026-02-24T19:17:59.665 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.599+0000 7f556b38f880 10 librados: wait_for_osdmap done waiting 2026-02-24T19:17:59.665 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.599+0000 7f556b38f880 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:17:59.665 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.599+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.44:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x56539df68da0 con 0x56539e06ac10 2026-02-24T19:17:59.665 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.661+0000 7f5561ffb640 1 -- 10.20.193.195:0/3789380477 <== mon.1 v1:10.20.193.44:6789/0 9 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (unknown 3745509079 0 0) 0x7f555405be50 con 0x56539e06ac10 2026-02-24T19:17:59.665 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.661+0000 7f5561ffb640 10 monclient: handle_get_version_reply finishing 1 version 32 2026-02-24T19:17:59.665 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.661+0000 7f5562ffd640 10 client.4777.objecter _get_latest_version latest 32, have it 2026-02-24T19:17:59.665 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.661+0000 7f556b38f880 10 client.4777.objecter create_pool name=ceph_test_rados_api_asio 2026-02-24T19:18:01.356 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.661+0000 7f556b38f880 10 client.4777.objecter pool_op_submit 1 2026-02-24T19:18:01.356 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.661+0000 7f556b38f880 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:18:01.357 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:17:59.661+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.44:6789/0 -- pool_op(create pool 0 tid 1 name ceph_test_rados_api_asio v0) -- 0x56539deed570 con 0x56539e06ac10 2026-02-24T19:18:01.357 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:01.337+0000 7f5561ffb640 1 -- 10.20.193.195:0/3789380477 <== mon.1 v1:10.20.193.44:6789/0 10 ==== pool_op_reply(tid 1 (0) Success v34) ==== 43+0+0 (unknown 1093445169 0 0) 0x7f555405c780 con 0x56539e06ac10 2026-02-24T19:18:01.357 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:01.337+0000 7f5561ffb640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 pool_op_reply(tid 1 (0) Success v34) 2026-02-24T19:18:01.357 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:01.337+0000 7f5561ffb640 10 client.4777.objecter handle_pool_op_reply pool_op_reply(tid 1 (0) Success v34) 2026-02-24T19:18:01.357 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:01.337+0000 7f5561ffb640 10 client.4777.objecter have request 1 at 0x56539e074590 Op: create 2026-02-24T19:18:01.357 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:01.337+0000 7f5561ffb640 20 client.4777.objecter waiting for client to reach epoch 34 before calling back 2026-02-24T19:18:01.357 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:01.337+0000 7f5561ffb640 10 client.4777.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:01.357 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:01.337+0000 7f5561ffb640 10 monclient: _renew_subs 2026-02-24T19:18:01.357 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:01.337+0000 7f5561ffb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:18:01.357 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:01.337+0000 7f5561ffb640 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.44:6789/0 -- mon_subscribe({osdmap=33}) -- 0x7f5550001df0 con 0x56539e06ac10 2026-02-24T19:18:01.357 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:01.337+0000 7f5561ffb640 10 client.4777.objecter done 2026-02-24T19:18:01.357 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:01.354+0000 7f5561ffb640 1 -- 10.20.193.195:0/3789380477 <== mon.1 v1:10.20.193.44:6789/0 11 ==== osd_map(33..34 src has 1..34) ==== 21607+0+0 (unknown 2101084338 0 0) 0x7f5554058010 con 0x56539e06ac10 2026-02-24T19:18:01.357 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:01.354+0000 7f5561ffb640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_map(33..34 src has 1..34) 2026-02-24T19:18:01.358 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:01.354+0000 7f5561ffb640 3 client.4777.objecter handle_osd_map got epochs [33,34] > 32 2026-02-24T19:18:01.358 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:01.354+0000 7f5561ffb640 3 client.4777.objecter handle_osd_map decoding incremental epoch 33 2026-02-24T19:18:01.358 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:01.354+0000 7f5561ffb640 3 client.4777.objecter handle_osd_map decoding incremental epoch 34 2026-02-24T19:18:01.358 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:01.354+0000 7f5561ffb640 20 client.4777.objecter dump_active .. 0 homeless 2026-02-24T19:18:01.358 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:01.354+0000 7f556b38f880 10 librados: set snap read head -> 1 2026-02-24T19:18:01.358 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:01.354+0000 7f556b38f880 10 librados: writefull oid=exist nspace= 2026-02-24T19:18:01.358 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:01.354+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e07c900 2026-02-24T19:18:01.358 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:01.354+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 34 base exist @28 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:01.358 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:01.354+0000 7f556b38f880 20 client.4777.objecter _calc_target target exist @28 -> pgid 28.d3a59201 2026-02-24T19:18:01.358 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:01.354+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.d3a59201 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:01.358 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:01.354+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:01.358 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:01.354+0000 7f556b38f880 10 client.4777.objecter _op_submit oid exist '@28' '@28' [writefull 0~5 in=5b] tid 2 osd.12 2026-02-24T19:18:04.667 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:01.354+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:04.667 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:01.354+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 12 2 2026-02-24T19:18:04.667 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:01.354+0000 7f556b38f880 15 client.4777.objecter _send_op 2 to 28.1 on osd.12 2026-02-24T19:18:04.667 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:01.354+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6801/1483397197 -- osd_op(unknown.0.0:2 28.1 28:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56539e07b7d0 con 0x56539e07b3c0 2026-02-24T19:18:04.667 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:01.354+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.667 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:01.354+0000 7f556b38f880 5 client.4777.objecter 1 in flight 2026-02-24T19:18:04.667 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:01.355+0000 7f5569646640 10 monclient: get_auth_request con 0x56539e07b3c0 auth_method 0 2026-02-24T19:18:04.668 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:01.356+0000 7f5561ffb640 10 client.4777.objecter ms_handle_connect 0x56539e07b3c0 2026-02-24T19:18:04.668 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:02.366+0000 7f5560ff9640 10 monclient: tick 2026-02-24T19:18:04.668 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:02.366+0000 7f5560ff9640 10 monclient: _check_auth_tickets 2026-02-24T19:18:04.668 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:02.366+0000 7f5560ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:04.668 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:02.366+0000 7f5560ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:04.668 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:03.366+0000 7f5560ff9640 10 monclient: tick 2026-02-24T19:18:04.668 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:03.366+0000 7f5560ff9640 10 monclient: _check_auth_tickets 2026-02-24T19:18:04.668 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:03.366+0000 7f5560ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:04.668 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.366+0000 7f5560ff9640 10 monclient: tick 2026-02-24T19:18:04.668 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.366+0000 7f5560ff9640 10 monclient: _check_auth_tickets 2026-02-24T19:18:04.668 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.366+0000 7f5560ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:04.668 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.539+0000 7f556b0d0640 10 client.4777.objecter tick 2026-02-24T19:18:04.669 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.539+0000 7f556b0d0640 20 client.4777.objecter tick: elapsed since last osdmap request 3.20191s, stale_window 10s, epoch 35, monc->get_start(osdmap) 0 2026-02-24T19:18:04.669 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.664+0000 7f5561ffb640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 1 ==== osd_map(35..36 src has 1..36) ==== 8835+0+0 (unknown 3539959628 0 0) 0x7f555c001be0 con 0x56539e07b3c0 2026-02-24T19:18:04.669 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.664+0000 7f5561ffb640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_map(35..36 src has 1..36) 2026-02-24T19:18:04.669 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.664+0000 7f5561ffb640 3 client.4777.objecter handle_osd_map got epochs [35,36] > 34 2026-02-24T19:18:04.669 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.664+0000 7f5561ffb640 3 client.4777.objecter handle_osd_map decoding incremental epoch 35 2026-02-24T19:18:04.669 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.664+0000 7f5561ffb640 10 client.4777.objecter checking op 2 2026-02-24T19:18:04.669 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.664+0000 7f5561ffb640 20 client.4777.objecter _calc_target epoch 35 base exist @28 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:04.669 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.664+0000 7f5561ffb640 20 client.4777.objecter _calc_target target exist @28 -> pgid 28.d3a59201 2026-02-24T19:18:04.669 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.664+0000 7f5561ffb640 3 client.4777.objecter handle_osd_map decoding incremental epoch 36 2026-02-24T19:18:04.669 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.664+0000 7f5561ffb640 10 client.4777.objecter checking op 2 2026-02-24T19:18:04.669 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.664+0000 7f5561ffb640 20 client.4777.objecter _calc_target epoch 36 base exist @28 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:04.761 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.664+0000 7f5561ffb640 20 client.4777.objecter _calc_target target exist @28 -> pgid 28.d3a59201 2026-02-24T19:18:04.761 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.664+0000 7f5561ffb640 20 client.4777.objecter dump_active .. 0 homeless 2026-02-24T19:18:04.761 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.664+0000 7f5561ffb640 20 client.4777.objecter 2 28.d3a59201 osd.12 exist [writefull 0~5 in=5b] 2026-02-24T19:18:04.761 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.758+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 2 ==== osd_op_reply(2 exist [writefull 0~5] v36'1 uv1 ondisk = 0) ==== 149+0+0 (unknown 695977104 0 0) 0x7f555c0040e0 con 0x56539e07b3c0 2026-02-24T19:18:04.761 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.759+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(2 exist [writefull 0~5] v36'1 uv1 ondisk = 0) 2026-02-24T19:18:04.762 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.759+0000 7f5569646640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:04.762 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.759+0000 7f5569646640 7 client.4777.objecter handle_osd_op_reply 2 ondisk uv 1 in 28.1 attempt 0 2026-02-24T19:18:04.762 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.759+0000 7f5569646640 10 client.4777.objecter op 0 rval 0 len 0 2026-02-24T19:18:04.762 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.759+0000 7f5569646640 15 client.4777.objecter handle_osd_op_reply completed tid 2 2026-02-24T19:18:04.762 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.759+0000 7f5569646640 15 client.4777.objecter _finish_op 2 2026-02-24T19:18:04.762 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2026-02-24T19:18:04.762 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.759+0000 7f5569646640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.762 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.759+0000 7f5569646640 15 client.4777.objecter _session_op_remove 12 2 2026-02-24T19:18:04.762 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.759+0000 7f5569646640 5 client.4777.objecter 0 in flight 2026-02-24T19:18:04.762 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.759+0000 7f556b38f880 10 librados: Objecter returned from writefull r=0 2026-02-24T19:18:04.762 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.759+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e07c7e0 2026-02-24T19:18:04.762 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.759+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base exist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:04.763 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.759+0000 7f556b38f880 20 client.4777.objecter _calc_target target exist @28 -> pgid 28.d3a59201 2026-02-24T19:18:04.763 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.759+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.d3a59201 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:04.763 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.759+0000 7f556b38f880 10 client.4777.objecter chose random osd.4 of [12,4] 2026-02-24T19:18:04.763 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.759+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07bc40 osd=4 3 2026-02-24T19:18:04.763 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.759+0000 7f556b38f880 10 client.4777.objecter _op_submit oid exist '@28' '@28' [read 0~256] tid 3 osd.4 2026-02-24T19:18:04.763 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.759+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07bc40 osd=4 3 2026-02-24T19:18:04.763 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.759+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 4 3 2026-02-24T19:18:04.763 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.759+0000 7f556b38f880 15 client.4777.objecter _send_op 3 to 28.1 on osd.4 2026-02-24T19:18:04.763 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.759+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6805/4020872388 -- osd_op(unknown.0.0:3 28.1 28:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e36) -- 0x56539e066940 con 0x56539e0664e0 2026-02-24T19:18:04.763 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.759+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07bc40 osd=4 4 2026-02-24T19:18:04.763 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.759+0000 7f556b38f880 5 client.4777.objecter 1 in flight 2026-02-24T19:18:04.763 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.759+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e080150 2026-02-24T19:18:04.769 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.759+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base noexist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:04.769 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.759+0000 7f556b38f880 20 client.4777.objecter _calc_target target noexist @28 -> pgid 28.a7bbaa1 2026-02-24T19:18:04.770 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.759+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.a7bbaa1 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:04.770 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.759+0000 7f556b38f880 10 client.4777.objecter chose random osd.4 of [12,4] 2026-02-24T19:18:04.770 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.759+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07bc40 osd=4 4 2026-02-24T19:18:04.770 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.759+0000 7f556b38f880 10 client.4777.objecter _op_submit oid noexist '@28' '@28' [read 0~256] tid 4 osd.4 2026-02-24T19:18:04.770 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.759+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07bc40 osd=4 4 2026-02-24T19:18:04.770 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.759+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 4 4 2026-02-24T19:18:04.770 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.759+0000 7f556b38f880 15 client.4777.objecter _send_op 4 to 28.1 on osd.4 2026-02-24T19:18:04.770 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.759+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6805/4020872388 -- osd_op(unknown.0.0:4 28.1 28:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e36) -- 0x56539e080600 con 0x56539e0664e0 2026-02-24T19:18:04.770 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.759+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07bc40 osd=4 5 2026-02-24T19:18:04.770 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.759+0000 7f556b38f880 5 client.4777.objecter 2 in flight 2026-02-24T19:18:04.770 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.759+0000 7f5568e45640 10 monclient: get_auth_request con 0x56539e0664e0 auth_method 0 2026-02-24T19:18:04.771 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.760+0000 7f5561ffb640 10 client.4777.objecter ms_handle_connect 0x56539e0664e0 2026-02-24T19:18:04.771 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.767+0000 7f5568e45640 1 -- 10.20.193.195:0/3789380477 <== osd.4 v1:10.20.193.14:6805/4020872388 1 ==== osd_op_reply(3 exist [read 0~256] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) ==== 149+0+0 (unknown 2051528934 0 0) 0x7f555405da20 con 0x56539e0664e0 2026-02-24T19:18:04.771 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.767+0000 7f5568e45640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(3 exist [read 0~256] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) 2026-02-24T19:18:04.771 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.767+0000 7f5568e45640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:04.771 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.767+0000 7f5568e45640 7 client.4777.objecter handle_osd_op_reply 3 ondisk uv 0 in 28.1 attempt 0 2026-02-24T19:18:04.771 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.767+0000 7f5568e45640 7 client.4777.objecter got -EAGAIN, resubmitting 2026-02-24T19:18:04.771 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.767+0000 7f5568e45640 20 client.4777.objecter put_session s=0x56539e07bc40 osd=4 5 2026-02-24T19:18:04.771 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.767+0000 7f5568e45640 15 client.4777.objecter _session_op_remove 4 3 2026-02-24T19:18:04.771 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.767+0000 7f5568e45640 10 client.4777.objecter _op_submit op 0x56539e07c7e0 2026-02-24T19:18:04.771 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.767+0000 7f5568e45640 20 client.4777.objecter _calc_target epoch 36 base exist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:04.771 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.767+0000 7f5568e45640 20 client.4777.objecter _calc_target target exist @28 -> pgid 28.d3a59201 2026-02-24T19:18:04.771 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.767+0000 7f5568e45640 10 client.4777.objecter _calc_target raw pgid 28.d3a59201 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:04.771 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.767+0000 7f5568e45640 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:04.771 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.767+0000 7f5568e45640 10 client.4777.objecter _op_submit oid exist '@28' '@28' [read 0~256] tid 5 osd.12 2026-02-24T19:18:04.785 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.767+0000 7f5568e45640 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:04.785 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.767+0000 7f5568e45640 15 client.4777.objecter _session_op_assign 12 5 2026-02-24T19:18:04.785 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.767+0000 7f5568e45640 15 client.4777.objecter _send_op 5 to 28.1 on osd.12 2026-02-24T19:18:04.785 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.767+0000 7f5568e45640 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6801/1483397197 -- osd_op(unknown.0.0:5 28.1 28:8049a5cb:::exist:head [read 0~256] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e36) -- 0x56539e080600 con 0x56539e07b3c0 2026-02-24T19:18:04.785 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.767+0000 7f5568e45640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.785 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.767+0000 7f5568e45640 5 client.4777.objecter 2 in flight 2026-02-24T19:18:04.785 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.767+0000 7f5568e45640 1 -- 10.20.193.195:0/3789380477 <== osd.4 v1:10.20.193.14:6805/4020872388 2 ==== osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3072404560 0 0) 0x7f555405da20 con 0x56539e0664e0 2026-02-24T19:18:04.785 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.767+0000 7f5568e45640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:04.785 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.767+0000 7f5568e45640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:04.786 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.767+0000 7f5568e45640 7 client.4777.objecter handle_osd_op_reply 4 ondisk uv 0 in 28.1 attempt 0 2026-02-24T19:18:04.786 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.767+0000 7f5568e45640 10 client.4777.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:04.786 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.767+0000 7f5568e45640 10 client.4777.objecter op 0 rval 0 len 0 2026-02-24T19:18:04.786 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.767+0000 7f5568e45640 15 client.4777.objecter handle_osd_op_reply completed tid 4 2026-02-24T19:18:04.786 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.767+0000 7f5568e45640 15 client.4777.objecter _finish_op 4 2026-02-24T19:18:04.786 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.767+0000 7f5568e45640 20 client.4777.objecter put_session s=0x56539e07bc40 osd=4 4 2026-02-24T19:18:04.786 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.767+0000 7f5568e45640 15 client.4777.objecter _session_op_remove 4 4 2026-02-24T19:18:04.786 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.767+0000 7f5568e45640 5 client.4777.objecter 1 in flight 2026-02-24T19:18:04.786 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.782+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 3 ==== osd_op_reply(5 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 2485628864 0 3741568377) 0x7f555c0040e0 con 0x56539e07b3c0 2026-02-24T19:18:04.786 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.782+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(5 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-24T19:18:04.786 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.782+0000 7f5569646640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:04.786 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.782+0000 7f5569646640 7 client.4777.objecter handle_osd_op_reply 5 ondisk uv 1 in 28.1 attempt 1 2026-02-24T19:18:04.787 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.782+0000 7f5569646640 10 client.4777.objecter op 0 rval 0 len 5 2026-02-24T19:18:04.787 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.782+0000 7f5569646640 15 client.4777.objecter handle_osd_op_reply completed tid 5 2026-02-24T19:18:04.787 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.782+0000 7f5569646640 15 client.4777.objecter _finish_op 5 2026-02-24T19:18:04.787 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.782+0000 7f5569646640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.787 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.782+0000 7f5569646640 15 client.4777.objecter _session_op_remove 12 5 2026-02-24T19:18:04.787 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.782+0000 7f5569646640 5 client.4777.objecter 0 in flight 2026-02-24T19:18:04.787 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (23 ms) 2026-02-24T19:18:04.787 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ RUN ] AsioRados.AsyncReadDeferred 2026-02-24T19:18:04.788 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.783+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e080150 2026-02-24T19:18:04.788 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.783+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base exist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:04.788 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.783+0000 7f556b38f880 20 client.4777.objecter _calc_target target exist @28 -> pgid 28.d3a59201 2026-02-24T19:18:04.788 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.783+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.d3a59201 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:04.788 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.783+0000 7f556b38f880 10 client.4777.objecter chose random osd.12 of [12,4] 2026-02-24T19:18:04.788 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.783+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:04.788 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.783+0000 7f556b38f880 10 client.4777.objecter _op_submit oid exist '@28' '@28' [read 0~256] tid 6 osd.12 2026-02-24T19:18:04.788 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.783+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:04.788 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.783+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 12 6 2026-02-24T19:18:04.788 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.783+0000 7f556b38f880 15 client.4777.objecter _send_op 6 to 28.1 on osd.12 2026-02-24T19:18:04.788 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.783+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6801/1483397197 -- osd_op(unknown.0.0:6 28.1 28:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e36) -- 0x56539e07c7e0 con 0x56539e07b3c0 2026-02-24T19:18:04.788 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.783+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.789 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.783+0000 7f556b38f880 5 client.4777.objecter 1 in flight 2026-02-24T19:18:04.789 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.783+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e080a80 2026-02-24T19:18:04.789 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.783+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base noexist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:04.789 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.783+0000 7f556b38f880 20 client.4777.objecter _calc_target target noexist @28 -> pgid 28.a7bbaa1 2026-02-24T19:18:04.789 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.783+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.a7bbaa1 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:04.789 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.783+0000 7f556b38f880 10 client.4777.objecter chose random osd.4 of [12,4] 2026-02-24T19:18:04.789 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.783+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07bc40 osd=4 3 2026-02-24T19:18:04.789 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.783+0000 7f556b38f880 10 client.4777.objecter _op_submit oid noexist '@28' '@28' [read 0~256] tid 7 osd.4 2026-02-24T19:18:04.789 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.783+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07bc40 osd=4 3 2026-02-24T19:18:04.789 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.783+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 4 7 2026-02-24T19:18:04.789 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.783+0000 7f556b38f880 15 client.4777.objecter _send_op 7 to 28.1 on osd.4 2026-02-24T19:18:04.789 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.783+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6805/4020872388 -- osd_op(unknown.0.0:7 28.1 28:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e36) -- 0x56539e080f30 con 0x56539e0664e0 2026-02-24T19:18:04.789 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.783+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07bc40 osd=4 4 2026-02-24T19:18:04.790 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.783+0000 7f556b38f880 5 client.4777.objecter 2 in flight 2026-02-24T19:18:04.790 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.785+0000 7f5568e45640 1 -- 10.20.193.195:0/3789380477 <== osd.4 v1:10.20.193.14:6805/4020872388 3 ==== osd_op_reply(7 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3072404560 0 0) 0x7f555405da20 con 0x56539e0664e0 2026-02-24T19:18:04.790 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.785+0000 7f5568e45640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(7 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:04.790 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.785+0000 7f5568e45640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:04.790 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.785+0000 7f5568e45640 7 client.4777.objecter handle_osd_op_reply 7 ondisk uv 0 in 28.1 attempt 0 2026-02-24T19:18:04.790 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.785+0000 7f5568e45640 10 client.4777.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:04.791 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.785+0000 7f5568e45640 10 client.4777.objecter op 0 rval 0 len 0 2026-02-24T19:18:04.791 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.785+0000 7f5568e45640 15 client.4777.objecter handle_osd_op_reply completed tid 7 2026-02-24T19:18:04.791 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.785+0000 7f5568e45640 15 client.4777.objecter _finish_op 7 2026-02-24T19:18:04.791 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.785+0000 7f5568e45640 20 client.4777.objecter put_session s=0x56539e07bc40 osd=4 4 2026-02-24T19:18:04.791 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.785+0000 7f5568e45640 15 client.4777.objecter _session_op_remove 4 7 2026-02-24T19:18:04.791 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.785+0000 7f5568e45640 5 client.4777.objecter 1 in flight 2026-02-24T19:18:04.791 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.788+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 4 ==== osd_op_reply(6 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 553310345 0 3741568377) 0x7f555c0040e0 con 0x56539e07b3c0 2026-02-24T19:18:04.791 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.788+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(6 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-24T19:18:04.791 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.788+0000 7f5569646640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:04.791 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.788+0000 7f5569646640 7 client.4777.objecter handle_osd_op_reply 6 ondisk uv 1 in 28.1 attempt 0 2026-02-24T19:18:04.791 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.788+0000 7f5569646640 10 client.4777.objecter op 0 rval 0 len 5 2026-02-24T19:18:04.791 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.788+0000 7f5569646640 15 client.4777.objecter handle_osd_op_reply completed tid 6 2026-02-24T19:18:04.792 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.788+0000 7f5569646640 15 client.4777.objecter _finish_op 6 2026-02-24T19:18:04.792 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.788+0000 7f5569646640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.792 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.788+0000 7f5569646640 15 client.4777.objecter _session_op_remove 12 6 2026-02-24T19:18:04.792 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.788+0000 7f5569646640 5 client.4777.objecter 0 in flight 2026-02-24T19:18:04.792 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ OK ] AsioRados.AsyncReadDeferred (5 ms) 2026-02-24T19:18:04.792 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2026-02-24T19:18:04.792 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.788+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e080150 2026-02-24T19:18:04.792 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.788+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base exist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:04.792 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.788+0000 7f556b38f880 20 client.4777.objecter _calc_target target exist @28 -> pgid 28.d3a59201 2026-02-24T19:18:04.792 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.788+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.d3a59201 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:04.792 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.788+0000 7f556b38f880 10 client.4777.objecter chose random osd.4 of [12,4] 2026-02-24T19:18:04.792 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.788+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07bc40 osd=4 3 2026-02-24T19:18:04.792 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.788+0000 7f556b38f880 10 client.4777.objecter _op_submit oid exist '@28' '@28' [read 0~256] tid 8 osd.4 2026-02-24T19:18:04.793 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.788+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07bc40 osd=4 3 2026-02-24T19:18:04.794 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.788+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 4 8 2026-02-24T19:18:04.794 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.788+0000 7f556b38f880 15 client.4777.objecter _send_op 8 to 28.1 on osd.4 2026-02-24T19:18:04.794 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.788+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6805/4020872388 -- osd_op(unknown.0.0:8 28.1 28:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e36) -- 0x56539e080a80 con 0x56539e0664e0 2026-02-24T19:18:04.794 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.788+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07bc40 osd=4 4 2026-02-24T19:18:04.794 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.788+0000 7f556b38f880 5 client.4777.objecter 1 in flight 2026-02-24T19:18:04.794 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.788+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e081530 2026-02-24T19:18:04.795 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.788+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base noexist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:04.795 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.788+0000 7f556b38f880 20 client.4777.objecter _calc_target target noexist @28 -> pgid 28.a7bbaa1 2026-02-24T19:18:04.795 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.788+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.a7bbaa1 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:04.795 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.788+0000 7f556b38f880 10 client.4777.objecter chose random osd.4 of [12,4] 2026-02-24T19:18:04.795 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.788+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07bc40 osd=4 4 2026-02-24T19:18:04.795 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.788+0000 7f556b38f880 10 client.4777.objecter _op_submit oid noexist '@28' '@28' [read 0~256] tid 9 osd.4 2026-02-24T19:18:04.795 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.788+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07bc40 osd=4 4 2026-02-24T19:18:04.795 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.788+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 4 9 2026-02-24T19:18:04.795 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.788+0000 7f556b38f880 15 client.4777.objecter _send_op 9 to 28.1 on osd.4 2026-02-24T19:18:04.795 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.788+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6805/4020872388 -- osd_op(unknown.0.0:9 28.1 28:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e36) -- 0x56539e0819e0 con 0x56539e0664e0 2026-02-24T19:18:04.795 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.788+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07bc40 osd=4 5 2026-02-24T19:18:04.795 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.788+0000 7f556b38f880 5 client.4777.objecter 2 in flight 2026-02-24T19:18:04.795 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.792+0000 7f5568e45640 1 -- 10.20.193.195:0/3789380477 <== osd.4 v1:10.20.193.14:6805/4020872388 4 ==== osd_op_reply(8 exist [read 0~256] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) ==== 149+0+0 (unknown 2051528934 0 0) 0x7f555405da20 con 0x56539e0664e0 2026-02-24T19:18:04.796 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.792+0000 7f5568e45640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(8 exist [read 0~256] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) 2026-02-24T19:18:04.796 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.792+0000 7f5568e45640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:04.796 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.792+0000 7f5568e45640 7 client.4777.objecter handle_osd_op_reply 8 ondisk uv 0 in 28.1 attempt 0 2026-02-24T19:18:04.796 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.792+0000 7f5568e45640 7 client.4777.objecter got -EAGAIN, resubmitting 2026-02-24T19:18:04.796 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.792+0000 7f5568e45640 20 client.4777.objecter put_session s=0x56539e07bc40 osd=4 5 2026-02-24T19:18:04.796 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.792+0000 7f5568e45640 15 client.4777.objecter _session_op_remove 4 8 2026-02-24T19:18:04.796 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.792+0000 7f5568e45640 10 client.4777.objecter _op_submit op 0x56539e080150 2026-02-24T19:18:04.797 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.792+0000 7f5568e45640 20 client.4777.objecter _calc_target epoch 36 base exist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:04.797 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.792+0000 7f5568e45640 20 client.4777.objecter _calc_target target exist @28 -> pgid 28.d3a59201 2026-02-24T19:18:04.798 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.792+0000 7f5568e45640 10 client.4777.objecter _calc_target raw pgid 28.d3a59201 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:04.798 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.792+0000 7f5568e45640 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:04.798 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.792+0000 7f5568e45640 10 client.4777.objecter _op_submit oid exist '@28' '@28' [read 0~256] tid 10 osd.12 2026-02-24T19:18:04.798 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.792+0000 7f5568e45640 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:04.798 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.792+0000 7f5568e45640 15 client.4777.objecter _session_op_assign 12 10 2026-02-24T19:18:04.798 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.792+0000 7f5568e45640 15 client.4777.objecter _send_op 10 to 28.1 on osd.12 2026-02-24T19:18:04.798 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.792+0000 7f5568e45640 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6801/1483397197 -- osd_op(unknown.0.0:10 28.1 28:8049a5cb:::exist:head [read 0~256] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e36) -- 0x56539e0819e0 con 0x56539e07b3c0 2026-02-24T19:18:04.798 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.792+0000 7f5568e45640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.798 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.792+0000 7f5568e45640 5 client.4777.objecter 2 in flight 2026-02-24T19:18:04.798 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.792+0000 7f5568e45640 1 -- 10.20.193.195:0/3789380477 <== osd.4 v1:10.20.193.14:6805/4020872388 5 ==== osd_op_reply(9 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3072404560 0 0) 0x7f555405da20 con 0x56539e0664e0 2026-02-24T19:18:04.798 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.792+0000 7f5568e45640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(9 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:04.798 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.792+0000 7f5568e45640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:04.799 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.792+0000 7f5568e45640 7 client.4777.objecter handle_osd_op_reply 9 ondisk uv 0 in 28.1 attempt 0 2026-02-24T19:18:04.799 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.792+0000 7f5568e45640 10 client.4777.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:04.799 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.792+0000 7f5568e45640 10 client.4777.objecter op 0 rval 0 len 0 2026-02-24T19:18:04.799 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.792+0000 7f5568e45640 15 client.4777.objecter handle_osd_op_reply completed tid 9 2026-02-24T19:18:04.799 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.792+0000 7f5568e45640 15 client.4777.objecter _finish_op 9 2026-02-24T19:18:04.799 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.792+0000 7f5568e45640 20 client.4777.objecter put_session s=0x56539e07bc40 osd=4 4 2026-02-24T19:18:04.799 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.792+0000 7f5568e45640 15 client.4777.objecter _session_op_remove 4 9 2026-02-24T19:18:04.799 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.792+0000 7f5568e45640 5 client.4777.objecter 1 in flight 2026-02-24T19:18:04.799 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.795+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 5 ==== osd_op_reply(10 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 2485628864 0 3741568377) 0x7f555c0040e0 con 0x56539e07b3c0 2026-02-24T19:18:04.799 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.795+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(10 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-24T19:18:04.799 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.795+0000 7f5569646640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:04.799 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.795+0000 7f5569646640 7 client.4777.objecter handle_osd_op_reply 10 ondisk uv 1 in 28.1 attempt 1 2026-02-24T19:18:04.799 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.795+0000 7f5569646640 10 client.4777.objecter op 0 rval 0 len 5 2026-02-24T19:18:04.800 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.795+0000 7f5569646640 15 client.4777.objecter handle_osd_op_reply completed tid 10 2026-02-24T19:18:04.800 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.795+0000 7f5569646640 15 client.4777.objecter _finish_op 10 2026-02-24T19:18:04.800 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.795+0000 7f5569646640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.800 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.795+0000 7f5569646640 15 client.4777.objecter _session_op_remove 12 10 2026-02-24T19:18:04.800 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.795+0000 7f5569646640 5 client.4777.objecter 0 in flight 2026-02-24T19:18:04.800 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (7 ms) 2026-02-24T19:18:04.800 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2026-02-24T19:18:04.800 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.795+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e081510 2026-02-24T19:18:04.800 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.795+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base exist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:04.800 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.795+0000 7f556b38f880 20 client.4777.objecter _calc_target target exist @28 -> pgid 28.d3a59201 2026-02-24T19:18:04.800 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.795+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.d3a59201 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:04.800 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.795+0000 7f556b38f880 10 client.4777.objecter chose random osd.12 of [12,4] 2026-02-24T19:18:04.801 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.795+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:04.801 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.795+0000 7f556b38f880 10 client.4777.objecter _op_submit oid exist '@28' '@28' [read 0~256] tid 11 osd.12 2026-02-24T19:18:04.801 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.795+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:04.801 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.795+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 12 11 2026-02-24T19:18:04.801 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.795+0000 7f556b38f880 15 client.4777.objecter _send_op 11 to 28.1 on osd.12 2026-02-24T19:18:04.801 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.795+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6801/1483397197 -- osd_op(unknown.0.0:11 28.1 28:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e36) -- 0x56539e080260 con 0x56539e07b3c0 2026-02-24T19:18:04.801 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.795+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.801 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.795+0000 7f556b38f880 5 client.4777.objecter 1 in flight 2026-02-24T19:18:04.801 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.795+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e082050 2026-02-24T19:18:04.801 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.795+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base noexist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:04.801 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.795+0000 7f556b38f880 20 client.4777.objecter _calc_target target noexist @28 -> pgid 28.a7bbaa1 2026-02-24T19:18:04.801 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.795+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.a7bbaa1 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:04.801 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.795+0000 7f556b38f880 10 client.4777.objecter chose random osd.12 of [12,4] 2026-02-24T19:18:04.802 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.795+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.802 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.795+0000 7f556b38f880 10 client.4777.objecter _op_submit oid noexist '@28' '@28' [read 0~256] tid 12 osd.12 2026-02-24T19:18:04.802 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.795+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.802 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.795+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 12 12 2026-02-24T19:18:04.802 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.795+0000 7f556b38f880 15 client.4777.objecter _send_op 12 to 28.1 on osd.12 2026-02-24T19:18:04.803 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.795+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6801/1483397197 -- osd_op(unknown.0.0:12 28.1 28:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e36) -- 0x56539e082500 con 0x56539e07b3c0 2026-02-24T19:18:04.803 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.795+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 5 2026-02-24T19:18:04.804 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.795+0000 7f556b38f880 5 client.4777.objecter 2 in flight 2026-02-24T19:18:04.804 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 6 ==== osd_op_reply(11 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 553310345 0 3741568377) 0x7f555c0040e0 con 0x56539e07b3c0 2026-02-24T19:18:04.804 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(11 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-24T19:18:04.804 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f5569646640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:04.804 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f5569646640 7 client.4777.objecter handle_osd_op_reply 11 ondisk uv 1 in 28.1 attempt 0 2026-02-24T19:18:04.804 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f5569646640 10 client.4777.objecter op 0 rval 0 len 5 2026-02-24T19:18:04.804 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f5569646640 15 client.4777.objecter handle_osd_op_reply completed tid 11 2026-02-24T19:18:04.804 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f5569646640 15 client.4777.objecter _finish_op 11 2026-02-24T19:18:04.804 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f5569646640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 5 2026-02-24T19:18:04.804 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f5569646640 15 client.4777.objecter _session_op_remove 12 11 2026-02-24T19:18:04.804 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f5569646640 5 client.4777.objecter 1 in flight 2026-02-24T19:18:04.804 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 7 ==== osd_op_reply(12 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3072404560 0 0) 0x7f555c0040e0 con 0x56539e07b3c0 2026-02-24T19:18:04.805 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(12 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:04.805 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f5569646640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:04.805 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f5569646640 7 client.4777.objecter handle_osd_op_reply 12 ondisk uv 0 in 28.1 attempt 0 2026-02-24T19:18:04.805 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f5569646640 10 client.4777.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:04.805 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f5569646640 10 client.4777.objecter op 0 rval 0 len 0 2026-02-24T19:18:04.805 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f5569646640 15 client.4777.objecter handle_osd_op_reply completed tid 12 2026-02-24T19:18:04.805 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f5569646640 15 client.4777.objecter _finish_op 12 2026-02-24T19:18:04.805 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f5569646640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.805 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f5569646640 15 client.4777.objecter _session_op_remove 12 12 2026-02-24T19:18:04.805 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (6 ms) 2026-02-24T19:18:04.805 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f5569646640 5 client.4777.objecter 0 in flight 2026-02-24T19:18:04.805 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ RUN ] AsioRados.AsyncReadAwaitable 2026-02-24T19:18:04.805 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e081510 2026-02-24T19:18:04.806 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base exist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:04.806 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f556b38f880 20 client.4777.objecter _calc_target target exist @28 -> pgid 28.d3a59201 2026-02-24T19:18:04.806 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.d3a59201 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:04.806 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f556b38f880 10 client.4777.objecter chose random osd.12 of [12,4] 2026-02-24T19:18:04.806 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:04.806 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f556b38f880 10 client.4777.objecter _op_submit oid exist '@28' '@28' [read 0~256] tid 13 osd.12 2026-02-24T19:18:04.806 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:04.806 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 12 13 2026-02-24T19:18:04.807 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f556b38f880 15 client.4777.objecter _send_op 13 to 28.1 on osd.12 2026-02-24T19:18:04.807 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6801/1483397197 -- osd_op(unknown.0.0:13 28.1 28:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e36) -- 0x56539e0828a0 con 0x56539e07b3c0 2026-02-24T19:18:04.807 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.807 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f556b38f880 5 client.4777.objecter 1 in flight 2026-02-24T19:18:04.807 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e082dc0 2026-02-24T19:18:04.807 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base noexist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:04.807 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f556b38f880 20 client.4777.objecter _calc_target target noexist @28 -> pgid 28.a7bbaa1 2026-02-24T19:18:04.807 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.a7bbaa1 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:04.807 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f556b38f880 10 client.4777.objecter chose random osd.4 of [12,4] 2026-02-24T19:18:04.807 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07bc40 osd=4 3 2026-02-24T19:18:04.807 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f556b38f880 10 client.4777.objecter _op_submit oid noexist '@28' '@28' [read 0~256] tid 14 osd.4 2026-02-24T19:18:04.807 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07bc40 osd=4 3 2026-02-24T19:18:04.808 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 4 14 2026-02-24T19:18:04.808 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f556b38f880 15 client.4777.objecter _send_op 14 to 28.1 on osd.4 2026-02-24T19:18:04.808 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6805/4020872388 -- osd_op(unknown.0.0:14 28.1 28:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e36) -- 0x56539e083270 con 0x56539e0664e0 2026-02-24T19:18:04.808 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07bc40 osd=4 4 2026-02-24T19:18:04.808 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.801+0000 7f556b38f880 5 client.4777.objecter 2 in flight 2026-02-24T19:18:04.808 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.804+0000 7f5568e45640 1 -- 10.20.193.195:0/3789380477 <== osd.4 v1:10.20.193.14:6805/4020872388 6 ==== osd_op_reply(14 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3072404560 0 0) 0x7f555405da20 con 0x56539e0664e0 2026-02-24T19:18:04.808 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.804+0000 7f5568e45640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(14 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:04.808 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.804+0000 7f5568e45640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:04.809 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.804+0000 7f5568e45640 7 client.4777.objecter handle_osd_op_reply 14 ondisk uv 0 in 28.1 attempt 0 2026-02-24T19:18:04.809 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.804+0000 7f5568e45640 10 client.4777.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:04.809 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.804+0000 7f5568e45640 10 client.4777.objecter op 0 rval 0 len 0 2026-02-24T19:18:04.809 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.804+0000 7f5568e45640 15 client.4777.objecter handle_osd_op_reply completed tid 14 2026-02-24T19:18:04.809 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.804+0000 7f5568e45640 15 client.4777.objecter _finish_op 14 2026-02-24T19:18:04.809 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.804+0000 7f5568e45640 20 client.4777.objecter put_session s=0x56539e07bc40 osd=4 4 2026-02-24T19:18:04.809 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.804+0000 7f5568e45640 15 client.4777.objecter _session_op_remove 4 14 2026-02-24T19:18:04.809 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.804+0000 7f5568e45640 5 client.4777.objecter 1 in flight 2026-02-24T19:18:04.809 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.804+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 8 ==== osd_op_reply(13 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 553310345 0 3741568377) 0x7f555c0040e0 con 0x56539e07b3c0 2026-02-24T19:18:04.809 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.804+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(13 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-24T19:18:04.809 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.804+0000 7f5569646640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:04.809 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.804+0000 7f5569646640 7 client.4777.objecter handle_osd_op_reply 13 ondisk uv 1 in 28.1 attempt 0 2026-02-24T19:18:04.810 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.804+0000 7f5569646640 10 client.4777.objecter op 0 rval 0 len 5 2026-02-24T19:18:04.810 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.804+0000 7f5569646640 15 client.4777.objecter handle_osd_op_reply completed tid 13 2026-02-24T19:18:04.810 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.804+0000 7f5569646640 15 client.4777.objecter _finish_op 13 2026-02-24T19:18:04.810 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.804+0000 7f5569646640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.810 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.804+0000 7f5569646640 15 client.4777.objecter _session_op_remove 12 13 2026-02-24T19:18:04.810 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.804+0000 7f5569646640 5 client.4777.objecter 0 in flight 2026-02-24T19:18:04.810 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ OK ] AsioRados.AsyncReadAwaitable (3 ms) 2026-02-24T19:18:04.810 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2026-02-24T19:18:04.810 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.804+0000 7f556b38f880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-24T19:18:04.810 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.804+0000 7f556b38f880 20 librados: queue_aio_write 0x56539df13390 completion 0x56539e081510 write_seq 1 2026-02-24T19:18:04.810 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.804+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e082dc0 2026-02-24T19:18:04.810 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.804+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base exist @28 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:04.810 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.804+0000 7f556b38f880 20 client.4777.objecter _calc_target target exist @28 -> pgid 28.d3a59201 2026-02-24T19:18:04.810 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.804+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.d3a59201 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:04.811 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.804+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:04.811 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.804+0000 7f556b38f880 10 client.4777.objecter _op_submit oid exist '@28' '@28' [write 0~5 in=5b] tid 15 osd.12 2026-02-24T19:18:04.811 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.804+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:04.811 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.804+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 12 15 2026-02-24T19:18:04.850 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.804+0000 7f556b38f880 15 client.4777.objecter _send_op 15 to 28.1 on osd.12 2026-02-24T19:18:04.851 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.804+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6801/1483397197 -- osd_op(unknown.0.0:15 28.1 28:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56539e081620 con 0x56539e07b3c0 2026-02-24T19:18:04.851 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.804+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.851 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.804+0000 7f556b38f880 5 client.4777.objecter 1 in flight 2026-02-24T19:18:04.851 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.804+0000 7f556b38f880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-24T19:18:04.851 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.848+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 9 ==== osd_op_reply(15 exist [write 0~5] v36'2 uv2 ondisk = 0) ==== 149+0+0 (unknown 701349496 0 0) 0x7f555c0040e0 con 0x56539e07b3c0 2026-02-24T19:18:04.851 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.848+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(15 exist [write 0~5] v36'2 uv2 ondisk = 0) 2026-02-24T19:18:04.851 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.848+0000 7f5569646640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:04.851 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.848+0000 7f5569646640 7 client.4777.objecter handle_osd_op_reply 15 ondisk uv 2 in 28.1 attempt 0 2026-02-24T19:18:04.851 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.848+0000 7f5569646640 10 client.4777.objecter op 0 rval 0 len 0 2026-02-24T19:18:04.851 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.848+0000 7f5569646640 15 client.4777.objecter handle_osd_op_reply completed tid 15 2026-02-24T19:18:04.851 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.848+0000 7f5569646640 15 client.4777.objecter _finish_op 15 2026-02-24T19:18:04.852 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.848+0000 7f5569646640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.852 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.848+0000 7f5569646640 15 client.4777.objecter _session_op_remove 12 15 2026-02-24T19:18:04.852 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.848+0000 7f5569646640 5 client.4777.objecter 0 in flight 2026-02-24T19:18:04.852 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.848+0000 7f5569646640 20 librados: complete_aio_write 0x56539e081510 2026-02-24T19:18:04.852 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (44 ms) 2026-02-24T19:18:04.852 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteDeferred 2026-02-24T19:18:04.852 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.848+0000 7f556b38f880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-24T19:18:04.852 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.848+0000 7f556b38f880 20 librados: queue_aio_write 0x56539df13390 completion 0x56539e084670 write_seq 2 2026-02-24T19:18:04.852 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.848+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e082dc0 2026-02-24T19:18:04.852 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.848+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base exist @28 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:04.852 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.848+0000 7f556b38f880 20 client.4777.objecter _calc_target target exist @28 -> pgid 28.d3a59201 2026-02-24T19:18:04.852 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.848+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.d3a59201 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:04.852 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.848+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:04.853 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.848+0000 7f556b38f880 10 client.4777.objecter _op_submit oid exist '@28' '@28' [write 0~5 in=5b] tid 16 osd.12 2026-02-24T19:18:04.853 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.848+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:04.853 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.848+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 12 16 2026-02-24T19:18:04.853 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.848+0000 7f556b38f880 15 client.4777.objecter _send_op 16 to 28.1 on osd.12 2026-02-24T19:18:04.879 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.848+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6801/1483397197 -- osd_op(unknown.0.0:16 28.1 28:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56539e081620 con 0x56539e07b3c0 2026-02-24T19:18:04.879 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.848+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.879 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.848+0000 7f556b38f880 5 client.4777.objecter 1 in flight 2026-02-24T19:18:04.879 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.848+0000 7f556b38f880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-24T19:18:04.879 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.877+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 10 ==== osd_op_reply(16 exist [write 0~5] v36'3 uv3 ondisk = 0) ==== 149+0+0 (unknown 1565328812 0 0) 0x7f555c0040e0 con 0x56539e07b3c0 2026-02-24T19:18:04.879 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.877+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(16 exist [write 0~5] v36'3 uv3 ondisk = 0) 2026-02-24T19:18:04.880 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.877+0000 7f5569646640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:04.880 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.877+0000 7f5569646640 7 client.4777.objecter handle_osd_op_reply 16 ondisk uv 3 in 28.1 attempt 0 2026-02-24T19:18:04.880 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.877+0000 7f5569646640 10 client.4777.objecter op 0 rval 0 len 0 2026-02-24T19:18:04.880 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.877+0000 7f5569646640 15 client.4777.objecter handle_osd_op_reply completed tid 16 2026-02-24T19:18:04.880 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.877+0000 7f5569646640 15 client.4777.objecter _finish_op 16 2026-02-24T19:18:04.880 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.877+0000 7f5569646640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.880 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.877+0000 7f5569646640 15 client.4777.objecter _session_op_remove 12 16 2026-02-24T19:18:04.880 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.877+0000 7f5569646640 5 client.4777.objecter 0 in flight 2026-02-24T19:18:04.880 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.877+0000 7f5569646640 20 librados: complete_aio_write 0x56539e084670 2026-02-24T19:18:04.880 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ OK ] AsioRados.AsyncWriteDeferred (28 ms) 2026-02-24T19:18:04.880 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2026-02-24T19:18:04.880 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.877+0000 7f556b38f880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-24T19:18:04.880 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.877+0000 7f556b38f880 20 librados: queue_aio_write 0x56539df13390 completion 0x56539e0857b0 write_seq 3 2026-02-24T19:18:04.881 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.877+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e082dc0 2026-02-24T19:18:04.881 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.877+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base exist @28 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:04.881 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.877+0000 7f556b38f880 20 client.4777.objecter _calc_target target exist @28 -> pgid 28.d3a59201 2026-02-24T19:18:04.881 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.877+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.d3a59201 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:04.881 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.877+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:04.881 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.877+0000 7f556b38f880 10 client.4777.objecter _op_submit oid exist '@28' '@28' [write 0~5 in=5b] tid 17 osd.12 2026-02-24T19:18:04.881 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.877+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:04.881 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.877+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 12 17 2026-02-24T19:18:04.881 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.877+0000 7f556b38f880 15 client.4777.objecter _send_op 17 to 28.1 on osd.12 2026-02-24T19:18:04.916 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.877+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6801/1483397197 -- osd_op(unknown.0.0:17 28.1 28:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56539e081620 con 0x56539e07b3c0 2026-02-24T19:18:04.917 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.877+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.917 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.877+0000 7f556b38f880 5 client.4777.objecter 1 in flight 2026-02-24T19:18:04.917 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.877+0000 7f556b38f880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-24T19:18:04.917 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.914+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 11 ==== osd_op_reply(17 exist [write 0~5] v36'4 uv4 ondisk = 0) ==== 149+0+0 (unknown 388124785 0 0) 0x7f555c0040e0 con 0x56539e07b3c0 2026-02-24T19:18:04.917 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.914+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(17 exist [write 0~5] v36'4 uv4 ondisk = 0) 2026-02-24T19:18:04.917 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.914+0000 7f5569646640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:04.917 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.914+0000 7f5569646640 7 client.4777.objecter handle_osd_op_reply 17 ondisk uv 4 in 28.1 attempt 0 2026-02-24T19:18:04.917 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.914+0000 7f5569646640 10 client.4777.objecter op 0 rval 0 len 0 2026-02-24T19:18:04.917 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.914+0000 7f5569646640 15 client.4777.objecter handle_osd_op_reply completed tid 17 2026-02-24T19:18:04.917 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.914+0000 7f5569646640 15 client.4777.objecter _finish_op 17 2026-02-24T19:18:04.917 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.914+0000 7f5569646640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.918 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.914+0000 7f5569646640 15 client.4777.objecter _session_op_remove 12 17 2026-02-24T19:18:04.918 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.914+0000 7f5569646640 5 client.4777.objecter 0 in flight 2026-02-24T19:18:04.918 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.914+0000 7f5569646640 20 librados: complete_aio_write 0x56539e0857b0 2026-02-24T19:18:04.918 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (37 ms) 2026-02-24T19:18:04.918 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2026-02-24T19:18:04.918 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.914+0000 7f556b38f880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-24T19:18:04.918 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.914+0000 7f556b38f880 20 librados: queue_aio_write 0x56539df13390 completion 0x56539e083720 write_seq 4 2026-02-24T19:18:04.918 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.914+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e082dc0 2026-02-24T19:18:04.918 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.914+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base exist @28 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:04.918 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.914+0000 7f556b38f880 20 client.4777.objecter _calc_target target exist @28 -> pgid 28.d3a59201 2026-02-24T19:18:04.918 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.914+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.d3a59201 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:04.918 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.914+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:04.919 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.914+0000 7f556b38f880 10 client.4777.objecter _op_submit oid exist '@28' '@28' [write 0~5 in=5b] tid 18 osd.12 2026-02-24T19:18:04.919 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.914+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:04.919 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.914+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 12 18 2026-02-24T19:18:04.919 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.914+0000 7f556b38f880 15 client.4777.objecter _send_op 18 to 28.1 on osd.12 2026-02-24T19:18:04.919 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.914+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6801/1483397197 -- osd_op(unknown.0.0:18 28.1 28:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56539e08b1c0 con 0x56539e07b3c0 2026-02-24T19:18:04.919 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.914+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.942 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.914+0000 7f556b38f880 5 client.4777.objecter 1 in flight 2026-02-24T19:18:04.942 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.914+0000 7f556b38f880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-24T19:18:04.943 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.926+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 12 ==== osd_op_reply(18 exist [write 0~5] v36'5 uv5 ondisk = 0) ==== 149+0+0 (unknown 1671621541 0 0) 0x7f555c0040e0 con 0x56539e07b3c0 2026-02-24T19:18:04.943 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.926+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(18 exist [write 0~5] v36'5 uv5 ondisk = 0) 2026-02-24T19:18:04.943 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.926+0000 7f5569646640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:04.943 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.926+0000 7f5569646640 7 client.4777.objecter handle_osd_op_reply 18 ondisk uv 5 in 28.1 attempt 0 2026-02-24T19:18:04.943 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.926+0000 7f5569646640 10 client.4777.objecter op 0 rval 0 len 0 2026-02-24T19:18:04.943 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.926+0000 7f5569646640 15 client.4777.objecter handle_osd_op_reply completed tid 18 2026-02-24T19:18:04.943 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.926+0000 7f5569646640 15 client.4777.objecter _finish_op 18 2026-02-24T19:18:04.943 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.926+0000 7f5569646640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.943 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.926+0000 7f5569646640 15 client.4777.objecter _session_op_remove 12 18 2026-02-24T19:18:04.943 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.926+0000 7f5569646640 5 client.4777.objecter 0 in flight 2026-02-24T19:18:04.943 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.926+0000 7f5569646640 20 librados: complete_aio_write 0x56539e083720 2026-02-24T19:18:04.943 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (12 ms) 2026-02-24T19:18:04.944 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteAwaitable 2026-02-24T19:18:04.944 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.926+0000 7f556b38f880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-24T19:18:04.944 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.926+0000 7f556b38f880 20 librados: queue_aio_write 0x56539df13390 completion 0x56539e08b580 write_seq 5 2026-02-24T19:18:04.944 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.926+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e082dc0 2026-02-24T19:18:04.944 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.926+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base exist @28 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:04.944 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.926+0000 7f556b38f880 20 client.4777.objecter _calc_target target exist @28 -> pgid 28.d3a59201 2026-02-24T19:18:04.944 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.926+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.d3a59201 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:04.944 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.926+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:04.944 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.926+0000 7f556b38f880 10 client.4777.objecter _op_submit oid exist '@28' '@28' [write 0~5 in=5b] tid 19 osd.12 2026-02-24T19:18:04.944 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.926+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:04.944 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.926+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 12 19 2026-02-24T19:18:04.944 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.926+0000 7f556b38f880 15 client.4777.objecter _send_op 19 to 28.1 on osd.12 2026-02-24T19:18:04.944 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.926+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6801/1483397197 -- osd_op(unknown.0.0:19 28.1 28:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56539e08b750 con 0x56539e07b3c0 2026-02-24T19:18:04.945 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.926+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.945 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.926+0000 7f556b38f880 5 client.4777.objecter 1 in flight 2026-02-24T19:18:04.945 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.926+0000 7f556b38f880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-24T19:18:04.945 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.940+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 13 ==== osd_op_reply(19 exist [write 0~5] v36'6 uv6 ondisk = 0) ==== 149+0+0 (unknown 4263716825 0 0) 0x7f555c0040e0 con 0x56539e07b3c0 2026-02-24T19:18:04.945 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.940+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(19 exist [write 0~5] v36'6 uv6 ondisk = 0) 2026-02-24T19:18:04.945 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.940+0000 7f5569646640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:04.945 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.940+0000 7f5569646640 7 client.4777.objecter handle_osd_op_reply 19 ondisk uv 6 in 28.1 attempt 0 2026-02-24T19:18:04.945 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.940+0000 7f5569646640 10 client.4777.objecter op 0 rval 0 len 0 2026-02-24T19:18:04.945 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.940+0000 7f5569646640 15 client.4777.objecter handle_osd_op_reply completed tid 19 2026-02-24T19:18:04.945 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.940+0000 7f5569646640 15 client.4777.objecter _finish_op 19 2026-02-24T19:18:04.945 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.940+0000 7f5569646640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.945 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.940+0000 7f5569646640 15 client.4777.objecter _session_op_remove 12 19 2026-02-24T19:18:04.946 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.940+0000 7f5569646640 5 client.4777.objecter 0 in flight 2026-02-24T19:18:04.946 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ OK ] AsioRados.AsyncWriteAwaitable (13 ms) 2026-02-24T19:18:04.946 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.940+0000 7f5569646640 20 librados: complete_aio_write 0x56539e08b580 2026-02-24T19:18:04.946 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2026-02-24T19:18:04.946 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.940+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e082dc0 2026-02-24T19:18:04.946 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.940+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base exist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:04.946 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.940+0000 7f556b38f880 20 client.4777.objecter _calc_target target exist @28 -> pgid 28.d3a59201 2026-02-24T19:18:04.946 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.940+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.d3a59201 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:04.946 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.940+0000 7f556b38f880 10 client.4777.objecter chose random osd.12 of [12,4] 2026-02-24T19:18:04.946 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.940+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:04.946 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.940+0000 7f556b38f880 10 client.4777.objecter _op_submit oid exist '@28' '@28' [read 0~0] tid 20 osd.12 2026-02-24T19:18:04.946 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.940+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:04.946 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.940+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 12 20 2026-02-24T19:18:04.947 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.940+0000 7f556b38f880 15 client.4777.objecter _send_op 20 to 28.1 on osd.12 2026-02-24T19:18:04.947 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.940+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6801/1483397197 -- osd_op(unknown.0.0:20 28.1 28:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e36) -- 0x56539e08b750 con 0x56539e07b3c0 2026-02-24T19:18:04.947 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.940+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.947 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.940+0000 7f556b38f880 5 client.4777.objecter 1 in flight 2026-02-24T19:18:04.947 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.940+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e084780 2026-02-24T19:18:04.947 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.940+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base noexist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:04.947 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.940+0000 7f556b38f880 20 client.4777.objecter _calc_target target noexist @28 -> pgid 28.a7bbaa1 2026-02-24T19:18:04.948 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.940+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.a7bbaa1 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:04.948 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.940+0000 7f556b38f880 10 client.4777.objecter chose random osd.4 of [12,4] 2026-02-24T19:18:04.948 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.940+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07bc40 osd=4 3 2026-02-24T19:18:04.948 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.940+0000 7f556b38f880 10 client.4777.objecter _op_submit oid noexist '@28' '@28' [read 0~0] tid 21 osd.4 2026-02-24T19:18:04.948 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.940+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07bc40 osd=4 3 2026-02-24T19:18:04.948 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.940+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 4 21 2026-02-24T19:18:04.948 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.940+0000 7f556b38f880 15 client.4777.objecter _send_op 21 to 28.1 on osd.4 2026-02-24T19:18:04.948 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.940+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6805/4020872388 -- osd_op(unknown.0.0:21 28.1 28:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e36) -- 0x56539e084c30 con 0x56539e0664e0 2026-02-24T19:18:04.948 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.940+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07bc40 osd=4 4 2026-02-24T19:18:04.948 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.940+0000 7f556b38f880 5 client.4777.objecter 2 in flight 2026-02-24T19:18:04.949 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.943+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 14 ==== osd_op_reply(20 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 1720255666 0 3741568377) 0x7f555c0040e0 con 0x56539e07b3c0 2026-02-24T19:18:04.949 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.943+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(20 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-24T19:18:04.949 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.943+0000 7f5569646640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:04.949 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.943+0000 7f5569646640 7 client.4777.objecter handle_osd_op_reply 20 ondisk uv 6 in 28.1 attempt 0 2026-02-24T19:18:04.949 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.943+0000 7f5569646640 10 client.4777.objecter op 0 rval 0 len 5 2026-02-24T19:18:04.949 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.943+0000 7f5569646640 15 client.4777.objecter handle_osd_op_reply completed tid 20 2026-02-24T19:18:04.949 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.943+0000 7f5569646640 15 client.4777.objecter _finish_op 20 2026-02-24T19:18:04.949 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.943+0000 7f5569646640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.949 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.943+0000 7f5569646640 15 client.4777.objecter _session_op_remove 12 20 2026-02-24T19:18:04.949 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.943+0000 7f5569646640 5 client.4777.objecter 1 in flight 2026-02-24T19:18:04.949 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.944+0000 7f5568e45640 1 -- 10.20.193.195:0/3789380477 <== osd.4 v1:10.20.193.14:6805/4020872388 7 ==== osd_op_reply(21 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3668513384 0 0) 0x7f555405da20 con 0x56539e0664e0 2026-02-24T19:18:04.949 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.944+0000 7f5568e45640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(21 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:04.950 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.944+0000 7f5568e45640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:04.950 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.944+0000 7f5568e45640 7 client.4777.objecter handle_osd_op_reply 21 ondisk uv 0 in 28.1 attempt 0 2026-02-24T19:18:04.950 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.944+0000 7f5568e45640 10 client.4777.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:04.950 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.944+0000 7f5568e45640 10 client.4777.objecter op 0 rval 0 len 0 2026-02-24T19:18:04.950 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.944+0000 7f5568e45640 15 client.4777.objecter handle_osd_op_reply completed tid 21 2026-02-24T19:18:04.950 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.944+0000 7f5568e45640 15 client.4777.objecter _finish_op 21 2026-02-24T19:18:04.950 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.944+0000 7f5568e45640 20 client.4777.objecter put_session s=0x56539e07bc40 osd=4 4 2026-02-24T19:18:04.950 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.944+0000 7f5568e45640 15 client.4777.objecter _session_op_remove 4 21 2026-02-24T19:18:04.950 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.944+0000 7f5568e45640 5 client.4777.objecter 0 in flight 2026-02-24T19:18:04.950 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (3 ms) 2026-02-24T19:18:04.950 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationDeferred 2026-02-24T19:18:04.950 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.944+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e084780 2026-02-24T19:18:04.951 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.944+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base exist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:04.951 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.944+0000 7f556b38f880 20 client.4777.objecter _calc_target target exist @28 -> pgid 28.d3a59201 2026-02-24T19:18:04.951 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.944+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.d3a59201 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:04.951 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.944+0000 7f556b38f880 10 client.4777.objecter chose random osd.4 of [12,4] 2026-02-24T19:18:04.951 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.944+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07bc40 osd=4 3 2026-02-24T19:18:04.951 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.944+0000 7f556b38f880 10 client.4777.objecter _op_submit oid exist '@28' '@28' [read 0~0] tid 22 osd.4 2026-02-24T19:18:04.951 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.944+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07bc40 osd=4 3 2026-02-24T19:18:04.951 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.944+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 4 22 2026-02-24T19:18:04.951 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.944+0000 7f556b38f880 15 client.4777.objecter _send_op 22 to 28.1 on osd.4 2026-02-24T19:18:04.951 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.944+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6805/4020872388 -- osd_op(unknown.0.0:22 28.1 28:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e36) -- 0x56539e08b750 con 0x56539e0664e0 2026-02-24T19:18:04.951 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.944+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07bc40 osd=4 4 2026-02-24T19:18:04.951 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.944+0000 7f556b38f880 5 client.4777.objecter 1 in flight 2026-02-24T19:18:04.951 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.944+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e082da0 2026-02-24T19:18:04.952 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.944+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base noexist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:04.952 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.944+0000 7f556b38f880 20 client.4777.objecter _calc_target target noexist @28 -> pgid 28.a7bbaa1 2026-02-24T19:18:04.952 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.944+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.a7bbaa1 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:04.952 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.944+0000 7f556b38f880 10 client.4777.objecter chose random osd.4 of [12,4] 2026-02-24T19:18:04.952 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.944+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07bc40 osd=4 4 2026-02-24T19:18:04.952 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.944+0000 7f556b38f880 10 client.4777.objecter _op_submit oid noexist '@28' '@28' [read 0~0] tid 23 osd.4 2026-02-24T19:18:04.952 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.944+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07bc40 osd=4 4 2026-02-24T19:18:04.952 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.944+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 4 23 2026-02-24T19:18:04.952 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.944+0000 7f556b38f880 15 client.4777.objecter _send_op 23 to 28.1 on osd.4 2026-02-24T19:18:04.953 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.944+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6805/4020872388 -- osd_op(unknown.0.0:23 28.1 28:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e36) -- 0x56539e085070 con 0x56539e0664e0 2026-02-24T19:18:04.953 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.944+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07bc40 osd=4 5 2026-02-24T19:18:04.953 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.944+0000 7f556b38f880 5 client.4777.objecter 2 in flight 2026-02-24T19:18:04.953 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.946+0000 7f5568e45640 1 -- 10.20.193.195:0/3789380477 <== osd.4 v1:10.20.193.14:6805/4020872388 8 ==== osd_op_reply(22 exist [read 0~0] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) ==== 149+0+0 (unknown 399501022 0 0) 0x7f555405da20 con 0x56539e0664e0 2026-02-24T19:18:04.953 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.946+0000 7f5568e45640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(22 exist [read 0~0] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) 2026-02-24T19:18:04.953 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.946+0000 7f5568e45640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:04.953 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.946+0000 7f5568e45640 7 client.4777.objecter handle_osd_op_reply 22 ondisk uv 0 in 28.1 attempt 0 2026-02-24T19:18:04.953 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.946+0000 7f5568e45640 7 client.4777.objecter got -EAGAIN, resubmitting 2026-02-24T19:18:04.954 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.946+0000 7f5568e45640 20 client.4777.objecter put_session s=0x56539e07bc40 osd=4 5 2026-02-24T19:18:04.954 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.946+0000 7f5568e45640 15 client.4777.objecter _session_op_remove 4 22 2026-02-24T19:18:04.954 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.946+0000 7f5568e45640 10 client.4777.objecter _op_submit op 0x56539e084780 2026-02-24T19:18:04.954 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.946+0000 7f5568e45640 20 client.4777.objecter _calc_target epoch 36 base exist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:04.954 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.946+0000 7f5568e45640 20 client.4777.objecter _calc_target target exist @28 -> pgid 28.d3a59201 2026-02-24T19:18:04.954 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.946+0000 7f5568e45640 10 client.4777.objecter _calc_target raw pgid 28.d3a59201 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:04.954 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.946+0000 7f5568e45640 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:04.954 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.946+0000 7f5568e45640 10 client.4777.objecter _op_submit oid exist '@28' '@28' [read 0~0] tid 24 osd.12 2026-02-24T19:18:04.954 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.946+0000 7f5568e45640 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:04.954 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.946+0000 7f5568e45640 15 client.4777.objecter _session_op_assign 12 24 2026-02-24T19:18:04.954 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.946+0000 7f5568e45640 15 client.4777.objecter _send_op 24 to 28.1 on osd.12 2026-02-24T19:18:04.954 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.946+0000 7f5568e45640 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6801/1483397197 -- osd_op(unknown.0.0:24 28.1 28:8049a5cb:::exist:head [read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e36) -- 0x56539e085070 con 0x56539e07b3c0 2026-02-24T19:18:04.954 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.946+0000 7f5568e45640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.955 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.946+0000 7f5568e45640 5 client.4777.objecter 2 in flight 2026-02-24T19:18:04.955 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.947+0000 7f5568e45640 1 -- 10.20.193.195:0/3789380477 <== osd.4 v1:10.20.193.14:6805/4020872388 9 ==== osd_op_reply(23 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3668513384 0 0) 0x7f555405da20 con 0x56539e0664e0 2026-02-24T19:18:04.955 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.947+0000 7f5568e45640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(23 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:04.955 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.947+0000 7f5568e45640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:04.955 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.947+0000 7f5568e45640 7 client.4777.objecter handle_osd_op_reply 23 ondisk uv 0 in 28.1 attempt 0 2026-02-24T19:18:04.955 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.947+0000 7f5568e45640 10 client.4777.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:04.955 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.947+0000 7f5568e45640 10 client.4777.objecter op 0 rval 0 len 0 2026-02-24T19:18:04.955 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.947+0000 7f5568e45640 15 client.4777.objecter handle_osd_op_reply completed tid 23 2026-02-24T19:18:04.955 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.947+0000 7f5568e45640 15 client.4777.objecter _finish_op 23 2026-02-24T19:18:04.955 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.947+0000 7f5568e45640 20 client.4777.objecter put_session s=0x56539e07bc40 osd=4 4 2026-02-24T19:18:04.955 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.947+0000 7f5568e45640 15 client.4777.objecter _session_op_remove 4 23 2026-02-24T19:18:04.955 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.947+0000 7f5568e45640 5 client.4777.objecter 1 in flight 2026-02-24T19:18:04.956 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.949+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 15 ==== osd_op_reply(24 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 3528750075 0 3741568377) 0x7f555c0040e0 con 0x56539e07b3c0 2026-02-24T19:18:04.956 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.949+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(24 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-24T19:18:04.956 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.949+0000 7f5569646640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:04.956 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.949+0000 7f5569646640 7 client.4777.objecter handle_osd_op_reply 24 ondisk uv 6 in 28.1 attempt 1 2026-02-24T19:18:04.956 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.949+0000 7f5569646640 10 client.4777.objecter op 0 rval 0 len 5 2026-02-24T19:18:04.956 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.949+0000 7f5569646640 15 client.4777.objecter handle_osd_op_reply completed tid 24 2026-02-24T19:18:04.956 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.949+0000 7f5569646640 15 client.4777.objecter _finish_op 24 2026-02-24T19:18:04.956 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.949+0000 7f5569646640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.956 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.949+0000 7f5569646640 15 client.4777.objecter _session_op_remove 12 24 2026-02-24T19:18:04.956 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.949+0000 7f5569646640 5 client.4777.objecter 0 in flight 2026-02-24T19:18:04.956 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationDeferred (5 ms) 2026-02-24T19:18:04.956 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2026-02-24T19:18:04.956 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.949+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e084780 2026-02-24T19:18:04.957 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.949+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base exist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:04.957 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.949+0000 7f556b38f880 20 client.4777.objecter _calc_target target exist @28 -> pgid 28.d3a59201 2026-02-24T19:18:04.957 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.949+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.d3a59201 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:04.957 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.949+0000 7f556b38f880 10 client.4777.objecter chose random osd.12 of [12,4] 2026-02-24T19:18:04.957 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.949+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:04.957 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.949+0000 7f556b38f880 10 client.4777.objecter _op_submit oid exist '@28' '@28' [read 0~0] tid 25 osd.12 2026-02-24T19:18:04.957 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.949+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:04.957 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.949+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 12 25 2026-02-24T19:18:04.957 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.949+0000 7f556b38f880 15 client.4777.objecter _send_op 25 to 28.1 on osd.12 2026-02-24T19:18:04.958 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.949+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6801/1483397197 -- osd_op(unknown.0.0:25 28.1 28:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e36) -- 0x56539e082da0 con 0x56539e07b3c0 2026-02-24T19:18:04.958 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.949+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.958 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.949+0000 7f556b38f880 5 client.4777.objecter 1 in flight 2026-02-24T19:18:04.958 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.949+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e085070 2026-02-24T19:18:04.958 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.949+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base noexist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:04.958 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.949+0000 7f556b38f880 20 client.4777.objecter _calc_target target noexist @28 -> pgid 28.a7bbaa1 2026-02-24T19:18:04.958 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.949+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.a7bbaa1 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:04.958 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.949+0000 7f556b38f880 10 client.4777.objecter chose random osd.4 of [12,4] 2026-02-24T19:18:04.959 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.949+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07bc40 osd=4 3 2026-02-24T19:18:04.959 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.949+0000 7f556b38f880 10 client.4777.objecter _op_submit oid noexist '@28' '@28' [read 0~0] tid 26 osd.4 2026-02-24T19:18:04.959 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.949+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07bc40 osd=4 3 2026-02-24T19:18:04.959 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.949+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 4 26 2026-02-24T19:18:04.959 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.949+0000 7f556b38f880 15 client.4777.objecter _send_op 26 to 28.1 on osd.4 2026-02-24T19:18:04.959 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.949+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6805/4020872388 -- osd_op(unknown.0.0:26 28.1 28:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e36) -- 0x56539dfbc5d0 con 0x56539e0664e0 2026-02-24T19:18:04.959 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.949+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07bc40 osd=4 4 2026-02-24T19:18:04.959 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.949+0000 7f556b38f880 5 client.4777.objecter 2 in flight 2026-02-24T19:18:04.959 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.951+0000 7f5568e45640 1 -- 10.20.193.195:0/3789380477 <== osd.4 v1:10.20.193.14:6805/4020872388 10 ==== osd_op_reply(26 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3668513384 0 0) 0x7f555405da20 con 0x56539e0664e0 2026-02-24T19:18:04.959 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.951+0000 7f5568e45640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(26 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:04.959 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.951+0000 7f5568e45640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:04.959 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.951+0000 7f5568e45640 7 client.4777.objecter handle_osd_op_reply 26 ondisk uv 0 in 28.1 attempt 0 2026-02-24T19:18:04.959 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.951+0000 7f5568e45640 10 client.4777.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:04.960 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.951+0000 7f5568e45640 10 client.4777.objecter op 0 rval 0 len 0 2026-02-24T19:18:04.960 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.951+0000 7f5568e45640 15 client.4777.objecter handle_osd_op_reply completed tid 26 2026-02-24T19:18:04.960 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.951+0000 7f5568e45640 15 client.4777.objecter _finish_op 26 2026-02-24T19:18:04.960 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.951+0000 7f5568e45640 20 client.4777.objecter put_session s=0x56539e07bc40 osd=4 4 2026-02-24T19:18:04.960 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.951+0000 7f5568e45640 15 client.4777.objecter _session_op_remove 4 26 2026-02-24T19:18:04.960 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.951+0000 7f5568e45640 5 client.4777.objecter 1 in flight 2026-02-24T19:18:04.960 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.952+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 16 ==== osd_op_reply(25 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 1720255666 0 3741568377) 0x7f555c0040e0 con 0x56539e07b3c0 2026-02-24T19:18:04.960 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.952+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(25 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-24T19:18:04.960 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.952+0000 7f5569646640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:04.960 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.952+0000 7f5569646640 7 client.4777.objecter handle_osd_op_reply 25 ondisk uv 6 in 28.1 attempt 0 2026-02-24T19:18:04.960 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.952+0000 7f5569646640 10 client.4777.objecter op 0 rval 0 len 5 2026-02-24T19:18:04.960 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.952+0000 7f5569646640 15 client.4777.objecter handle_osd_op_reply completed tid 25 2026-02-24T19:18:04.961 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.952+0000 7f5569646640 15 client.4777.objecter _finish_op 25 2026-02-24T19:18:04.961 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.952+0000 7f5569646640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.961 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.952+0000 7f5569646640 15 client.4777.objecter _session_op_remove 12 25 2026-02-24T19:18:04.961 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.952+0000 7f5569646640 5 client.4777.objecter 0 in flight 2026-02-24T19:18:04.961 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (2 ms) 2026-02-24T19:18:04.961 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2026-02-24T19:18:04.961 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.952+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e084780 2026-02-24T19:18:04.961 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.952+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base exist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:04.961 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.952+0000 7f556b38f880 20 client.4777.objecter _calc_target target exist @28 -> pgid 28.d3a59201 2026-02-24T19:18:04.961 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.952+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.d3a59201 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:04.961 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.952+0000 7f556b38f880 10 client.4777.objecter chose random osd.12 of [12,4] 2026-02-24T19:18:04.961 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.952+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:04.961 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.952+0000 7f556b38f880 10 client.4777.objecter _op_submit oid exist '@28' '@28' [read 0~0] tid 27 osd.12 2026-02-24T19:18:04.962 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.952+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:04.962 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.952+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 12 27 2026-02-24T19:18:04.962 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.952+0000 7f556b38f880 15 client.4777.objecter _send_op 27 to 28.1 on osd.12 2026-02-24T19:18:04.962 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.952+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6801/1483397197 -- osd_op(unknown.0.0:27 28.1 28:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e36) -- 0x56539e082da0 con 0x56539e07b3c0 2026-02-24T19:18:04.962 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.952+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.962 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.952+0000 7f556b38f880 5 client.4777.objecter 1 in flight 2026-02-24T19:18:04.962 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.952+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e085070 2026-02-24T19:18:04.962 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.952+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base noexist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:04.962 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.952+0000 7f556b38f880 20 client.4777.objecter _calc_target target noexist @28 -> pgid 28.a7bbaa1 2026-02-24T19:18:04.962 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.952+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.a7bbaa1 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:04.962 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.952+0000 7f556b38f880 10 client.4777.objecter chose random osd.12 of [12,4] 2026-02-24T19:18:04.963 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.952+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.964 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.952+0000 7f556b38f880 10 client.4777.objecter _op_submit oid noexist '@28' '@28' [read 0~0] tid 28 osd.12 2026-02-24T19:18:04.964 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.952+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.964 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.952+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 12 28 2026-02-24T19:18:04.964 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.952+0000 7f556b38f880 15 client.4777.objecter _send_op 28 to 28.1 on osd.12 2026-02-24T19:18:04.964 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.952+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6801/1483397197 -- osd_op(unknown.0.0:28 28.1 28:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e36) -- 0x56539dfbca10 con 0x56539e07b3c0 2026-02-24T19:18:04.964 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.952+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 5 2026-02-24T19:18:04.964 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.952+0000 7f556b38f880 5 client.4777.objecter 2 in flight 2026-02-24T19:18:04.964 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 17 ==== osd_op_reply(27 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 1720255666 0 3741568377) 0x7f555c0040e0 con 0x56539e07b3c0 2026-02-24T19:18:04.964 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(27 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-24T19:18:04.964 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f5569646640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:04.964 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f5569646640 7 client.4777.objecter handle_osd_op_reply 27 ondisk uv 6 in 28.1 attempt 0 2026-02-24T19:18:04.965 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f5569646640 10 client.4777.objecter op 0 rval 0 len 5 2026-02-24T19:18:04.965 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f5569646640 15 client.4777.objecter handle_osd_op_reply completed tid 27 2026-02-24T19:18:04.965 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f5569646640 15 client.4777.objecter _finish_op 27 2026-02-24T19:18:04.965 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f5569646640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 5 2026-02-24T19:18:04.965 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f5569646640 15 client.4777.objecter _session_op_remove 12 27 2026-02-24T19:18:04.965 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f5569646640 5 client.4777.objecter 1 in flight 2026-02-24T19:18:04.965 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 18 ==== osd_op_reply(28 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3668513384 0 0) 0x7f555c0040e0 con 0x56539e07b3c0 2026-02-24T19:18:04.965 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(28 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:04.965 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f5569646640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:04.965 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f5569646640 7 client.4777.objecter handle_osd_op_reply 28 ondisk uv 0 in 28.1 attempt 0 2026-02-24T19:18:04.965 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f5569646640 10 client.4777.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:04.965 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f5569646640 10 client.4777.objecter op 0 rval 0 len 0 2026-02-24T19:18:04.966 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f5569646640 15 client.4777.objecter handle_osd_op_reply completed tid 28 2026-02-24T19:18:04.966 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f5569646640 15 client.4777.objecter _finish_op 28 2026-02-24T19:18:04.966 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f5569646640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.966 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f5569646640 15 client.4777.objecter _session_op_remove 12 28 2026-02-24T19:18:04.966 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f5569646640 5 client.4777.objecter 0 in flight 2026-02-24T19:18:04.966 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (4 ms) 2026-02-24T19:18:04.966 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationAwaitable 2026-02-24T19:18:04.966 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e084780 2026-02-24T19:18:04.966 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base exist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:04.966 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f556b38f880 20 client.4777.objecter _calc_target target exist @28 -> pgid 28.d3a59201 2026-02-24T19:18:04.966 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.d3a59201 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:04.966 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f556b38f880 10 client.4777.objecter chose random osd.12 of [12,4] 2026-02-24T19:18:04.966 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:04.967 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f556b38f880 10 client.4777.objecter _op_submit oid exist '@28' '@28' [read 0~0] tid 29 osd.12 2026-02-24T19:18:04.967 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:04.967 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 12 29 2026-02-24T19:18:04.967 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f556b38f880 15 client.4777.objecter _send_op 29 to 28.1 on osd.12 2026-02-24T19:18:04.967 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6801/1483397197 -- osd_op(unknown.0.0:29 28.1 28:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e36) -- 0x56539e082da0 con 0x56539e07b3c0 2026-02-24T19:18:04.967 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.967 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f556b38f880 5 client.4777.objecter 1 in flight 2026-02-24T19:18:04.967 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e085070 2026-02-24T19:18:04.967 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base noexist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:04.967 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f556b38f880 20 client.4777.objecter _calc_target target noexist @28 -> pgid 28.a7bbaa1 2026-02-24T19:18:04.967 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.a7bbaa1 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:04.967 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f556b38f880 10 client.4777.objecter chose random osd.12 of [12,4] 2026-02-24T19:18:04.967 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.968 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f556b38f880 10 client.4777.objecter _op_submit oid noexist '@28' '@28' [read 0~0] tid 30 osd.12 2026-02-24T19:18:04.968 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.968 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 12 30 2026-02-24T19:18:04.968 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f556b38f880 15 client.4777.objecter _send_op 30 to 28.1 on osd.12 2026-02-24T19:18:04.968 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6801/1483397197 -- osd_op(unknown.0.0:30 28.1 28:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e36) -- 0x56539dfbca10 con 0x56539e07b3c0 2026-02-24T19:18:04.968 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 5 2026-02-24T19:18:04.968 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.956+0000 7f556b38f880 5 client.4777.objecter 2 in flight 2026-02-24T19:18:04.968 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.960+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 19 ==== osd_op_reply(29 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 1720255666 0 3741568377) 0x7f555c0040e0 con 0x56539e07b3c0 2026-02-24T19:18:04.968 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.960+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(29 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-24T19:18:04.968 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.960+0000 7f5569646640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:04.968 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.960+0000 7f5569646640 7 client.4777.objecter handle_osd_op_reply 29 ondisk uv 6 in 28.1 attempt 0 2026-02-24T19:18:04.968 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.960+0000 7f5569646640 10 client.4777.objecter op 0 rval 0 len 5 2026-02-24T19:18:04.969 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.960+0000 7f5569646640 15 client.4777.objecter handle_osd_op_reply completed tid 29 2026-02-24T19:18:04.969 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.960+0000 7f5569646640 15 client.4777.objecter _finish_op 29 2026-02-24T19:18:04.969 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.960+0000 7f5569646640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 5 2026-02-24T19:18:04.969 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.960+0000 7f5569646640 15 client.4777.objecter _session_op_remove 12 29 2026-02-24T19:18:04.969 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.960+0000 7f5569646640 5 client.4777.objecter 1 in flight 2026-02-24T19:18:04.969 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.960+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 20 ==== osd_op_reply(30 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3668513384 0 0) 0x7f555c0040e0 con 0x56539e07b3c0 2026-02-24T19:18:04.969 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.960+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(30 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:04.969 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.960+0000 7f5569646640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:04.969 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.960+0000 7f5569646640 7 client.4777.objecter handle_osd_op_reply 30 ondisk uv 0 in 28.1 attempt 0 2026-02-24T19:18:04.969 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.960+0000 7f5569646640 10 client.4777.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:04.969 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.960+0000 7f5569646640 10 client.4777.objecter op 0 rval 0 len 0 2026-02-24T19:18:04.969 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.960+0000 7f5569646640 15 client.4777.objecter handle_osd_op_reply completed tid 30 2026-02-24T19:18:04.969 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.960+0000 7f5569646640 15 client.4777.objecter _finish_op 30 2026-02-24T19:18:04.970 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.960+0000 7f5569646640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.970 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.960+0000 7f5569646640 15 client.4777.objecter _session_op_remove 12 30 2026-02-24T19:18:04.970 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.960+0000 7f5569646640 5 client.4777.objecter 0 in flight 2026-02-24T19:18:04.970 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationAwaitable (4 ms) 2026-02-24T19:18:04.970 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2026-02-24T19:18:04.970 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.960+0000 7f556b38f880 20 librados: queue_aio_write 0x56539df13390 completion 0x56539e08b330 write_seq 6 2026-02-24T19:18:04.970 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.960+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e084780 2026-02-24T19:18:04.970 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.960+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base exist @28 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:04.970 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.960+0000 7f556b38f880 20 client.4777.objecter _calc_target target exist @28 -> pgid 28.d3a59201 2026-02-24T19:18:04.979 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.960+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.d3a59201 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:04.979 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.960+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:04.979 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.960+0000 7f556b38f880 10 client.4777.objecter _op_submit oid exist '@28' '@28' [writefull 0~5 in=5b] tid 31 osd.12 2026-02-24T19:18:04.979 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.960+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:04.979 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.960+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 12 31 2026-02-24T19:18:04.979 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.960+0000 7f556b38f880 15 client.4777.objecter _send_op 31 to 28.1 on osd.12 2026-02-24T19:18:04.979 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.960+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6801/1483397197 -- osd_op(unknown.0.0:31 28.1 28:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56539e082da0 con 0x56539e07b3c0 2026-02-24T19:18:04.980 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.960+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.980 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.960+0000 7f556b38f880 5 client.4777.objecter 1 in flight 2026-02-24T19:18:04.980 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.977+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 21 ==== osd_op_reply(31 exist [writefull 0~5] v36'7 uv7 ondisk = 0) ==== 149+0+0 (unknown 395586201 0 0) 0x7f555c0040e0 con 0x56539e07b3c0 2026-02-24T19:18:04.980 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.977+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(31 exist [writefull 0~5] v36'7 uv7 ondisk = 0) 2026-02-24T19:18:04.980 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.977+0000 7f5569646640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:04.980 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.977+0000 7f5569646640 7 client.4777.objecter handle_osd_op_reply 31 ondisk uv 7 in 28.1 attempt 0 2026-02-24T19:18:04.980 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.977+0000 7f5569646640 10 client.4777.objecter op 0 rval 0 len 0 2026-02-24T19:18:04.980 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.977+0000 7f5569646640 15 client.4777.objecter handle_osd_op_reply completed tid 31 2026-02-24T19:18:04.980 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.977+0000 7f5569646640 15 client.4777.objecter _finish_op 31 2026-02-24T19:18:04.980 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.977+0000 7f5569646640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.980 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.977+0000 7f5569646640 15 client.4777.objecter _session_op_remove 12 31 2026-02-24T19:18:04.980 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.977+0000 7f5569646640 5 client.4777.objecter 0 in flight 2026-02-24T19:18:04.981 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.977+0000 7f5569646640 20 librados: complete_aio_write 0x56539e08b330 2026-02-24T19:18:04.981 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (16 ms) 2026-02-24T19:18:04.981 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationDeferred 2026-02-24T19:18:04.981 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.977+0000 7f556b38f880 20 librados: queue_aio_write 0x56539df13390 completion 0x56539e081840 write_seq 7 2026-02-24T19:18:04.981 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.977+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e084780 2026-02-24T19:18:04.981 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.977+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base exist @28 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:04.981 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.977+0000 7f556b38f880 20 client.4777.objecter _calc_target target exist @28 -> pgid 28.d3a59201 2026-02-24T19:18:04.981 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.977+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.d3a59201 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:04.981 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.977+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:04.981 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.977+0000 7f556b38f880 10 client.4777.objecter _op_submit oid exist '@28' '@28' [writefull 0~5 in=5b] tid 32 osd.12 2026-02-24T19:18:04.992 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.977+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:04.992 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.977+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 12 32 2026-02-24T19:18:04.992 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.977+0000 7f556b38f880 15 client.4777.objecter _send_op 32 to 28.1 on osd.12 2026-02-24T19:18:04.992 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.977+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6801/1483397197 -- osd_op(unknown.0.0:32 28.1 28:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56539e082da0 con 0x56539e07b3c0 2026-02-24T19:18:04.992 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.977+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.993 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.977+0000 7f556b38f880 5 client.4777.objecter 1 in flight 2026-02-24T19:18:04.993 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.990+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 22 ==== osd_op_reply(32 exist [writefull 0~5] v36'8 uv8 ondisk = 0) ==== 149+0+0 (unknown 4157225719 0 0) 0x7f555c0040e0 con 0x56539e07b3c0 2026-02-24T19:18:04.993 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.990+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(32 exist [writefull 0~5] v36'8 uv8 ondisk = 0) 2026-02-24T19:18:04.993 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.990+0000 7f5569646640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:04.993 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.990+0000 7f5569646640 7 client.4777.objecter handle_osd_op_reply 32 ondisk uv 8 in 28.1 attempt 0 2026-02-24T19:18:04.993 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.990+0000 7f5569646640 10 client.4777.objecter op 0 rval 0 len 0 2026-02-24T19:18:04.993 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.990+0000 7f5569646640 15 client.4777.objecter handle_osd_op_reply completed tid 32 2026-02-24T19:18:04.993 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.990+0000 7f5569646640 15 client.4777.objecter _finish_op 32 2026-02-24T19:18:04.993 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.990+0000 7f5569646640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:04.993 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.990+0000 7f5569646640 15 client.4777.objecter _session_op_remove 12 32 2026-02-24T19:18:04.993 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.990+0000 7f5569646640 5 client.4777.objecter 0 in flight 2026-02-24T19:18:04.993 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.990+0000 7f5569646640 20 librados: complete_aio_write 0x56539e081840 2026-02-24T19:18:04.994 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationDeferred (13 ms) 2026-02-24T19:18:04.994 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2026-02-24T19:18:04.994 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.990+0000 7f556b38f880 20 librados: queue_aio_write 0x56539df13390 completion 0x56539e08b330 write_seq 8 2026-02-24T19:18:04.994 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.990+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e084780 2026-02-24T19:18:04.994 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.990+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base exist @28 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:04.994 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.990+0000 7f556b38f880 20 client.4777.objecter _calc_target target exist @28 -> pgid 28.d3a59201 2026-02-24T19:18:04.994 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.990+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.d3a59201 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:04.994 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.990+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:04.994 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.990+0000 7f556b38f880 10 client.4777.objecter _op_submit oid exist '@28' '@28' [writefull 0~5 in=5b] tid 33 osd.12 2026-02-24T19:18:04.994 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.990+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:04.994 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.990+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 12 33 2026-02-24T19:18:04.994 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.990+0000 7f556b38f880 15 client.4777.objecter _send_op 33 to 28.1 on osd.12 2026-02-24T19:18:05.045 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.990+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6801/1483397197 -- osd_op(unknown.0.0:33 28.1 28:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56539e082da0 con 0x56539e07b3c0 2026-02-24T19:18:05.045 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.990+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:05.045 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:04.990+0000 7f556b38f880 5 client.4777.objecter 1 in flight 2026-02-24T19:18:05.046 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.028+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 23 ==== osd_op_reply(33 exist [writefull 0~5] v36'9 uv9 ondisk = 0) ==== 149+0+0 (unknown 2202698019 0 0) 0x7f555c0040e0 con 0x56539e07b3c0 2026-02-24T19:18:05.046 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.028+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(33 exist [writefull 0~5] v36'9 uv9 ondisk = 0) 2026-02-24T19:18:05.046 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.028+0000 7f5569646640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:05.046 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.028+0000 7f5569646640 7 client.4777.objecter handle_osd_op_reply 33 ondisk uv 9 in 28.1 attempt 0 2026-02-24T19:18:05.046 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.028+0000 7f5569646640 10 client.4777.objecter op 0 rval 0 len 0 2026-02-24T19:18:05.046 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.028+0000 7f5569646640 15 client.4777.objecter handle_osd_op_reply completed tid 33 2026-02-24T19:18:05.046 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.028+0000 7f5569646640 15 client.4777.objecter _finish_op 33 2026-02-24T19:18:05.046 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.028+0000 7f5569646640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:05.046 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.028+0000 7f5569646640 15 client.4777.objecter _session_op_remove 12 33 2026-02-24T19:18:05.046 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.028+0000 7f5569646640 5 client.4777.objecter 0 in flight 2026-02-24T19:18:05.046 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.028+0000 7f5569646640 20 librados: complete_aio_write 0x56539e08b330 2026-02-24T19:18:05.046 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (38 ms) 2026-02-24T19:18:05.047 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2026-02-24T19:18:05.047 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.028+0000 7f556b38f880 20 librados: queue_aio_write 0x56539df13390 completion 0x56539e081870 write_seq 9 2026-02-24T19:18:05.047 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.028+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e084780 2026-02-24T19:18:05.047 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.028+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base exist @28 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:05.047 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.028+0000 7f556b38f880 20 client.4777.objecter _calc_target target exist @28 -> pgid 28.d3a59201 2026-02-24T19:18:05.047 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.028+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.d3a59201 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:05.047 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.028+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:05.047 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.028+0000 7f556b38f880 10 client.4777.objecter _op_submit oid exist '@28' '@28' [writefull 0~5 in=5b] tid 34 osd.12 2026-02-24T19:18:05.047 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.028+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:05.047 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.028+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 12 34 2026-02-24T19:18:05.047 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.028+0000 7f556b38f880 15 client.4777.objecter _send_op 34 to 28.1 on osd.12 2026-02-24T19:18:05.047 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.028+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6801/1483397197 -- osd_op(unknown.0.0:34 28.1 28:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56539e082da0 con 0x56539e07b3c0 2026-02-24T19:18:05.047 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.028+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:05.048 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.028+0000 7f556b38f880 5 client.4777.objecter 1 in flight 2026-02-24T19:18:05.056 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.043+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 24 ==== osd_op_reply(34 exist [writefull 0~5] v36'10 uv10 ondisk = 0) ==== 149+0+0 (unknown 516640095 0 0) 0x7f555c0040e0 con 0x56539e07b3c0 2026-02-24T19:18:05.056 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.043+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(34 exist [writefull 0~5] v36'10 uv10 ondisk = 0) 2026-02-24T19:18:05.057 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.043+0000 7f5569646640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:05.057 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.043+0000 7f5569646640 7 client.4777.objecter handle_osd_op_reply 34 ondisk uv 10 in 28.1 attempt 0 2026-02-24T19:18:05.057 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.043+0000 7f5569646640 10 client.4777.objecter op 0 rval 0 len 0 2026-02-24T19:18:05.057 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.043+0000 7f5569646640 15 client.4777.objecter handle_osd_op_reply completed tid 34 2026-02-24T19:18:05.057 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.043+0000 7f5569646640 15 client.4777.objecter _finish_op 34 2026-02-24T19:18:05.057 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.043+0000 7f5569646640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:05.057 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (14 ms) 2026-02-24T19:18:05.057 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationAwaitable 2026-02-24T19:18:05.057 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.043+0000 7f5569646640 15 client.4777.objecter _session_op_remove 12 34 2026-02-24T19:18:05.057 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.043+0000 7f5569646640 5 client.4777.objecter 0 in flight 2026-02-24T19:18:05.057 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.043+0000 7f5569646640 20 librados: complete_aio_write 0x56539e081870 2026-02-24T19:18:05.057 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.043+0000 7f556b38f880 20 librados: queue_aio_write 0x56539df13390 completion 0x56539e08b330 write_seq 10 2026-02-24T19:18:05.058 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.043+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e084780 2026-02-24T19:18:05.058 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.043+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base exist @28 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:05.058 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.043+0000 7f556b38f880 20 client.4777.objecter _calc_target target exist @28 -> pgid 28.d3a59201 2026-02-24T19:18:05.058 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.043+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.d3a59201 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:05.058 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.043+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:05.058 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.043+0000 7f556b38f880 10 client.4777.objecter _op_submit oid exist '@28' '@28' [writefull 0~5 in=5b] tid 35 osd.12 2026-02-24T19:18:05.058 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.043+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:05.058 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.043+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 12 35 2026-02-24T19:18:05.058 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.043+0000 7f556b38f880 15 client.4777.objecter _send_op 35 to 28.1 on osd.12 2026-02-24T19:18:05.058 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.043+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6801/1483397197 -- osd_op(unknown.0.0:35 28.1 28:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56539e082da0 con 0x56539e07b3c0 2026-02-24T19:18:05.058 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.043+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:05.058 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.043+0000 7f556b38f880 5 client.4777.objecter 1 in flight 2026-02-24T19:18:05.059 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 25 ==== osd_op_reply(35 exist [writefull 0~5] v36'11 uv11 ondisk = 0) ==== 149+0+0 (unknown 1783363211 0 0) 0x7f555c0040e0 con 0x56539e07b3c0 2026-02-24T19:18:05.059 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(35 exist [writefull 0~5] v36'11 uv11 ondisk = 0) 2026-02-24T19:18:05.059 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f5569646640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:05.059 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f5569646640 7 client.4777.objecter handle_osd_op_reply 35 ondisk uv 11 in 28.1 attempt 0 2026-02-24T19:18:05.059 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f5569646640 10 client.4777.objecter op 0 rval 0 len 0 2026-02-24T19:18:05.059 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f5569646640 15 client.4777.objecter handle_osd_op_reply completed tid 35 2026-02-24T19:18:05.059 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f5569646640 15 client.4777.objecter _finish_op 35 2026-02-24T19:18:05.059 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f5569646640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:05.059 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f5569646640 15 client.4777.objecter _session_op_remove 12 35 2026-02-24T19:18:05.059 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f5569646640 5 client.4777.objecter 0 in flight 2026-02-24T19:18:05.059 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f5569646640 20 librados: complete_aio_write 0x56539e08b330 2026-02-24T19:18:05.059 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationAwaitable (10 ms) 2026-02-24T19:18:05.059 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyCallback 2026-02-24T19:18:05.060 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 10 client.4777.objecter linger_register info 0x56539e084780 linger_id 1 cookie 94917133617024 2026-02-24T19:18:05.060 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base exist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:05.060 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 20 client.4777.objecter _calc_target target exist @28 -> pgid 28.d3a59201 2026-02-24T19:18:05.060 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.d3a59201 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:05.060 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:05.060 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:05.060 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 15 client.4777.objecter _session_linger_op_assign 12 1 2026-02-24T19:18:05.060 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:05.060 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 15 client.4777.objecter send_linger 1 register 2026-02-24T19:18:05.060 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e085160 2026-02-24T19:18:05.060 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base exist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:05.060 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 20 client.4777.objecter _calc_target target exist @28 -> pgid 28.d3a59201 2026-02-24T19:18:05.060 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:05.061 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 10 client.4777.objecter _op_submit oid exist '@28' '@28' [notify cookie 94917133617024 in=17b] tid 36 osd.12 2026-02-24T19:18:05.061 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:05.061 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 12 36 2026-02-24T19:18:05.061 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 15 client.4777.objecter _send_op 36 to 28.1 on osd.12 2026-02-24T19:18:05.061 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6801/1483397197 -- osd_op(unknown.0.0:36 28.1 28:8049a5cb:::exist:head [notify cookie 94917133617024 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56539e082da0 con 0x56539e07b3c0 2026-02-24T19:18:05.070 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 5 2026-02-24T19:18:05.070 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 5 client.4777.objecter 1 in flight 2026-02-24T19:18:05.070 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 10 client.4777.objecter linger_register info 0x56539dfbeb40 linger_id 2 cookie 94917132806976 2026-02-24T19:18:05.070 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base noexist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:05.070 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 20 client.4777.objecter _calc_target target noexist @28 -> pgid 28.a7bbaa1 2026-02-24T19:18:05.070 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.a7bbaa1 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:05.070 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 5 2026-02-24T19:18:05.070 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 5 2026-02-24T19:18:05.070 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 15 client.4777.objecter _session_linger_op_assign 12 2 2026-02-24T19:18:05.070 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 6 2026-02-24T19:18:05.070 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 15 client.4777.objecter send_linger 2 register 2026-02-24T19:18:05.071 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539dfc00e0 2026-02-24T19:18:05.071 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base noexist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:05.071 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 20 client.4777.objecter _calc_target target noexist @28 -> pgid 28.a7bbaa1 2026-02-24T19:18:05.071 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 6 2026-02-24T19:18:05.071 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 10 client.4777.objecter _op_submit oid noexist '@28' '@28' [notify cookie 94917132806976 in=17b] tid 37 osd.12 2026-02-24T19:18:05.071 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 6 2026-02-24T19:18:05.071 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 12 37 2026-02-24T19:18:05.071 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 15 client.4777.objecter _send_op 37 to 28.1 on osd.12 2026-02-24T19:18:05.071 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6801/1483397197 -- osd_op(unknown.0.0:37 28.1 28:855dde50:::noexist:head [notify cookie 94917132806976 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56539dfc06a0 con 0x56539e07b3c0 2026-02-24T19:18:05.071 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 7 2026-02-24T19:18:05.071 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.054+0000 7f556b38f880 5 client.4777.objecter 2 in flight 2026-02-24T19:18:05.071 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 26 ==== watch-notify(notify_complete (2) cookie 94917133617024 notify 154618822656 ret 0) ==== 42+0+8 (unknown 2593230941 0 0) 0x7f555c009020 con 0x56539e07b3c0 2026-02-24T19:18:05.071 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 watch-notify(notify_complete (2) cookie 94917133617024 notify 154618822656 ret 0) 2026-02-24T19:18:05.072 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 27 ==== osd_op_reply(36 exist [notify cookie 94917133617024 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 3875089571 0 2886149496) 0x7f555c0040e0 con 0x56539e07b3c0 2026-02-24T19:18:05.072 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(36 exist [notify cookie 94917133617024 out=8b] v0'0 uv11 ondisk = 0) 2026-02-24T19:18:05.072 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f5569646640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:05.072 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f5569646640 7 client.4777.objecter handle_osd_op_reply 36 ondisk uv 11 in 28.1 attempt 0 2026-02-24T19:18:05.072 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f5569646640 10 client.4777.objecter op 0 rval 0 len 8 2026-02-24T19:18:05.072 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f5569646640 15 client.4777.objecter handle_osd_op_reply completed tid 36 2026-02-24T19:18:05.072 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f5569646640 15 client.4777.objecter _finish_op 36 2026-02-24T19:18:05.072 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f5562ffd640 10 librados: operator() completed notify (linger op 0x56539e084780), ec = system:0 2026-02-24T19:18:05.072 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f5569646640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 7 2026-02-24T19:18:05.072 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f5569646640 15 client.4777.objecter _session_op_remove 12 36 2026-02-24T19:18:05.072 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f5569646640 5 client.4777.objecter 1 in flight 2026-02-24T19:18:05.072 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f55627fc640 10 client.4777.objecter _linger_commit 1 2026-02-24T19:18:05.073 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f55627fc640 10 client.4777.objecter _linger_commit notify_id=154618822656 2026-02-24T19:18:05.073 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 28 ==== osd_op_reply(37 noexist [notify cookie 94917132806976] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2430327362 0 0) 0x7f555c0040e0 con 0x56539e07b3c0 2026-02-24T19:18:05.073 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(37 noexist [notify cookie 94917132806976] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:05.073 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f5569646640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:05.073 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f5569646640 7 client.4777.objecter handle_osd_op_reply 37 ondisk uv 0 in 28.1 attempt 0 2026-02-24T19:18:05.073 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f5569646640 10 client.4777.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:05.073 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f5569646640 10 client.4777.objecter op 0 rval 0 len 0 2026-02-24T19:18:05.073 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f5569646640 15 client.4777.objecter handle_osd_op_reply completed tid 37 2026-02-24T19:18:05.073 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f5569646640 15 client.4777.objecter _finish_op 37 2026-02-24T19:18:05.073 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f5569646640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 6 2026-02-24T19:18:05.073 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f55627fc640 10 librados: finish linger op 0x56539e084780 acked (0) 2026-02-24T19:18:05.073 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f5569646640 15 client.4777.objecter _session_op_remove 12 37 2026-02-24T19:18:05.073 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f5569646640 5 client.4777.objecter 0 in flight 2026-02-24T19:18:05.074 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f55627fc640 20 client.4777.objecter _linger_cancel linger_id=1 2026-02-24T19:18:05.074 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyCallback (13 ms) 2026-02-24T19:18:05.074 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f55627fc640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 5 2026-02-24T19:18:05.074 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f55627fc640 15 client.4777.objecter _session_linger_op_remove 12 1 2026-02-24T19:18:05.074 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyDeferred 2026-02-24T19:18:05.074 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f5562ffd640 10 client.4777.objecter _linger_commit 2 2026-02-24T19:18:05.074 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f5562ffd640 10 librados: finish linger op 0x56539dfbeb40 acked (-2) 2026-02-24T19:18:05.074 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f55627fc640 10 librados: operator() completed notify (linger op 0x56539dfbeb40), ec = osd:2 2026-02-24T19:18:05.074 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f55627fc640 20 client.4777.objecter _linger_cancel linger_id=2 2026-02-24T19:18:05.074 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f55627fc640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:05.074 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f55627fc640 15 client.4777.objecter _session_linger_op_remove 12 2 2026-02-24T19:18:05.074 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 10 client.4777.objecter linger_register info 0x56539dfc06a0 linger_id 3 cookie 94917132813984 2026-02-24T19:18:05.075 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base exist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:05.075 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 20 client.4777.objecter _calc_target target exist @28 -> pgid 28.d3a59201 2026-02-24T19:18:05.075 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.d3a59201 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:05.075 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:05.075 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:05.075 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 15 client.4777.objecter _session_linger_op_assign 12 3 2026-02-24T19:18:05.075 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:05.075 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 15 client.4777.objecter send_linger 3 register 2026-02-24T19:18:05.075 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e085160 2026-02-24T19:18:05.075 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base exist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:05.075 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 20 client.4777.objecter _calc_target target exist @28 -> pgid 28.d3a59201 2026-02-24T19:18:05.075 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:05.075 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 10 client.4777.objecter _op_submit oid exist '@28' '@28' [notify cookie 94917132813984 in=17b] tid 38 osd.12 2026-02-24T19:18:05.075 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:05.076 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 12 38 2026-02-24T19:18:05.076 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 15 client.4777.objecter _send_op 38 to 28.1 on osd.12 2026-02-24T19:18:05.076 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6801/1483397197 -- osd_op(unknown.0.0:38 28.1 28:8049a5cb:::exist:head [notify cookie 94917132813984 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56539e082da0 con 0x56539e07b3c0 2026-02-24T19:18:05.076 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 5 2026-02-24T19:18:05.076 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 5 client.4777.objecter 1 in flight 2026-02-24T19:18:05.076 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 10 client.4777.objecter linger_register info 0x56539dfc0080 linger_id 4 cookie 94917132812416 2026-02-24T19:18:05.076 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base noexist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:05.076 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 20 client.4777.objecter _calc_target target noexist @28 -> pgid 28.a7bbaa1 2026-02-24T19:18:05.076 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.a7bbaa1 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:05.077 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 5 2026-02-24T19:18:05.077 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 5 2026-02-24T19:18:05.077 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 15 client.4777.objecter _session_linger_op_assign 12 4 2026-02-24T19:18:05.077 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 6 2026-02-24T19:18:05.077 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 15 client.4777.objecter send_linger 4 register 2026-02-24T19:18:05.077 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539dfbfa40 2026-02-24T19:18:05.077 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base noexist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:05.078 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 20 client.4777.objecter _calc_target target noexist @28 -> pgid 28.a7bbaa1 2026-02-24T19:18:05.078 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 6 2026-02-24T19:18:05.078 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 10 client.4777.objecter _op_submit oid noexist '@28' '@28' [notify cookie 94917132812416 in=17b] tid 39 osd.12 2026-02-24T19:18:05.078 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 6 2026-02-24T19:18:05.078 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 12 39 2026-02-24T19:18:05.078 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 15 client.4777.objecter _send_op 39 to 28.1 on osd.12 2026-02-24T19:18:05.078 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6801/1483397197 -- osd_op(unknown.0.0:39 28.1 28:855dde50:::noexist:head [notify cookie 94917132812416 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56539e1c2ce0 con 0x56539e07b3c0 2026-02-24T19:18:05.078 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 7 2026-02-24T19:18:05.078 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.067+0000 7f556b38f880 5 client.4777.objecter 2 in flight 2026-02-24T19:18:05.078 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 29 ==== watch-notify(notify_complete (2) cookie 94917132813984 notify 154618822657 ret 0) ==== 42+0+8 (unknown 1803680421 0 0) 0x7f555c009020 con 0x56539e07b3c0 2026-02-24T19:18:05.078 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 watch-notify(notify_complete (2) cookie 94917132813984 notify 154618822657 ret 0) 2026-02-24T19:18:05.078 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 30 ==== osd_op_reply(38 exist [notify cookie 94917132813984 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 1341081452 0 3845871711) 0x7f555c0040e0 con 0x56539e07b3c0 2026-02-24T19:18:05.079 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(38 exist [notify cookie 94917132813984 out=8b] v0'0 uv11 ondisk = 0) 2026-02-24T19:18:05.079 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f5569646640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:05.079 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f5562ffd640 10 librados: operator() completed notify (linger op 0x56539dfc06a0), ec = system:0 2026-02-24T19:18:05.079 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f5569646640 7 client.4777.objecter handle_osd_op_reply 38 ondisk uv 11 in 28.1 attempt 0 2026-02-24T19:18:05.079 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f5569646640 10 client.4777.objecter op 0 rval 0 len 8 2026-02-24T19:18:05.079 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f5569646640 15 client.4777.objecter handle_osd_op_reply completed tid 38 2026-02-24T19:18:05.079 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f5569646640 15 client.4777.objecter _finish_op 38 2026-02-24T19:18:05.079 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f5569646640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 7 2026-02-24T19:18:05.079 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f5569646640 15 client.4777.objecter _session_op_remove 12 38 2026-02-24T19:18:05.079 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f5569646640 5 client.4777.objecter 1 in flight 2026-02-24T19:18:05.079 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f55627fc640 10 client.4777.objecter _linger_commit 3 2026-02-24T19:18:05.079 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 31 ==== osd_op_reply(39 noexist [notify cookie 94917132812416] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2098709068 0 0) 0x7f555c0040e0 con 0x56539e07b3c0 2026-02-24T19:18:05.080 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f55627fc640 10 client.4777.objecter _linger_commit notify_id=154618822657 2026-02-24T19:18:05.080 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(39 noexist [notify cookie 94917132812416] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:05.080 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f5569646640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:05.080 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f55627fc640 10 librados: finish linger op 0x56539dfc06a0 acked (0) 2026-02-24T19:18:05.080 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f5569646640 7 client.4777.objecter handle_osd_op_reply 39 ondisk uv 0 in 28.1 attempt 0 2026-02-24T19:18:05.080 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f5569646640 10 client.4777.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:05.080 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f55627fc640 20 client.4777.objecter _linger_cancel linger_id=3 2026-02-24T19:18:05.080 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f5569646640 10 client.4777.objecter op 0 rval 0 len 0 2026-02-24T19:18:05.080 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f5569646640 15 client.4777.objecter handle_osd_op_reply completed tid 39 2026-02-24T19:18:05.080 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f5569646640 15 client.4777.objecter _finish_op 39 2026-02-24T19:18:05.080 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f5569646640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 6 2026-02-24T19:18:05.080 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f5569646640 15 client.4777.objecter _session_op_remove 12 39 2026-02-24T19:18:05.080 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f5569646640 5 client.4777.objecter 0 in flight 2026-02-24T19:18:05.081 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f55627fc640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:05.081 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f55627fc640 15 client.4777.objecter _session_linger_op_remove 12 3 2026-02-24T19:18:05.081 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f5562ffd640 10 client.4777.objecter _linger_commit 4 2026-02-24T19:18:05.081 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f5562ffd640 10 librados: finish linger op 0x56539dfc0080 acked (-2) 2026-02-24T19:18:05.081 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f5562ffd640 10 librados: operator() completed notify (linger op 0x56539dfc0080), ec = osd:2 2026-02-24T19:18:05.081 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f5562ffd640 20 client.4777.objecter _linger_cancel linger_id=4 2026-02-24T19:18:05.081 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f5562ffd640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:05.081 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f5562ffd640 15 client.4777.objecter _session_linger_op_remove 12 4 2026-02-24T19:18:05.081 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyDeferred (5 ms) 2026-02-24T19:18:05.081 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyFuture 2026-02-24T19:18:05.081 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 10 client.4777.objecter linger_register info 0x56539dfc06a0 linger_id 5 cookie 94917132813984 2026-02-24T19:18:05.081 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base exist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:05.081 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 20 client.4777.objecter _calc_target target exist @28 -> pgid 28.d3a59201 2026-02-24T19:18:05.082 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.d3a59201 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:05.082 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:05.082 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:05.082 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 15 client.4777.objecter _session_linger_op_assign 12 5 2026-02-24T19:18:05.082 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:05.082 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 15 client.4777.objecter send_linger 5 register 2026-02-24T19:18:05.082 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539dfc0000 2026-02-24T19:18:05.082 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base exist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:05.082 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 20 client.4777.objecter _calc_target target exist @28 -> pgid 28.d3a59201 2026-02-24T19:18:05.082 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:05.082 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 10 client.4777.objecter _op_submit oid exist '@28' '@28' [notify cookie 94917132813984 in=17b] tid 40 osd.12 2026-02-24T19:18:05.082 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:05.083 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 12 40 2026-02-24T19:18:05.083 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 15 client.4777.objecter _send_op 40 to 28.1 on osd.12 2026-02-24T19:18:05.083 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6801/1483397197 -- osd_op(unknown.0.0:40 28.1 28:8049a5cb:::exist:head [notify cookie 94917132813984 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56539e082da0 con 0x56539e07b3c0 2026-02-24T19:18:05.083 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 5 2026-02-24T19:18:05.083 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 5 client.4777.objecter 1 in flight 2026-02-24T19:18:05.083 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 10 client.4777.objecter linger_register info 0x56539e085160 linger_id 6 cookie 94917133619552 2026-02-24T19:18:05.083 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base noexist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:05.083 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 20 client.4777.objecter _calc_target target noexist @28 -> pgid 28.a7bbaa1 2026-02-24T19:18:05.083 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.a7bbaa1 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:05.083 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 5 2026-02-24T19:18:05.083 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 5 2026-02-24T19:18:05.083 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 15 client.4777.objecter _session_linger_op_assign 12 6 2026-02-24T19:18:05.083 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 6 2026-02-24T19:18:05.084 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 15 client.4777.objecter send_linger 6 register 2026-02-24T19:18:05.084 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539dfbfa40 2026-02-24T19:18:05.084 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base noexist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:05.084 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 20 client.4777.objecter _calc_target target noexist @28 -> pgid 28.a7bbaa1 2026-02-24T19:18:05.085 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 6 2026-02-24T19:18:05.085 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 10 client.4777.objecter _op_submit oid noexist '@28' '@28' [notify cookie 94917133619552 in=17b] tid 41 osd.12 2026-02-24T19:18:05.085 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 6 2026-02-24T19:18:05.085 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 12 41 2026-02-24T19:18:05.085 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 15 client.4777.objecter _send_op 41 to 28.1 on osd.12 2026-02-24T19:18:05.085 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6801/1483397197 -- osd_op(unknown.0.0:41 28.1 28:855dde50:::noexist:head [notify cookie 94917133619552 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56539e1c1d10 con 0x56539e07b3c0 2026-02-24T19:18:05.085 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 7 2026-02-24T19:18:05.085 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.073+0000 7f556b38f880 5 client.4777.objecter 2 in flight 2026-02-24T19:18:05.085 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 32 ==== watch-notify(notify_complete (2) cookie 94917132813984 notify 154618822658 ret 0) ==== 42+0+8 (unknown 2696793030 0 0) 0x7f555c009020 con 0x56539e07b3c0 2026-02-24T19:18:05.085 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 watch-notify(notify_complete (2) cookie 94917132813984 notify 154618822658 ret 0) 2026-02-24T19:18:05.085 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 33 ==== osd_op_reply(40 exist [notify cookie 94917132813984 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 1341081452 0 1048567606) 0x7f555c0040e0 con 0x56539e07b3c0 2026-02-24T19:18:05.085 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(40 exist [notify cookie 94917132813984 out=8b] v0'0 uv11 ondisk = 0) 2026-02-24T19:18:05.086 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f5569646640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:05.086 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f5569646640 7 client.4777.objecter handle_osd_op_reply 40 ondisk uv 11 in 28.1 attempt 0 2026-02-24T19:18:05.086 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f5569646640 10 client.4777.objecter op 0 rval 0 len 8 2026-02-24T19:18:05.086 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f5569646640 15 client.4777.objecter handle_osd_op_reply completed tid 40 2026-02-24T19:18:05.086 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f5569646640 15 client.4777.objecter _finish_op 40 2026-02-24T19:18:05.086 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f5569646640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 7 2026-02-24T19:18:05.086 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f5569646640 15 client.4777.objecter _session_op_remove 12 40 2026-02-24T19:18:05.086 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f5569646640 5 client.4777.objecter 1 in flight 2026-02-24T19:18:05.086 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f55627fc640 10 librados: operator() completed notify (linger op 0x56539dfc06a0), ec = system:0 2026-02-24T19:18:05.086 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f55627fc640 10 client.4777.objecter _linger_commit 5 2026-02-24T19:18:05.086 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 34 ==== osd_op_reply(41 noexist [notify cookie 94917133619552] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 1569373519 0 0) 0x7f555c0040e0 con 0x56539e07b3c0 2026-02-24T19:18:05.086 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f55627fc640 10 client.4777.objecter _linger_commit notify_id=154618822658 2026-02-24T19:18:05.087 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(41 noexist [notify cookie 94917133619552] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:05.087 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f5569646640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:05.087 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f5569646640 7 client.4777.objecter handle_osd_op_reply 41 ondisk uv 0 in 28.1 attempt 0 2026-02-24T19:18:05.087 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f5569646640 10 client.4777.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:05.087 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f5569646640 10 client.4777.objecter op 0 rval 0 len 0 2026-02-24T19:18:05.087 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f5569646640 15 client.4777.objecter handle_osd_op_reply completed tid 41 2026-02-24T19:18:05.087 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f5569646640 15 client.4777.objecter _finish_op 41 2026-02-24T19:18:05.087 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f5569646640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 6 2026-02-24T19:18:05.087 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f5569646640 15 client.4777.objecter _session_op_remove 12 41 2026-02-24T19:18:05.087 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f55627fc640 10 librados: finish linger op 0x56539dfc06a0 acked (0) 2026-02-24T19:18:05.087 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f5569646640 5 client.4777.objecter 0 in flight 2026-02-24T19:18:05.087 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f55627fc640 10 client.4777.objecter _linger_commit 6 2026-02-24T19:18:05.087 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f5562ffd640 20 client.4777.objecter _linger_cancel linger_id=5 2026-02-24T19:18:05.087 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f5562ffd640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:05.088 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f5562ffd640 15 client.4777.objecter _session_linger_op_remove 12 5 2026-02-24T19:18:05.088 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f55627fc640 10 librados: finish linger op 0x56539e085160 acked (-2) 2026-02-24T19:18:05.088 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f55627fc640 10 librados: operator() completed notify (linger op 0x56539e085160), ec = osd:2 2026-02-24T19:18:05.088 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f55627fc640 20 client.4777.objecter _linger_cancel linger_id=6 2026-02-24T19:18:05.088 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f55627fc640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:05.088 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyFuture (6 ms) 2026-02-24T19:18:05.088 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f55627fc640 15 client.4777.objecter _session_linger_op_remove 12 6 2026-02-24T19:18:05.088 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyYield 2026-02-24T19:18:05.088 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 10 client.4777.objecter linger_register info 0x56539dfc06a0 linger_id 7 cookie 94917132813984 2026-02-24T19:18:05.088 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base exist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:05.088 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 20 client.4777.objecter _calc_target target exist @28 -> pgid 28.d3a59201 2026-02-24T19:18:05.088 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.d3a59201 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:05.089 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:05.089 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:05.089 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 15 client.4777.objecter _session_linger_op_assign 12 7 2026-02-24T19:18:05.089 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:05.089 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 15 client.4777.objecter send_linger 7 register 2026-02-24T19:18:05.089 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539dfc0000 2026-02-24T19:18:05.089 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base exist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:05.089 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 20 client.4777.objecter _calc_target target exist @28 -> pgid 28.d3a59201 2026-02-24T19:18:05.089 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:05.089 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 10 client.4777.objecter _op_submit oid exist '@28' '@28' [notify cookie 94917132813984 in=17b] tid 42 osd.12 2026-02-24T19:18:05.089 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:05.089 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 12 42 2026-02-24T19:18:05.090 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 15 client.4777.objecter _send_op 42 to 28.1 on osd.12 2026-02-24T19:18:05.090 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6801/1483397197 -- osd_op(unknown.0.0:42 28.1 28:8049a5cb:::exist:head [notify cookie 94917132813984 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56539e082da0 con 0x56539e07b3c0 2026-02-24T19:18:05.090 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 5 2026-02-24T19:18:05.090 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 5 client.4777.objecter 1 in flight 2026-02-24T19:18:05.090 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 10 client.4777.objecter linger_register info 0x56539dfbea30 linger_id 8 cookie 94917132806704 2026-02-24T19:18:05.090 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base noexist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:05.090 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 20 client.4777.objecter _calc_target target noexist @28 -> pgid 28.a7bbaa1 2026-02-24T19:18:05.090 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.a7bbaa1 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:05.090 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 5 2026-02-24T19:18:05.090 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 5 2026-02-24T19:18:05.090 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 15 client.4777.objecter _session_linger_op_assign 12 8 2026-02-24T19:18:05.090 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 6 2026-02-24T19:18:05.090 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 15 client.4777.objecter send_linger 8 register 2026-02-24T19:18:05.091 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e201d30 2026-02-24T19:18:05.091 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base noexist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:05.091 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 20 client.4777.objecter _calc_target target noexist @28 -> pgid 28.a7bbaa1 2026-02-24T19:18:05.091 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 6 2026-02-24T19:18:05.091 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 10 client.4777.objecter _op_submit oid noexist '@28' '@28' [notify cookie 94917132806704 in=17b] tid 43 osd.12 2026-02-24T19:18:05.091 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 6 2026-02-24T19:18:05.091 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 12 43 2026-02-24T19:18:05.091 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 15 client.4777.objecter _send_op 43 to 28.1 on osd.12 2026-02-24T19:18:05.092 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6801/1483397197 -- osd_op(unknown.0.0:43 28.1 28:855dde50:::noexist:head [notify cookie 94917132806704 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56539e082da0 con 0x56539e07b3c0 2026-02-24T19:18:05.092 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 7 2026-02-24T19:18:05.092 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.079+0000 7f556b38f880 5 client.4777.objecter 2 in flight 2026-02-24T19:18:05.092 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 35 ==== watch-notify(notify_complete (2) cookie 94917132813984 notify 154618822659 ret 0) ==== 42+0+8 (unknown 452069704 0 0) 0x7f555c009020 con 0x56539e07b3c0 2026-02-24T19:18:05.093 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 watch-notify(notify_complete (2) cookie 94917132813984 notify 154618822659 ret 0) 2026-02-24T19:18:05.093 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 36 ==== osd_op_reply(42 exist [notify cookie 94917132813984 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 1341081452 0 2000921105) 0x7f555c0040e0 con 0x56539e07b3c0 2026-02-24T19:18:05.093 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f5562ffd640 10 librados: operator() completed notify (linger op 0x56539dfc06a0), ec = system:0 2026-02-24T19:18:05.093 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(42 exist [notify cookie 94917132813984 out=8b] v0'0 uv11 ondisk = 0) 2026-02-24T19:18:05.093 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f5569646640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:05.093 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f5569646640 7 client.4777.objecter handle_osd_op_reply 42 ondisk uv 11 in 28.1 attempt 0 2026-02-24T19:18:05.093 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f5569646640 10 client.4777.objecter op 0 rval 0 len 8 2026-02-24T19:18:05.093 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f5569646640 15 client.4777.objecter handle_osd_op_reply completed tid 42 2026-02-24T19:18:05.093 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f5569646640 15 client.4777.objecter _finish_op 42 2026-02-24T19:18:05.093 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f5569646640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 7 2026-02-24T19:18:05.093 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f5569646640 15 client.4777.objecter _session_op_remove 12 42 2026-02-24T19:18:05.094 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f5569646640 5 client.4777.objecter 1 in flight 2026-02-24T19:18:05.094 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f55627fc640 10 client.4777.objecter _linger_commit 7 2026-02-24T19:18:05.094 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 37 ==== osd_op_reply(43 noexist [notify cookie 94917132806704] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 460143722 0 0) 0x7f555c0040e0 con 0x56539e07b3c0 2026-02-24T19:18:05.094 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f55627fc640 10 client.4777.objecter _linger_commit notify_id=154618822659 2026-02-24T19:18:05.094 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(43 noexist [notify cookie 94917132806704] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:05.094 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f5569646640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:05.094 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f5569646640 7 client.4777.objecter handle_osd_op_reply 43 ondisk uv 0 in 28.1 attempt 0 2026-02-24T19:18:05.094 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f55627fc640 10 librados: finish linger op 0x56539dfc06a0 acked (0) 2026-02-24T19:18:05.094 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f5569646640 10 client.4777.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:05.094 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f5569646640 10 client.4777.objecter op 0 rval 0 len 0 2026-02-24T19:18:05.094 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f55627fc640 20 client.4777.objecter _linger_cancel linger_id=7 2026-02-24T19:18:05.094 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f5569646640 15 client.4777.objecter handle_osd_op_reply completed tid 43 2026-02-24T19:18:05.094 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f5569646640 15 client.4777.objecter _finish_op 43 2026-02-24T19:18:05.095 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f5569646640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 6 2026-02-24T19:18:05.095 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f5569646640 15 client.4777.objecter _session_op_remove 12 43 2026-02-24T19:18:05.095 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f5569646640 5 client.4777.objecter 0 in flight 2026-02-24T19:18:05.095 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f55627fc640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:05.095 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f55627fc640 15 client.4777.objecter _session_linger_op_remove 12 7 2026-02-24T19:18:05.095 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f5562ffd640 10 client.4777.objecter _linger_commit 8 2026-02-24T19:18:05.095 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f5562ffd640 10 librados: finish linger op 0x56539dfbea30 acked (-2) 2026-02-24T19:18:05.095 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f5562ffd640 10 librados: operator() completed notify (linger op 0x56539dfbea30), ec = osd:2 2026-02-24T19:18:05.095 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyYield (5 ms) 2026-02-24T19:18:05.095 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f5562ffd640 20 client.4777.objecter _linger_cancel linger_id=8 2026-02-24T19:18:05.095 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyAwaitable 2026-02-24T19:18:05.095 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f5562ffd640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:05.095 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f5562ffd640 15 client.4777.objecter _session_linger_op_remove 12 8 2026-02-24T19:18:05.095 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 10 client.4777.objecter linger_register info 0x56539dfc06a0 linger_id 9 cookie 94917132813984 2026-02-24T19:18:05.096 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base exist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:05.096 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 20 client.4777.objecter _calc_target target exist @28 -> pgid 28.d3a59201 2026-02-24T19:18:05.096 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.d3a59201 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:05.096 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:05.096 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:05.096 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 15 client.4777.objecter _session_linger_op_assign 12 9 2026-02-24T19:18:05.096 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:05.096 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 15 client.4777.objecter send_linger 9 register 2026-02-24T19:18:05.096 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e085160 2026-02-24T19:18:05.096 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base exist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:05.096 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 20 client.4777.objecter _calc_target target exist @28 -> pgid 28.d3a59201 2026-02-24T19:18:05.096 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:05.096 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 10 client.4777.objecter _op_submit oid exist '@28' '@28' [notify cookie 94917132813984 in=17b] tid 44 osd.12 2026-02-24T19:18:05.096 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:05.096 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 12 44 2026-02-24T19:18:05.097 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 15 client.4777.objecter _send_op 44 to 28.1 on osd.12 2026-02-24T19:18:05.097 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6801/1483397197 -- osd_op(unknown.0.0:44 28.1 28:8049a5cb:::exist:head [notify cookie 94917132813984 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56539e082da0 con 0x56539e07b3c0 2026-02-24T19:18:05.097 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 5 2026-02-24T19:18:05.097 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 5 client.4777.objecter 1 in flight 2026-02-24T19:18:05.097 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 10 client.4777.objecter linger_register info 0x56539dfbea30 linger_id 10 cookie 94917132806704 2026-02-24T19:18:05.097 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base noexist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:05.097 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 20 client.4777.objecter _calc_target target noexist @28 -> pgid 28.a7bbaa1 2026-02-24T19:18:05.097 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.a7bbaa1 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:05.097 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 5 2026-02-24T19:18:05.097 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 5 2026-02-24T19:18:05.097 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 15 client.4777.objecter _session_linger_op_assign 12 10 2026-02-24T19:18:05.097 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 6 2026-02-24T19:18:05.097 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 15 client.4777.objecter send_linger 10 register 2026-02-24T19:18:05.097 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e1c1d10 2026-02-24T19:18:05.098 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base noexist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:05.098 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 20 client.4777.objecter _calc_target target noexist @28 -> pgid 28.a7bbaa1 2026-02-24T19:18:05.098 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 6 2026-02-24T19:18:05.098 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 10 client.4777.objecter _op_submit oid noexist '@28' '@28' [notify cookie 94917132806704 in=17b] tid 45 osd.12 2026-02-24T19:18:05.098 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 6 2026-02-24T19:18:05.098 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 12 45 2026-02-24T19:18:05.098 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 15 client.4777.objecter _send_op 45 to 28.1 on osd.12 2026-02-24T19:18:05.098 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6801/1483397197 -- osd_op(unknown.0.0:45 28.1 28:855dde50:::noexist:head [notify cookie 94917132806704 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56539e1c21c0 con 0x56539e07b3c0 2026-02-24T19:18:05.098 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 7 2026-02-24T19:18:05.098 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.084+0000 7f556b38f880 5 client.4777.objecter 2 in flight 2026-02-24T19:18:05.098 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 38 ==== watch-notify(notify_complete (2) cookie 94917132813984 notify 154618822660 ret 0) ==== 42+0+8 (unknown 858382321 0 0) 0x7f555c009020 con 0x56539e07b3c0 2026-02-24T19:18:05.098 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 watch-notify(notify_complete (2) cookie 94917132813984 notify 154618822660 ret 0) 2026-02-24T19:18:05.098 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 39 ==== osd_op_reply(44 exist [notify cookie 94917132813984 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 1341081452 0 2367334165) 0x7f555c0040e0 con 0x56539e07b3c0 2026-02-24T19:18:05.098 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(44 exist [notify cookie 94917132813984 out=8b] v0'0 uv11 ondisk = 0) 2026-02-24T19:18:05.098 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f5569646640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:05.099 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f55627fc640 10 librados: operator() completed notify (linger op 0x56539dfc06a0), ec = system:0 2026-02-24T19:18:05.099 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f5569646640 7 client.4777.objecter handle_osd_op_reply 44 ondisk uv 11 in 28.1 attempt 0 2026-02-24T19:18:05.099 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f5569646640 10 client.4777.objecter op 0 rval 0 len 8 2026-02-24T19:18:05.099 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f5569646640 15 client.4777.objecter handle_osd_op_reply completed tid 44 2026-02-24T19:18:05.099 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f5569646640 15 client.4777.objecter _finish_op 44 2026-02-24T19:18:05.099 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f5569646640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 7 2026-02-24T19:18:05.099 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f5569646640 15 client.4777.objecter _session_op_remove 12 44 2026-02-24T19:18:05.099 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f5569646640 5 client.4777.objecter 1 in flight 2026-02-24T19:18:05.099 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f5562ffd640 10 client.4777.objecter _linger_commit 9 2026-02-24T19:18:05.099 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f5562ffd640 10 client.4777.objecter _linger_commit notify_id=154618822660 2026-02-24T19:18:05.099 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 40 ==== osd_op_reply(45 noexist [notify cookie 94917132806704] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 460143722 0 0) 0x7f555c0040e0 con 0x56539e07b3c0 2026-02-24T19:18:05.099 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f5562ffd640 10 librados: finish linger op 0x56539dfc06a0 acked (0) 2026-02-24T19:18:05.099 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f5562ffd640 20 client.4777.objecter _linger_cancel linger_id=9 2026-02-24T19:18:05.099 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(45 noexist [notify cookie 94917132806704] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:05.099 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f5562ffd640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 5 2026-02-24T19:18:05.099 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f5569646640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:05.100 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f5562ffd640 15 client.4777.objecter _session_linger_op_remove 12 9 2026-02-24T19:18:05.100 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f5569646640 7 client.4777.objecter handle_osd_op_reply 45 ondisk uv 0 in 28.1 attempt 0 2026-02-24T19:18:05.100 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f5569646640 10 client.4777.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:05.100 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f5569646640 10 client.4777.objecter op 0 rval 0 len 0 2026-02-24T19:18:05.100 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f5569646640 15 client.4777.objecter handle_osd_op_reply completed tid 45 2026-02-24T19:18:05.100 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f5569646640 15 client.4777.objecter _finish_op 45 2026-02-24T19:18:05.100 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f5569646640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 5 2026-02-24T19:18:05.100 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f5569646640 15 client.4777.objecter _session_op_remove 12 45 2026-02-24T19:18:05.100 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f5569646640 5 client.4777.objecter 0 in flight 2026-02-24T19:18:05.100 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f55627fc640 10 client.4777.objecter _linger_commit 10 2026-02-24T19:18:05.100 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f55627fc640 10 librados: finish linger op 0x56539dfbea30 acked (-2) 2026-02-24T19:18:05.100 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f5562ffd640 10 librados: operator() completed notify (linger op 0x56539dfbea30), ec = osd:2 2026-02-24T19:18:05.100 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f5562ffd640 20 client.4777.objecter _linger_cancel linger_id=10 2026-02-24T19:18:05.100 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f5562ffd640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:05.100 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f5562ffd640 15 client.4777.objecter _session_linger_op_remove 12 10 2026-02-24T19:18:05.100 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyAwaitable (5 ms) 2026-02-24T19:18:05.101 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCancelTerminal 2026-02-24T19:18:05.101 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e085160 2026-02-24T19:18:05.101 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base noexist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:05.101 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 20 client.4777.objecter _calc_target target noexist @28 -> pgid 28.a7bbaa1 2026-02-24T19:18:05.101 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.a7bbaa1 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:05.101 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 10 client.4777.objecter chose random osd.4 of [12,4] 2026-02-24T19:18:05.101 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07bc40 osd=4 3 2026-02-24T19:18:05.101 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 10 client.4777.objecter _op_submit oid noexist '@28' '@28' [stat] tid 46 osd.4 2026-02-24T19:18:05.101 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07bc40 osd=4 3 2026-02-24T19:18:05.101 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 4 46 2026-02-24T19:18:05.101 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 15 client.4777.objecter _send_op 46 to 28.1 on osd.4 2026-02-24T19:18:05.101 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6805/4020872388 -- osd_op(unknown.0.0:46 28.1 28:855dde50:::noexist:head [stat] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e36) -- 0x56539e082da0 con 0x56539e0664e0 2026-02-24T19:18:05.101 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07bc40 osd=4 4 2026-02-24T19:18:05.101 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 5 client.4777.objecter 1 in flight 2026-02-24T19:18:05.101 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCancelTerminal (0 ms) 2026-02-24T19:18:05.102 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 5 client.4777.objecter _op_cancel: cancelling tid 46 r=-125 2026-02-24T19:18:05.102 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCancelTotal 2026-02-24T19:18:05.102 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 10 client.4777.objecter op_cancel tid 46 in session 4 2026-02-24T19:18:05.102 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 15 client.4777.objecter _finish_op 46 2026-02-24T19:18:05.102 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07bc40 osd=4 3 2026-02-24T19:18:05.102 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 15 client.4777.objecter _session_op_remove 4 46 2026-02-24T19:18:05.102 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e085160 2026-02-24T19:18:05.102 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base noexist @28 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:05.102 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 20 client.4777.objecter _calc_target target noexist @28 -> pgid 28.a7bbaa1 2026-02-24T19:18:05.102 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.a7bbaa1 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:05.102 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 10 client.4777.objecter chose random osd.4 of [12,4] 2026-02-24T19:18:05.102 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07bc40 osd=4 3 2026-02-24T19:18:05.102 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 10 client.4777.objecter _op_submit oid noexist '@28' '@28' [stat] tid 47 osd.4 2026-02-24T19:18:05.102 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCancelTotal (0 ms) 2026-02-24T19:18:05.102 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCancelTerminal 2026-02-24T19:18:05.102 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07bc40 osd=4 3 2026-02-24T19:18:05.102 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 4 47 2026-02-24T19:18:05.102 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 15 client.4777.objecter _send_op 47 to 28.1 on osd.4 2026-02-24T19:18:05.102 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6805/4020872388 -- osd_op(unknown.0.0:47 28.1 28:855dde50:::noexist:head [stat] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e36) -- 0x56539dfc06a0 con 0x56539e0664e0 2026-02-24T19:18:05.103 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07bc40 osd=4 4 2026-02-24T19:18:05.103 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 5 client.4777.objecter 1 in flight 2026-02-24T19:18:05.103 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 5 client.4777.objecter _op_cancel: cancelling tid 47 r=-125 2026-02-24T19:18:05.103 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 10 client.4777.objecter op_cancel tid 47 in session 4 2026-02-24T19:18:05.103 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 15 client.4777.objecter _finish_op 47 2026-02-24T19:18:05.103 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07bc40 osd=4 3 2026-02-24T19:18:05.103 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 15 client.4777.objecter _session_op_remove 4 47 2026-02-24T19:18:05.103 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 20 librados: queue_aio_write 0x56539df13390 completion 0x56539dfc00f0 write_seq 11 2026-02-24T19:18:05.103 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e085160 2026-02-24T19:18:05.103 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base noexist @28 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:05.103 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 20 client.4777.objecter _calc_target target noexist @28 -> pgid 28.a7bbaa1 2026-02-24T19:18:05.103 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.a7bbaa1 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:05.103 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:05.103 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 10 client.4777.objecter _op_submit oid noexist '@28' '@28' [stat] tid 48 osd.12 2026-02-24T19:18:05.103 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCancelTerminal (0 ms) 2026-02-24T19:18:05.103 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:05.103 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCancelTotal 2026-02-24T19:18:05.103 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 12 48 2026-02-24T19:18:05.104 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 15 client.4777.objecter _send_op 48 to 28.1 on osd.12 2026-02-24T19:18:05.104 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6801/1483397197 -- osd_op(unknown.0.0:48 28.1 28:855dde50:::noexist:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56539e082da0 con 0x56539e07b3c0 2026-02-24T19:18:05.104 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:05.104 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 5 client.4777.objecter 1 in flight 2026-02-24T19:18:05.104 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 5 client.4777.objecter _op_cancel: cancelling tid 48 r=-125 2026-02-24T19:18:05.104 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 10 client.4777.objecter op_cancel tid 48 in session 12 2026-02-24T19:18:05.104 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 20 librados: complete_aio_write 0x56539dfc00f0 2026-02-24T19:18:05.105 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 15 client.4777.objecter _finish_op 48 2026-02-24T19:18:05.105 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:05.105 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 15 client.4777.objecter _session_op_remove 12 48 2026-02-24T19:18:05.105 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 20 librados: queue_aio_write 0x56539df13390 completion 0x56539dfc00f0 write_seq 12 2026-02-24T19:18:05.105 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 10 client.4777.objecter _op_submit op 0x56539e085160 2026-02-24T19:18:05.105 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 20 client.4777.objecter _calc_target epoch 36 base noexist @28 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:05.105 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 20 client.4777.objecter _calc_target target noexist @28 -> pgid 28.a7bbaa1 2026-02-24T19:18:05.105 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 10 client.4777.objecter _calc_target raw pgid 28.a7bbaa1 -> actual 28.1 acting [12,4] primary 12 2026-02-24T19:18:05.105 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 20 client.4777.objecter _get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:05.105 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 10 client.4777.objecter _op_submit oid noexist '@28' '@28' [stat] tid 49 osd.12 2026-02-24T19:18:05.105 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 20 client.4777.objecter get_session s=0x56539e07cdb0 osd=12 3 2026-02-24T19:18:05.105 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 15 client.4777.objecter _session_op_assign 12 49 2026-02-24T19:18:05.105 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 15 client.4777.objecter _send_op 49 to 28.1 on osd.12 2026-02-24T19:18:05.105 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 --> v1:10.20.193.14:6801/1483397197 -- osd_op(unknown.0.0:49 28.1 28:855dde50:::noexist:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56539dfc06a0 con 0x56539e07b3c0 2026-02-24T19:18:05.105 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:05.105 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.090+0000 7f556b38f880 5 client.4777.objecter 1 in flight 2026-02-24T19:18:05.105 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.092+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 41 ==== osd_op_reply(48 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3443337401 0 0) 0x7f555c0040e0 con 0x56539e07b3c0 2026-02-24T19:18:05.106 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.092+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(48 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:05.106 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.092+0000 7f5569646640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:05.106 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.092+0000 7f5569646640 7 client.4777.objecter handle_osd_op_reply 48 ondisk ... stray 2026-02-24T19:18:05.106 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.093+0000 7f5568e45640 1 -- 10.20.193.195:0/3789380477 <== osd.4 v1:10.20.193.14:6805/4020872388 11 ==== osd_op_reply(46 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 1201579260 0 0) 0x7f555405da20 con 0x56539e0664e0 2026-02-24T19:18:05.106 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.093+0000 7f5568e45640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(46 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:05.106 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.093+0000 7f5568e45640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:05.106 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.093+0000 7f5568e45640 7 client.4777.objecter handle_osd_op_reply 46 ondisk ... stray 2026-02-24T19:18:05.106 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.094+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 <== osd.12 v1:10.20.193.14:6801/1483397197 42 ==== osd_op_reply(49 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3443337401 0 0) 0x7f555c0040e0 con 0x56539e07b3c0 2026-02-24T19:18:05.106 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.094+0000 7f5569646640 10 client.4777.objecter ms_dispatch2 0x56539df2f590 osd_op_reply(49 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:05.106 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.094+0000 7f5569646640 10 client.4777.objecter in handle_osd_op_reply 2026-02-24T19:18:05.106 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.094+0000 7f5569646640 7 client.4777.objecter handle_osd_op_reply 49 ondisk uv 0 in 28.1 attempt 0 2026-02-24T19:18:05.106 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.094+0000 7f5569646640 10 client.4777.objecter op 0 rval 0 len 0 2026-02-24T19:18:05.106 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.094+0000 7f5569646640 15 client.4777.objecter handle_osd_op_reply completed tid 49 2026-02-24T19:18:05.106 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.094+0000 7f5569646640 15 client.4777.objecter _finish_op 49 2026-02-24T19:18:05.106 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.094+0000 7f5569646640 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 4 2026-02-24T19:18:05.106 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.094+0000 7f5569646640 15 client.4777.objecter _session_op_remove 12 49 2026-02-24T19:18:05.106 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.094+0000 7f5569646640 5 client.4777.objecter 0 in flight 2026-02-24T19:18:05.106 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.094+0000 7f5569646640 20 librados: complete_aio_write 0x56539dfc00f0 2026-02-24T19:18:05.107 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCancelTotal (4 ms) 2026-02-24T19:18:05.107 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.094+0000 7f556b38f880 10 librados: watch_flush enter 2026-02-24T19:18:05.107 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.094+0000 7f556b38f880 10 librados: watch_flush exit 2026-02-24T19:18:05.107 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.094+0000 7f556b38f880 10 client.4777.objecter close_session for osd.4 2026-02-24T19:18:05.107 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.094+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 >> v1:10.20.193.14:6805/4020872388 conn(0x56539e0664e0 legacy=0x56539e07ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:05.107 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.094+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07bc40 osd=4 1 2026-02-24T19:18:05.107 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.094+0000 7f556b38f880 10 client.4777.objecter close_session for osd.12 2026-02-24T19:18:05.107 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.094+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 >> v1:10.20.193.14:6801/1483397197 conn(0x56539e07b3c0 legacy=0x56539e07d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:05.107 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.094+0000 7f556b38f880 20 client.4777.objecter put_session s=0x56539e07cdb0 osd=12 1 2026-02-24T19:18:05.107 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.094+0000 7f556b38f880 20 client.4777.objecter shutdown clearing up homeless session... 2026-02-24T19:18:05.107 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.094+0000 7f556b38f880 10 client.4777.objecter successfully canceled tick 2026-02-24T19:18:05.107 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.094+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 >> v1:10.20.193.14:6800/4014096310 conn(0x7f5550076a50 legacy=0x7f5550096f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:05.107 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.094+0000 7f556b38f880 10 monclient: shutdown 2026-02-24T19:18:05.107 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.094+0000 7f556b38f880 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:05.107 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.094+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 >> v1:10.20.193.44:6789/0 conn(0x56539e06ac10 legacy=0x56539e077d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:05.107 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.094+0000 7f5569646640 1 -- 10.20.193.195:0/3789380477 reap_dead start 2026-02-24T19:18:05.107 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.094+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 shutdown_connections 2026-02-24T19:18:05.108 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.094+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 >> 10.20.193.195:0/3789380477 conn(0x56539dfbaa70 msgr2=0x56539e0cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:05.108 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.094+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 shutdown_connections 2026-02-24T19:18:05.108 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.094+0000 7f556b38f880 1 -- 10.20.193.195:0/3789380477 wait complete. 2026-02-24T19:18:05.108 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.094+0000 7f556b38f880 1 librados: shutdown 2026-02-24T19:18:05.108 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [----------] 29 tests from AsioRados (335 ms total) 2026-02-24T19:18:05.108 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: 2026-02-24T19:18:05.108 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [----------] Global test environment tear-down 2026-02-24T19:18:05.108 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [==========] 29 tests from 1 test suite ran. (5797 ms total) 2026-02-24T19:18:05.108 INFO:tasks.workunit.client.0.trial195.stdout: api_asio: [ PASSED ] 29 tests. 2026-02-24T19:18:05.108 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:18:05.108 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=48990 2026-02-24T19:18:05.108 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 48990 2026-02-24T19:18:06.658 INFO:tasks.workunit.client.0.trial195.stdout: cls: Running main() from gmock_main.cc 2026-02-24T19:18:06.658 INFO:tasks.workunit.client.0.trial195.stdout: cls: [==========] Running 1 test from 1 test suite. 2026-02-24T19:18:06.658 INFO:tasks.workunit.client.0.trial195.stdout: cls: [----------] Global test environment set-up. 2026-02-24T19:18:06.658 INFO:tasks.workunit.client.0.trial195.stdout: cls: [----------] 1 test from NeoRadosCls 2026-02-24T19:18:06.658 INFO:tasks.workunit.client.0.trial195.stdout: cls: [ RUN ] NeoRadosCls.DNE 2026-02-24T19:18:06.658 INFO:tasks.workunit.client.0.trial195.stdout: cls: [ OK ] NeoRadosCls.DNE (7330 ms) 2026-02-24T19:18:06.658 INFO:tasks.workunit.client.0.trial195.stdout: cls: [----------] 1 test from NeoRadosCls (7330 ms total) 2026-02-24T19:18:06.658 INFO:tasks.workunit.client.0.trial195.stdout: cls: 2026-02-24T19:18:06.658 INFO:tasks.workunit.client.0.trial195.stdout: cls: [----------] Global test environment tear-down 2026-02-24T19:18:06.659 INFO:tasks.workunit.client.0.trial195.stdout: cls: [==========] 1 test from 1 test suite ran. (7330 ms total) 2026-02-24T19:18:06.659 INFO:tasks.workunit.client.0.trial195.stdout: cls: [ PASSED ] 1 test. 2026-02-24T19:18:06.729 INFO:tasks.workunit.client.0.trial195.stdout: handler_error: Running main() from gmock_main.cc 2026-02-24T19:18:06.729 INFO:tasks.workunit.client.0.trial195.stdout: handler_error: [==========] Running 1 test from 1 test suite. 2026-02-24T19:18:06.729 INFO:tasks.workunit.client.0.trial195.stdout: handler_error: [----------] Global test environment set-up. 2026-02-24T19:18:06.729 INFO:tasks.workunit.client.0.trial195.stdout: handler_error: [----------] 1 test from neocls_handler_error 2026-02-24T19:18:06.729 INFO:tasks.workunit.client.0.trial195.stdout: handler_error: [ RUN ] neocls_handler_error.test_handler_error 2026-02-24T19:18:06.729 INFO:tasks.workunit.client.0.trial195.stdout: handler_error: [ OK ] neocls_handler_error.test_handler_error (7396 ms) 2026-02-24T19:18:06.729 INFO:tasks.workunit.client.0.trial195.stdout: handler_error: [----------] 1 test from neocls_handler_error (7396 ms total) 2026-02-24T19:18:06.729 INFO:tasks.workunit.client.0.trial195.stdout: handler_error: 2026-02-24T19:18:06.729 INFO:tasks.workunit.client.0.trial195.stdout: handler_error: [----------] Global test environment tear-down 2026-02-24T19:18:06.730 INFO:tasks.workunit.client.0.trial195.stdout: handler_error: [==========] 1 test from 1 test suite ran. (7396 ms total) 2026-02-24T19:18:06.730 INFO:tasks.workunit.client.0.trial195.stdout: handler_error: [ PASSED ] 1 test. 2026-02-24T19:18:07.728 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd_pp: Running main() from gmock_main.cc 2026-02-24T19:18:07.728 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd_pp: [==========] Running 3 tests from 1 test suite. 2026-02-24T19:18:07.728 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd_pp: [----------] Global test environment set-up. 2026-02-24T19:18:07.728 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd 2026-02-24T19:18:07.728 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.MonDescribePP 2026-02-24T19:18:07.728 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd_pp: [ OK ] LibRadosCmd.MonDescribePP (431 ms) 2026-02-24T19:18:07.728 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.OSDCmdPP 2026-02-24T19:18:07.728 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd_pp: [ OK ] LibRadosCmd.OSDCmdPP (202 ms) 2026-02-24T19:18:07.729 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.PGCmdPP 2026-02-24T19:18:07.729 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd_pp: [ OK ] LibRadosCmd.PGCmdPP (7790 ms) 2026-02-24T19:18:07.729 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd (8423 ms total) 2026-02-24T19:18:07.729 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd_pp: 2026-02-24T19:18:07.729 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd_pp: [----------] Global test environment tear-down 2026-02-24T19:18:07.729 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd_pp: [==========] 3 tests from 1 test suite ran. (8423 ms total) 2026-02-24T19:18:07.729 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd_pp: [ PASSED ] 3 tests. 2026-02-24T19:18:08.864 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: Running main() from gmock_main.cc 2026-02-24T19:18:08.864 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: [==========] Running 4 tests from 1 test suite. 2026-02-24T19:18:08.865 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: [----------] Global test environment set-up. 2026-02-24T19:18:08.865 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: [----------] 4 tests from LibRadosCmd 2026-02-24T19:18:08.865 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: [ RUN ] LibRadosCmd.MonDescribe 2026-02-24T19:18:08.865 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: [ OK ] LibRadosCmd.MonDescribe (568 ms) 2026-02-24T19:18:08.865 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: [ RUN ] LibRadosCmd.OSDCmd 2026-02-24T19:18:08.865 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: [ OK ] LibRadosCmd.OSDCmd (35 ms) 2026-02-24T19:18:08.865 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: [ RUN ] LibRadosCmd.PGCmd 2026-02-24T19:18:08.865 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: [ OK ] LibRadosCmd.PGCmd (7824 ms) 2026-02-24T19:18:08.865 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: [ RUN ] LibRadosCmd.WatchLog 2026-02-24T19:18:08.865 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:05.197309+0000 mon.a [INF] from='client.? v1:10.20.193.195:0/3588426088' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_trial195-48896-2","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T19:18:08.865 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:05.198790+0000 mon.a [INF] from='client.? v1:10.20.193.195:0/183187275' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_trial195-48867-2","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T19:18:08.865 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:05.199756+0000 mon.a [INF] from='client.? v1:10.20.193.195:0/1690241216' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial195-49105-2","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T19:18:08.866 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:06.663288+0000 mon.c [INF] from='client.? v1:10.20.193.195:0/1607979539' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritetrial195-49724-1"} : dispatch 2026-02-24T19:18:08.866 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:06.690719+0000 mon.a [INF] from='client.4886 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritetrial195-49724-1"} : dispatch 2026-02-24T19:18:08.866 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:06.699646+0000 mon.a [INF] from='client.? v1:10.20.193.195:0/3588426088' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_trial195-48896-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:08.866 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:07.598743+0000 mon.a [INF] from='client.4886 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritetrial195-49724-1"}]': finished 2026-02-24T19:18:08.866 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:07.600161+0000 mon.a [INF] from='client.? v1:10.20.193.195:0/3588426088' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_trial195-48896-3","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T19:18:08.866 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:07.700491+0000 mon.c [INF] from='client.? v1:10.20.193.195:0/1607979539' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritetrial195-49724-1"} : dispatch 2026-02-24T19:18:08.866 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:07.709406+0000 mon.a [INF] from='client.4886 ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritetrial195-49724-1"} : dispatch 2026-02-24T19:18:08.866 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:07.716104+0000 mon.c [INF] from='client.? v1:10.20.193.195:0/2527009709' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial195-49483-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:08.866 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:07.718940+0000 mon.a [INF] from='client.? v1:10.20.193.195:0/3588426088' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_trial195-48896-3", "field": "max_bytes", "val": "4096"} : dispatch 2026-02-24T19:18:11.933 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:07.730166+0000 mon.a [INF] from='client.5009 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial195-49483-2","app": "rados","yes_i_really_mean_it": cmd: Running main() from gmock_main.cc 2026-02-24T19:18:11.933 INFO:tasks.workunit.client.0.trial195.stdout: cmd: [==========] Running 3 tests from 1 test suite. 2026-02-24T19:18:11.934 INFO:tasks.workunit.client.0.trial195.stdout: cmd: [----------] Global test environment set-up. 2026-02-24T19:18:11.934 INFO:tasks.workunit.client.0.trial195.stdout: cmd: [----------] 3 tests from NeoRadosCmd 2026-02-24T19:18:11.934 INFO:tasks.workunit.client.0.trial195.stdout: cmd: [ RUN ] NeoRadosCmd.MonDescribe 2026-02-24T19:18:11.934 INFO:tasks.workunit.client.0.trial195.stdout: cmd: [ OK ] NeoRadosCmd.MonDescribe (2055 ms) 2026-02-24T19:18:11.934 INFO:tasks.workunit.client.0.trial195.stdout: cmd: [ RUN ] NeoRadosCmd.OSDCmd 2026-02-24T19:18:11.934 INFO:tasks.workunit.client.0.trial195.stdout: cmd: [ OK ] NeoRadosCmd.OSDCmd (5272 ms) 2026-02-24T19:18:11.934 INFO:tasks.workunit.client.0.trial195.stdout: cmd: [ RUN ] NeoRadosCmd.PGCmd 2026-02-24T19:18:11.934 INFO:tasks.workunit.client.0.trial195.stdout: cmd: [ OK ] NeoRadosCmd.PGCmd (5275 ms) 2026-02-24T19:18:11.934 INFO:tasks.workunit.client.0.trial195.stdout: cmd: [----------] 3 tests from NeoRadosCmd (12603 ms total) 2026-02-24T19:18:11.934 INFO:tasks.workunit.client.0.trial195.stdout: cmd: 2026-02-24T19:18:11.934 INFO:tasks.workunit.client.0.trial195.stdout: cmd: [----------] Global test environment tear-down 2026-02-24T19:18:11.934 INFO:tasks.workunit.client.0.trial195.stdout: cmd: [==========] 3 tests from 1 test suite ran. (12603 ms total) 2026-02-24T19:18:11.935 INFO:tasks.workunit.client.0.trial195.stdout: cmd: [ PASSED ] 3 tests. 2026-02-24T19:18:12.971 INFO:tasks.workunit.client.0.trial195.stdout:true} : dispatch 2026-02-24T19:18:12.972 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:07.734283+0000 mon.c [INF] from='client.? v1:10.20.193.195:0/2232968302' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial195-49105-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:12.972 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:07.746955+0000 mon.a [INF] from='client.5054 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial195-49105-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:12.972 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:07.772979+0000 mon.b [INF] from='client.? v1:10.20.193.195:0/23273102' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_trial195-49213-7"} : dispatch 2026-02-24T19:18:12.972 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:07.779577+0000 client.admin [INF] onexx 2026-02-24T19:18:12.972 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:07.789275+0000 mon.a [INF] from='client.? v1:10.20.193.195:0/1491711807' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2026-02-24T19:18:12.972 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:07.799428+0000 mon.c [INF] from='client.? v1:10.20.193.195:0/2896314553' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_trial195-49238-7"} : dispatch 2026-02-24T19:18:12.972 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:07.810310+0000 mon.a [INF] from='client.4990 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_trial195-49213-7"} : dispatch 2026-02-24T19:18:12.972 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:07.820943+0000 mon.b [INF] from='client.? v1:10.20.193.195:0/23273102' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_trial195-49213-7"} : dispatch 2026-02-24T19:18:12.972 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:07.824230+0000 mon.a [INF] from='client.5078 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_trial195-49238-7"} : dispatch 2026-02-24T19:18:12.972 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:07.832840+0000 mon.a [INF] from='client.4990 ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_trial195-49213-7"} : dispatch 2026-02-24T19:18:12.972 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:07.839083+0000 mon.c [INF] from='client.? v1:10.20.193.195:0/2896314553' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_trial195-49238-7"} : dispatch 2026-02-24T19:18:12.973 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:07.841295+0000 mon.b [INF] from='client.? v1:10.20.193.195:0/23273102' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_trial195-49213-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T19:18:12.973 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:07.845446+0000 mon.a [INF] from='client.5078 ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_trial195-49238-7"} : dispatch 2026-02-24T19:18:12.973 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:07.851730+0000 mon.a [INF] from='client.4990 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_trial195-49213-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T19:18:12.973 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:07.853068+0000 mon.c [INF] from='client.? v1:10.20.193.195:0/2896314553' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_trial195-49238-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T19:18:12.973 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:07.861405+0000 mon.a [INF] from='client.5078 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_trial195-49238-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T19:18:12.973 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:10.847808+0000 mon.b [INF] from='client.? v1:10.20.193.195:0/907269442' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial195-49105-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:12.973 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:10.860733+0000 mon.c [INF] from='client.? v1:10.20.193.195:0/618273423' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial195-49483-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:12.973 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:10.877834+0000 mon.a [INF] from='client.5083 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial195-49105-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:12.973 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:10.882879+0000 mon.a [INF] from='client.5150 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial195-49483-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:12.973 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:10.885045+0000 mon.a [INF] from='client.? v1:10.20.193.195:0/2963593349' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockEC_trial195-48993-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_trial195-48993-10"} : dispatch 2026-02-24T19:18:12.973 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:10.909637+0000 mon.b [INF] from='client.? v1:10.20.193.195:0/431145094' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNStrial195-49788-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T19:18:12.973 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:10.945867+0000 mon.a [INF] from='client.? v1:10.20.193.195:0/1491711807' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2026-02-24T19:18:12.974 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:10.992990+0000 mon.a [INF] from='client.5116 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNStrial195-49788-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T19:18:12.974 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:11.024080+0000 mon.b [INF] from='client.? v1:10.20.193.195:0/3913336778' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_trial195-48911-16"} : dispatch 2026-02-24T19:18:12.974 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:11.053906+0000 mon.a [INF] from='client.5137 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_trial195-48911-16"} : dispatch 2026-02-24T19:18:12.974 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:11.060707+0000 mon.b [INF] from='client.? v1:10.20.193.195:0/3913336778' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoEC_trial195-48911-16"} : dispatch 2026-02-24T19:18:12.974 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:11.068168+0000 mon.a [INF] from='client.5137 ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoEC_trial195-48911-16"} : dispatch 2026-02-24T19:18:12.974 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:11.074764+0000 mon.b [INF] from='client.? v1:10.20.193.195:0/3913336778' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_trial195-48911-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T19:18:12.974 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:11.080140+0000 mon.a [INF] from='client.5137 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_trial195-48911-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T19:18:12.974 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:11.816967+0000 mon.a [INF] from='client.5008 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReadOptrial195-49724-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOptrial195-49724-2"}]': finished 2026-02-24T19:18:12.977 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:11.818226+0000 mon.a [INF] from='client.5083 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial195-49105-4","app api_c_read_operations: Running main() from gmock_main.cc 2026-02-24T19:18:12.977 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [==========] Running 17 tests from 1 test suite. 2026-02-24T19:18:12.977 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [----------] Global test environment set-up. 2026-02-24T19:18:12.977 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest 2026-02-24T19:18:12.977 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.NewDelete 2026-02-24T19:18:12.978 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [ OK ] CReadOpsTest.NewDelete (0 ms) 2026-02-24T19:18:12.978 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.SetOpFlags 2026-02-24T19:18:12.978 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [ OK ] CReadOpsTest.SetOpFlags (2086 ms) 2026-02-24T19:18:12.978 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertExists 2026-02-24T19:18:12.978 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertExists (168 ms) 2026-02-24T19:18:12.978 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertVersion 2026-02-24T19:18:12.978 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertVersion (76 ms) 2026-02-24T19:18:12.978 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpXattr 2026-02-24T19:18:12.978 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpXattr (555 ms) 2026-02-24T19:18:12.978 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Read 2026-02-24T19:18:12.978 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Read (802 ms) 2026-02-24T19:18:12.978 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Checksum 2026-02-24T19:18:12.979 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Checksum (888 ms) 2026-02-24T19:18:12.979 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.RWOrderedRead 2026-02-24T19:18:12.979 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [ OK ] CReadOpsTest.RWOrderedRead (288 ms) 2026-02-24T19:18:12.979 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ShortRead 2026-02-24T19:18:12.979 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ShortRead (956 ms) 2026-02-24T19:18:12.979 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Exec 2026-02-24T19:18:12.979 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Exec (49 ms) 2026-02-24T19:18:12.979 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ExecUserBuf 2026-02-24T19:18:12.979 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ExecUserBuf (140 ms) 2026-02-24T19:18:12.979 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat 2026-02-24T19:18:12.979 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat (860 ms) 2026-02-24T19:18:12.979 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat2 2026-02-24T19:18:12.979 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat2 (131 ms) 2026-02-24T19:18:12.980 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Omap 2026-02-24T19:18:12.980 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Omap (958 ms) 2026-02-24T19:18:12.980 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.OmapNuls 2026-02-24T19:18:12.980 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [ OK ] CReadOpsTest.OmapNuls (177 ms) 2026-02-24T19:18:12.980 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.GetXattrs 2026-02-24T19:18:12.980 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [ OK ] CReadOpsTest.GetXattrs (847 ms) 2026-02-24T19:18:12.980 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpExt 2026-02-24T19:18:12.980 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpExt (100 ms) 2026-02-24T19:18:12.980 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest (9088 ms total) 2026-02-24T19:18:12.980 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: 2026-02-24T19:18:12.980 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [----------] Global test environment tear-down 2026-02-24T19:18:12.980 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [==========] 17 tests from 1 test suite ran. (13660 ms total) 2026-02-24T19:18:12.980 INFO:tasks.workunit.client.0.trial195.stdout: api_c_read_operations: [ PASSED ] 17 tests. 2026-02-24T19:18:13.060 INFO:tasks.workunit.client.0.trial195.stdout:": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T19:18:13.060 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:11.819156+0000 mon.a [INF] from='client.5150 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial195-49483-3","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T19:18:13.060 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:11.820112+0000 mon.a [INF] from='client.5116 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNStrial195-49788-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-24T19:18:13.060 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:11.821174+0000 mon.a [INF] from='client.5137 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_trial195-48911-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-24T19:18:13.060 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:11.934659+0000 mon.a [INF] from='client.? v1:10.20.193.195:0/1111721165' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTrip_trial195-48867-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:13.060 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:11.939871+0000 mon.b [INF] from='client.? v1:10.20.193.195:0/431145094' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectsNStrial195-49788-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNStrial195-49788-2"} : dispatch 2026-02-24T19:18:13.060 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:11.942953+0000 mon.b [INF] from='client.? v1:10.20.193.195:0/3913336778' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoEC_trial195-48911-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_trial195-48911-16"} : dispatch 2026-02-24T19:18:13.060 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:11.952970+0000 mon.b [INF] from='client.? v1:10.20.193.195:0/2909614473' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_trial195-49287-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:13.060 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:11.954349+0000 mon.a [INF] from='client.5116 ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectsNStrial195-49788-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNStrial195-49788-2"} : dispatch 2026-02-24T19:18:13.060 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:11.963209+0000 mon.a [INF] from='client.5137 ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoEC_trial195-48911-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_trial195-48911-16"} : dispatch 2026-02-24T19:18:13.061 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:11.974778+0000 mon.a [INF] from='client.5140 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_trial195-49287-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:13.061 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:12.864114+0000 mon.a [INF] from='client.? v1:10.20.193.195:0/3012440501' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_trial195-49025-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_trial195-49025-10"}]': finished 2026-02-24T19:18:13.061 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:12.865627+0000 mon.a [INF] from='client.? v1:10.20.193.195:0/2963593349' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_trial195-48993-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_trial195-48993-10"}]': finished 2026-02-24T19:18:15.000 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:12.866673+0000 mon.a [INF] from='client.? v1:10.20.193.195:0/1111721165' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_trial195-48867-4","app": "rados","yes_i_real pool: Running main() from gmock_main.cc 2026-02-24T19:18:15.000 INFO:tasks.workunit.client.0.trial195.stdout: pool: [==========] Running 6 tests from 1 test suite. 2026-02-24T19:18:15.000 INFO:tasks.workunit.client.0.trial195.stdout: pool: [----------] Global test environment set-up. 2026-02-24T19:18:15.001 INFO:tasks.workunit.client.0.trial195.stdout: pool: [----------] 6 tests from NeoRadosPools 2026-02-24T19:18:15.001 INFO:tasks.workunit.client.0.trial195.stdout: pool: [ RUN ] NeoRadosPools.PoolList 2026-02-24T19:18:15.001 INFO:tasks.workunit.client.0.trial195.stdout: pool: [ OK ] NeoRadosPools.PoolList (2034 ms) 2026-02-24T19:18:15.001 INFO:tasks.workunit.client.0.trial195.stdout: pool: [ RUN ] NeoRadosPools.PoolLookup 2026-02-24T19:18:15.001 INFO:tasks.workunit.client.0.trial195.stdout: pool: [ OK ] NeoRadosPools.PoolLookup (2901 ms) 2026-02-24T19:18:15.001 INFO:tasks.workunit.client.0.trial195.stdout: pool: [ RUN ] NeoRadosPools.PoolLookupOtherInstance 2026-02-24T19:18:15.001 INFO:tasks.workunit.client.0.trial195.stdout: pool: [ OK ] NeoRadosPools.PoolLookupOtherInstance (4495 ms) 2026-02-24T19:18:15.001 INFO:tasks.workunit.client.0.trial195.stdout: pool: [ RUN ] NeoRadosPools.PoolDelete 2026-02-24T19:18:15.001 INFO:tasks.workunit.client.0.trial195.stdout: pool: [ OK ] NeoRadosPools.PoolDelete (2085 ms) 2026-02-24T19:18:15.001 INFO:tasks.workunit.client.0.trial195.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateDelete 2026-02-24T19:18:15.001 INFO:tasks.workunit.client.0.trial195.stdout: pool: [ OK ] NeoRadosPools.PoolCreateDelete (2099 ms) 2026-02-24T19:18:15.001 INFO:tasks.workunit.client.0.trial195.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateWithCrushRule 2026-02-24T19:18:15.002 INFO:tasks.workunit.client.0.trial195.stdout: pool: [ OK ] NeoRadosPools.PoolCreateWithCrushRule (2033 ms) 2026-02-24T19:18:15.002 INFO:tasks.workunit.client.0.trial195.stdout: pool: [----------] 6 tests from NeoRadosPools (15650 ms total) 2026-02-24T19:18:15.002 INFO:tasks.workunit.client.0.trial195.stdout: pool: 2026-02-24T19:18:15.002 INFO:tasks.workunit.client.0.trial195.stdout: pool: [----------] Global test environment tear-down 2026-02-24T19:18:15.002 INFO:tasks.workunit.client.0.trial195.stdout: pool: [==========] 6 tests from 1 test suite ran. (15650 ms total) 2026-02-24T19:18:15.002 INFO:tasks.workunit.client.0.trial195.stdout: pool: [ PASSED ] 6 tests. 2026-02-24T19:18:15.037 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:01:49.299 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:15.069 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:01:49.328 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:15.071 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:01:49.333 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:15.078 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:01:49.337 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:15.105 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:01:49.327 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:15.106 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:01:49.328 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:15.141 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:01:49.400 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:15.156 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:01:49.418 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:15.165 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:01:49.387 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:16.028 INFO:tasks.workunit.client.0.trial195.stdout: api_stat: Running main() from gmock_main.cc 2026-02-24T19:18:16.028 INFO:tasks.workunit.client.0.trial195.stdout: api_stat: [==========] Running 9 tests from 2 test suites. 2026-02-24T19:18:16.028 INFO:tasks.workunit.client.0.trial195.stdout: api_stat: [----------] Global test environment set-up. 2026-02-24T19:18:16.028 INFO:tasks.workunit.client.0.trial195.stdout: api_stat: [----------] 5 tests from LibRadosStat 2026-02-24T19:18:16.029 INFO:tasks.workunit.client.0.trial195.stdout: api_stat: [ RUN ] LibRadosStat.Stat 2026-02-24T19:18:16.029 INFO:tasks.workunit.client.0.trial195.stdout: api_stat: [ OK ] LibRadosStat.Stat (2339 ms) 2026-02-24T19:18:16.029 INFO:tasks.workunit.client.0.trial195.stdout: api_stat: [ RUN ] LibRadosStat.Stat2 2026-02-24T19:18:16.029 INFO:tasks.workunit.client.0.trial195.stdout: api_stat: [ OK ] LibRadosStat.Stat2 (853 ms) 2026-02-24T19:18:16.029 INFO:tasks.workunit.client.0.trial195.stdout: api_stat: [ RUN ] LibRadosStat.StatNS 2026-02-24T19:18:16.029 INFO:tasks.workunit.client.0.trial195.stdout: api_stat: [ OK ] LibRadosStat.StatNS (240 ms) 2026-02-24T19:18:16.029 INFO:tasks.workunit.client.0.trial195.stdout: api_stat: [ RUN ] LibRadosStat.ClusterStat 2026-02-24T19:18:16.029 INFO:tasks.workunit.client.0.trial195.stdout: api_stat: [ OK ] LibRadosStat.ClusterStat (662 ms) 2026-02-24T19:18:16.029 INFO:tasks.workunit.client.0.trial195.stdout: api_stat: [ RUN ] LibRadosStat.PoolStat 2026-02-24T19:18:16.029 INFO:tasks.workunit.client.0.trial195.stdout: api_stat: [ OK ] LibRadosStat.PoolStat (617 ms) 2026-02-24T19:18:16.029 INFO:tasks.workunit.client.0.trial195.stdout: api_stat: [----------] 5 tests from LibRadosStat (4713 ms total) 2026-02-24T19:18:16.029 INFO:tasks.workunit.client.0.trial195.stdout: api_stat: 2026-02-24T19:18:16.030 INFO:tasks.workunit.client.0.trial195.stdout: api_stat: [----------] 4 tests from LibRadosStatEC 2026-02-24T19:18:16.030 INFO:tasks.workunit.client.0.trial195.stdout: api_stat: [ RUN ] LibRadosStatEC.Stat 2026-02-24T19:18:16.030 INFO:tasks.workunit.client.0.trial195.stdout: api_stat: [ OK ] LibRadosStatEC.Stat (2002 ms) 2026-02-24T19:18:16.030 INFO:tasks.workunit.client.0.trial195.stdout: api_stat: [ RUN ] LibRadosStatEC.StatNS 2026-02-24T19:18:16.030 INFO:tasks.workunit.client.0.trial195.stdout: api_stat: [ OK ] LibRadosStatEC.StatNS (931 ms) 2026-02-24T19:18:16.030 INFO:tasks.workunit.client.0.trial195.stdout: api_stat: [ RUN ] LibRadosStatEC.ClusterStat 2026-02-24T19:18:16.030 INFO:tasks.workunit.client.0.trial195.stdout: api_stat: [ OK ] LibRadosStatEC.ClusterStat (6 ms) 2026-02-24T19:18:16.030 INFO:tasks.workunit.client.0.trial195.stdout: api_stat: [ RUN ] LibRadosStatEC.PoolStat 2026-02-24T19:18:16.030 INFO:tasks.workunit.client.0.trial195.stdout: api_stat: [ OK ] LibRadosStatEC.PoolStat (67 ms) 2026-02-24T19:18:16.030 INFO:tasks.workunit.client.0.trial195.stdout: api_stat: [----------] 4 tests from LibRadosStatEC (3008 ms total) 2026-02-24T19:18:16.030 INFO:tasks.workunit.client.0.trial195.stdout: api_stat: 2026-02-24T19:18:16.030 INFO:tasks.workunit.client.0.trial195.stdout: api_stat: [----------] Global test environment tear-down 2026-02-24T19:18:16.030 INFO:tasks.workunit.client.0.trial195.stdout: api_stat: [==========] 9 tests from 2 test suites ran. (16738 ms total) 2026-02-24T19:18:16.031 INFO:tasks.workunit.client.0.trial195.stdout: api_stat: [ PASSED ] 9 tests. 2026-02-24T19:18:17.035 INFO:tasks.workunit.client.0.trial195.stdout: ec_io: Running main() from gmock_main.cc 2026-02-24T19:18:17.035 INFO:tasks.workunit.client.0.trial195.stdout: ec_io: [==========] Running 2 tests from 1 test suite. 2026-02-24T19:18:17.035 INFO:tasks.workunit.client.0.trial195.stdout: ec_io: [----------] Global test environment set-up. 2026-02-24T19:18:17.035 INFO:tasks.workunit.client.0.trial195.stdout: ec_io: [----------] 2 tests from NeoRadosECIo 2026-02-24T19:18:17.035 INFO:tasks.workunit.client.0.trial195.stdout: ec_io: [ RUN ] NeoRadosECIo.SimpleWrite 2026-02-24T19:18:17.035 INFO:tasks.workunit.client.0.trial195.stdout: ec_io: [ OK ] NeoRadosECIo.SimpleWrite (9388 ms) 2026-02-24T19:18:17.035 INFO:tasks.workunit.client.0.trial195.stdout: ec_io: [ RUN ] NeoRadosECIo.ReadOp 2026-02-24T19:18:17.036 INFO:tasks.workunit.client.0.trial195.stdout: ec_io: [ OK ] NeoRadosECIo.ReadOp (8308 ms) 2026-02-24T19:18:17.036 INFO:tasks.workunit.client.0.trial195.stdout: ec_io: [----------] 2 tests from NeoRadosECIo (17696 ms total) 2026-02-24T19:18:17.036 INFO:tasks.workunit.client.0.trial195.stdout: ec_io: 2026-02-24T19:18:17.036 INFO:tasks.workunit.client.0.trial195.stdout: ec_io: [----------] Global test environment tear-down 2026-02-24T19:18:17.036 INFO:tasks.workunit.client.0.trial195.stdout: ec_io: [==========] 2 tests from 1 test suite ran. (17696 ms total) 2026-02-24T19:18:17.036 INFO:tasks.workunit.client.0.trial195.stdout: ec_io: [ PASSED ] 2 tests. 2026-02-24T19:18:17.049 INFO:tasks.workunit.client.0.trial195.stdout: api_stat_pp: Running main() from gmock_main.cc 2026-02-24T19:18:17.050 INFO:tasks.workunit.client.0.trial195.stdout: api_stat_pp: [==========] Running 9 tests from 2 test suites. 2026-02-24T19:18:17.050 INFO:tasks.workunit.client.0.trial195.stdout: api_stat_pp: [----------] Global test environment set-up. 2026-02-24T19:18:17.050 INFO:tasks.workunit.client.0.trial195.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP 2026-02-24T19:18:17.050 INFO:tasks.workunit.client.0.trial195.stdout: api_stat_pp: seed 49238 2026-02-24T19:18:17.050 INFO:tasks.workunit.client.0.trial195.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPP 2026-02-24T19:18:17.050 INFO:tasks.workunit.client.0.trial195.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPP (2990 ms) 2026-02-24T19:18:17.050 INFO:tasks.workunit.client.0.trial195.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.Stat2Mtime2PP 2026-02-24T19:18:17.050 INFO:tasks.workunit.client.0.trial195.stdout: api_stat_pp: [ OK ] LibRadosStatPP.Stat2Mtime2PP (82 ms) 2026-02-24T19:18:17.050 INFO:tasks.workunit.client.0.trial195.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.ClusterStatPP 2026-02-24T19:18:17.050 INFO:tasks.workunit.client.0.trial195.stdout: api_stat_pp: [ OK ] LibRadosStatPP.ClusterStatPP (353 ms) 2026-02-24T19:18:17.050 INFO:tasks.workunit.client.0.trial195.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.PoolStatPP 2026-02-24T19:18:17.051 INFO:tasks.workunit.client.0.trial195.stdout: api_stat_pp: [ OK ] LibRadosStatPP.PoolStatPP (677 ms) 2026-02-24T19:18:17.051 INFO:tasks.workunit.client.0.trial195.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPPNS 2026-02-24T19:18:17.051 INFO:tasks.workunit.client.0.trial195.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPPNS (983 ms) 2026-02-24T19:18:17.051 INFO:tasks.workunit.client.0.trial195.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP (5087 ms total) 2026-02-24T19:18:17.051 INFO:tasks.workunit.client.0.trial195.stdout: api_stat_pp: 2026-02-24T19:18:17.051 INFO:tasks.workunit.client.0.trial195.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP 2026-02-24T19:18:17.051 INFO:tasks.workunit.client.0.trial195.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPP 2026-02-24T19:18:17.051 INFO:tasks.workunit.client.0.trial195.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPP (1879 ms) 2026-02-24T19:18:17.051 INFO:tasks.workunit.client.0.trial195.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.ClusterStatPP 2026-02-24T19:18:17.051 INFO:tasks.workunit.client.0.trial195.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.ClusterStatPP (1 ms) 2026-02-24T19:18:17.051 INFO:tasks.workunit.client.0.trial195.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.PoolStatPP 2026-02-24T19:18:17.051 INFO:tasks.workunit.client.0.trial195.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.PoolStatPP (217 ms) 2026-02-24T19:18:17.051 INFO:tasks.workunit.client.0.trial195.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPPNS 2026-02-24T19:18:17.052 INFO:tasks.workunit.client.0.trial195.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPPNS (1399 ms) 2026-02-24T19:18:17.052 INFO:tasks.workunit.client.0.trial195.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP (3497 ms total) 2026-02-24T19:18:17.052 INFO:tasks.workunit.client.0.trial195.stdout: api_stat_pp: 2026-02-24T19:18:17.052 INFO:tasks.workunit.client.0.trial195.stdout: api_stat_pp: [----------] Global test environment tear-down 2026-02-24T19:18:17.052 INFO:tasks.workunit.client.0.trial195.stdout: api_stat_pp: [==========] 9 tests from 2 test suites ran. (17755 ms total) 2026-02-24T19:18:17.052 INFO:tasks.workunit.client.0.trial195.stdout: api_stat_pp: [ PASSED ] 9 tests. 2026-02-24T19:18:17.177 INFO:tasks.workunit.client.0.trial195.stdout:ly_mean_it": true}]': finished 2026-02-24T19:18:17.177 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:12.867406+0000 mon.a [INF] from='client.5140 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_trial195-49287-4","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T19:18:17.177 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:12.966586+0000 client.admin [INF] threexx 2026-02-24T19:18:17.177 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: got: 2026-02-24T19:18:12.968335+0000 mon.a [INF] from='client.? v1:10.20.193.195:0/1491711807' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2026-02-24T19:18:17.177 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: [ OK ] LibRadosCmd.WatchLog (9448 ms) 2026-02-24T19:18:17.177 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: [----------] 4 tests from LibRadosCmd (17877 ms total) 2026-02-24T19:18:17.178 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: 2026-02-24T19:18:17.178 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: [----------] Global test environment tear-down 2026-02-24T19:18:17.178 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: [==========] 4 tests from 1 test suite ran. (17877 ms total) 2026-02-24T19:18:17.178 INFO:tasks.workunit.client.0.trial195.stdout: api_cmd: [ PASSED ] 4 tests. 2026-02-24T19:18:18.102 INFO:tasks.workunit.client.0.trial195.stdout: delete_pools_parallel: process_1_[49648]: starting. 2026-02-24T19:18:18.103 INFO:tasks.workunit.client.0.trial195.stdout: delete_pools_parallel: process_1_[49648]: creating pool ceph_test_rados_delete_pools_parallel.trial195-49558 2026-02-24T19:18:18.103 INFO:tasks.workunit.client.0.trial195.stdout: delete_pools_parallel: process_1_[49648]: created object 0... 2026-02-24T19:18:18.103 INFO:tasks.workunit.client.0.trial195.stdout: delete_pools_parallel: process_1_[49648]: created object 25... 2026-02-24T19:18:18.103 INFO:tasks.workunit.client.0.trial195.stdout: delete_pools_parallel: process_1_[49648]: created object 49... 2026-02-24T19:18:18.103 INFO:tasks.workunit.client.0.trial195.stdout: delete_pools_parallel: process_1_[49648]: finishing. 2026-02-24T19:18:18.103 INFO:tasks.workunit.client.0.trial195.stdout: delete_pools_parallel: process_1_[49648]: shutting down. 2026-02-24T19:18:18.103 INFO:tasks.workunit.client.0.trial195.stdout: delete_pools_parallel: process_2_[49650]: starting. 2026-02-24T19:18:18.103 INFO:tasks.workunit.client.0.trial195.stdout: delete_pools_parallel: process_2_[49650]: deleting pool ceph_test_rados_delete_pools_parallel.trial195-49558 2026-02-24T19:18:18.103 INFO:tasks.workunit.client.0.trial195.stdout: delete_pools_parallel: process_2_[49650]: shutting down. 2026-02-24T19:18:18.103 INFO:tasks.workunit.client.0.trial195.stdout: delete_pools_parallel: ******************************* 2026-02-24T19:18:18.103 INFO:tasks.workunit.client.0.trial195.stdout: delete_pools_parallel: process_3_[51177]: starting. 2026-02-24T19:18:18.103 INFO:tasks.workunit.client.0.trial195.stdout: delete_pools_parallel: process_3_[51177]: creating pool ceph_test_rados_delete_pools_parallel.trial195-49558 2026-02-24T19:18:18.104 INFO:tasks.workunit.client.0.trial195.stdout: delete_pools_parallel: process_3_[51177]: created object 0... 2026-02-24T19:18:18.104 INFO:tasks.workunit.client.0.trial195.stdout: delete_pools_parallel: process_3_[51177]: created object 25... 2026-02-24T19:18:18.104 INFO:tasks.workunit.client.0.trial195.stdout: delete_pools_parallel: process_3_[51177]: created object 49... 2026-02-24T19:18:18.104 INFO:tasks.workunit.client.0.trial195.stdout: delete_pools_parallel: process_3_[51177]: finishing. 2026-02-24T19:18:18.104 INFO:tasks.workunit.client.0.trial195.stdout: delete_pools_parallel: process_3_[51177]: shutting down. 2026-02-24T19:18:18.104 INFO:tasks.workunit.client.0.trial195.stdout: delete_pools_parallel: ******************************* 2026-02-24T19:18:18.104 INFO:tasks.workunit.client.0.trial195.stdout: delete_pools_parallel: process_5_[51179]: starting. 2026-02-24T19:18:18.104 INFO:tasks.workunit.client.0.trial195.stdout: delete_pools_parallel: process_5_[51179]: listing objects. 2026-02-24T19:18:18.104 INFO:tasks.workunit.client.0.trial195.stdout: delete_pools_parallel: process_5_[51179]: listed object 0... 2026-02-24T19:18:18.104 INFO:tasks.workunit.client.0.trial195.stdout: delete_pools_parallel: process_5_[51179]: listed object 25... 2026-02-24T19:18:18.104 INFO:tasks.workunit.client.0.trial195.stdout: delete_pools_parallel: process_5_[51179]: saw 50 objects 2026-02-24T19:18:18.104 INFO:tasks.workunit.client.0.trial195.stdout: delete_pools_parallel: process_5_[51179]: shutting down. 2026-02-24T19:18:18.104 INFO:tasks.workunit.client.0.trial195.stdout: delete_pools_parallel: ******************************* 2026-02-24T19:18:18.105 INFO:tasks.workunit.client.0.trial195.stdout: delete_pools_parallel: process_4_[51178]: starting. 2026-02-24T19:18:18.105 INFO:tasks.workunit.client.0.trial195.stdout: delete_pools_parallel: process_4_[51178]: deleting pool ceph_test_rados_delete_pools_parallel.trial195-49558 2026-02-24T19:18:18.105 INFO:tasks.workunit.client.0.trial195.stdout: delete_pools_parallel: process_4_[51178]: shutting down. 2026-02-24T19:18:18.105 INFO:tasks.workunit.client.0.trial195.stdout: delete_pools_parallel: ******************************* 2026-02-24T19:18:18.105 INFO:tasks.workunit.client.0.trial195.stdout: delete_pools_parallel: ******************************* 2026-02-24T19:18:18.105 INFO:tasks.workunit.client.0.trial195.stdout: delete_pools_parallel: ******* SUCCESS ********** 2026-02-24T19:18:18.107 INFO:tasks.workunit.client.0.trial195.stdout: open_pools_parallel: process_1_[49621]: starting. 2026-02-24T19:18:18.107 INFO:tasks.workunit.client.0.trial195.stdout: open_pools_parallel: process_1_[49621]: creating pool ceph_test_rados_open_pools_parallel.trial195-49530 2026-02-24T19:18:18.108 INFO:tasks.workunit.client.0.trial195.stdout: open_pools_parallel: process_1_[49621]: created object 0... 2026-02-24T19:18:18.108 INFO:tasks.workunit.client.0.trial195.stdout: open_pools_parallel: process_1_[49621]: created object 25... 2026-02-24T19:18:18.108 INFO:tasks.workunit.client.0.trial195.stdout: open_pools_parallel: process_1_[49621]: created object 49... 2026-02-24T19:18:18.108 INFO:tasks.workunit.client.0.trial195.stdout: open_pools_parallel: process_1_[49621]: finishing. 2026-02-24T19:18:18.108 INFO:tasks.workunit.client.0.trial195.stdout: open_pools_parallel: process_1_[49621]: shutting down. 2026-02-24T19:18:18.108 INFO:tasks.workunit.client.0.trial195.stdout: open_pools_parallel: process_2_[49624]: starting. 2026-02-24T19:18:18.108 INFO:tasks.workunit.client.0.trial195.stdout: open_pools_parallel: process_2_[49624]: rados_pool_create. 2026-02-24T19:18:18.108 INFO:tasks.workunit.client.0.trial195.stdout: open_pools_parallel: process_2_[49624]: rados_ioctx_create. 2026-02-24T19:18:18.108 INFO:tasks.workunit.client.0.trial195.stdout: open_pools_parallel: process_2_[49624]: shutting down. 2026-02-24T19:18:18.108 INFO:tasks.workunit.client.0.trial195.stdout: open_pools_parallel: ******************************* 2026-02-24T19:18:18.108 INFO:tasks.workunit.client.0.trial195.stdout: open_pools_parallel: process_3_[51326]: starting. 2026-02-24T19:18:18.108 INFO:tasks.workunit.client.0.trial195.stdout: open_pools_parallel: process_3_[51326]: creating pool ceph_test_rados_open_pools_parallel.trial195-49530 2026-02-24T19:18:18.109 INFO:tasks.workunit.client.0.trial195.stdout: open_pools_parallel: process_3_[51326]: created object 0... 2026-02-24T19:18:18.109 INFO:tasks.workunit.client.0.trial195.stdout: open_pools_parallel: process_3_[51326]: created object 25... 2026-02-24T19:18:18.109 INFO:tasks.workunit.client.0.trial195.stdout: open_pools_parallel: process_3_[51326]: created object 49... 2026-02-24T19:18:18.109 INFO:tasks.workunit.client.0.trial195.stdout: open_pools_parallel: process_3_[51326]: finishing. 2026-02-24T19:18:18.109 INFO:tasks.workunit.client.0.trial195.stdout: open_pools_parallel: process_3_[51326]: shutting down. 2026-02-24T19:18:18.109 INFO:tasks.workunit.client.0.trial195.stdout: open_pools_parallel: ******************************* 2026-02-24T19:18:18.109 INFO:tasks.workunit.client.0.trial195.stdout: open_pools_parallel: process_4_[51327]: starting. 2026-02-24T19:18:18.109 INFO:tasks.workunit.client.0.trial195.stdout: open_pools_parallel: process_4_[51327]: rados_pool_create. 2026-02-24T19:18:18.109 INFO:tasks.workunit.client.0.trial195.stdout: open_pools_parallel: process_4_[51327]: rados_ioctx_create. 2026-02-24T19:18:18.109 INFO:tasks.workunit.client.0.trial195.stdout: open_pools_parallel: process_4_[51327]: shutting down. 2026-02-24T19:18:18.109 INFO:tasks.workunit.client.0.trial195.stdout: open_pools_parallel: ******************************* 2026-02-24T19:18:18.109 INFO:tasks.workunit.client.0.trial195.stdout: open_pools_parallel: ******************************* 2026-02-24T19:18:18.109 INFO:tasks.workunit.client.0.trial195.stdout: open_pools_parallel: ******* SUCCESS ********** 2026-02-24T19:18:20.003 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: Running main() from gmock_main.cc 2026-02-24T19:18:20.004 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [==========] Running 16 tests from 2 test suites. 2026-02-24T19:18:20.004 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [----------] Global test environment set-up. 2026-02-24T19:18:20.004 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP 2026-02-24T19:18:20.004 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2026-02-24T19:18:20.004 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: notify 2026-02-24T19:18:20.004 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotify (1923 ms) 2026-02-24T19:18:20.004 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2026-02-24T19:18:20.004 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (1276 ms) 2026-02-24T19:18:20.004 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP (3199 ms total) 2026-02-24T19:18:20.005 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: 2026-02-24T19:18:20.005 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2026-02-24T19:18:20.005 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2026-02-24T19:18:20.005 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: notify 2026-02-24T19:18:20.005 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (776 ms) 2026-02-24T19:18:20.005 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2026-02-24T19:18:20.005 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: notify 2026-02-24T19:18:20.005 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (3843 ms) 2026-02-24T19:18:20.005 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2026-02-24T19:18:20.005 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (130 ms) 2026-02-24T19:18:20.005 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2026-02-24T19:18:20.005 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (74 ms) 2026-02-24T19:18:20.006 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2026-02-24T19:18:20.006 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: handle_notify cookie 94351924199376 notify_id 206158430211 notifier_gid 5140 2026-02-24T19:18:20.006 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (171 ms) 2026-02-24T19:18:20.006 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2026-02-24T19:18:20.006 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: handle_notify cookie 94351924216096 notify_id 210453397507 notifier_gid 5140 2026-02-24T19:18:20.006 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: handle_notify cookie 94351924216096 notify_id 210453397507 notifier_gid 5140 2026-02-24T19:18:20.006 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: handle_notify cookie 94351924216096 notify_id 210453397508 notifier_gid 5140 2026-02-24T19:18:20.006 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (848 ms) 2026-02-24T19:18:20.006 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2026-02-24T19:18:20.006 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: handle_notify cookie 94351924216096 notify_id 210453397508 notifier_gid 5140 2026-02-24T19:18:20.006 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (102 ms) 2026-02-24T19:18:20.006 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2026-02-24T19:18:20.006 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: handle_notify cookie 94351924216096 notify_id 210453397508 notifier_gid 5140 2026-02-24T19:18:20.007 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (122 ms) 2026-02-24T19:18:20.007 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2026-02-24T19:18:20.007 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: handle_notify cookie 94351924216096 notify_id 210453397509 notifier_gid 5140 2026-02-24T19:18:20.007 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (93 ms) 2026-02-24T19:18:20.007 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2026-02-24T19:18:20.007 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: handle_notify cookie 94351924235072 notify_id 214748364801 notifier_gid 5140 2026-02-24T19:18:20.007 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (828 ms) 2026-02-24T19:18:20.007 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2026-02-24T19:18:20.261 INFO:tasks.workunit.client.0.trial195.stdout: api_wat api_lock_pp: Running main() from gmock_main.cc 2026-02-24T19:18:20.262 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [==========] Running 16 tests from 2 test suites. 2026-02-24T19:18:20.262 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [----------] Global test environment set-up. 2026-02-24T19:18:20.262 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP 2026-02-24T19:18:20.262 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: seed 49025 2026-02-24T19:18:20.262 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusivePP 2026-02-24T19:18:20.262 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusivePP (3321 ms) 2026-02-24T19:18:20.262 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedPP 2026-02-24T19:18:20.262 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedPP (621 ms) 2026-02-24T19:18:20.262 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusiveDurPP 2026-02-24T19:18:20.262 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusiveDurPP (1123 ms) 2026-02-24T19:18:20.263 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedDurPP 2026-02-24T19:18:20.263 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedDurPP (1125 ms) 2026-02-24T19:18:20.263 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockMayRenewPP 2026-02-24T19:18:20.263 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockMayRenewPP (146 ms) 2026-02-24T19:18:20.263 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.UnlockPP 2026-02-24T19:18:20.263 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [ OK ] LibRadosLockPP.UnlockPP (893 ms) 2026-02-24T19:18:20.263 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.ListLockersPP 2026-02-24T19:18:20.263 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [ OK ] LibRadosLockPP.ListLockersPP (85 ms) 2026-02-24T19:18:20.263 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.BreakLockPP 2026-02-24T19:18:20.263 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [ OK ] LibRadosLockPP.BreakLockPP (38 ms) 2026-02-24T19:18:20.263 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP (7356 ms total) 2026-02-24T19:18:20.263 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: 2026-02-24T19:18:20.263 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP 2026-02-24T19:18:20.264 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusivePP 2026-02-24T19:18:20.264 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusivePP (1890 ms) 2026-02-24T19:18:20.264 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedPP 2026-02-24T19:18:20.264 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedPP (36 ms) 2026-02-24T19:18:20.264 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2026-02-24T19:18:20.264 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusiveDurPP (1547 ms) 2026-02-24T19:18:20.264 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedDurPP 2026-02-24T19:18:20.264 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedDurPP (1174 ms) 2026-02-24T19:18:20.264 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockMayRenewPP 2026-02-24T19:18:20.264 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockMayRenewPP (68 ms) 2026-02-24T19:18:20.264 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.UnlockPP 2026-02-24T19:18:20.264 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.UnlockPP (91 ms) 2026-02-24T19:18:20.265 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.ListLockersPP 2026-02-24T19:18:20.265 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.ListLockersPP (94 ms) 2026-02-24T19:18:20.265 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.BreakLockPP 2026-02-24T19:18:20.265 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.BreakLockPP (51 ms) 2026-02-24T19:18:20.265 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP (4955 ms total) 2026-02-24T19:18:20.265 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: 2026-02-24T19:18:20.265 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [----------] Global test environment tear-down 2026-02-24T19:18:20.265 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [==========] 16 tests from 2 test suites ran. (20989 ms total) 2026-02-24T19:18:20.265 INFO:tasks.workunit.client.0.trial195.stdout: api_lock_pp: [ PASSED ] 16 tests. 2026-02-24T19:18:21.044 INFO:tasks.workunit.client.0.trial195.stdout: api_list: [==========] Running 11 tests from 3 test suites. 2026-02-24T19:18:21.044 INFO:tasks.workunit.client.0.trial195.stdout: api_list: [----------] Global test environment set-up. 2026-02-24T19:18:21.044 INFO:tasks.workunit.client.0.trial195.stdout: api_list: [----------] 7 tests from LibRadosList 2026-02-24T19:18:21.044 INFO:tasks.workunit.client.0.trial195.stdout: api_list: [ RUN ] LibRadosList.ListObjects 2026-02-24T19:18:21.044 INFO:tasks.workunit.client.0.trial195.stdout: api_list: [ OK ] LibRadosList.ListObjects (5052 ms) 2026-02-24T19:18:21.044 INFO:tasks.workunit.client.0.trial195.stdout: api_list: [ RUN ] LibRadosList.ListObjectsZeroInName 2026-02-24T19:18:21.044 INFO:tasks.workunit.client.0.trial195.stdout: api_list: [ OK ] LibRadosList.ListObjectsZeroInName (2163 ms) 2026-02-24T19:18:21.044 INFO:tasks.workunit.client.0.trial195.stdout: api_list: [ RUN ] LibRadosList.ListObjectsNS 2026-02-24T19:18:21.044 INFO:tasks.workunit.client.0.trial195.stdout: api_list: myset foo1,foo2,foo3 2026-02-24T19:18:21.044 INFO:tasks.workunit.client.0.trial195.stdout: api_list: foo1 2026-02-24T19:18:21.045 INFO:tasks.workunit.client.0.trial195.stdout: api_list: foo2 2026-02-24T19:18:21.045 INFO:tasks.workunit.client.0.trial195.stdout: api_list: foo3 2026-02-24T19:18:21.045 INFO:tasks.workunit.client.0.trial195.stdout: api_list: myset foo1,foo4,foo5 2026-02-24T19:18:21.045 INFO:tasks.workunit.client.0.trial195.stdout: api_list: foo4 2026-02-24T19:18:21.045 INFO:tasks.workunit.client.0.trial195.stdout: api_list: foo5 2026-02-24T19:18:21.045 INFO:tasks.workunit.client.0.trial195.stdout: api_list: foo1 2026-02-24T19:18:21.045 INFO:tasks.workunit.client.0.trial195.stdout: api_list: myset foo6,foo7 2026-02-24T19:18:21.045 INFO:tasks.workunit.client.0.trial195.stdout: api_list: foo7 2026-02-24T19:18:21.045 INFO:tasks.workunit.client.0.trial195.stdout: api_list: foo6 2026-02-24T19:18:21.045 INFO:tasks.workunit.client.0.trial195.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2026-02-24T19:18:21.045 INFO:tasks.workunit.client.0.trial195.stdout: api_list: ns1:foo4 2026-02-24T19:18:21.045 INFO:tasks.workunit.client.0.trial195.stdout: api_list: ns1:foo5 2026-02-24T19:18:21.046 INFO:tasks.workunit.client.0.trial195.stdout: api_list: ns2:foo7 2026-02-24T19:18:21.046 INFO:tasks.workunit.client.0.trial195.stdout: api_list: ns2:foo6 2026-02-24T19:18:21.046 INFO:tasks.workunit.client.0.trial195.stdout: api_list: ns1:foo1 2026-02-24T19:18:21.046 INFO:tasks.workunit.client.0.trial195.stdout: api_list: :foo1 2026-02-24T19:18:21.046 INFO:tasks.workunit.client.0.trial195.stdout: api_list: :foo2 2026-02-24T19:18:21.046 INFO:tasks.workunit.client.0.trial195.stdout: api_list: :foo3 2026-02-24T19:18:21.046 INFO:tasks.workunit.client.0.trial195.stdout: api_list: [ OK ] LibRadosList.ListObjectsNS (4963 ms) 2026-02-24T19:18:21.046 INFO:tasks.workunit.client.0.trial195.stdout: api_list: [ RUN ] LibRadosList.ListObjectsStart 2026-02-24T19:18:21.046 INFO:tasks.workunit.client.0.trial195.stdout: api_list: 1 0 2026-02-24T19:18:21.046 INFO:tasks.workunit.client.0.trial195.stdout: api_list: 10 0 2026-02-24T19:18:21.046 INFO:tasks.workunit.client.0.trial195.stdout: api_list: 13 0 2026-02-24T19:18:21.046 INFO:tasks.workunit.client.0.trial195.stdout: api_list: 7 0 2026-02-24T19:18:21.046 INFO:tasks.workunit.client.0.trial195.stdout: api_list: 14 0 2026-02-24T19:18:21.047 INFO:tasks.workunit.client.0.trial195.stdout: api_list: 0 0 2026-02-24T19:18:21.047 INFO:tasks.workunit.client.0.trial195.stdout: api_list: 15 0 2026-02-24T19:18:21.047 INFO:tasks.workunit.client.0.trial195.stdout: api_list: 11 0 2026-02-24T19:18:21.047 INFO:tasks.workunit.client.0.trial195.stdout: api_list: 5 0 2026-02-24T19:18:21.047 INFO:tasks.workunit.client.0.trial195.stdout: api_list: 8 0 2026-02-24T19:18:21.047 INFO:tasks.workunit.client.0.trial195.stdout: api_list: 6 0 2026-02-24T19:18:21.047 INFO:tasks.workunit.client.0.trial195.stdout: api_list: 3 0 2026-02-24T19:18:21.047 INFO:tasks.workunit.client.0.trial195.stdout: api_list: 4 0 2026-02-24T19:18:21.047 INFO:tasks.workunit.client.0.trial195.stdout: api_list: 12 0 2026-02-24T19:18:21.047 INFO:tasks.workunit.client.0.trial195.stdout: api_list: 9 0 2026-02-24T19:18:21.047 INFO:tasks.workunit.client.0.trial195.stdout: api_list: 2 0 2026-02-24T19:18:21.047 INFO:tasks.workunit.client.0.trial195.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2026-02-24T19:18:21.047 INFO:tasks.workunit.client.0.trial195.stdout: api_list: [ OK ] LibRadosList.ListObjectsStart (4144 ms) 2026-02-24T19:18:21.048 INFO:tasks.workunit.client.0.trial195.stdout: api_list: [ RUN ] LibRadosList.ListObjectsCursor 2026-02-24T19:18:21.048 INFO:tasks.workunit.client.0.trial195.stdout: api_list: x cursor=MIN 2026-02-24T19:18:21.048 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > oid=1 cursor=13:02547ec2:::1:head 2026-02-24T19:18:21.048 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > oid=10 cursor=13:52ea6a34:::10:head 2026-02-24T19:18:21.048 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > oid=13 cursor=13:566253c9:::13:head 2026-02-24T19:18:21.048 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > oid=7 cursor=13:5c6b0b28:::7:head 2026-02-24T19:18:21.048 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > oid=14 cursor=13:62a1935d:::14:head 2026-02-24T19:18:21.048 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > oid=0 cursor=13:6cac518f:::0:head 2026-02-24T19:18:21.048 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > oid=15 cursor=13:863748b0:::15:head 2026-02-24T19:18:21.048 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > oid=11 cursor=13:89d3ae78:::11:head 2026-02-24T19:18:21.048 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > oid=5 cursor=13:b29083e3:::5:head 2026-02-24T19:18:21.048 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > oid=8 cursor=13:bd63b0f1:::8:head 2026-02-24T19:18:21.048 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > oid=6 cursor=13:c4fdafeb:::6:head 2026-02-24T19:18:21.049 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > oid=3 cursor=13:cfc208b3:::3:head 2026-02-24T19:18:21.049 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > oid=4 cursor=13:d83876eb:::4:head 2026-02-24T19:18:21.049 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > oid=12 cursor=13:de5d7c5f:::12:head 2026-02-24T19:18:21.049 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > oid=9 cursor=13:e960b815:::9:head 2026-02-24T19:18:21.049 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > oid=2 cursor=13:f905c69b:::2:head 2026-02-24T19:18:21.049 INFO:tasks.workunit.client.0.trial195.stdout: api_list: FIRST> seek to MIN oid=1 2026-02-24T19:18:21.049 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : oid=1 cursor=13:02547ec2:::1:head 2026-02-24T19:18:21.049 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : seek to 13:02547ec2:::1:head 2026-02-24T19:18:21.049 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > 13:02547ec2:::1:head -> 1 2026-02-24T19:18:21.049 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : oid=10 cursor=13:52ea6a34:::10:head 2026-02-24T19:18:21.049 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : seek to 13:52ea6a34:::10:head 2026-02-24T19:18:21.049 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > 13:52ea6a34:::10:head -> 10 2026-02-24T19:18:21.049 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : oid=13 cursor=13:566253c9:::13:head 2026-02-24T19:18:21.050 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : seek to 13:566253c9:::13:head 2026-02-24T19:18:21.050 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > 13:566253c9:::13:head -> 13 2026-02-24T19:18:21.050 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : oid=7 cursor=13:5c6b0b28:::7:head 2026-02-24T19:18:21.050 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : seek to 13:5c6b0b28:::7:head 2026-02-24T19:18:21.050 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > 13:5c6b0b28:::7:head -> 7 2026-02-24T19:18:21.318 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : oid api_io: Running main() from gmock_main.cc 2026-02-24T19:18:21.318 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [==========] Running 24 tests from 2 test suites. 2026-02-24T19:18:21.318 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [----------] Global test environment set-up. 2026-02-24T19:18:21.318 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [----------] 14 tests from LibRadosIo 2026-02-24T19:18:21.319 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ RUN ] LibRadosIo.SimpleWrite 2026-02-24T19:18:21.319 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ OK ] LibRadosIo.SimpleWrite (2839 ms) 2026-02-24T19:18:21.319 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ RUN ] LibRadosIo.TooBig 2026-02-24T19:18:21.319 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ OK ] LibRadosIo.TooBig (0 ms) 2026-02-24T19:18:21.319 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ RUN ] LibRadosIo.ReadTimeout 2026-02-24T19:18:21.319 INFO:tasks.workunit.client.0.trial195.stdout: api_io: no timeout :/ 2026-02-24T19:18:21.319 INFO:tasks.workunit.client.0.trial195.stdout: api_io: no timeout :/ 2026-02-24T19:18:21.319 INFO:tasks.workunit.client.0.trial195.stdout: api_io: no timeout :/ 2026-02-24T19:18:21.319 INFO:tasks.workunit.client.0.trial195.stdout: api_io: no timeout :/ 2026-02-24T19:18:21.319 INFO:tasks.workunit.client.0.trial195.stdout: api_io: no timeout :/ 2026-02-24T19:18:21.319 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ OK ] LibRadosIo.ReadTimeout (2326 ms) 2026-02-24T19:18:21.319 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ RUN ] LibRadosIo.RoundTrip 2026-02-24T19:18:21.319 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ OK ] LibRadosIo.RoundTrip (577 ms) 2026-02-24T19:18:21.320 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ RUN ] LibRadosIo.Checksum 2026-02-24T19:18:21.320 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ OK ] LibRadosIo.Checksum (148 ms) 2026-02-24T19:18:21.320 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2026-02-24T19:18:21.320 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ OK ] LibRadosIo.OverlappingWriteRoundTrip (173 ms) 2026-02-24T19:18:21.320 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ RUN ] LibRadosIo.WriteFullRoundTrip 2026-02-24T19:18:21.320 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ OK ] LibRadosIo.WriteFullRoundTrip (65 ms) 2026-02-24T19:18:21.320 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ RUN ] LibRadosIo.AppendRoundTrip 2026-02-24T19:18:21.320 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ OK ] LibRadosIo.AppendRoundTrip (111 ms) 2026-02-24T19:18:21.320 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ RUN ] LibRadosIo.ZeroLenZero 2026-02-24T19:18:21.320 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ OK ] LibRadosIo.ZeroLenZero (110 ms) 2026-02-24T19:18:21.320 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ RUN ] LibRadosIo.TruncTest 2026-02-24T19:18:21.320 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ OK ] LibRadosIo.TruncTest (836 ms) 2026-02-24T19:18:21.321 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ RUN ] LibRadosIo.RemoveTest 2026-02-24T19:18:21.321 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ OK ] LibRadosIo.RemoveTest (67 ms) 2026-02-24T19:18:21.321 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ RUN ] LibRadosIo.XattrsRoundTrip 2026-02-24T19:18:21.321 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ OK ] LibRadosIo.XattrsRoundTrip (511 ms) 2026-02-24T19:18:21.321 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ RUN ] LibRadosIo.RmXattr 2026-02-24T19:18:21.321 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ OK ] LibRadosIo.RmXattr (507 ms) 2026-02-24T19:18:21.321 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ RUN ] LibRadosIo.XattrIter 2026-02-24T19:18:21.321 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ OK ] LibRadosIo.XattrIter (72 ms) 2026-02-24T19:18:21.321 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [----------] 14 tests from LibRadosIo (8348 ms total) 2026-02-24T19:18:21.321 INFO:tasks.workunit.client.0.trial195.stdout: api_io: 2026-02-24T19:18:21.321 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [----------] 10 tests from LibRadosIoEC 2026-02-24T19:18:21.321 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ RUN ] LibRadosIoEC.SimpleWrite 2026-02-24T19:18:21.321 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ OK ] LibRadosIoEC.SimpleWrite (1773 ms) 2026-02-24T19:18:21.321 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ RUN ] LibRadosIoEC.RoundTrip 2026-02-24T19:18:21.322 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ OK ] LibRadosIoEC.RoundTrip (271 ms) 2026-02-24T19:18:21.322 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2026-02-24T19:18:21.322 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ OK ] LibRadosIoEC.OverlappingWriteRoundTrip (702 ms) 2026-02-24T19:18:21.322 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ RUN ] LibRadosIoEC.WriteFullRoundTrip 2026-02-24T19:18:21.322 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ OK ] LibRadosIoEC.WriteFullRoundTrip (274 ms) 2026-02-24T19:18:21.322 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ RUN ] LibRadosIoEC.AppendRoundTrip 2026-02-24T19:18:21.322 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ OK ] LibRadosIoEC.AppendRoundTrip (585 ms) 2026-02-24T19:18:21.322 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ RUN ] LibRadosIoEC.TruncTest 2026-02-24T19:18:21.322 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ OK ] LibRadosIoEC.TruncTest (175 ms) 2026-02-24T19:18:21.322 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ RUN ] LibRadosIoEC.RemoveTest 2026-02-24T19:18:21.322 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ OK ] LibRadosIoEC.RemoveTest (161 ms) 2026-02-24T19:18:21.322 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ RUN ] LibRadosIoEC.XattrsRoundTrip 2026-02-24T19:18:21.323 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ OK ] LibRadosIoEC.XattrsRoundTrip (72 ms) 2026-02-24T19:18:21.323 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ RUN ] LibRadosIoEC.RmXattr 2026-02-24T19:18:21.323 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ OK ] LibRadosIoEC.RmXattr (883 ms) 2026-02-24T19:18:21.323 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ RUN ] LibRadosIoEC.XattrIter 2026-02-24T19:18:21.323 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ OK ] LibRadosIoEC.XattrIter (73 ms) 2026-02-24T19:18:21.323 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [----------] 10 tests from LibRadosIoEC (4975 ms total) 2026-02-24T19:18:21.324 INFO:tasks.workunit.client.0.trial195.stdout: api_io: 2026-02-24T19:18:21.324 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [----------] Global test environment tear-down 2026-02-24T19:18:21.324 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [==========] 24 tests from 2 test suites ran. (22060 ms total) 2026-02-24T19:18:21.324 INFO:tasks.workunit.client.0.trial195.stdout: api_io: [ PASSED ] 24 tests. 2026-02-24T19:18:21.343 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: Running main() from gmock_main.cc 2026-02-24T19:18:21.343 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [==========] Running 16 tests from 2 test suites. 2026-02-24T19:18:21.343 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [----------] Global test environment set-up. 2026-02-24T19:18:21.343 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [----------] 8 tests from LibRadosLock 2026-02-24T19:18:21.343 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusive 2026-02-24T19:18:21.343 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [ OK ] LibRadosLock.LockExclusive (2418 ms) 2026-02-24T19:18:21.343 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [ RUN ] LibRadosLock.LockShared 2026-02-24T19:18:21.343 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [ OK ] LibRadosLock.LockShared (735 ms) 2026-02-24T19:18:21.343 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusiveDur 2026-02-24T19:18:21.343 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [ OK ] LibRadosLock.LockExclusiveDur (1440 ms) 2026-02-24T19:18:21.344 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [ RUN ] LibRadosLock.LockSharedDur 2026-02-24T19:18:21.344 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [ OK ] LibRadosLock.LockSharedDur (1318 ms) 2026-02-24T19:18:21.344 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [ RUN ] LibRadosLock.LockMayRenew 2026-02-24T19:18:21.344 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [ OK ] LibRadosLock.LockMayRenew (218 ms) 2026-02-24T19:18:21.344 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [ RUN ] LibRadosLock.Unlock 2026-02-24T19:18:21.344 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [ OK ] LibRadosLock.Unlock (92 ms) 2026-02-24T19:18:21.344 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [ RUN ] LibRadosLock.ListLockers 2026-02-24T19:18:21.344 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [ OK ] LibRadosLock.ListLockers (791 ms) 2026-02-24T19:18:21.344 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [ RUN ] LibRadosLock.BreakLock 2026-02-24T19:18:21.344 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [ OK ] LibRadosLock.BreakLock (250 ms) 2026-02-24T19:18:21.344 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [----------] 8 tests from LibRadosLock (7266 ms total) 2026-02-24T19:18:21.344 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: 2026-02-24T19:18:21.344 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [----------] 8 tests from LibRadosLockEC 2026-02-24T19:18:21.345 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusive 2026-02-24T19:18:21.345 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusive (1949 ms) 2026-02-24T19:18:21.345 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [ RUN ] LibRadosLockEC.LockShared 2026-02-24T19:18:21.345 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [ OK ] LibRadosLockEC.LockShared (708 ms) 2026-02-24T19:18:21.345 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusiveDur 2026-02-24T19:18:21.345 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusiveDur (1159 ms) 2026-02-24T19:18:21.345 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [ RUN ] LibRadosLockEC.LockSharedDur 2026-02-24T19:18:21.345 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [ OK ] LibRadosLockEC.LockSharedDur (1047 ms) 2026-02-24T19:18:21.345 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [ RUN ] LibRadosLockEC.LockMayRenew 2026-02-24T19:18:21.345 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [ OK ] LibRadosLockEC.LockMayRenew (68 ms) 2026-02-24T19:18:21.345 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [ RUN ] LibRadosLockEC.Unlock 2026-02-24T19:18:21.345 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [ OK ] LibRadosLockEC.Unlock (107 ms) 2026-02-24T19:18:21.345 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [ RUN ] LibRadosLockEC.ListLockers 2026-02-24T19:18:21.346 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [ OK ] LibRadosLockEC.ListLockers (804 ms) 2026-02-24T19:18:21.346 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [ RUN ] LibRadosLockEC.BreakLock 2026-02-24T19:18:21.346 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [ OK ] LibRadosLockEC.BreakLock (122 ms) 2026-02-24T19:18:21.346 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [----------] 8 tests from LibRadosLockEC (5969 ms total) 2026-02-24T19:18:21.346 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: 2026-02-24T19:18:21.346 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [----------] Global test environment tear-down 2026-02-24T19:18:21.346 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [==========] 16 tests from 2 test suites ran. (22072 ms total) 2026-02-24T19:18:21.346 INFO:tasks.workunit.client.0.trial195.stdout: api_lock: [ PASSED ] 16 tests. 2026-02-24T19:18:22.460 INFO:tasks.workunit.client.0.trial195.stdout:=14 cursor=13:62a1935d:::14:head 2026-02-24T19:18:22.461 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : seek to 13:62a1935d:::14:head 2026-02-24T19:18:22.461 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > 13:62a1935d:::14:head -> 14 2026-02-24T19:18:22.461 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : oid=0 cursor=13:6cac518f:::0:head 2026-02-24T19:18:22.461 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : seek to 13:6cac518f:::0:head 2026-02-24T19:18:22.461 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > 13:6cac518f:::0:head -> 0 2026-02-24T19:18:22.461 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : oid=15 cursor=13:863748b0:::15:head 2026-02-24T19:18:22.461 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : seek to 13:863748b0:::15:head 2026-02-24T19:18:22.461 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > 13:863748b0:::15:head -> 15 2026-02-24T19:18:22.461 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : oid=11 cursor=13:89d3ae78:::11:head 2026-02-24T19:18:22.461 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : seek to 13:89d3ae78:::11:head 2026-02-24T19:18:22.462 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > 13:89d3ae78:::11:head -> 11 2026-02-24T19:18:22.462 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : oid=5 cursor=13:b29083e3:::5:head 2026-02-24T19:18:22.462 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : seek to 13:b29083e3:::5:head 2026-02-24T19:18:22.462 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > 13:b29083e3:::5:head -> 5 2026-02-24T19:18:22.462 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : oid=8 cursor=13:bd63b0f1:::8:head 2026-02-24T19:18:22.462 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : seek to 13:bd63b0f1:::8:head 2026-02-24T19:18:22.462 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > 13:bd63b0f1:::8:head -> 8 2026-02-24T19:18:22.462 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : oid=6 cursor=13:c4fdafeb:::6:head 2026-02-24T19:18:22.462 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : seek to 13:c4fdafeb:::6:head 2026-02-24T19:18:22.462 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > 13:c4fdafeb:::6:head -> 6 2026-02-24T19:18:22.462 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : oid=3 cursor=13:cfc208b3:::3:head 2026-02-24T19:18:22.462 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : seek to 13:cfc208b3:::3:head 2026-02-24T19:18:22.462 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > 13:cfc208b3:::3:head -> 3 2026-02-24T19:18:22.462 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : oid=4 cursor=13:d83876eb:::4:head 2026-02-24T19:18:22.463 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : seek to 13:d83876eb:::4:head 2026-02-24T19:18:22.463 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > 13:d83876eb:::4:head -> 4 2026-02-24T19:18:22.463 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : oid=12 cursor=13:de5d7c5f:::12:head 2026-02-24T19:18:22.463 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : seek to 13:de5d7c5f:::12:head 2026-02-24T19:18:22.463 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > 13:de5d7c5f:::12:head -> 12 2026-02-24T19:18:22.463 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : oid=9 cursor=13:e960b815:::9:head 2026-02-24T19:18:22.463 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : seek to 13:e960b815:::9:head 2026-02-24T19:18:22.463 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > 13:e960b815:::9:head -> 9 2026-02-24T19:18:22.463 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : oid=2 cursor=13:f905c69b:::2:head 2026-02-24T19:18:22.463 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : seek to 13:f905c69b:::2:head 2026-02-24T19:18:22.463 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > 13:f905c69b:::2:head -> 2 2026-02-24T19:18:22.463 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : seek to 13:b29083e3:::5:head 2026-02-24T19:18:22.463 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : cursor()=13:b29083e3:::5:head expected=13:b29083e3:::5:head 2026-02-24T19:18:22.464 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > 13:b29083e3:::5:head -> 5 2026-02-24T19:18:22.464 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : entry=5 expected=5 2026-02-24T19:18:22.464 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : seek to 13:89d3ae78:::11:head 2026-02-24T19:18:22.464 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : cursor()=13:89d3ae78:::11:head expected=13:89d3ae78:::11:head 2026-02-24T19:18:22.464 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > 13:89d3ae78:::11:head -> 11 2026-02-24T19:18:22.464 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : entry=11 expected=11 2026-02-24T19:18:22.464 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : seek to 13:863748b0:::15:head 2026-02-24T19:18:22.464 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : cursor()=13:863748b0:::15:head expected=13:863748b0:::15:head 2026-02-24T19:18:22.464 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > 13:863748b0:::15:head -> 15 2026-02-24T19:18:22.464 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : entry=15 expected=15 2026-02-24T19:18:22.464 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : seek to 13:6cac518f:::0:head 2026-02-24T19:18:22.464 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : cursor()=13:6cac518f:::0:head expected=13:6cac518f:::0:head 2026-02-24T19:18:22.464 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > 13:6cac518f:::0:head -> 0 2026-02-24T19:18:22.465 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : entry=0 expected=0 2026-02-24T19:18:22.465 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : seek to 13:62a1935d:::14:head 2026-02-24T19:18:22.465 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : cursor()=13:62a1935d:::14:head expected=13:62a1935d:::14:head 2026-02-24T19:18:22.465 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > 13:62a1935d:::14:head -> 14 2026-02-24T19:18:22.465 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : entry=14 expected=14 2026-02-24T19:18:22.465 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : seek to 13:5c6b0b28:::7:head 2026-02-24T19:18:22.465 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : cursor()=13:5c6b0b28:::7:head expected=13:5c6b0b28:::7:head 2026-02-24T19:18:22.465 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > 13:5c6b0b28:::7:head -> 7 2026-02-24T19:18:22.465 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : entry=7 expected=7 2026-02-24T19:18:22.465 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : seek to 13:566253c9:::13:head 2026-02-24T19:18:22.465 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : cursor()=13:566253c9:::13:head expected=13:566253c9:::13:head 2026-02-24T19:18:22.465 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > 13:566253c9:::13:head -> 13 2026-02-24T19:18:22.465 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : entry=13 expected=13 2026-02-24T19:18:22.466 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : seek to 13:52ea6a34:::10:head 2026-02-24T19:18:22.466 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : cursor()=13:52ea6a34:::10:head expected=13:52ea6a34:::10:head 2026-02-24T19:18:22.466 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > 13:52ea6a34:::10:head -> 10 2026-02-24T19:18:25.148 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_1_[49590]: starting. 2026-02-24T19:18:25.148 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_1_[49590]: creating pool ceph_test_rados_list_parallel.trial195-49506 2026-02-24T19:18:25.148 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_1_[49590]: created object 0... 2026-02-24T19:18:25.148 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_1_[49590]: created object 25... 2026-02-24T19:18:25.148 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_1_[49590]: created object 49... 2026-02-24T19:18:25.148 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_1_[49590]: finishing. 2026-02-24T19:18:25.148 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_1_[49590]: shutting down. 2026-02-24T19:18:25.149 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_2_[49596]: starting. 2026-02-24T19:18:25.149 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_2_[49596]: listing objects. 2026-02-24T19:18:25.149 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_2_[49596]: listed object 0... 2026-02-24T19:18:25.149 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_2_[49596]: listed object 25... 2026-02-24T19:18:25.149 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_2_[49596]: saw 50 objects 2026-02-24T19:18:25.149 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_2_[49596]: shutting down. 2026-02-24T19:18:25.149 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:25.149 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_3_[51269]: starting. 2026-02-24T19:18:25.149 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_3_[51269]: creating pool ceph_test_rados_list_parallel.trial195-49506 2026-02-24T19:18:25.149 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_3_[51269]: created object 0... 2026-02-24T19:18:25.149 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_3_[51269]: created object 25... 2026-02-24T19:18:25.149 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_3_[51269]: created object 49... 2026-02-24T19:18:25.150 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_3_[51269]: finishing. 2026-02-24T19:18:25.150 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_3_[51269]: shutting down. 2026-02-24T19:18:25.150 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:25.150 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_4_[51270]: starting. 2026-02-24T19:18:25.150 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_4_[51270]: listing objects. 2026-02-24T19:18:25.150 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_4_[51270]: listed object 0... 2026-02-24T19:18:25.150 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_4_[51270]: listed object 25... 2026-02-24T19:18:25.150 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_4_[51270]: saw 44 objects 2026-02-24T19:18:25.150 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_4_[51270]: shutting down. 2026-02-24T19:18:25.150 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:25.150 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_5_[51271]: starting. 2026-02-24T19:18:25.150 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_5_[51271]: removed 25 objects... 2026-02-24T19:18:25.150 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_5_[51271]: removed half of the objects 2026-02-24T19:18:25.151 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_5_[51271]: removed 50 objects... 2026-02-24T19:18:25.151 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_5_[51271]: removed 50 objects 2026-02-24T19:18:25.151 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_5_[51271]: shutting down. 2026-02-24T19:18:25.151 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:25.151 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:25.151 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_6_[51739]: starting. 2026-02-24T19:18:25.151 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_6_[51739]: creating pool ceph_test_rados_list_parallel.trial195-49506 2026-02-24T19:18:25.151 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_6_[51739]: created object 0... 2026-02-24T19:18:25.151 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_6_[51739]: created object 25... 2026-02-24T19:18:25.151 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_6_[51739]: created object 49... 2026-02-24T19:18:25.151 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_6_[51739]: finishing. 2026-02-24T19:18:25.151 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_6_[51739]: shutting down. 2026-02-24T19:18:25.151 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:25.152 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:25.152 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_7_[51740]: starting. 2026-02-24T19:18:25.152 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_7_[51740]: listing objects. 2026-02-24T19:18:25.152 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_7_[51740]: listed object 0... 2026-02-24T19:18:25.152 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_7_[51740]: listed object 25... 2026-02-24T19:18:25.152 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_7_[51740]: listed object 50... 2026-02-24T19:18:25.152 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_7_[51740]: saw 53 objects 2026-02-24T19:18:25.152 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_7_[51740]: shutting down. 2026-02-24T19:18:25.152 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:25.152 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:25.152 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_8_[51741]: starting. 2026-02-24T19:18:25.152 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_8_[51741]: added 25 objects... 2026-02-24T19:18:25.152 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_8_[51741]: added half of the objects 2026-02-24T19:18:25.153 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_8_[51741]: added 50 objects... 2026-02-24T19:18:25.153 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_8_[51741]: added 50 objects 2026-02-24T19:18:25.153 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_8_[51741]: shutting down. 2026-02-24T19:18:25.153 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:25.153 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:28.979 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ************************* api_service: [==========] Running 4 tests from 1 test suite. 2026-02-24T19:18:28.980 INFO:tasks.workunit.client.0.trial195.stdout: api_service: [----------] Global test environment set-up. 2026-02-24T19:18:28.980 INFO:tasks.workunit.client.0.trial195.stdout: api_service: [----------] 4 tests from LibRadosService 2026-02-24T19:18:28.980 INFO:tasks.workunit.client.0.trial195.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2026-02-24T19:18:28.980 INFO:tasks.workunit.client.0.trial195.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (5355 ms) 2026-02-24T19:18:28.980 INFO:tasks.workunit.client.0.trial195.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2026-02-24T19:18:28.980 INFO:tasks.workunit.client.0.trial195.stdout: api_service: [ OK ] LibRadosService.RegisterLate (935 ms) 2026-02-24T19:18:28.980 INFO:tasks.workunit.client.0.trial195.stdout: api_service: [ RUN ] LibRadosService.StatusFormat 2026-02-24T19:18:28.980 INFO:tasks.workunit.client.0.trial195.stdout: api_service: cluster: 2026-02-24T19:18:28.981 INFO:tasks.workunit.client.0.trial195.stdout: api_service: id: 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:18:28.981 INFO:tasks.workunit.client.0.trial195.stdout: api_service: health: HEALTH_OK 2026-02-24T19:18:28.981 INFO:tasks.workunit.client.0.trial195.stdout: api_service: 2026-02-24T19:18:28.981 INFO:tasks.workunit.client.0.trial195.stdout: api_service: services: 2026-02-24T19:18:28.981 INFO:tasks.workunit.client.0.trial195.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 86s) [leader: a] 2026-02-24T19:18:28.981 INFO:tasks.workunit.client.0.trial195.stdout: api_service: mgr: y(active, since 83s), standbys: x 2026-02-24T19:18:28.981 INFO:tasks.workunit.client.0.trial195.stdout: api_service: osd: 16 osds: 16 up (since 52s), 16 in (since 79s) 2026-02-24T19:18:28.981 INFO:tasks.workunit.client.0.trial195.stdout: api_service: 2026-02-24T19:18:28.981 INFO:tasks.workunit.client.0.trial195.stdout: api_service: data: 2026-02-24T19:18:28.981 INFO:tasks.workunit.client.0.trial195.stdout: api_service: pools: 31 pools, 865 pgs 2026-02-24T19:18:28.981 INFO:tasks.workunit.client.0.trial195.stdout: api_service: objects: 28 objects, 450 KiB 2026-02-24T19:18:28.981 INFO:tasks.workunit.client.0.trial195.stdout: api_service: usage: 429 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T19:18:28.982 INFO:tasks.workunit.client.0.trial195.stdout: api_service: pgs: 13.295% pgs unknown 2026-02-24T19:18:28.982 INFO:tasks.workunit.client.0.trial195.stdout: api_service: 14.220% pgs not active 2026-02-24T19:18:28.982 INFO:tasks.workunit.client.0.trial195.stdout: api_service: 627 active+clean 2026-02-24T19:18:28.982 INFO:tasks.workunit.client.0.trial195.stdout: api_service: 115 unknown 2026-02-24T19:18:28.982 INFO:tasks.workunit.client.0.trial195.stdout: api_service: 79 creating+peering 2026-02-24T19:18:28.982 INFO:tasks.workunit.client.0.trial195.stdout: api_service: 44 creating+activating 2026-02-24T19:18:28.982 INFO:tasks.workunit.client.0.trial195.stdout: api_service: 2026-02-24T19:18:28.982 INFO:tasks.workunit.client.0.trial195.stdout: api_service: io: 2026-02-24T19:18:28.982 INFO:tasks.workunit.client.0.trial195.stdout: api_service: client: 0 B/s rd, 4.0 KiB/s wr, 1 op/s rd, 4 op/s wr 2026-02-24T19:18:28.982 INFO:tasks.workunit.client.0.trial195.stdout: api_service: 2026-02-24T19:18:28.982 INFO:tasks.workunit.client.0.trial195.stdout: api_service: 2026-02-24T19:18:28.982 INFO:tasks.workunit.client.0.trial195.stdout: api_service: cluster: 2026-02-24T19:18:28.982 INFO:tasks.workunit.client.0.trial195.stdout: api_service: id: 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:18:28.983 INFO:tasks.workunit.client.0.trial195.stdout: api_service: health: HEALTH_OK 2026-02-24T19:18:28.983 INFO:tasks.workunit.client.0.trial195.stdout: api_service: 2026-02-24T19:18:28.983 INFO:tasks.workunit.client.0.trial195.stdout: api_service: services: 2026-02-24T19:18:28.983 INFO:tasks.workunit.client.0.trial195.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 88s) [leader: a] 2026-02-24T19:18:28.983 INFO:tasks.workunit.client.0.trial195.stdout: api_service: mgr: y(active, since 85s), standbys: x 2026-02-24T19:18:28.983 INFO:tasks.workunit.client.0.trial195.stdout: api_service: osd: 16 osds: 16 up (since 55s), 16 in (since 81s) 2026-02-24T19:18:28.983 INFO:tasks.workunit.client.0.trial195.stdout: api_service: foo: 16 portals active (1 hosts, 3 zones) 2026-02-24T19:18:28.983 INFO:tasks.workunit.client.0.trial195.stdout: api_service: laundry: 1 daemon active (1 hosts) 2026-02-24T19:18:28.983 INFO:tasks.workunit.client.0.trial195.stdout: api_service: 2026-02-24T19:18:28.983 INFO:tasks.workunit.client.0.trial195.stdout: api_service: data: 2026-02-24T19:18:28.983 INFO:tasks.workunit.client.0.trial195.stdout: api_service: pools: 28 pools, 793 pgs 2026-02-24T19:18:28.983 INFO:tasks.workunit.client.0.trial195.stdout: api_service: objects: 25 objects, 450 KiB 2026-02-24T19:18:28.983 INFO:tasks.workunit.client.0.trial195.stdout: api_service: usage: 429 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T19:18:28.984 INFO:tasks.workunit.client.0.trial195.stdout: api_service: pgs: 21.311% pgs unknown 2026-02-24T19:18:28.984 INFO:tasks.workunit.client.0.trial195.stdout: api_service: 11.728% pgs not active 2026-02-24T19:18:28.984 INFO:tasks.workunit.client.0.trial195.stdout: api_service: 531 active+clean 2026-02-24T19:18:28.984 INFO:tasks.workunit.client.0.trial195.stdout: api_service: 169 unknown 2026-02-24T19:18:28.984 INFO:tasks.workunit.client.0.trial195.stdout: api_service: 50 creating+peering 2026-02-24T19:18:28.984 INFO:tasks.workunit.client.0.trial195.stdout: api_service: 43 creating+activating 2026-02-24T19:18:28.984 INFO:tasks.workunit.client.0.trial195.stdout: api_service: 2026-02-24T19:18:28.984 INFO:tasks.workunit.client.0.trial195.stdout: api_service: io: 2026-02-24T19:18:28.984 INFO:tasks.workunit.client.0.trial195.stdout: api_service: client: 0 B/s rd, 3.3 KiB/s wr, 0 op/s rd, 3 op/s wr 2026-02-24T19:18:28.984 INFO:tasks.workunit.client.0.trial195.stdout: api_service: 2026-02-24T19:18:28.984 INFO:tasks.workunit.client.0.trial195.stdout: api_service: 2026-02-24T19:18:28.984 INFO:tasks.workunit.client.0.trial195.stdout: api_service: [ OK ] LibRadosService.StatusFormat (3351 ms) 2026-02-24T19:18:28.984 INFO:tasks.workunit.client.0.trial195.stdout: api_service: [ RUN ] LibRadosService.Status 2026-02-24T19:18:28.985 INFO:tasks.workunit.client.0.trial195.stdout: api_service: [ OK ] LibRadosService.Status (20022 ms) 2026-02-24T19:18:28.985 INFO:tasks.workunit.client.0.trial195.stdout: api_service: [----------] 4 tests from LibRadosService (29665 ms total) 2026-02-24T19:18:28.985 INFO:tasks.workunit.client.0.trial195.stdout: api_service: 2026-02-24T19:18:28.985 INFO:tasks.workunit.client.0.trial195.stdout: api_service: [----------] Global test environment tear-down 2026-02-24T19:18:28.985 INFO:tasks.workunit.client.0.trial195.stdout: api_service: [==========] 4 tests from 1 test suite ran. (29665 ms total) 2026-02-24T19:18:28.985 INFO:tasks.workunit.client.0.trial195.stdout: api_service: [ PASSED ] 4 tests. 2026-02-24T19:18:29.553 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: Running main() from gmock_main.cc 2026-02-24T19:18:29.553 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [==========] Running 40 tests from 2 test suites. 2026-02-24T19:18:29.554 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [----------] Global test environment set-up. 2026-02-24T19:18:29.554 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [----------] 22 tests from LibRadosIoPP 2026-02-24T19:18:29.554 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: seed 48938 2026-02-24T19:18:29.554 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TooBigPP 2026-02-24T19:18:29.554 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoPP.TooBigPP (0 ms) 2026-02-24T19:18:29.554 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SimpleWritePP 2026-02-24T19:18:29.554 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoPP.SimpleWritePP (2509 ms) 2026-02-24T19:18:29.554 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadOpPP 2026-02-24T19:18:29.554 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadOpPP (676 ms) 2026-02-24T19:18:29.554 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadOpPP 2026-02-24T19:18:29.554 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadOpPP (73 ms) 2026-02-24T19:18:29.554 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadExtentArrayOpPP 2026-02-24T19:18:29.555 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadExtentArrayOpPP (13178 ms) 2026-02-24T19:18:29.555 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP 2026-02-24T19:18:29.555 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP (50 ms) 2026-02-24T19:18:29.555 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP2 2026-02-24T19:18:29.555 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP2 (33 ms) 2026-02-24T19:18:29.555 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoPP.Checksum 2026-02-24T19:18:29.555 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoPP.Checksum (533 ms) 2026-02-24T19:18:29.555 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadIntoBufferlist 2026-02-24T19:18:29.555 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadIntoBufferlist (280 ms) 2026-02-24T19:18:29.555 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2026-02-24T19:18:29.555 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (38 ms) 2026-02-24T19:18:29.555 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2026-02-24T19:18:29.556 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP (89 ms) 2026-02-24T19:18:29.556 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2026-02-24T19:18:29.556 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (32 ms) 2026-02-24T19:18:29.556 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoPP.AppendRoundTripPP 2026-02-24T19:18:29.556 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoPP.AppendRoundTripPP (40 ms) 2026-02-24T19:18:29.556 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TruncTestPP 2026-02-24T19:18:29.556 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoPP.TruncTestPP (49 ms) 2026-02-24T19:18:29.556 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RemoveTestPP 2026-02-24T19:18:29.556 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoPP.RemoveTestPP (443 ms) 2026-02-24T19:18:29.556 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrsRoundTripPP 2026-02-24T19:18:29.556 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrsRoundTripPP (263 ms) 2026-02-24T19:18:29.556 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RmXattrPP 2026-02-24T19:18:29.556 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoPP.RmXattrPP (118 ms) 2026-02-24T19:18:29.557 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrListPP 2026-02-24T19:18:29.557 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrListPP (42 ms) 2026-02-24T19:18:29.557 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CrcZeroWrite 2026-02-24T19:18:29.557 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoPP.CrcZeroWrite (31 ms) 2026-02-24T19:18:29.557 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtPP 2026-02-24T19:18:29.557 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtPP (39 ms) 2026-02-24T19:18:29.557 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtDNEPP 2026-02-24T19:18:29.557 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtDNEPP (22 ms) 2026-02-24T19:18:29.557 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtMismatchPP 2026-02-24T19:18:29.557 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtMismatchPP (43 ms) 2026-02-24T19:18:29.557 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [----------] 22 tests from LibRadosIoPP (18591 ms total) 2026-02-24T19:18:29.557 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: 2026-02-24T19:18:29.557 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [----------] 18 tests from LibRadosIoECPP 2026-02-24T19:18:29.557 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SimpleWritePP 2026-02-24T19:18:29.558 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SimpleWritePP (3163 ms) 2026-02-24T19:18:29.558 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.ReadOpPP 2026-02-24T19:18:29.558 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoECPP.ReadOpPP (158 ms) 2026-02-24T19:18:29.558 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SparseReadOpPP 2026-02-24T19:18:30.096 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SparseRead****** 2026-02-24T19:18:30.096 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_9_[54124]: starting. 2026-02-24T19:18:30.096 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_9_[54124]: creating pool ceph_test_rados_list_parallel.trial195-49506 2026-02-24T19:18:30.096 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_9_[54124]: created object 0... 2026-02-24T19:18:30.096 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_9_[54124]: created object 25... 2026-02-24T19:18:30.096 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_9_[54124]: created object 49... 2026-02-24T19:18:30.096 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_9_[54124]: finishing. 2026-02-24T19:18:30.096 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_9_[54124]: shutting down. 2026-02-24T19:18:30.097 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:30.097 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:30.097 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:30.097 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_10_[54125]: starting. 2026-02-24T19:18:30.097 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_10_[54125]: listing objects. 2026-02-24T19:18:30.097 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_10_[54125]: listed object 0... 2026-02-24T19:18:30.097 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_10_[54125]: listed object 25... 2026-02-24T19:18:30.097 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_10_[54125]: listed object 50... 2026-02-24T19:18:30.097 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_10_[54125]: listed object 75... 2026-02-24T19:18:30.097 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_10_[54125]: saw 92 objects 2026-02-24T19:18:30.098 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_10_[54125]: shutting down. 2026-02-24T19:18:30.098 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:30.098 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:30.098 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:30.098 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_13_[54128]: starting. 2026-02-24T19:18:30.098 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_13_[54128]: removed 25 objects... 2026-02-24T19:18:30.098 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_13_[54128]: removed half of the objects 2026-02-24T19:18:30.098 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_13_[54128]: removed 50 objects... 2026-02-24T19:18:30.098 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_13_[54128]: removed 50 objects 2026-02-24T19:18:30.098 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_13_[54128]: shutting down. 2026-02-24T19:18:30.098 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:30.098 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:30.098 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:30.099 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_11_[54126]: starting. 2026-02-24T19:18:30.099 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_11_[54126]: added 25 objects... 2026-02-24T19:18:30.099 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_11_[54126]: added half of the objects 2026-02-24T19:18:30.099 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_11_[54126]: added 50 objects... 2026-02-24T19:18:30.099 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_11_[54126]: added 50 objects 2026-02-24T19:18:30.099 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_11_[54126]: shutting down. 2026-02-24T19:18:30.099 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:30.099 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:30.099 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:30.099 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_12_[54127]: starting. 2026-02-24T19:18:30.099 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_12_[54127]: added 25 objects... 2026-02-24T19:18:30.099 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_12_[54127]: added half of the objects 2026-02-24T19:18:30.099 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_12_[54127]: added 50 objects... 2026-02-24T19:18:30.100 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_12_[54127]: added 50 objects 2026-02-24T19:18:30.100 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_12_[54127]: shutting down. 2026-02-24T19:18:30.100 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:30.100 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:30.100 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:30.100 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:30.100 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_14_[58935]: starting. 2026-02-24T19:18:30.100 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_14_[58935]: creating pool ceph_test_rados_list_parallel.trial195-49506 2026-02-24T19:18:30.100 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_14_[58935]: created object 0... 2026-02-24T19:18:30.100 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_14_[58935]: created object 25... 2026-02-24T19:18:30.100 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_14_[58935]: created object 49... 2026-02-24T19:18:30.100 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_14_[58935]: finishing. 2026-02-24T19:18:30.100 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_14_[58935]: shutting down. 2026-02-24T19:18:30.101 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:30.101 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:30.101 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:30.101 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:30.101 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_15_[58936]: starting. 2026-02-24T19:18:30.101 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_15_[58936]: listing objects. 2026-02-24T19:18:30.101 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_15_[58936]: listed object 0... 2026-02-24T19:18:30.101 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_15_[58936]: listed object 25... 2026-02-24T19:18:32.327 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: Running main() from gmock_main.cc 2026-02-24T19:18:32.327 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2026-02-24T19:18:32.327 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: [----------] Global test environment set-up. 2026-02-24T19:18:32.327 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2026-02-24T19:18:32.327 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2026-02-24T19:18:32.327 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: watch_notify_test_cb 2026-02-24T19:18:32.327 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify (2107 ms) 2026-02-24T19:18:32.328 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch2Delete 2026-02-24T19:18:32.328 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2026-02-24T19:18:32.328 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: watch_notify2_test_errcb cookie 93914657894400 err -107 2026-02-24T19:18:32.328 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch2Delete (1667 ms) 2026-02-24T19:18:32.328 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete 2026-02-24T19:18:32.328 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2026-02-24T19:18:32.328 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: watch_notify2_test_errcb cookie 93914657901968 err -107 2026-02-24T19:18:32.328 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete (1164 ms) 2026-02-24T19:18:32.328 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2 2026-02-24T19:18:32.328 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: watch_notify2_test_cb from 4807 notify_id 163208757249 cookie 93914657916736 2026-02-24T19:18:32.328 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2 (94 ms) 2026-02-24T19:18:32.328 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchNotify2 2026-02-24T19:18:32.329 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: watch_notify2_test_cb from 4807 notify_id 163208757248 cookie 93914657950208 2026-02-24T19:18:32.329 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchNotify2 (134 ms) 2026-02-24T19:18:32.329 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioNotify 2026-02-24T19:18:32.329 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: watch_notify2_test_cb from 4807 notify_id 167503724544 cookie 93914657937264 2026-02-24T19:18:32.329 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioNotify (813 ms) 2026-02-24T19:18:32.329 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2026-02-24T19:18:32.329 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: watch_notify2_test_cb from 4807 notify_id 167503724544 cookie 93914657937264 2026-02-24T19:18:32.329 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: watch_notify2_test_cb from 4807 notify_id 167503724544 cookie 93914659717168 2026-02-24T19:18:32.329 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Multi (158 ms) 2026-02-24T19:18:32.329 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2026-02-24T19:18:32.329 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: watch_notify2_test_cb from 4807 notify_id 167503724545 cookie 93914657937264 2026-02-24T19:18:32.329 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: watch_notify2_test_cb from 4807 notify_id 171798691842 cookie 93914657937264 2026-02-24T19:18:32.329 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3073 ms) 2026-02-24T19:18:32.330 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch3Timeout 2026-02-24T19:18:32.330 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: waiting up to 1024 for osd to time us out ... 2026-02-24T19:18:32.330 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: watch_notify2_test_errcb cookie 93914657937264 err -107 2026-02-24T19:18:32.330 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: watch_notify2_test_cb from 4807 notify_id 201863462915 cookie 93914657937264 2026-02-24T19:18:32.330 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch3Timeout (5097 ms) 2026-02-24T19:18:32.330 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete2 2026-02-24T19:18:32.330 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: waiting up to 30 for disconnect notification ... 2026-02-24T19:18:32.330 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: watch_notify2_test_errcb cookie 93914659715040 err -107 2026-02-24T19:18:32.330 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete2 (1071 ms) 2026-02-24T19:18:32.330 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify (15381 ms total) 2026-02-24T19:18:32.330 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: 2026-02-24T19:18:32.330 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC 2026-02-24T19:18:32.330 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotifyEC.WatchNotify 2026-02-24T19:18:32.331 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: watch_notify_test_cb 2026-02-24T19:18:32.331 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: [ OK ] LibRadosWatchNotifyEC.WatchNotify (2575 ms) 2026-02-24T19:18:32.331 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC (2575 ms total) 2026-02-24T19:18:32.331 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: 2026-02-24T19:18:32.331 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: [----------] Global test environment tear-down 2026-02-24T19:18:32.331 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: [==========] 11 tests from 2 test suites ran. (33034 ms total) 2026-02-24T19:18:32.331 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify: [ PASSED ] 11 tests. 2026-02-24T19:18:32.398 INFO:tasks.workunit.client.0.trial195.stdout: list: Running main() from gmock_main.cc 2026-02-24T19:18:32.398 INFO:tasks.workunit.client.0.trial195.stdout: list: [==========] Running 3 tests from 1 test suite. 2026-02-24T19:18:32.398 INFO:tasks.workunit.client.0.trial195.stdout: list: [----------] Global test environment set-up. 2026-02-24T19:18:32.398 INFO:tasks.workunit.client.0.trial195.stdout: list: [----------] 3 tests from NeoradosList 2026-02-24T19:18:32.398 INFO:tasks.workunit.client.0.trial195.stdout: list: [ RUN ] NeoradosList.ListObjects 2026-02-24T19:18:32.399 INFO:tasks.workunit.client.0.trial195.stdout: list: [ OK ] NeoradosList.ListObjects (7321 ms) 2026-02-24T19:18:32.399 INFO:tasks.workunit.client.0.trial195.stdout: list: [ RUN ] NeoradosList.ListObjectsNS 2026-02-24T19:18:32.399 INFO:tasks.workunit.client.0.trial195.stdout: list: [ OK ] NeoradosList.ListObjectsNS (6308 ms) 2026-02-24T19:18:32.399 INFO:tasks.workunit.client.0.trial195.stdout: list: [ RUN ] NeoradosList.ListObjectsMany 2026-02-24T19:18:32.399 INFO:tasks.workunit.client.0.trial195.stdout: list: [ OK ] NeoradosList.ListObjectsMany (19425 ms) 2026-02-24T19:18:32.399 INFO:tasks.workunit.client.0.trial195.stdout: list: [----------] 3 tests from NeoradosList (33055 ms total) 2026-02-24T19:18:32.399 INFO:tasks.workunit.client.0.trial195.stdout: list: 2026-02-24T19:18:32.399 INFO:tasks.workunit.client.0.trial195.stdout: list: [----------] Global test environment tear-down 2026-02-24T19:18:32.399 INFO:tasks.workunit.client.0.trial195.stdout: list: [==========] 3 tests from 1 test suite ran. (33055 ms total) 2026-02-24T19:18:32.399 INFO:tasks.workunit.client.0.trial195.stdout: list: [ PASSED ] 3 tests. 2026-02-24T19:18:34.903 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_15_[58936]: listed object 50... 2026-02-24T19:18:34.903 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_15_[58936]: listed object 75... 2026-02-24T19:18:34.903 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_15_[58936]: listed object 100... 2026-02-24T19:18:34.903 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_15_[58936]: listed object 125... 2026-02-24T19:18:34.903 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_15_[58936]: saw 150 objects 2026-02-24T19:18:34.903 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_15_[58936]: shutting down. 2026-02-24T19:18:34.903 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:34.904 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:34.904 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:34.904 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:34.904 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_16_[58937]: starting. 2026-02-24T19:18:34.904 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_16_[58937]: added 25 objects... 2026-02-24T19:18:34.904 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_16_[58937]: added half of the objects 2026-02-24T19:18:34.904 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_16_[58937]: added 50 objects... 2026-02-24T19:18:34.904 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_16_[58937]: added 50 objects 2026-02-24T19:18:34.904 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: process_16_[58937]: shutting down. 2026-02-24T19:18:34.904 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:34.904 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:34.904 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:34.905 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:34.905 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******************************* 2026-02-24T19:18:34.905 INFO:tasks.workunit.client.0.trial195.stdout: list_parallel: ******* SUCCESS ********** 2026-02-24T19:18:35.713 INFO:tasks.workunit.client.0.trial195.stdout: api_service_pp: [==========] Running 4 tests from 1 test suite. 2026-02-24T19:18:35.714 INFO:tasks.workunit.client.0.trial195.stdout: api_service_pp: [----------] Global test environment set-up. 2026-02-24T19:18:35.714 INFO:tasks.workunit.client.0.trial195.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2026-02-24T19:18:35.714 INFO:tasks.workunit.client.0.trial195.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2026-02-24T19:18:35.714 INFO:tasks.workunit.client.0.trial195.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5253 ms) 2026-02-24T19:18:35.714 INFO:tasks.workunit.client.0.trial195.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2026-02-24T19:18:35.714 INFO:tasks.workunit.client.0.trial195.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (1021 ms) 2026-02-24T19:18:35.714 INFO:tasks.workunit.client.0.trial195.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2026-02-24T19:18:35.714 INFO:tasks.workunit.client.0.trial195.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (20609 ms) 2026-02-24T19:18:35.714 INFO:tasks.workunit.client.0.trial195.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2026-02-24T19:18:35.714 INFO:tasks.workunit.client.0.trial195.stdout: api_service_pp: attempt 0 of 20 2026-02-24T19:18:35.714 INFO:tasks.workunit.client.0.trial195.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (9509 ms) 2026-02-24T19:18:35.714 INFO:tasks.workunit.client.0.trial195.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (36394 ms total) 2026-02-24T19:18:35.715 INFO:tasks.workunit.client.0.trial195.stdout: api_service_pp: 2026-02-24T19:18:35.715 INFO:tasks.workunit.client.0.trial195.stdout: api_service_pp: [----------] Global test environment tear-down 2026-02-24T19:18:35.715 INFO:tasks.workunit.client.0.trial195.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (36395 ms total) 2026-02-24T19:18:35.715 INFO:tasks.workunit.client.0.trial195.stdout: api_service_pp: [ PASSED ] 4 tests. 2026-02-24T19:18:40.870 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:02:15.131 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:40.886 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:02:15.148 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:40.939 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:02:15.201 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:40.995 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:02:15.254 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:41.087 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:02:15.309 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:41.088 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:02:15.347 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:41.151 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:02:15.410 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:41.193 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:02:15.415 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:41.241 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:02:15.463 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:43.842 INFO:tasks.workunit.client.0.trial195.stdout:ch_notify_pp: trying... 2026-02-24T19:18:43.842 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: handle_notify cookie 94351924235072 notify_id 214748364802 notifier_gid 5140 2026-02-24T19:18:43.842 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: timed out 2026-02-24T19:18:43.842 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: flushing 2026-02-24T19:18:43.842 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: flushed 2026-02-24T19:18:43.842 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3048 ms) 2026-02-24T19:18:43.842 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2026-02-24T19:18:43.842 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: trying... 2026-02-24T19:18:43.843 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: handle_notify cookie 94351924235072 notify_id 223338299397 notifier_gid 5140 2026-02-24T19:18:43.843 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: timed out 2026-02-24T19:18:43.843 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: flushing 2026-02-24T19:18:43.843 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: flushed 2026-02-24T19:18:43.843 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3053 ms) 2026-02-24T19:18:43.843 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2026-02-24T19:18:43.843 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: List watches 2026-02-24T19:18:43.843 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: notify2 2026-02-24T19:18:43.843 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: handle_notify cookie 94351924235072 notify_id 231928233988 notifier_gid 5140 2026-02-24T19:18:43.843 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: notify2 done 2026-02-24T19:18:43.843 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: watch_check 2026-02-24T19:18:43.843 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: unwatch2 2026-02-24T19:18:43.843 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: flushing 2026-02-24T19:18:43.844 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: done 2026-02-24T19:18:43.844 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3146 ms) 2026-02-24T19:18:43.844 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2026-02-24T19:18:43.844 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: List watches 2026-02-24T19:18:43.844 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: notify2 2026-02-24T19:18:43.844 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: handle_notify cookie 94351924216096 notify_id 240518168581 notifier_gid 5140 2026-02-24T19:18:43.844 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: notify2 done 2026-02-24T19:18:43.844 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: watch_check 2026-02-24T19:18:43.844 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: unwatch2 2026-02-24T19:18:43.844 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: flushing 2026-02-24T19:18:43.844 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: done 2026-02-24T19:18:43.844 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3256 ms) 2026-02-24T19:18:43.844 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (19494 ms total) 2026-02-24T19:18:43.845 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: 2026-02-24T19:18:43.845 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [----------] Global test environment tear-down 2026-02-24T19:18:43.845 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [==========] 16 tests from 2 test suites ran. (44543 ms total) 2026-02-24T19:18:43.845 INFO:tasks.workunit.client.0.trial195.stdout: api_watch_notify_pp: [ PASSED ] 16 tests. 2026-02-24T19:18:50.921 INFO:tasks.workunit.client.0.trial195.stdout: ec_list: Running main() from gmock_main.cc 2026-02-24T19:18:50.921 INFO:tasks.workunit.client.0.trial195.stdout: ec_list: [==========] Running 3 tests from 1 test suite. 2026-02-24T19:18:50.921 INFO:tasks.workunit.client.0.trial195.stdout: ec_list: [----------] Global test environment set-up. 2026-02-24T19:18:50.921 INFO:tasks.workunit.client.0.trial195.stdout: ec_list: [----------] 3 tests from NeoradosECList 2026-02-24T19:18:50.921 INFO:tasks.workunit.client.0.trial195.stdout: ec_list: [ RUN ] NeoradosECList.ListObjects 2026-02-24T19:18:50.921 INFO:tasks.workunit.client.0.trial195.stdout: ec_list: [ OK ] NeoradosECList.ListObjects (11497 ms) 2026-02-24T19:18:50.921 INFO:tasks.workunit.client.0.trial195.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsNS 2026-02-24T19:18:50.921 INFO:tasks.workunit.client.0.trial195.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsNS (9409 ms) 2026-02-24T19:18:50.922 INFO:tasks.workunit.client.0.trial195.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsMany 2026-02-24T19:18:50.922 INFO:tasks.workunit.client.0.trial195.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsMany (30669 ms) 2026-02-24T19:18:50.922 INFO:tasks.workunit.client.0.trial195.stdout: ec_list: [----------] 3 tests from NeoradosECList (51576 ms total) 2026-02-24T19:18:50.922 INFO:tasks.workunit.client.0.trial195.stdout: ec_list: 2026-02-24T19:18:50.922 INFO:tasks.workunit.client.0.trial195.stdout: ec_list: [----------] Global test environment tear-down 2026-02-24T19:18:50.922 INFO:tasks.workunit.client.0.trial195.stdout: ec_list: [==========] 3 tests from 1 test suite ran. (51576 ms total) 2026-02-24T19:18:50.922 INFO:tasks.workunit.client.0.trial195.stdout: ec_list: [ PASSED ] 3 tests. 2026-02-24T19:18:59.750 INFO:tasks.workunit.client.0.trial195.stdout: api_c_write_operations: Running main() from gmock_main.cc 2026-02-24T19:18:59.751 INFO:tasks.workunit.client.0.trial195.stdout: api_c_write_operations: [==========] Running 8 tests from 2 test suites. 2026-02-24T19:18:59.751 INFO:tasks.workunit.client.0.trial195.stdout: api_c_write_operations: [----------] Global test environment set-up. 2026-02-24T19:18:59.751 INFO:tasks.workunit.client.0.trial195.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps 2026-02-24T19:18:59.751 INFO:tasks.workunit.client.0.trial195.stdout: api_c_write_operations: [ RUN ] LibradosCWriteOps.NewDelete 2026-02-24T19:18:59.751 INFO:tasks.workunit.client.0.trial195.stdout: api_c_write_operations: [ OK ] LibradosCWriteOps.NewDelete (0 ms) 2026-02-24T19:18:59.751 INFO:tasks.workunit.client.0.trial195.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps (0 ms total) 2026-02-24T19:18:59.751 INFO:tasks.workunit.client.0.trial195.stdout: api_c_write_operations: 2026-02-24T19:18:59.751 INFO:tasks.workunit.client.0.trial195.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps 2026-02-24T19:18:59.751 INFO:tasks.workunit.client.0.trial195.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.assertExists 2026-02-24T19:18:59.751 INFO:tasks.workunit.client.0.trial195.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.assertExists (6327 ms) 2026-02-24T19:18:59.751 INFO:tasks.workunit.client.0.trial195.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2026-02-24T19:18:59.752 INFO:tasks.workunit.client.0.trial195.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteOpAssertVersion (4177 ms) 2026-02-24T19:18:59.752 INFO:tasks.workunit.client.0.trial195.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Xattrs 2026-02-24T19:18:59.752 INFO:tasks.workunit.client.0.trial195.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Xattrs (4168 ms) 2026-02-24T19:18:59.752 INFO:tasks.workunit.client.0.trial195.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Write 2026-02-24T19:18:59.752 INFO:tasks.workunit.client.0.trial195.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Write (3055 ms) 2026-02-24T19:18:59.752 INFO:tasks.workunit.client.0.trial195.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Exec 2026-02-24T19:18:59.752 INFO:tasks.workunit.client.0.trial195.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Exec (3227 ms) 2026-02-24T19:18:59.752 INFO:tasks.workunit.client.0.trial195.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteSame 2026-02-24T19:18:59.752 INFO:tasks.workunit.client.0.trial195.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteSame (6888 ms) 2026-02-24T19:18:59.752 INFO:tasks.workunit.client.0.trial195.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.CmpExt 2026-02-24T19:18:59.752 INFO:tasks.workunit.client.0.trial195.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.CmpExt (32591 ms) 2026-02-24T19:18:59.752 INFO:tasks.workunit.client.0.trial195.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps (60436 ms total) 2026-02-24T19:18:59.752 INFO:tasks.workunit.client.0.trial195.stdout: api_c_write_operations: 2026-02-24T19:18:59.753 INFO:tasks.workunit.client.0.trial195.stdout: api_c_write_operations: [----------] Global test environment tear-down 2026-02-24T19:18:59.753 INFO:tasks.workunit.client.0.trial195.stdout: api_c_write_operations: [==========] 8 tests from 2 test suites ran. (60436 ms total) 2026-02-24T19:18:59.753 INFO:tasks.workunit.client.0.trial195.stdout: api_c_write_operations: [ PASSED ] 8 tests. 2026-02-24T19:18:59.803 INFO:tasks.workunit.client.0.trial195.stdout:OpPP (80 ms) 2026-02-24T19:18:59.803 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP 2026-02-24T19:18:59.803 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP (34 ms) 2026-02-24T19:18:59.803 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP2 2026-02-24T19:18:59.803 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP2 (65 ms) 2026-02-24T19:18:59.803 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2026-02-24T19:18:59.803 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoECPP.OverlappingWriteRoundTripPP (193 ms) 2026-02-24T19:18:59.803 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2026-02-24T19:18:59.803 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP (81 ms) 2026-02-24T19:18:59.803 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2026-02-24T19:18:59.804 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP2 (46 ms) 2026-02-24T19:18:59.804 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.AppendRoundTripPP 2026-02-24T19:18:59.804 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoECPP.AppendRoundTripPP (104 ms) 2026-02-24T19:18:59.804 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.TruncTestPP 2026-02-24T19:18:59.804 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoECPP.TruncTestPP (63 ms) 2026-02-24T19:18:59.804 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RemoveTestPP 2026-02-24T19:18:59.804 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RemoveTestPP (60 ms) 2026-02-24T19:18:59.804 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2026-02-24T19:18:59.804 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrsRoundTripPP (62 ms) 2026-02-24T19:18:59.804 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RmXattrPP 2026-02-24T19:18:59.804 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RmXattrPP (622 ms) 2026-02-24T19:18:59.804 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CrcZeroWrite 2026-02-24T19:18:59.805 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CrcZeroWrite (20658 ms) 2026-02-24T19:18:59.805 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrListPP 2026-02-24T19:18:59.805 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrListPP (1381 ms) 2026-02-24T19:18:59.805 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtPP 2026-02-24T19:18:59.805 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtPP (186 ms) 2026-02-24T19:18:59.805 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtDNEPP 2026-02-24T19:18:59.805 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtDNEPP (46 ms) 2026-02-24T19:18:59.805 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2026-02-24T19:18:59.805 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtMismatchPP (1106 ms) 2026-02-24T19:18:59.805 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [----------] 18 tests from LibRadosIoECPP (28116 ms total) 2026-02-24T19:18:59.805 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: 2026-02-24T19:18:59.805 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [----------] Global test environment tear-down 2026-02-24T19:18:59.806 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [==========] 40 tests from 2 test suites ran. (60540 ms total) 2026-02-24T19:18:59.806 INFO:tasks.workunit.client.0.trial195.stdout: api_io_pp: [ PASSED ] 40 tests. 2026-02-24T19:19:00.997 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:02:35.258 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:01.013 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:02:35.275 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:01.066 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:02:35.327 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:01.187 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:02:35.446 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:01.189 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:02:35.449 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:01.224 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:02:35.446 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:01.227 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:02:35.449 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:01.338 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:02:35.597 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:01.363 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:02:35.585 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:04.521 INFO:tasks.workunit.client.0.trial195.stdout: write_operations: Running main() from gmock_main.cc 2026-02-24T19:19:04.521 INFO:tasks.workunit.client.0.trial195.stdout: write_operations: [==========] Running 8 tests from 1 test suite. 2026-02-24T19:19:04.521 INFO:tasks.workunit.client.0.trial195.stdout: write_operations: [----------] Global test environment set-up. 2026-02-24T19:19:04.521 INFO:tasks.workunit.client.0.trial195.stdout: write_operations: [----------] 8 tests from NeoRadosWriteOps 2026-02-24T19:19:04.522 INFO:tasks.workunit.client.0.trial195.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertExists 2026-02-24T19:19:04.522 INFO:tasks.workunit.client.0.trial195.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertExists (6138 ms) 2026-02-24T19:19:04.522 INFO:tasks.workunit.client.0.trial195.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertVersion 2026-02-24T19:19:04.522 INFO:tasks.workunit.client.0.trial195.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertVersion (3284 ms) 2026-02-24T19:19:04.522 INFO:tasks.workunit.client.0.trial195.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Xattrs 2026-02-24T19:19:04.522 INFO:tasks.workunit.client.0.trial195.stdout: write_operations: [ OK ] NeoRadosWriteOps.Xattrs (3153 ms) 2026-02-24T19:19:04.522 INFO:tasks.workunit.client.0.trial195.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Write 2026-02-24T19:19:04.522 INFO:tasks.workunit.client.0.trial195.stdout: write_operations: [ OK ] NeoRadosWriteOps.Write (5126 ms) 2026-02-24T19:19:04.522 INFO:tasks.workunit.client.0.trial195.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Exec 2026-02-24T19:19:04.522 INFO:tasks.workunit.client.0.trial195.stdout: write_operations: [ OK ] NeoRadosWriteOps.Exec (3178 ms) 2026-02-24T19:19:04.522 INFO:tasks.workunit.client.0.trial195.stdout: write_operations: [ RUN ] NeoRadosWriteOps.WriteSame 2026-02-24T19:19:04.522 INFO:tasks.workunit.client.0.trial195.stdout: write_operations: [ OK ] NeoRadosWriteOps.WriteSame (6888 ms) 2026-02-24T19:19:04.523 INFO:tasks.workunit.client.0.trial195.stdout: write_operations: [ RUN ] NeoRadosWriteOps.CmpExt 2026-02-24T19:19:04.523 INFO:tasks.workunit.client.0.trial195.stdout: write_operations: [ OK ] NeoRadosWriteOps.CmpExt (31042 ms) 2026-02-24T19:19:04.523 INFO:tasks.workunit.client.0.trial195.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Cancel 2026-02-24T19:19:04.523 INFO:tasks.workunit.client.0.trial195.stdout: write_operations: [ OK ] NeoRadosWriteOps.Cancel (6350 ms) 2026-02-24T19:19:04.523 INFO:tasks.workunit.client.0.trial195.stdout: write_operations: [----------] 8 tests from NeoRadosWriteOps (65162 ms total) 2026-02-24T19:19:04.523 INFO:tasks.workunit.client.0.trial195.stdout: write_operations: 2026-02-24T19:19:04.523 INFO:tasks.workunit.client.0.trial195.stdout: write_operations: [----------] Global test environment tear-down 2026-02-24T19:19:04.523 INFO:tasks.workunit.client.0.trial195.stdout: write_operations: [==========] 8 tests from 1 test suite ran. (65162 ms total) 2026-02-24T19:19:04.523 INFO:tasks.workunit.client.0.trial195.stdout: write_operations: [ PASSED ] 8 tests. 2026-02-24T19:19:04.544 INFO:tasks.workunit.client.0.trial195.stdout: api_pool: Running main() from gmock_main.cc 2026-02-24T19:19:04.544 INFO:tasks.workunit.client.0.trial195.stdout: api_pool: [==========] Running 9 tests from 1 test suite. 2026-02-24T19:19:04.544 INFO:tasks.workunit.client.0.trial195.stdout: api_pool: [----------] Global test environment set-up. 2026-02-24T19:19:04.544 INFO:tasks.workunit.client.0.trial195.stdout: api_pool: [----------] 9 tests from LibRadosPools 2026-02-24T19:19:04.544 INFO:tasks.workunit.client.0.trial195.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2026-02-24T19:19:04.544 INFO:tasks.workunit.client.0.trial195.stdout: api_pool: [ OK ] LibRadosPools.PoolList (3231 ms) 2026-02-24T19:19:04.544 INFO:tasks.workunit.client.0.trial195.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2026-02-24T19:19:04.544 INFO:tasks.workunit.client.0.trial195.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (4219 ms) 2026-02-24T19:19:04.544 INFO:tasks.workunit.client.0.trial195.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2026-02-24T19:19:04.545 INFO:tasks.workunit.client.0.trial195.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (3079 ms) 2026-02-24T19:19:04.545 INFO:tasks.workunit.client.0.trial195.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookupOtherInstance 2026-02-24T19:19:04.545 INFO:tasks.workunit.client.0.trial195.stdout: api_pool: [ OK ] LibRadosPools.PoolLookupOtherInstance (3168 ms) 2026-02-24T19:19:04.545 INFO:tasks.workunit.client.0.trial195.stdout: api_pool: [ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2026-02-24T19:19:04.545 INFO:tasks.workunit.client.0.trial195.stdout: api_pool: [ OK ] LibRadosPools.PoolReverseLookupOtherInstance (3045 ms) 2026-02-24T19:19:04.545 INFO:tasks.workunit.client.0.trial195.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2026-02-24T19:19:04.545 INFO:tasks.workunit.client.0.trial195.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (5290 ms) 2026-02-24T19:19:04.545 INFO:tasks.workunit.client.0.trial195.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2026-02-24T19:19:04.545 INFO:tasks.workunit.client.0.trial195.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (10846 ms) 2026-02-24T19:19:04.545 INFO:tasks.workunit.client.0.trial195.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2026-02-24T19:19:04.545 INFO:tasks.workunit.client.0.trial195.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (14997 ms) 2026-02-24T19:19:04.545 INFO:tasks.workunit.client.0.trial195.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2026-02-24T19:19:04.545 INFO:tasks.workunit.client.0.trial195.stdout: api_pool: [ OK ] LibRadosPools.PoolGetBaseTier (17385 ms) 2026-02-24T19:19:04.546 INFO:tasks.workunit.client.0.trial195.stdout: api_pool: [----------] 9 tests from LibRadosPools (65264 ms total) 2026-02-24T19:19:04.546 INFO:tasks.workunit.client.0.trial195.stdout: api_pool: 2026-02-24T19:19:04.546 INFO:tasks.workunit.client.0.trial195.stdout: api_pool: [----------] Global test environment tear-down 2026-02-24T19:19:04.546 INFO:tasks.workunit.client.0.trial195.stdout: api_pool: [==========] 9 tests from 1 test suite ran. (65264 ms total) 2026-02-24T19:19:04.546 INFO:tasks.workunit.client.0.trial195.stdout: api_pool: [ PASSED ] 9 tests. 2026-02-24T19:19:12.796 INFO:tasks.workunit.client.0.trial195.stdout: misc: Running main() from gmock_main.cc 2026-02-24T19:19:12.796 INFO:tasks.workunit.client.0.trial195.stdout: misc: [==========] Running 12 tests from 1 test suite. 2026-02-24T19:19:12.796 INFO:tasks.workunit.client.0.trial195.stdout: misc: [----------] Global test environment set-up. 2026-02-24T19:19:12.796 INFO:tasks.workunit.client.0.trial195.stdout: misc: [----------] 12 tests from NeoRadosMisc 2026-02-24T19:19:12.796 INFO:tasks.workunit.client.0.trial195.stdout: misc: [ RUN ] NeoRadosMisc.Version 2026-02-24T19:19:12.796 INFO:tasks.workunit.client.0.trial195.stdout: misc: [ OK ] NeoRadosMisc.Version (3169 ms) 2026-02-24T19:19:12.796 INFO:tasks.workunit.client.0.trial195.stdout: misc: [ RUN ] NeoRadosMisc.WaitOSDMap 2026-02-24T19:19:12.796 INFO:tasks.workunit.client.0.trial195.stdout: misc: [ OK ] NeoRadosMisc.WaitOSDMap (3044 ms) 2026-02-24T19:19:12.797 INFO:tasks.workunit.client.0.trial195.stdout: misc: [ RUN ] NeoRadosMisc.LongName 2026-02-24T19:19:12.797 INFO:tasks.workunit.client.0.trial195.stdout: misc: [ OK ] NeoRadosMisc.LongName (4289 ms) 2026-02-24T19:19:12.797 INFO:tasks.workunit.client.0.trial195.stdout: misc: [ RUN ] NeoRadosMisc.LongLocator 2026-02-24T19:19:12.797 INFO:tasks.workunit.client.0.trial195.stdout: misc: [ OK ] NeoRadosMisc.LongLocator (4166 ms) 2026-02-24T19:19:12.797 INFO:tasks.workunit.client.0.trial195.stdout: misc: [ RUN ] NeoRadosMisc.LongNamespace 2026-02-24T19:19:12.797 INFO:tasks.workunit.client.0.trial195.stdout: misc: [ OK ] NeoRadosMisc.LongNamespace (3001 ms) 2026-02-24T19:19:12.797 INFO:tasks.workunit.client.0.trial195.stdout: misc: [ RUN ] NeoRadosMisc.LongAttrName 2026-02-24T19:19:12.797 INFO:tasks.workunit.client.0.trial195.stdout: misc: [ OK ] NeoRadosMisc.LongAttrName (3247 ms) 2026-02-24T19:19:12.797 INFO:tasks.workunit.client.0.trial195.stdout: misc: [ RUN ] NeoRadosMisc.Exec 2026-02-24T19:19:12.797 INFO:tasks.workunit.client.0.trial195.stdout: misc: [ OK ] NeoRadosMisc.Exec (6874 ms) 2026-02-24T19:19:12.797 INFO:tasks.workunit.client.0.trial195.stdout: misc: [ RUN ] NeoRadosMisc.Operate1 2026-02-24T19:19:12.797 INFO:tasks.workunit.client.0.trial195.stdout: misc: [ OK ] NeoRadosMisc.Operate1 (7759 ms) 2026-02-24T19:19:12.798 INFO:tasks.workunit.client.0.trial195.stdout: misc: [ RUN ] NeoRadosMisc.Operate2 2026-02-24T19:19:12.798 INFO:tasks.workunit.client.0.trial195.stdout: misc: [ OK ] NeoRadosMisc.Operate2 (10855 ms) 2026-02-24T19:19:12.798 INFO:tasks.workunit.client.0.trial195.stdout: misc: [ RUN ] NeoRadosMisc.BigObject 2026-02-24T19:19:12.798 INFO:tasks.workunit.client.0.trial195.stdout: misc: [ OK ] NeoRadosMisc.BigObject (8260 ms) 2026-02-24T19:19:12.798 INFO:tasks.workunit.client.0.trial195.stdout: misc: [ RUN ] NeoRadosMisc.BigAttr 2026-02-24T19:19:12.798 INFO:tasks.workunit.client.0.trial195.stdout: misc: [ OK ] NeoRadosMisc.BigAttr (9070 ms) 2026-02-24T19:19:12.798 INFO:tasks.workunit.client.0.trial195.stdout: misc: [ RUN ] NeoRadosMisc.WriteSame 2026-02-24T19:19:12.798 INFO:tasks.workunit.client.0.trial195.stdout: misc: [ OK ] NeoRadosMisc.WriteSame (9705 ms) 2026-02-24T19:19:12.798 INFO:tasks.workunit.client.0.trial195.stdout: misc: [----------] 12 tests from NeoRadosMisc (73446 ms total) 2026-02-24T19:19:12.798 INFO:tasks.workunit.client.0.trial195.stdout: misc: 2026-02-24T19:19:12.798 INFO:tasks.workunit.client.0.trial195.stdout: misc: [----------] Global test environment tear-down 2026-02-24T19:19:12.798 INFO:tasks.workunit.client.0.trial195.stdout: misc: [==========] 12 tests from 1 test suite ran. (73446 ms total) 2026-02-24T19:19:12.798 INFO:tasks.workunit.client.0.trial195.stdout: misc: [ PASSED ] 12 tests. 2026-02-24T19:19:19.309 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: [==========] Running 12 tests from 4 test suites. 2026-02-24T19:19:19.309 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: [----------] Global test environment set-up. 2026-02-24T19:19:19.309 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2026-02-24T19:19:19.309 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2026-02-24T19:19:19.309 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2026-02-24T19:19:19.309 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2026-02-24T19:19:19.309 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: 2026-02-24T19:19:19.309 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure 2026-02-24T19:19:19.310 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2026-02-24T19:19:19.310 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: unable to get monitor info from DNS SRV with service name: ceph-mon 2026-02-24T19:19:19.310 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: 2026-02-24T19:17:59.476+0000 7f2b27081880 -1 failed for service _ceph-mon._tcp 2026-02-24T19:19:19.310 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: 2026-02-24T19:17:59.476+0000 7f2b27081880 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2026-02-24T19:19:19.310 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (199 ms) 2026-02-24T19:19:19.310 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2026-02-24T19:19:19.310 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectTimeout (5003 ms) 2026-02-24T19:19:19.310 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure (5202 ms total) 2026-02-24T19:19:19.310 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: 2026-02-24T19:19:19.310 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2026-02-24T19:19:19.310 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2026-02-24T19:19:19.310 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: started 0x55b4aa666fb0 2026-02-24T19:19:19.310 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: started 0x55b4aa848750 2026-02-24T19:19:19.311 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: started 2 aios 2026-02-24T19:19:19.311 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: waiting 0x55b4aa666fb0 2026-02-24T19:19:19.311 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: waiting 0x55b4aa848750 2026-02-24T19:19:19.311 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: done. 2026-02-24T19:19:19.311 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (8496 ms) 2026-02-24T19:19:19.311 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (8496 ms total) 2026-02-24T19:19:19.311 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: 2026-02-24T19:19:19.311 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2026-02-24T19:19:19.311 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2026-02-24T19:19:19.311 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (0 ms) 2026-02-24T19:19:19.311 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2026-02-24T19:19:19.311 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: [ OK ] LibRadosMisc.Exec (551 ms) 2026-02-24T19:19:19.311 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: [ RUN ] LibRadosMisc.WriteSame 2026-02-24T19:19:19.312 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (234 ms) 2026-02-24T19:19:19.312 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: [ RUN ] LibRadosMisc.CmpExt 2026-02-24T19:19:19.312 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: [ OK ] LibRadosMisc.CmpExt (44 ms) 2026-02-24T19:19:19.312 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2026-02-24T19:19:19.312 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: [ OK ] LibRadosMisc.Applications (5489 ms) 2026-02-24T19:19:19.312 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2026-02-24T19:19:19.312 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2026-02-24T19:19:19.312 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2026-02-24T19:19:19.312 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2026-02-24T19:19:19.312 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2026-02-24T19:19:19.312 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (57202 ms) 2026-02-24T19:19:19.312 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: [----------] 8 tests from LibRadosMisc (63523 ms total) 2026-02-24T19:19:19.313 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: 2026-02-24T19:19:19.313 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: [----------] Global test environment tear-down 2026-02-24T19:19:19.313 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: [==========] 12 tests from 4 test suites ran. (80013 ms total) 2026-02-24T19:19:19.313 INFO:tasks.workunit.client.0.trial195.stdout: api_misc: [ PASSED ] 12 tests. 2026-02-24T19:19:24.511 INFO:tasks.workunit.client.0.trial195.stdout: io: Running main() from gmock_main.cc 2026-02-24T19:19:24.511 INFO:tasks.workunit.client.0.trial195.stdout: io: [==========] Running 14 tests from 1 test suite. 2026-02-24T19:19:24.511 INFO:tasks.workunit.client.0.trial195.stdout: io: [----------] Global test environment set-up. 2026-02-24T19:19:24.512 INFO:tasks.workunit.client.0.trial195.stdout: io: [----------] 14 tests from NeoRadosIo 2026-02-24T19:19:24.512 INFO:tasks.workunit.client.0.trial195.stdout: io: [ RUN ] NeoRadosIo.Limits 2026-02-24T19:19:24.512 INFO:tasks.workunit.client.0.trial195.stdout: io: [ OK ] NeoRadosIo.Limits (6156 ms) 2026-02-24T19:19:24.512 INFO:tasks.workunit.client.0.trial195.stdout: io: [ RUN ] NeoRadosIo.SimpleWrite 2026-02-24T19:19:24.512 INFO:tasks.workunit.client.0.trial195.stdout: io: [ OK ] NeoRadosIo.SimpleWrite (4320 ms) 2026-02-24T19:19:24.512 INFO:tasks.workunit.client.0.trial195.stdout: io: [ RUN ] NeoRadosIo.ReadOp 2026-02-24T19:19:24.512 INFO:tasks.workunit.client.0.trial195.stdout: io: [ OK ] NeoRadosIo.ReadOp (4189 ms) 2026-02-24T19:19:24.512 INFO:tasks.workunit.client.0.trial195.stdout: io: [ RUN ] NeoRadosIo.SparseRead 2026-02-24T19:19:24.512 INFO:tasks.workunit.client.0.trial195.stdout: io: [ OK ] NeoRadosIo.SparseRead (3016 ms) 2026-02-24T19:19:24.512 INFO:tasks.workunit.client.0.trial195.stdout: io: [ RUN ] NeoRadosIo.RoundTrip 2026-02-24T19:19:24.512 INFO:tasks.workunit.client.0.trial195.stdout: io: [ OK ] NeoRadosIo.RoundTrip (3246 ms) 2026-02-24T19:19:24.512 INFO:tasks.workunit.client.0.trial195.stdout: io: [ RUN ] NeoRadosIo.ReadIntoBuufferlist 2026-02-24T19:19:24.513 INFO:tasks.workunit.client.0.trial195.stdout: io: [ OK ] NeoRadosIo.ReadIntoBuufferlist (6887 ms) 2026-02-24T19:19:24.513 INFO:tasks.workunit.client.0.trial195.stdout: io: [ RUN ] NeoRadosIo.OverlappingWriteRoundTrip 2026-02-24T19:19:24.513 INFO:tasks.workunit.client.0.trial195.stdout: io: [ OK ] NeoRadosIo.OverlappingWriteRoundTrip (7884 ms) 2026-02-24T19:19:24.513 INFO:tasks.workunit.client.0.trial195.stdout: io: [ RUN ] NeoRadosIo.WriteFullRoundTrip 2026-02-24T19:19:24.513 INFO:tasks.workunit.client.0.trial195.stdout: io: [ OK ] NeoRadosIo.WriteFullRoundTrip (8825 ms) 2026-02-24T19:19:24.513 INFO:tasks.workunit.client.0.trial195.stdout: io: [ RUN ] NeoRadosIo.AppendRoundTrip 2026-02-24T19:19:24.513 INFO:tasks.workunit.client.0.trial195.stdout: io: [ OK ] NeoRadosIo.AppendRoundTrip (6756 ms) 2026-02-24T19:19:24.513 INFO:tasks.workunit.client.0.trial195.stdout: io: [ RUN ] NeoRadosIo.Trunc 2026-02-24T19:19:24.513 INFO:tasks.workunit.client.0.trial195.stdout: io: [ OK ] NeoRadosIo.Trunc (7548 ms) 2026-02-24T19:19:24.513 INFO:tasks.workunit.client.0.trial195.stdout: io: [ RUN ] NeoRadosIo.Remove 2026-02-24T19:19:24.513 INFO:tasks.workunit.client.0.trial195.stdout: io: [ OK ] NeoRadosIo.Remove (10328 ms) 2026-02-24T19:19:24.513 INFO:tasks.workunit.client.0.trial195.stdout: io: [ RUN ] NeoRadosIo.XattrsRoundTrip 2026-02-24T19:19:24.513 INFO:tasks.workunit.client.0.trial195.stdout: io: [ OK ] NeoRadosIo.XattrsRoundTrip (8306 ms) 2026-02-24T19:19:24.514 INFO:tasks.workunit.client.0.trial195.stdout: io: [ RUN ] NeoRadosIo.RmXattr 2026-02-24T19:19:24.514 INFO:tasks.workunit.client.0.trial195.stdout: io: [ OK ] NeoRadosIo.RmXattr (4589 ms) 2026-02-24T19:19:24.514 INFO:tasks.workunit.client.0.trial195.stdout: io: [ RUN ] NeoRadosIo.GetXattrs 2026-02-24T19:19:24.514 INFO:tasks.workunit.client.0.trial195.stdout: io: [ OK ] NeoRadosIo.GetXattrs (3114 ms) 2026-02-24T19:19:24.514 INFO:tasks.workunit.client.0.trial195.stdout: io: [----------] 14 tests from NeoRadosIo (85171 ms total) 2026-02-24T19:19:24.514 INFO:tasks.workunit.client.0.trial195.stdout: io: 2026-02-24T19:19:24.514 INFO:tasks.workunit.client.0.trial195.stdout: io: [----------] Global test environment tear-down 2026-02-24T19:19:24.514 INFO:tasks.workunit.client.0.trial195.stdout: io: [==========] 14 tests from 1 test suite ran. (85171 ms total) 2026-02-24T19:19:24.514 INFO:tasks.workunit.client.0.trial195.stdout: io: [ PASSED ] 14 tests. 2026-02-24T19:19:25.393 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:02:59.654 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:25.394 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:02:59.656 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:25.425 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:02:59.684 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:25.427 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:02:59.649 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:25.429 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:02:59.688 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:25.430 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:02:59.652 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:25.449 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:02:59.711 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:25.465 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:02:59.724 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:25.466 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:02:59.687 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:29.434 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: Running main() from gmock_main.cc 2026-02-24T19:19:29.434 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: [==========] Running 15 tests from 1 test suite. 2026-02-24T19:19:29.434 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: [----------] Global test environment set-up. 2026-02-24T19:19:29.434 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: [----------] 15 tests from NeoRadosReadOps 2026-02-24T19:19:29.434 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: [ RUN ] NeoRadosReadOps.SetOpFlags 2026-02-24T19:19:29.434 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: [ OK ] NeoRadosReadOps.SetOpFlags (6309 ms) 2026-02-24T19:19:29.435 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertExists 2026-02-24T19:19:29.435 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertExists (5280 ms) 2026-02-24T19:19:29.435 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertVersion 2026-02-24T19:19:29.435 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertVersion (3054 ms) 2026-02-24T19:19:29.435 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpXattr 2026-02-24T19:19:29.435 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpXattr (4103 ms) 2026-02-24T19:19:29.435 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: [ RUN ] NeoRadosReadOps.Read 2026-02-24T19:19:29.435 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: [ OK ] NeoRadosReadOps.Read (3229 ms) 2026-02-24T19:19:29.435 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: [ RUN ] NeoRadosReadOps.Checksum 2026-02-24T19:19:29.435 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: [ OK ] NeoRadosReadOps.Checksum (9359 ms) 2026-02-24T19:19:29.435 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: [ RUN ] NeoRadosReadOps.RWOrderedRead 2026-02-24T19:19:29.435 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: [ OK ] NeoRadosReadOps.RWOrderedRead (10066 ms) 2026-02-24T19:19:29.436 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: [ RUN ] NeoRadosReadOps.ShortRead 2026-02-24T19:19:29.436 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: [ OK ] NeoRadosReadOps.ShortRead (8120 ms) 2026-02-24T19:19:29.436 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: [ RUN ] NeoRadosReadOps.Exec 2026-02-24T19:19:29.436 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: [ OK ] NeoRadosReadOps.Exec (9292 ms) 2026-02-24T19:19:29.436 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: [ RUN ] NeoRadosReadOps.Stat 2026-02-24T19:19:29.436 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: [ OK ] NeoRadosReadOps.Stat (8633 ms) 2026-02-24T19:19:29.436 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: [ RUN ] NeoRadosReadOps.Omap 2026-02-24T19:19:29.436 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: [ OK ] NeoRadosReadOps.Omap (5997 ms) 2026-02-24T19:19:29.436 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: [ RUN ] NeoRadosReadOps.OmapNuls 2026-02-24T19:19:29.436 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: [ OK ] NeoRadosReadOps.OmapNuls (7583 ms) 2026-02-24T19:19:29.436 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: [ RUN ] NeoRadosReadOps.GetXattrs 2026-02-24T19:19:29.436 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: [ OK ] NeoRadosReadOps.GetXattrs (3114 ms) 2026-02-24T19:19:29.436 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpExt 2026-02-24T19:19:29.437 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpExt (2868 ms) 2026-02-24T19:19:29.437 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: [ RUN ] NeoRadosReadOps.Cancel 2026-02-24T19:19:29.437 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: [ OK ] NeoRadosReadOps.Cancel (3065 ms) 2026-02-24T19:19:29.437 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: [----------] 15 tests from NeoRadosReadOps (90080 ms total) 2026-02-24T19:19:29.437 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: 2026-02-24T19:19:29.437 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: [----------] Global test environment tear-down 2026-02-24T19:19:29.437 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: [==========] 15 tests from 1 test suite ran. (90080 ms total) 2026-02-24T19:19:29.437 INFO:tasks.workunit.client.0.trial195.stdout: read_operations: [ PASSED ] 15 tests. 2026-02-24T19:19:30.480 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: Running main() from gmock_main.cc 2026-02-24T19:19:30.480 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [==========] Running 13 tests from 4 test suites. 2026-02-24T19:19:30.480 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [----------] Global test environment set-up. 2026-02-24T19:19:30.480 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots 2026-02-24T19:19:30.481 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapList 2026-02-24T19:19:30.481 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapList (5187 ms) 2026-02-24T19:19:30.481 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapRemove 2026-02-24T19:19:30.481 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapRemove (2068 ms) 2026-02-24T19:19:30.481 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.Rollback 2026-02-24T19:19:30.481 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [ OK ] LibRadosSnapshots.Rollback (2093 ms) 2026-02-24T19:19:30.481 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapGetName 2026-02-24T19:19:30.481 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapGetName (2109 ms) 2026-02-24T19:19:30.481 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots (11459 ms total) 2026-02-24T19:19:30.481 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: 2026-02-24T19:19:30.481 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged 2026-02-24T19:19:30.481 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Snap 2026-02-24T19:19:30.482 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Snap (4557 ms) 2026-02-24T19:19:30.482 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2026-02-24T19:19:30.482 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Rollback (8609 ms) 2026-02-24T19:19:30.482 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2026-02-24T19:19:30.482 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (11632 ms) 2026-02-24T19:19:30.482 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged (24799 ms total) 2026-02-24T19:19:30.482 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: 2026-02-24T19:19:30.482 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC 2026-02-24T19:19:30.482 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapList 2026-02-24T19:19:30.482 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapList (5107 ms) 2026-02-24T19:19:30.482 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapRemove 2026-02-24T19:19:30.482 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapRemove (3687 ms) 2026-02-24T19:19:30.483 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.Rollback 2026-02-24T19:19:30.483 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.Rollback (3599 ms) 2026-02-24T19:19:30.483 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapGetName 2026-02-24T19:19:30.483 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapGetName (3526 ms) 2026-02-24T19:19:30.483 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC (15921 ms total) 2026-02-24T19:19:30.483 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: 2026-02-24T19:19:30.483 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2026-02-24T19:19:30.483 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2026-02-24T19:19:30.483 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Snap (4524 ms) 2026-02-24T19:19:30.483 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2026-02-24T19:19:30.483 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Rollback (3804 ms) 2026-02-24T19:19:30.483 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC (8328 ms total) 2026-02-24T19:19:30.484 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: 2026-02-24T19:19:30.484 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [----------] Global test environment tear-down 2026-02-24T19:19:30.484 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [==========] 13 tests from 4 test suites ran. (91195 ms total) 2026-02-24T19:19:30.484 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots: [ PASSED ] 13 tests. 2026-02-24T19:19:30.486 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:19:30.486 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49397 2026-02-24T19:19:30.486 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 49397 2026-02-24T19:19:30.486 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:19:30.486 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49214 2026-02-24T19:19:30.486 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 49214 2026-02-24T19:19:30.486 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:19:30.486 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49075 2026-02-24T19:19:30.486 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 49075 2026-02-24T19:19:30.486 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:19:30.487 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=48927 2026-02-24T19:19:30.487 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 48927 2026-02-24T19:19:30.487 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:19:30.487 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49137 2026-02-24T19:19:30.487 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 49137 2026-02-24T19:19:30.487 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:19:30.487 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49529 2026-02-24T19:19:30.487 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 49529 2026-02-24T19:19:30.487 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:19:30.487 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49555 2026-02-24T19:19:30.487 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 49555 2026-02-24T19:19:30.488 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:19:30.488 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=48947 2026-02-24T19:19:30.488 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 48947 2026-02-24T19:19:34.621 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: Running main() from gmock_main.cc 2026-02-24T19:19:34.621 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [==========] Running 21 tests from 5 test suites. 2026-02-24T19:19:34.621 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [----------] Global test environment set-up. 2026-02-24T19:19:34.621 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP 2026-02-24T19:19:34.622 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: seed 49164 2026-02-24T19:19:34.622 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapListPP 2026-02-24T19:19:34.622 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapListPP (5186 ms) 2026-02-24T19:19:34.622 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2026-02-24T19:19:34.622 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapRemovePP (2069 ms) 2026-02-24T19:19:34.622 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.RollbackPP 2026-02-24T19:19:34.622 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.RollbackPP (2095 ms) 2026-02-24T19:19:34.622 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2026-02-24T19:19:34.622 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapGetNamePP (2108 ms) 2026-02-24T19:19:34.622 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2026-02-24T19:19:34.622 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (4081 ms) 2026-02-24T19:19:34.622 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP (15542 ms total) 2026-02-24T19:19:34.623 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: 2026-02-24T19:19:34.623 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2026-02-24T19:19:34.623 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2026-02-24T19:19:34.623 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (7152 ms) 2026-02-24T19:19:34.623 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2026-02-24T19:19:34.623 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (7604 ms) 2026-02-24T19:19:34.623 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2026-02-24T19:19:34.623 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (12098 ms) 2026-02-24T19:19:34.623 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2026-02-24T19:19:34.623 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (6888 ms) 2026-02-24T19:19:34.623 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2026-02-24T19:19:34.623 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (4083 ms) 2026-02-24T19:19:34.624 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2026-02-24T19:19:34.624 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: /ceph/rpmbuild/BUILD/ceph-20.2.0-681-g36d388f2/src/test/librados/snapshots_cxx.cc:460: Skipped 2026-02-24T19:19:34.624 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: 2026-02-24T19:19:34.624 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: 2026-02-24T19:19:34.624 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2026-02-24T19:19:34.624 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2026-02-24T19:19:34.624 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: deleting snap 14 in pool LibRadosSnapshotsSelfManagedPP_trial195-49164-7 2026-02-24T19:19:34.624 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: waiting for snaps to purge 2026-02-24T19:19:34.624 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (20052 ms) 2026-02-24T19:19:34.624 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP (57879 ms total) 2026-02-24T19:19:34.624 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: 2026-02-24T19:19:34.624 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2026-02-24T19:19:34.625 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2026-02-24T19:19:34.625 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (2 ms) 2026-02-24T19:19:34.625 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2026-02-24T19:19:34.625 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (5292 ms) 2026-02-24T19:19:34.625 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (5295 ms total) 2026-02-24T19:19:34.625 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: 2026-02-24T19:19:34.625 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP 2026-02-24T19:19:34.625 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapListPP 2026-02-24T19:19:34.625 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapListPP (3112 ms) 2026-02-24T19:19:34.625 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2026-02-24T19:19:34.625 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapRemovePP (2103 ms) 2026-02-24T19:19:34.625 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.RollbackPP 2026-02-24T19:19:45.371 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:03:19.632 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:45.398 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:03:19.657 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:45.399 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:03:19.620 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:45.400 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:03:19.661 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:45.401 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:03:19.660 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:45.401 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:03:19.623 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:45.437 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:03:19.659 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:45.438 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:03:19.700 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:45.439 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:03:19.699 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:52.649 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ snapshots: Running main() from gmock_main.cc 2026-02-24T19:19:52.649 INFO:tasks.workunit.client.0.trial195.stdout: snapshots: [==========] Running 11 tests from 2 test suites. 2026-02-24T19:19:52.649 INFO:tasks.workunit.client.0.trial195.stdout: snapshots: [----------] Global test environment set-up. 2026-02-24T19:19:52.649 INFO:tasks.workunit.client.0.trial195.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots 2026-02-24T19:19:52.649 INFO:tasks.workunit.client.0.trial195.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapList 2026-02-24T19:19:52.650 INFO:tasks.workunit.client.0.trial195.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapList (8354 ms) 2026-02-24T19:19:52.650 INFO:tasks.workunit.client.0.trial195.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapRemove 2026-02-24T19:19:52.650 INFO:tasks.workunit.client.0.trial195.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapRemove (5268 ms) 2026-02-24T19:19:52.650 INFO:tasks.workunit.client.0.trial195.stdout: snapshots: [ RUN ] NeoRadosSnapshots.Rollback 2026-02-24T19:19:52.650 INFO:tasks.workunit.client.0.trial195.stdout: snapshots: [ OK ] NeoRadosSnapshots.Rollback (4107 ms) 2026-02-24T19:19:52.650 INFO:tasks.workunit.client.0.trial195.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapGetName 2026-02-24T19:19:52.650 INFO:tasks.workunit.client.0.trial195.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapGetName (6213 ms) 2026-02-24T19:19:52.650 INFO:tasks.workunit.client.0.trial195.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapCreateRemove 2026-02-24T19:19:52.650 INFO:tasks.workunit.client.0.trial195.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapCreateRemove (19025 ms) 2026-02-24T19:19:52.650 INFO:tasks.workunit.client.0.trial195.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots (42969 ms total) 2026-02-24T19:19:52.650 INFO:tasks.workunit.client.0.trial195.stdout: snapshots: 2026-02-24T19:19:52.650 INFO:tasks.workunit.client.0.trial195.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps 2026-02-24T19:19:52.651 INFO:tasks.workunit.client.0.trial195.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Snap 2026-02-24T19:19:52.651 INFO:tasks.workunit.client.0.trial195.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Snap (10255 ms) 2026-02-24T19:19:52.651 INFO:tasks.workunit.client.0.trial195.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Rollback 2026-02-24T19:19:52.651 INFO:tasks.workunit.client.0.trial195.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Rollback (18577 ms) 2026-02-24T19:19:52.651 INFO:tasks.workunit.client.0.trial195.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.SnapOverlap 2026-02-24T19:19:52.651 INFO:tasks.workunit.client.0.trial195.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.SnapOverlap (12347 ms) 2026-02-24T19:19:52.651 INFO:tasks.workunit.client.0.trial195.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Bug11677 2026-02-24T19:19:52.651 INFO:tasks.workunit.client.0.trial195.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Bug11677 (5910 ms) 2026-02-24T19:19:52.651 INFO:tasks.workunit.client.0.trial195.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.OrderSnap 2026-02-24T19:19:52.651 INFO:tasks.workunit.client.0.trial195.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.OrderSnap (4183 ms) 2026-02-24T19:19:52.651 INFO:tasks.workunit.client.0.trial195.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.ReusePurgedSnap 2026-02-24T19:19:52.651 INFO:tasks.workunit.client.0.trial195.stdout: snapshots: Deleting snap 3 in pool ReusePurgedSnaptrial195-49887-11. 2026-02-24T19:19:52.651 INFO:tasks.workunit.client.0.trial195.stdout: snapshots: Waiting for snaps to purge. 2026-02-24T19:19:52.652 INFO:tasks.workunit.client.0.trial195.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.ReusePurgedSnap (19051 ms) 2026-02-24T19:19:52.652 INFO:tasks.workunit.client.0.trial195.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps (70324 ms total) 2026-02-24T19:19:52.652 INFO:tasks.workunit.client.0.trial195.stdout: snapshots: 2026-02-24T19:19:52.652 INFO:tasks.workunit.client.0.trial195.stdout: snapshots: [----------] Global test environment tear-down 2026-02-24T19:19:52.652 INFO:tasks.workunit.client.0.trial195.stdout: snapshots: [==========] 11 tests from 2 test suites ran. (113294 ms total) 2026-02-24T19:19:52.652 INFO:tasks.workunit.client.0.trial195.stdout: snapshots: [ PASSED ] 11 tests. 2026-02-24T19:19:57.447 INFO:tasks.workunit.client.0.trial195.stdout: OK ] LibRadosSnapshotsECPP.RollbackPP (2033 ms) 2026-02-24T19:19:57.447 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2026-02-24T19:19:57.448 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapGetNamePP (1792 ms) 2026-02-24T19:19:57.448 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP (9041 ms total) 2026-02-24T19:19:57.448 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: 2026-02-24T19:19:57.448 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2026-02-24T19:19:57.448 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2026-02-24T19:19:57.448 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.SnapPP (3860 ms) 2026-02-24T19:19:57.448 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2026-02-24T19:19:57.448 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (4064 ms) 2026-02-24T19:19:57.448 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2026-02-24T19:19:57.448 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (4095 ms) 2026-02-24T19:19:57.448 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (12019 ms total) 2026-02-24T19:19:57.449 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: 2026-02-24T19:19:57.449 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [----------] Global test environment tear-down 2026-02-24T19:19:57.449 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [==========] 21 tests from 5 test suites ran. (118159 ms total) 2026-02-24T19:19:57.449 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ PASSED ] 20 tests. 2026-02-24T19:19:57.449 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ SKIPPED ] 1 test, listed below: 2026-02-24T19:19:57.449 INFO:tasks.workunit.client.0.trial195.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2026-02-24T19:20:01.542 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [==========] Running 31 tests from 7 test suites. 2026-02-24T19:20:01.542 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [----------] Global test environment set-up. 2026-02-24T19:20:01.542 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion 2026-02-24T19:20:01.543 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ RUN ] LibRadosMiscVersion.VersionPP 2026-02-24T19:20:01.543 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2026-02-24T19:20:01.543 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2026-02-24T19:20:01.543 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: 2026-02-24T19:20:01.543 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP 2026-02-24T19:20:01.543 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: seed 49076 2026-02-24T19:20:01.543 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WaitOSDMapPP 2026-02-24T19:20:01.543 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WaitOSDMapPP (3 ms) 2026-02-24T19:20:01.543 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNamePP 2026-02-24T19:20:01.543 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNamePP (3022 ms) 2026-02-24T19:20:01.543 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongLocatorPP 2026-02-24T19:20:01.543 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongLocatorPP (454 ms) 2026-02-24T19:20:01.544 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNSpacePP 2026-02-24T19:20:01.544 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNSpacePP (260 ms) 2026-02-24T19:20:01.544 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongAttrNamePP 2026-02-24T19:20:01.544 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongAttrNamePP (153 ms) 2026-02-24T19:20:01.544 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.ExecPP 2026-02-24T19:20:01.544 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.ExecPP (18 ms) 2026-02-24T19:20:01.544 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BadFlagsPP 2026-02-24T19:20:01.544 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BadFlagsPP (251 ms) 2026-02-24T19:20:01.544 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate1PP 2026-02-24T19:20:01.544 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate1PP (730 ms) 2026-02-24T19:20:01.544 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate2PP 2026-02-24T19:20:01.544 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate2PP (33 ms) 2026-02-24T19:20:01.544 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigObjectPP 2026-02-24T19:20:01.545 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigObjectPP (112 ms) 2026-02-24T19:20:01.545 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AioOperatePP 2026-02-24T19:20:01.545 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AioOperatePP (20 ms) 2026-02-24T19:20:01.545 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertExistsPP 2026-02-24T19:20:01.545 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertExistsPP (570 ms) 2026-02-24T19:20:01.545 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertVersionPP 2026-02-24T19:20:01.545 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertVersionPP (227 ms) 2026-02-24T19:20:01.545 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigAttrPP 2026-02-24T19:20:01.545 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: osd_max_attr_size = 0 2026-02-24T19:20:01.545 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: osd_max_attr_size == 0; skipping test 2026-02-24T19:20:01.545 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigAttrPP (38299 ms) 2026-02-24T19:20:01.545 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyPP 2026-02-24T19:20:01.546 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyPP (3141 ms) 2026-02-24T19:20:01.546 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyScrubPP 2026-02-24T19:20:01.546 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: waiting for initial deep scrubs... 2026-02-24T19:20:01.546 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: done waiting, doing copies 2026-02-24T19:20:01.546 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: waiting for final deep scrubs... 2026-02-24T19:20:01.546 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: done waiting 2026-02-24T19:20:01.546 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyScrubPP (66493 ms) 2026-02-24T19:20:01.546 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WriteSamePP 2026-02-24T19:20:01.546 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WriteSamePP (47 ms) 2026-02-24T19:20:01.546 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CmpExtPP 2026-02-24T19:20:01.546 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CmpExtPP (23 ms) 2026-02-24T19:20:01.546 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Applications 2026-02-24T19:20:01.547 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Applications (5150 ms) 2026-02-24T19:20:01.547 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatOSD 2026-02-24T19:20:01.547 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2026-02-24T19:20:01.547 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatClient 2026-02-24T19:20:01.547 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2026-02-24T19:20:01.547 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Conf 2026-02-24T19:20:01.547 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Conf (0 ms) 2026-02-24T19:20:03.571 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [----------] 22 tests api_aio: Running main() from gmock_main.cc 2026-02-24T19:20:03.571 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [==========] Running 45 tests from 2 test suites. 2026-02-24T19:20:03.572 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [----------] Global test environment set-up. 2026-02-24T19:20:03.572 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [----------] 29 tests from LibRadosAio 2026-02-24T19:20:03.572 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2026-02-24T19:20:03.572 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAio.TooBig (3214 ms) 2026-02-24T19:20:03.572 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2026-02-24T19:20:03.572 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAio.SimpleWrite (5267 ms) 2026-02-24T19:20:03.572 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAio.WaitForSafe 2026-02-24T19:20:03.572 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAio.WaitForSafe (3124 ms) 2026-02-24T19:20:03.572 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip 2026-02-24T19:20:03.572 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip (3167 ms) 2026-02-24T19:20:03.572 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip2 2026-02-24T19:20:03.573 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip2 (3007 ms) 2026-02-24T19:20:03.573 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip3 2026-02-24T19:20:03.573 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip3 (3231 ms) 2026-02-24T19:20:03.573 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripAppend 2026-02-24T19:20:03.573 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAio.RoundTripAppend (4895 ms) 2026-02-24T19:20:03.573 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAio.RemoveTest 2026-02-24T19:20:03.573 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAio.RemoveTest (8362 ms) 2026-02-24T19:20:03.573 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAio.XattrsRoundTrip 2026-02-24T19:20:03.573 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAio.XattrsRoundTrip (8934 ms) 2026-02-24T19:20:03.573 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAio.RmXattr 2026-02-24T19:20:03.573 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAio.RmXattr (8601 ms) 2026-02-24T19:20:03.573 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAio.XattrIter 2026-02-24T19:20:03.573 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAio.XattrIter (7047 ms) 2026-02-24T19:20:03.574 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAio.IsComplete 2026-02-24T19:20:03.574 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAio.IsComplete (8614 ms) 2026-02-24T19:20:03.574 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAio.IsSafe 2026-02-24T19:20:03.574 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAio.IsSafe (10080 ms) 2026-02-24T19:20:03.574 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAio.ReturnValue 2026-02-24T19:20:03.574 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAio.ReturnValue (4589 ms) 2026-02-24T19:20:03.574 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAio.Flush 2026-02-24T19:20:03.574 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAio.Flush (3107 ms) 2026-02-24T19:20:03.574 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAio.FlushAsync 2026-02-24T19:20:03.574 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAio.FlushAsync (2868 ms) 2026-02-24T19:20:03.574 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteFull 2026-02-24T19:20:03.574 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteFull (3106 ms) 2026-02-24T19:20:03.575 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteSame 2026-02-24T19:20:03.575 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteSame (3113 ms) 2026-02-24T19:20:03.575 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStat 2026-02-24T19:20:03.575 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAio.SimpleStat (2819 ms) 2026-02-24T19:20:03.575 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAio.OperateMtime 2026-02-24T19:20:03.575 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAio.OperateMtime (3118 ms) 2026-02-24T19:20:03.575 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAio.Operate2Mtime 2026-02-24T19:20:03.575 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAio.Operate2Mtime (3101 ms) 2026-02-24T19:20:03.575 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStatNS 2026-02-24T19:20:03.575 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAio.SimpleStatNS (2739 ms) 2026-02-24T19:20:03.575 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAio.StatRemove 2026-02-24T19:20:03.575 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAio.StatRemove (3144 ms) 2026-02-24T19:20:03.575 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAio.ExecuteClass 2026-02-24T19:20:03.575 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAio.ExecuteClass (3046 ms) 2026-02-24T19:20:03.576 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAio.MultiWrite 2026-02-24T19:20:03.576 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAio.MultiWrite (3111 ms) 2026-02-24T19:20:03.576 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAio.AioUnlock 2026-02-24T19:20:03.576 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAio.AioUnlock (2752 ms) 2026-02-24T19:20:03.576 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAio.CancelBeforeSubmit 2026-02-24T19:20:03.576 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAio.CancelBeforeSubmit (3047 ms) 2026-02-24T19:20:03.576 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAio.CancelBeforeComplete 2026-02-24T19:20:10.382 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:03:44.643 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:10.409 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:03:44.670 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:10.409 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:03:44.667 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:10.410 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:03:44.632 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:10.410 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:03:44.669 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:10.412 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:03:44.633 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:10.438 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:03:44.700 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:10.442 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:03:44.663 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:10.442 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:03:44.701 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:18.556 INFO:tasks.workunit.client.0.trial195.stdout: ap api_aio_pp: Running main() from gmock_main.cc 2026-02-24T19:20:18.556 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [==========] Running 63 tests from 5 test suites. 2026-02-24T19:20:18.556 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [----------] Global test environment set-up. 2026-02-24T19:20:18.556 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio 2026-02-24T19:20:18.556 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio.TooBigPP 2026-02-24T19:20:18.556 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAio.TooBigPP (3227 ms) 2026-02-24T19:20:18.557 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolQuotaPP 2026-02-24T19:20:18.557 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolQuotaPP (20676 ms) 2026-02-24T19:20:18.557 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleWritePP 2026-02-24T19:20:18.557 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleWritePP (20681 ms) 2026-02-24T19:20:18.557 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio.WaitForSafePP 2026-02-24T19:20:18.557 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAio.WaitForSafePP (7220 ms) 2026-02-24T19:20:18.557 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP 2026-02-24T19:20:18.557 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP (10634 ms) 2026-02-24T19:20:18.557 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP2 2026-02-24T19:20:18.557 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP2 (8451 ms) 2026-02-24T19:20:18.557 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP3 2026-02-24T19:20:18.558 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP3 (8195 ms) 2026-02-24T19:20:18.558 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripSparseReadPP 2026-02-24T19:20:18.558 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripSparseReadPP (3046 ms) 2026-02-24T19:20:18.558 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsCompletePP 2026-02-24T19:20:18.558 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAio.IsCompletePP (3119 ms) 2026-02-24T19:20:18.558 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsSafePP 2026-02-24T19:20:18.558 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAio.IsSafePP (2861 ms) 2026-02-24T19:20:18.558 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio.ReturnValuePP 2026-02-24T19:20:18.558 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAio.ReturnValuePP (3114 ms) 2026-02-24T19:20:18.558 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushPP 2026-02-24T19:20:18.558 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushPP (3107 ms) 2026-02-24T19:20:18.558 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushAsyncPP 2026-02-24T19:20:18.558 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushAsyncPP (2816 ms) 2026-02-24T19:20:18.559 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP 2026-02-24T19:20:18.559 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP (3114 ms) 2026-02-24T19:20:18.559 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP2 2026-02-24T19:20:18.559 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP2 (3107 ms) 2026-02-24T19:20:18.559 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP 2026-02-24T19:20:18.559 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP (2734 ms) 2026-02-24T19:20:18.559 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP2 2026-02-24T19:20:18.559 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP2 (3147 ms) 2026-02-24T19:20:18.559 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPPNS 2026-02-24T19:20:18.559 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPPNS (3049 ms) 2026-02-24T19:20:18.559 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPP 2026-02-24T19:20:18.559 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPP (3108 ms) 2026-02-24T19:20:18.559 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime 2026-02-24T19:20:18.560 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime (2754 ms) 2026-02-24T19:20:18.560 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime2 2026-02-24T19:20:18.560 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime2 (3042 ms) 2026-02-24T19:20:18.560 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio.StatRemovePP 2026-02-24T19:20:18.560 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAio.StatRemovePP (3103 ms) 2026-02-24T19:20:18.560 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio.ExecuteClassPP 2026-02-24T19:20:18.560 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAio.ExecuteClassPP (2945 ms) 2026-02-24T19:20:18.560 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio.OmapPP 2026-02-24T19:20:18.560 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAio.OmapPP (3149 ms) 2026-02-24T19:20:18.560 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiWritePP 2026-02-24T19:20:18.560 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiWritePP (3204 ms) 2026-02-24T19:20:18.560 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio.AioUnlockPP 2026-02-24T19:20:18.560 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAio.AioUnlockPP (2579 ms) 2026-02-24T19:20:18.561 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripAppendPP 2026-02-24T19:20:27.520 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosA from LibRadosMiscPP (119013 ms total) 2026-02-24T19:20:27.520 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: 2026-02-24T19:20:27.520 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP 2026-02-24T19:20:27.520 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2026-02-24T19:20:27.520 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ OK ] LibRadosTwoPoolsECPP.CopyFrom (926 ms) 2026-02-24T19:20:27.521 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP (926 ms total) 2026-02-24T19:20:27.521 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: 2026-02-24T19:20:27.521 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0,Checksummer::xxhash32,ceph_le > 2026-02-24T19:20:27.521 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Subset 2026-02-24T19:20:27.521 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Subset (172 ms) 2026-02-24T19:20:27.521 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Chunked 2026-02-24T19:20:27.521 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Chunked (18 ms) 2026-02-24T19:20:27.521 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0 (190 ms total) 2026-02-24T19:20:27.521 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: 2026-02-24T19:20:27.521 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1,Checksummer::xxhash64,ceph_le > 2026-02-24T19:20:27.521 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Subset 2026-02-24T19:20:27.522 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Subset (122 ms) 2026-02-24T19:20:27.522 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Chunked 2026-02-24T19:20:27.522 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Chunked (24 ms) 2026-02-24T19:20:27.522 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1 (146 ms total) 2026-02-24T19:20:27.522 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: 2026-02-24T19:20:27.522 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2,Checksummer::crc32c,ceph_le > 2026-02-24T19:20:27.522 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Subset 2026-02-24T19:20:27.522 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Subset (146 ms) 2026-02-24T19:20:27.522 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Chunked 2026-02-24T19:20:27.522 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Chunked (37 ms) 2026-02-24T19:20:27.522 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2 (183 ms total) 2026-02-24T19:20:27.522 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: 2026-02-24T19:20:27.522 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP 2026-02-24T19:20:27.523 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ RUN ] LibRadosMiscECPP.CompareExtentRange 2026-02-24T19:20:27.523 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ OK ] LibRadosMiscECPP.CompareExtentRange (1205 ms) 2026-02-24T19:20:27.523 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP (1205 ms total) 2026-02-24T19:20:27.523 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: 2026-02-24T19:20:27.523 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [----------] Global test environment tear-down 2026-02-24T19:20:27.523 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [==========] 31 tests from 7 test suites ran. (148233 ms total) 2026-02-24T19:20:27.523 INFO:tasks.workunit.client.0.trial195.stdout: api_misc_pp: [ PASSED ] 31 tests. 2026-02-24T19:20:27.524 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:20:27.524 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49431 2026-02-24T19:20:27.525 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 49431 2026-02-24T19:20:27.525 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:20:27.525 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=48826 2026-02-24T19:20:27.525 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 48826 2026-02-24T19:20:27.525 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:20:27.525 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=48887 2026-02-24T19:20:27.525 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 48887 2026-02-24T19:20:27.525 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:20:27.525 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49347 2026-02-24T19:20:27.525 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 49347 2026-02-24T19:20:27.525 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:20:27.526 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=48816 2026-02-24T19:20:27.526 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 48816 2026-02-24T19:20:30.458 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:04:04.720 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:30.460 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:04:04.722 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:30.486 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:04:04.745 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:30.487 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:04:04.746 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:30.488 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:04:04.710 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:30.490 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:04:04.751 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:30.490 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:04:04.712 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:30.514 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:04:04.773 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:30.516 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:04:04.738 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:35.794 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : entry=10 expected=10 2026-02-24T19:20:35.795 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : seek to 13:f905c69b:::2:head 2026-02-24T19:20:35.795 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : cursor()=13:f905c69b:::2:head expected=13:f905c69b:::2:head 2026-02-24T19:20:35.795 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > 13:f905c69b:::2:head -> 2 2026-02-24T19:20:35.795 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : entry=2 expected=2 2026-02-24T19:20:35.795 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : seek to 13:e960b815:::9:head 2026-02-24T19:20:35.795 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : cursor()=13:e960b815:::9:head expected=13:e960b815:::9:head 2026-02-24T19:20:35.795 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > 13:e960b815:::9:head -> 9 2026-02-24T19:20:35.795 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : entry=9 expected=9 2026-02-24T19:20:35.795 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : seek to 13:de5d7c5f:::12:head 2026-02-24T19:20:35.796 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : cursor()=13:de5d7c5f:::12:head expected=13:de5d7c5f:::12:head 2026-02-24T19:20:35.796 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > 13:de5d7c5f:::12:head -> 12 2026-02-24T19:20:35.796 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : entry=12 expected=12 2026-02-24T19:20:35.796 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : seek to 13:d83876eb:::4:head 2026-02-24T19:20:35.796 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : cursor()=13:d83876eb:::4:head expected=13:d83876eb:::4:head 2026-02-24T19:20:35.796 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > 13:d83876eb:::4:head -> 4 2026-02-24T19:20:35.796 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : entry=4 expected=4 2026-02-24T19:20:35.796 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : seek to 13:cfc208b3:::3:head 2026-02-24T19:20:35.796 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : cursor()=13:cfc208b3:::3:head expected=13:cfc208b3:::3:head 2026-02-24T19:20:35.796 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > 13:cfc208b3:::3:head -> 3 2026-02-24T19:20:35.796 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : entry=3 expected=3 2026-02-24T19:20:35.796 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : seek to 13:c4fdafeb:::6:head 2026-02-24T19:20:35.796 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : cursor()=13:c4fdafeb:::6:head expected=13:c4fdafeb:::6:head 2026-02-24T19:20:35.797 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > 13:c4fdafeb:::6:head -> 6 2026-02-24T19:20:35.797 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : entry=6 expected=6 2026-02-24T19:20:35.797 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : seek to 13:bd63b0f1:::8:head 2026-02-24T19:20:35.797 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : cursor()=13:bd63b0f1:::8:head expected=13:bd63b0f1:::8:head 2026-02-24T19:20:35.797 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > 13:bd63b0f1:::8:head -> 8 2026-02-24T19:20:35.797 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : entry=8 expected=8 2026-02-24T19:20:35.797 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : seek to 13:02547ec2:::1:head 2026-02-24T19:20:35.797 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : cursor()=13:02547ec2:::1:head expected=13:02547ec2:::1:head 2026-02-24T19:20:35.797 INFO:tasks.workunit.client.0.trial195.stdout: api_list: > 13:02547ec2:::1:head -> 1 2026-02-24T19:20:35.797 INFO:tasks.workunit.client.0.trial195.stdout: api_list: : entry=1 expected=1 2026-02-24T19:20:35.797 INFO:tasks.workunit.client.0.trial195.stdout: api_list: [ OK ] LibRadosList.ListObjectsCursor (5234 ms) 2026-02-24T19:20:35.797 INFO:tasks.workunit.client.0.trial195.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjects 2026-02-24T19:20:35.798 INFO:tasks.workunit.client.0.trial195.stdout: api_list: [ OK ] LibRadosList.EnumerateObjects (96968 ms) 2026-02-24T19:20:35.798 INFO:tasks.workunit.client.0.trial195.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjectsSplit 2026-02-24T19:20:35.798 INFO:tasks.workunit.client.0.trial195.stdout: api_list: split 0/5 -> MIN 13:33333333::::head 2026-02-24T19:20:35.798 INFO:tasks.workunit.client.0.trial195.stdout: api_list: split 1/5 -> 13:33333333::::head 13:66666666::::head 2026-02-24T19:20:35.798 INFO:tasks.workunit.client.0.trial195.stdout: api_list: split 2/5 -> 13:66666666::::head 13:99999999::::head 2026-02-24T19:20:35.798 INFO:tasks.workunit.client.0.trial195.stdout: api_list: split 3/5 -> 13:99999999::::head 13:cccccccc::::head 2026-02-24T19:20:35.798 INFO:tasks.workunit.client.0.trial195.stdout: api_list: split 4/5 -> 13:cccccccc::::head MAX 2026-02-24T19:20:35.798 INFO:tasks.workunit.client.0.trial195.stdout: api_list: [ OK ] LibRadosList.EnumerateObjectsSplit (30275 ms) 2026-02-24T19:20:35.798 INFO:tasks.workunit.client.0.trial195.stdout: api_list: [----------] 7 tests from LibRadosList (148802 ms total) 2026-02-24T19:20:35.798 INFO:tasks.workunit.client.0.trial195.stdout: api_list: 2026-02-24T19:20:35.798 INFO:tasks.workunit.client.0.trial195.stdout: api_list: [----------] 3 tests from LibRadosListEC 2026-02-24T19:20:35.798 INFO:tasks.workunit.client.0.trial195.stdout: api_list: [ RUN ] LibRadosListEC.ListObjects 2026-02-24T19:20:35.798 INFO:tasks.workunit.client.0.trial195.stdout: api_list: [ OK ] LibRadosListEC.ListObjects (1271 ms) 2026-02-24T19:20:35.799 INFO:tasks.workunit.client.0.trial195.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsNS 2026-02-24T19:20:35.799 INFO:tasks.workunit.client.0.trial195.stdout: api_list: myset foo1,foo2,foo3 2026-02-24T19:20:35.799 INFO:tasks.workunit.client.0.trial195.stdout: api_list: foo1 2026-02-24T19:20:35.799 INFO:tasks.workunit.client.0.trial195.stdout: api_list: foo2 2026-02-24T19:20:35.799 INFO:tasks.workunit.client.0.trial195.stdout: api_list: foo3 2026-02-24T19:20:35.799 INFO:tasks.workunit.client.0.trial195.stdout: api_list: myset foo1,foo4,foo5 2026-02-24T19:20:35.799 INFO:tasks.workunit.client.0.trial195.stdout: api_list: foo4 2026-02-24T19:20:35.799 INFO:tasks.workunit.client.0.trial195.stdout: api_list: foo5 2026-02-24T19:20:35.799 INFO:tasks.workunit.client.0.trial195.stdout: api_list: foo1 2026-02-24T19:20:35.799 INFO:tasks.workunit.client.0.trial195.stdout: api_list: myset foo6,foo7 2026-02-24T19:20:35.799 INFO:tasks.workunit.client.0.trial195.stdout: api_list: foo7 2026-02-24T19:20:35.799 INFO:tasks.workunit.client.0.trial195.stdout: api_list: foo6 2026-02-24T19:20:35.800 INFO:tasks.workunit.client.0.trial195.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2026-02-24T19:20:35.800 INFO:tasks.workunit.client.0.trial195.stdout: api_list: ns1:foo4 2026-02-24T19:20:35.800 INFO:tasks.workunit.client.0.trial195.stdout: api_list: ns1:foo5 2026-02-24T19:20:35.800 INFO:tasks.workunit.client.0.trial195.stdout: api_list: ns2:foo7 2026-02-24T19:20:35.800 INFO:tasks.workunit.client.0.trial195.stdout: api_list: ns2:foo6 2026-02-24T19:20:35.800 INFO:tasks.workunit.client.0.trial195.stdout: api_list: ns1:foo1 2026-02-24T19:20:35.800 INFO:tasks.workunit.client.0.trial195.stdout: api_list: :foo1 2026-02-24T19:20:35.800 INFO:tasks.workunit.client.0.trial195.stdout: api_list: :foo2 2026-02-24T19:20:35.800 INFO:tasks.workunit.client.0.trial195.stdout: api_list: :foo3 2026-02-24T19:20:35.800 INFO:tasks.workunit.client.0.trial195.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsNS (613 ms) 2026-02-24T19:20:42.853 INFO:tasks.workunit.client.0.trial195.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsStart 2026-02-24T19:20:42.854 INFO:tasks.workunit.client.0.trial195.stdout: api_list: 1 0 2026-02-24T19:20:42.854 INFO:tasks.workunit.client.0.trial195.stdout: api_list: 10 0 2026-02-24T19:20:42.854 INFO:tasks.workunit.client.0.trial195.stdout: api_list: 13 0 2026-02-24T19:20:42.854 INFO:tasks.workunit.client.0.trial195.stdout: api_list: 7 0 2026-02-24T19:20:42.854 INFO:tasks.workunit.client.0.trial195.stdout: api_list: 14 0 2026-02-24T19:20:42.854 INFO:tasks.workunit.client.0.trial195.stdout: api_list: 0 0 2026-02-24T19:20:42.854 INFO:tasks.workunit.client.0.trial195.stdout: api_list: 15 0 2026-02-24T19:20:42.854 INFO:tasks.workunit.client.0.trial195.stdout: api_list: 11 0 2026-02-24T19:20:42.855 INFO:tasks.workunit.client.0.trial195.stdout: api_list: 5 0 2026-02-24T19:20:42.855 INFO:tasks.workunit.client.0.trial195.stdout: api_list: 8 0 2026-02-24T19:20:42.855 INFO:tasks.workunit.client.0.trial195.stdout: api_list: 6 0 2026-02-24T19:20:42.855 INFO:tasks.workunit.client.0.trial195.stdout: api_list: 3 0 2026-02-24T19:20:42.855 INFO:tasks.workunit.client.0.trial195.stdout: api_list: 4 0 2026-02-24T19:20:42.855 INFO:tasks.workunit.client.0.trial195.stdout: api_list: 12 0 2026-02-24T19:20:42.855 INFO:tasks.workunit.client.0.trial195.stdout: api_list: 9 0 2026-02-24T19:20:42.855 INFO:tasks.workunit.client.0.trial195.stdout: api_list: 2 0 2026-02-24T19:20:42.855 INFO:tasks.workunit.client.0.trial195.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2026-02-24T19:20:42.855 INFO:tasks.workunit.client.0.trial195.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsStart (697 ms) 2026-02-24T19:20:42.855 INFO:tasks.workunit.client.0.trial195.stdout: api_list: [----------] 3 tests from LibRadosListEC (2582 ms total) 2026-02-24T19:20:42.855 INFO:tasks.workunit.client.0.trial195.stdout: api_list: 2026-02-24T19:20:42.856 INFO:tasks.workunit.client.0.trial195.stdout: api_list: [----------] 1 test from LibRadosListNP 2026-02-24T19:20:42.856 INFO:tasks.workunit.client.0.trial195.stdout: api_list: [ RUN ] LibRadosListNP.ListObjectsError 2026-02-24T19:20:42.856 INFO:tasks.workunit.client.0.trial195.stdout: api_list: [ OK ] LibRadosListNP.ListObjectsError (3119 ms) 2026-02-24T19:20:42.856 INFO:tasks.workunit.client.0.trial195.stdout: api_list: [----------] 1 test from LibRadosListNP (3119 ms total) 2026-02-24T19:20:42.856 INFO:tasks.workunit.client.0.trial195.stdout: api_list: 2026-02-24T19:20:42.856 INFO:tasks.workunit.client.0.trial195.stdout: api_list: [----------] Global test environment tear-down 2026-02-24T19:20:42.856 INFO:tasks.workunit.client.0.trial195.stdout: api_list: [==========] 11 tests from 3 test suites ran. (163578 ms total) 2026-02-24T19:20:42.856 INFO:tasks.workunit.client.0.trial195.stdout: api_list: [ PASSED ] 11 tests. 2026-02-24T19:21:10.557 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:04:44.819 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:10.559 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:04:44.820 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:10.588 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:04:44.847 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:10.588 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:04:44.810 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:10.589 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:04:44.848 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:10.589 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:04:44.811 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:10.596 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:04:44.858 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:10.626 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:04:44.848 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:10.628 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:04:44.887 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:30.571 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:05:04.833 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:30.598 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:05:04.860 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:30.599 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:05:04.857 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:30.600 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:05:04.859 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:30.622 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:05:04.883 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:30.623 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:05:04.882 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:30.625 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:05:04.847 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:30.626 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:05:04.847 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:30.647 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:05:04.869 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:50.638 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:05:24.899 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:50.638 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:05:24.900 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:50.660 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:05:24.921 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:50.666 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:05:24.887 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:50.666 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:05:24.925 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:50.667 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:05:24.888 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:50.667 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:05:24.925 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:50.688 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:05:24.910 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:50.690 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:05:24.949 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:58.835 INFO:tasks.workunit.client.0.trial195.stdout:i_aio: [ OK ] LibRadosAio.CancelBeforeComplete (3099 ms) 2026-02-24T19:21:58.835 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAio.CancelAfterComplete 2026-02-24T19:21:58.835 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAio.CancelAfterComplete (2933 ms) 2026-02-24T19:21:58.835 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [----------] 29 tests from LibRadosAio (127251 ms total) 2026-02-24T19:21:58.835 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: 2026-02-24T19:21:58.835 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [----------] 16 tests from LibRadosAioEC 2026-02-24T19:21:58.835 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleWrite 2026-02-24T19:21:58.835 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleWrite (7457 ms) 2026-02-24T19:21:58.835 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAioEC.WaitForComplete 2026-02-24T19:21:58.836 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAioEC.WaitForComplete (6636 ms) 2026-02-24T19:21:58.836 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip 2026-02-24T19:21:58.836 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip (6913 ms) 2026-02-24T19:21:58.836 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip2 2026-02-24T19:21:58.836 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip2 (7396 ms) 2026-02-24T19:21:58.836 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripAppend 2026-02-24T19:21:58.836 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripAppend (6854 ms) 2026-02-24T19:21:58.836 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAioEC.IsComplete 2026-02-24T19:21:58.836 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAioEC.IsComplete (6880 ms) 2026-02-24T19:21:58.836 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAioEC.IsSafe 2026-02-24T19:21:58.836 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAioEC.IsSafe (6901 ms) 2026-02-24T19:21:58.836 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAioEC.ReturnValue 2026-02-24T19:21:58.837 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAioEC.ReturnValue (7418 ms) 2026-02-24T19:21:58.837 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAioEC.Flush 2026-02-24T19:21:58.837 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAioEC.Flush (6785 ms) 2026-02-24T19:21:58.837 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAioEC.FlushAsync 2026-02-24T19:21:58.837 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAioEC.FlushAsync (6909 ms) 2026-02-24T19:21:58.837 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripWriteFull 2026-02-24T19:21:58.837 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripWriteFull (7152 ms) 2026-02-24T19:21:58.837 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStat 2026-02-24T19:21:58.837 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStat (7000 ms) 2026-02-24T19:21:58.837 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStatNS 2026-02-24T19:21:58.837 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStatNS (6839 ms) 2026-02-24T19:21:58.837 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAioEC.StatRemove 2026-02-24T19:21:58.837 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAioEC.StatRemove (7126 ms) 2026-02-24T19:21:58.838 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAioEC.ExecuteClass 2026-02-24T19:21:58.838 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAioEC.ExecuteClass (7189 ms) 2026-02-24T19:21:58.838 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ RUN ] LibRadosAioEC.MultiWrite 2026-02-24T19:21:58.838 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ OK ] LibRadosAioEC.MultiWrite (6864 ms) 2026-02-24T19:21:58.838 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [----------] 16 tests from LibRadosAioEC (112327 ms total) 2026-02-24T19:21:58.838 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: 2026-02-24T19:21:58.838 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [----------] Global test environment tear-down 2026-02-24T19:21:58.838 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [==========] 45 tests from 2 test suites ran. (239578 ms total) 2026-02-24T19:21:58.838 INFO:tasks.workunit.client.0.trial195.stdout: api_aio: [ PASSED ] 45 tests. 2026-02-24T19:22:10.682 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:05:44.943 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:10.683 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:05:44.945 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:10.703 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:05:44.965 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:10.709 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:05:44.968 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:10.710 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:05:44.969 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:10.712 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:05:44.933 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:10.712 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:05:44.934 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:10.730 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:05:44.989 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:10.733 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:05:44.955 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:30.715 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:06:04.976 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:30.716 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:06:04.978 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:30.735 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:06:04.996 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:30.742 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:06:04.964 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:30.743 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:06:04.965 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:30.743 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:06:05.002 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:30.744 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:06:05.003 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:30.761 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:06:04.983 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:30.762 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:06:05.021 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:38.802 INFO:tasks.workunit.client.0.trial195.stdout:io.RoundTripAppendPP (3105 ms) 2026-02-24T19:22:38.802 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio.RacingRemovePP 2026-02-24T19:22:38.802 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAio.RacingRemovePP (3211 ms) 2026-02-24T19:22:38.802 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP 2026-02-24T19:22:38.803 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP (3040 ms) 2026-02-24T19:22:38.803 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP2 2026-02-24T19:22:38.803 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP2 (2703 ms) 2026-02-24T19:22:38.803 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolEIOFlag 2026-02-24T19:22:38.803 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: sending pool EIO time: 2026-02-24T19:20:34.651444+0000 2026-02-24T19:22:38.803 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: /ceph/rpmbuild/BUILD/ceph-20.2.0-681-g36d388f2/src/test/librados/aio_cxx.cc:2430: Skipped 2026-02-24T19:22:38.803 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: eio flag missed all ios that already completed 2026-02-24T19:22:38.803 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: 2026-02-24T19:22:38.803 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ SKIPPED ] LibRadosAio.PoolEIOFlag (7981 ms) 2026-02-24T19:22:38.803 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiReads 2026-02-24T19:22:38.803 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiReads (3160 ms) 2026-02-24T19:22:38.803 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio (159397 ms total) 2026-02-24T19:22:38.804 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: 2026-02-24T19:22:38.804 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP 2026-02-24T19:22:38.804 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.ReadIntoBufferlist 2026-02-24T19:22:38.804 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAioPP.ReadIntoBufferlist (3110 ms) 2026-02-24T19:22:38.804 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.XattrsRoundTripPP 2026-02-24T19:22:38.804 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAioPP.XattrsRoundTripPP (8947 ms) 2026-02-24T19:22:38.804 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RmXattrPP 2026-02-24T19:22:38.804 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RmXattrPP (14852 ms) 2026-02-24T19:22:38.804 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RemoveTestPP 2026-02-24T19:22:38.804 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RemoveTestPP (3098 ms) 2026-02-24T19:22:38.804 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP (30008 ms total) 2026-02-24T19:22:38.804 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: 2026-02-24T19:22:38.805 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP 2026-02-24T19:22:38.805 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosIoPP.XattrListPP 2026-02-24T19:22:38.805 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosIoPP.XattrListPP (3100 ms) 2026-02-24T19:22:38.805 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP (3100 ms total) 2026-02-24T19:22:38.805 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: 2026-02-24T19:22:38.805 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC 2026-02-24T19:22:38.805 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleWritePP 2026-02-24T19:22:38.805 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleWritePP (13842 ms) 2026-02-24T19:22:38.805 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.WaitForSafePP 2026-02-24T19:22:38.805 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAioEC.WaitForSafePP (7302 ms) 2026-02-24T19:22:38.805 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP 2026-02-24T19:22:38.805 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP (6761 ms) 2026-02-24T19:22:38.805 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP2 2026-02-24T19:22:38.805 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP2 (6989 ms) 2026-02-24T19:22:38.806 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP3 2026-02-24T19:22:38.806 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP3 (3098 ms) 2026-02-24T19:22:38.806 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2026-02-24T19:22:38.806 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripSparseReadPP (6950 ms) 2026-02-24T19:22:38.806 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripAppendPP 2026-02-24T19:22:38.806 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripAppendPP (7414 ms) 2026-02-24T19:22:38.806 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsCompletePP 2026-02-24T19:22:38.806 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsCompletePP (6788 ms) 2026-02-24T19:22:38.806 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsSafePP 2026-02-24T19:22:38.806 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsSafePP (6919 ms) 2026-02-24T19:22:38.806 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ReturnValuePP 2026-02-24T19:22:38.806 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ReturnValuePP (7321 ms) 2026-02-24T19:22:38.806 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushPP 2026-02-24T19:22:38.807 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushPP (6740 ms) 2026-02-24T19:22:38.807 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushAsyncPP 2026-02-24T19:22:38.807 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushAsyncPP (6908 ms) 2026-02-24T19:22:50.755 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:06:25.016 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:50.758 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:06:25.019 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:50.776 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:06:25.038 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:50.784 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:06:25.005 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:50.785 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:06:25.007 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:50.786 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:06:25.044 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:50.786 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:06:25.045 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:50.804 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:06:25.025 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:50.806 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:06:25.065 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:59.949 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:06:34.211 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:59.952 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:06:34.213 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:59.967 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:06:34.228 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:59.979 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:06:34.200 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:59.980 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:06:34.238 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:59.980 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:06:34.202 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:59.980 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:06:34.239 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:59.994 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:06:34.216 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:59.995 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:06:34.254 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:10.795 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:06:45.056 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:10.796 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:06:45.057 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:10.809 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:06:45.070 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:10.822 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:06:45.081 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:10.822 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:06:45.044 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:10.823 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:06:45.082 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:10.823 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:06:45.044 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:10.836 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:06:45.057 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:10.837 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:06:45.096 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:30.839 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:07:05.100 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:30.840 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:07:05.101 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:30.859 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:07:05.120 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:30.868 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:07:05.127 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:30.869 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:07:05.091 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:30.869 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:07:05.128 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:30.870 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:07:05.091 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:30.889 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:07:05.148 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:30.891 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:07:05.113 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:34.220 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2026-02-24T19:23:34.220 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP (6957 ms) 2026-02-24T19:23:34.220 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2026-02-24T19:23:34.220 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP2 (3067 ms) 2026-02-24T19:23:34.220 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPP 2026-02-24T19:23:34.220 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPP (6958 ms) 2026-02-24T19:23:34.221 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPPNS 2026-02-24T19:23:34.221 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPPNS (7243 ms) 2026-02-24T19:23:34.221 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.StatRemovePP 2026-02-24T19:23:34.221 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAioEC.StatRemovePP (6814 ms) 2026-02-24T19:23:34.221 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ExecuteClassPP 2026-02-24T19:23:34.221 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ExecuteClassPP (6989 ms) 2026-02-24T19:23:34.221 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.OmapPP 2026-02-24T19:23:34.221 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAioEC.OmapPP (7302 ms) 2026-02-24T19:23:34.221 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.MultiWritePP 2026-02-24T19:23:34.221 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAioEC.MultiWritePP (6883 ms) 2026-02-24T19:23:34.221 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC (139255 ms total) 2026-02-24T19:23:34.221 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: 2026-02-24T19:23:34.221 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [----------] 6 tests from LibRadosAio/Cancel 2026-02-24T19:23:34.222 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.BeforeSubmit/aio_cancel 2026-02-24T19:23:34.222 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.BeforeSubmit/aio_cancel (0 ms) 2026-02-24T19:23:34.222 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.BeforeSubmit/cancel 2026-02-24T19:23:34.222 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.BeforeSubmit/cancel (0 ms) 2026-02-24T19:23:34.222 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.BeforeComplete/aio_cancel 2026-02-24T19:23:34.222 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.BeforeComplete/aio_cancel (0 ms) 2026-02-24T19:23:34.222 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.BeforeComplete/cancel 2026-02-24T19:23:34.222 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.BeforeComplete/cancel (0 ms) 2026-02-24T19:23:34.222 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.AfterComplete/aio_cancel 2026-02-24T19:23:34.222 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.AfterComplete/aio_cancel (61 ms) 2026-02-24T19:23:34.222 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.AfterComplete/cancel 2026-02-24T19:23:34.222 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.AfterComplete/cancel (3 ms) 2026-02-24T19:23:34.223 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [----------] 6 tests from LibRadosAio/Cancel (65 ms total) 2026-02-24T19:23:34.223 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: 2026-02-24T19:23:34.223 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [----------] Global test environment tear-down 2026-02-24T19:23:34.223 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [==========] 63 tests from 5 test suites ran. (334961 ms total) 2026-02-24T19:23:34.223 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ PASSED ] 62 tests. 2026-02-24T19:23:34.223 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ SKIPPED ] 1 test, listed below: 2026-02-24T19:23:34.223 INFO:tasks.workunit.client.0.trial195.stdout: api_aio_pp: [ SKIPPED ] LibRadosAio.PoolEIOFlag 2026-02-24T19:23:34.224 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:23:34.225 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=48840 2026-02-24T19:23:34.225 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 48840 2026-02-24T19:23:34.225 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:23:34.225 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49629 2026-02-24T19:23:34.225 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 49629 2026-02-24T19:23:34.225 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:23:34.225 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49017 2026-02-24T19:23:34.225 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 49017 2026-02-24T19:23:34.225 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:23:34.225 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49702 2026-02-24T19:23:34.225 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 49702 2026-02-24T19:23:34.226 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:23:34.226 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49116 2026-02-24T19:23:34.226 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 49116 2026-02-24T19:23:34.226 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:23:34.226 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49500 2026-02-24T19:23:34.226 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 49500 2026-02-24T19:23:34.226 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:23:34.226 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49770 2026-02-24T19:23:34.226 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 49770 2026-02-24T19:23:45.295 INFO:tasks.workunit.client.0.trial195.stdout: watch_notify: Running main() from gmock_main.cc 2026-02-24T19:23:45.295 INFO:tasks.workunit.client.0.trial195.stdout: watch_notify: [==========] Running 6 tests from 2 test suites. 2026-02-24T19:23:45.295 INFO:tasks.workunit.client.0.trial195.stdout: watch_notify: [----------] Global test environment set-up. 2026-02-24T19:23:45.295 INFO:tasks.workunit.client.0.trial195.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify 2026-02-24T19:23:45.295 INFO:tasks.workunit.client.0.trial195.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotify 2026-02-24T19:23:45.296 INFO:tasks.workunit.client.0.trial195.stdout: watch_notify: handle_notify cookie 94563263952208 notify_id 150323855360 notifier_gid 4871 2026-02-24T19:23:45.296 INFO:tasks.workunit.client.0.trial195.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotify (6291 ms) 2026-02-24T19:23:45.296 INFO:tasks.workunit.client.0.trial195.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotifyTimeout 2026-02-24T19:23:45.296 INFO:tasks.workunit.client.0.trial195.stdout: watch_notify: Trying... 2026-02-24T19:23:45.296 INFO:tasks.workunit.client.0.trial195.stdout: watch_notify: handle_notify cookie 94563276767824 notify_id 171798691842 notifier_gid 5012 2026-02-24T19:23:45.296 INFO:tasks.workunit.client.0.trial195.stdout: watch_notify: Waiting for 3.000000000s 2026-02-24T19:23:45.296 INFO:tasks.workunit.client.0.trial195.stdout: watch_notify: Timed out. 2026-02-24T19:23:45.296 INFO:tasks.workunit.client.0.trial195.stdout: watch_notify: Flushing... 2026-02-24T19:23:45.296 INFO:tasks.workunit.client.0.trial195.stdout: watch_notify: Flushed... 2026-02-24T19:23:45.296 INFO:tasks.workunit.client.0.trial195.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotifyTimeout (8350 ms) 2026-02-24T19:23:45.296 INFO:tasks.workunit.client.0.trial195.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify (14642 ms total) 2026-02-24T19:23:45.296 INFO:tasks.workunit.client.0.trial195.stdout: watch_notify: 2026-02-24T19:23:45.297 INFO:tasks.workunit.client.0.trial195.stdout: watch_notify: [----------] 4 tests from NeoRadosWatchNotifyPoll 2026-02-24T19:23:45.297 INFO:tasks.workunit.client.0.trial195.stdout: watch_notify: [ RUN ] NeoRadosWatchNotifyPoll.WatchNotify 2026-02-24T19:23:45.297 INFO:tasks.workunit.client.0.trial195.stdout: watch_notify: Likely spurious timeout. 2026-02-24T19:23:45.297 INFO:tasks.workunit.client.0.trial195.stdout: watch_notify: [ OK ] NeoRadosWatchNotifyPoll.WatchNotify (321223 ms) 2026-02-24T19:23:45.297 INFO:tasks.workunit.client.0.trial195.stdout: watch_notify: [ RUN ] NeoRadosWatchNotifyPoll.WatchNotifyTimeout 2026-02-24T19:23:45.297 INFO:tasks.workunit.client.0.trial195.stdout: watch_notify: [ OK ] NeoRadosWatchNotifyPoll.WatchNotifyTimeout (3699 ms) 2026-02-24T19:23:45.297 INFO:tasks.workunit.client.0.trial195.stdout: watch_notify: [ RUN ] NeoRadosWatchNotifyPoll.WrongWatchType 2026-02-24T19:23:45.297 INFO:tasks.workunit.client.0.trial195.stdout: watch_notify: [ OK ] NeoRadosWatchNotifyPoll.WrongWatchType (3195 ms) 2026-02-24T19:23:45.297 INFO:tasks.workunit.client.0.trial195.stdout: watch_notify: [ RUN ] NeoRadosWatchNotifyPoll.WatchNotifyCancel 2026-02-24T19:23:45.297 INFO:tasks.workunit.client.0.trial195.stdout: watch_notify: [ OK ] NeoRadosWatchNotifyPoll.WatchNotifyCancel (3175 ms) 2026-02-24T19:23:45.297 INFO:tasks.workunit.client.0.trial195.stdout: watch_notify: [----------] 4 tests from NeoRadosWatchNotifyPoll (331293 ms total) 2026-02-24T19:23:45.298 INFO:tasks.workunit.client.0.trial195.stdout: watch_notify: 2026-02-24T19:23:45.298 INFO:tasks.workunit.client.0.trial195.stdout: watch_notify: [----------] Global test environment tear-down 2026-02-24T19:23:45.298 INFO:tasks.workunit.client.0.trial195.stdout: watch_notify: [==========] 6 tests from 2 test suites ran. (345936 ms total) 2026-02-24T19:23:45.298 INFO:tasks.workunit.client.0.trial195.stdout: watch_notify: [ PASSED ] 6 tests. 2026-02-24T19:23:45.300 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:23:45.301 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49049 2026-02-24T19:23:45.301 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 49049 2026-02-24T19:23:45.301 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:23:45.301 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49369 2026-02-24T19:23:45.301 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 49369 2026-02-24T19:23:45.301 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:23:45.301 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49609 2026-02-24T19:23:45.301 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 49609 2026-02-24T19:23:45.301 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:23:45.301 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49464 2026-02-24T19:23:45.302 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 49464 2026-02-24T19:23:45.302 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:23:45.302 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49657 2026-02-24T19:23:45.302 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 49657 2026-02-24T19:23:45.302 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:23:45.302 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49328 2026-02-24T19:23:45.302 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 49328 2026-02-24T19:23:45.302 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:23:45.302 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=48968 2026-02-24T19:23:45.302 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 48968 2026-02-24T19:23:45.302 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:23:45.302 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49731 2026-02-24T19:23:45.303 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 49731 2026-02-24T19:23:45.303 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:23:45.303 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49236 2026-02-24T19:23:45.303 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 49236 2026-02-24T19:23:45.303 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:23:45.303 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=48808 2026-02-24T19:23:45.303 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 48808 2026-02-24T19:23:45.303 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:23:45.303 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=48871 2026-02-24T19:23:45.303 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 48871 2026-02-24T19:23:45.303 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:23:45.303 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49163 2026-02-24T19:23:45.303 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 49163 2026-02-24T19:23:45.304 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:23:45.304 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=48906 2026-02-24T19:23:45.304 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 48906 2026-02-24T19:23:45.304 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:23:45.304 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49265 2026-02-24T19:23:45.304 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 49265 2026-02-24T19:23:45.304 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:23:45.304 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49289 2026-02-24T19:23:45.304 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 49289 2026-02-24T19:23:45.304 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:23:45.304 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49575 2026-02-24T19:23:45.304 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 49575 2026-02-24T19:23:45.304 INFO:tasks.workunit.client.0.trial195.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:23:45.304 INFO:tasks.workunit.client.0.trial195.stderr:+ pid=49821 2026-02-24T19:23:45.305 INFO:tasks.workunit.client.0.trial195.stderr:+ wait 49821 2026-02-24T19:23:45.305 INFO:tasks.workunit.client.0.trial195.stderr:+ exit 0 2026-02-24T19:23:45.305 INFO:tasks.workunit.client.0.trial195.stderr:+ cleanup 2026-02-24T19:23:45.305 INFO:tasks.workunit.client.0.trial195.stderr:+ pkill -P 48802 2026-02-24T19:23:45.306 INFO:tasks.workunit.client.0.trial195.stderr:+ true 2026-02-24T19:23:45.306 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-24T19:23:45.307 DEBUG:teuthology.orchestra.run.trial195:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-24T19:23:45.334 INFO:tasks.workunit:Stopping ['rados/test.sh'] on client.0... 2026-02-24T19:23:45.335 DEBUG:teuthology.orchestra.run.trial195:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-24T19:23:45.686 DEBUG:teuthology.parallel:result is None 2026-02-24T19:23:45.687 DEBUG:teuthology.orchestra.run.trial195:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-24T19:23:45.712 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-24T19:23:45.712 DEBUG:teuthology.orchestra.run.trial195:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-24T19:23:45.769 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-24T19:23:45.769 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-24T19:23:45.784 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-24T19:23:45.784 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T19:23:45.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.856+0000 7f51b6e9f640 10 monclient: get_monmap_and_config 2026-02-24T19:23:45.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.856+0000 7f51b6e9f640 10 monclient: build_initial_monmap 2026-02-24T19:23:45.858 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.856+0000 7f51b6e9f640 10 monclient: monmap: 2026-02-24T19:23:45.859 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:45.859 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:45.859 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:23:45.857640+0000 2026-02-24T19:23:45.859 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:23:45.857640+0000 2026-02-24T19:23:45.859 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:45.859 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:45.859 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:45.859 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:45.859 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:45.859 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:45.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.856+0000 7f51b6e9f640 1 Processor -- start 2026-02-24T19:23:45.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.856+0000 7f51b6e9f640 1 -- start start 2026-02-24T19:23:45.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.856+0000 7f51b6e9f640 10 monclient: init 2026-02-24T19:23:45.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.856+0000 7f51b6e9f640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:45.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.856+0000 7f51b6e9f640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:23:45.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.856+0000 7f51b6e9f640 10 monclient(hunting): picked mon.noname-a con 0x7f51b0058da0 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:45.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.857+0000 7f51b6e9f640 10 monclient(hunting): picked mon.noname-c con 0x7f51b00b0410 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:45.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.857+0000 7f51b6e9f640 10 monclient(hunting): picked mon.noname-b con 0x7f51b01626a0 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:45.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.857+0000 7f51b6e9f640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51b01655c0 con 0x7f51b0058da0 2026-02-24T19:23:45.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.857+0000 7f51b6e9f640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51b00b12b0 con 0x7f51b01626a0 2026-02-24T19:23:45.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.857+0000 7f51b6e9f640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51b00b1590 con 0x7f51b00b0410 2026-02-24T19:23:45.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.857+0000 7f51b6e9f640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:45.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.857+0000 7f51b6e9f640 10 monclient(hunting): authenticate will time out at 4000.539042s 2026-02-24T19:23:45.878 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.876+0000 7f51b4c14640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f51b0058da0 0x7f51b01647a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:48900/0 (socket says 10.20.193.14:48900) 2026-02-24T19:23:45.878 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.876+0000 7f51b4c14640 1 -- 10.20.193.14:0/3796372790 learned_addr learned my addr 10.20.193.14:0/3796372790 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:45.881 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.879+0000 7f51a77fe640 1 -- 10.20.193.14:0/3796372790 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 583329147 0 0) 0x7f51b00b12b0 con 0x7f51b01626a0 2026-02-24T19:23:45.881 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.879+0000 7f51a77fe640 10 monclient(hunting): _negotiate 2026-02-24T19:23:45.881 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.879+0000 7f51a77fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:45.881 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.879+0000 7f51a77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:45.882 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.879+0000 7f51a77fe640 10 monclient(hunting): my global_id is 29026 2026-02-24T19:23:45.882 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.879+0000 7f51a77fe640 1 -- 10.20.193.14:0/3796372790 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f519c003610 con 0x7f51b01626a0 2026-02-24T19:23:45.884 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.880+0000 7f51a77fe640 1 -- 10.20.193.14:0/3796372790 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1939496660 0 0) 0x7f51b01655c0 con 0x7f51b0058da0 2026-02-24T19:23:45.884 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.880+0000 7f51a77fe640 10 monclient(hunting): _negotiate 2026-02-24T19:23:45.884 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.880+0000 7f51a77fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:45.884 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.880+0000 7f51a77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:45.884 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.880+0000 7f51a77fe640 10 monclient(hunting): my global_id is 30705 2026-02-24T19:23:45.884 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.880+0000 7f51a77fe640 1 -- 10.20.193.14:0/3796372790 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51b00b12b0 con 0x7f51b0058da0 2026-02-24T19:23:45.884 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.880+0000 7f51a77fe640 1 -- 10.20.193.14:0/3796372790 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3789438673 0 0) 0x7f519c003610 con 0x7f51b01626a0 2026-02-24T19:23:45.884 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.880+0000 7f51a77fe640 1 -- 10.20.193.14:0/3796372790 >> v1:10.20.193.170:6789/0 conn(0x7f51b00b0410 legacy=0x7f51b0164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:23:45.884 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.880+0000 7f51a77fe640 1 -- 10.20.193.14:0/3796372790 >> v1:10.20.193.14:6789/0 conn(0x7f51b0058da0 legacy=0x7f51b01647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:45.884 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.880+0000 7f51a77fe640 10 monclient: _finish_hunting 0 2026-02-24T19:23:45.885 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.880+0000 7f51a77fe640 1 monclient: found mon.noname-b 2026-02-24T19:23:45.885 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.880+0000 7f51a77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:45.885 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.880+0000 7f51a77fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.44:6789/0 2026-02-24T19:23:45.885 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.880+0000 7f51a77fe640 1 -- 10.20.193.14:0/3796372790 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b00b1870 con 0x7f51b01626a0 2026-02-24T19:23:45.885 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.880+0000 7f51a77fe640 10 monclient: _finish_auth 0 2026-02-24T19:23:45.885 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.880+0000 7f51a77fe640 10 monclient: _check_auth_tickets 2026-02-24T19:23:45.885 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.880+0000 7f51a77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:45.885 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.880+0000 7f51a77fe640 1 -- 10.20.193.14:0/3796372790 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f51ac003170 con 0x7f51b01626a0 2026-02-24T19:23:45.885 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.880+0000 7f51a77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:45.885 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.880+0000 7f51a77fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:23:45.885 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.880+0000 7f51a77fe640 10 monclient: dump: 2026-02-24T19:23:45.885 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:45.885 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:45.886 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:45.886 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:45.886 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:45.886 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:45.886 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:45.886 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:45.886 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:45.886 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:45.886 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.880+0000 7f51b6e9f640 5 monclient: authenticate success, global_id 29026 2026-02-24T19:23:45.886 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.880+0000 7f51b6e9f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:45.892 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.881+0000 7f51a77fe640 1 -- 10.20.193.14:0/3796372790 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f51ac003380 con 0x7f51b01626a0 2026-02-24T19:23:45.892 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.881+0000 7f51a77fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:45.892 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.881+0000 7f51a77fe640 1 -- 10.20.193.14:0/3796372790 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f51ac0037c0 con 0x7f51b01626a0 2026-02-24T19:23:45.892 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.881+0000 7f51a77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:45.892 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.881+0000 7f51a77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:45.893 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.881+0000 7f51a77fe640 10 monclient: dump: 2026-02-24T19:23:45.893 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:45.893 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:45.893 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:45.893 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:45.893 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:45.893 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:45.893 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:45.893 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:45.893 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:45.893 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:45.893 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.881+0000 7f51b6e9f640 10 monclient: get_monmap_and_config success 2026-02-24T19:23:45.894 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.881+0000 7f51b6e9f640 4 set_mon_vals no callback set 2026-02-24T19:23:45.894 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.882+0000 7f51b6e9f640 10 monclient: shutdown 2026-02-24T19:23:45.894 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.882+0000 7f51b6e9f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:45.894 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.882+0000 7f51b6e9f640 1 -- 10.20.193.14:0/3796372790 >> v1:10.20.193.44:6789/0 conn(0x7f51b01626a0 legacy=0x7f51b01c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:45.894 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.882+0000 7f51b6e9f640 1 -- 10.20.193.14:0/3796372790 shutdown_connections 2026-02-24T19:23:45.894 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.882+0000 7f51b6e9f640 1 -- 10.20.193.14:0/3796372790 >> 10.20.193.14:0/3796372790 conn(0x7f51b00b65f0 msgr2=0x7f51b00b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:45.894 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.882+0000 7f51b6e9f640 1 -- 10.20.193.14:0/3796372790 shutdown_connections 2026-02-24T19:23:45.894 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.882+0000 7f51b6e9f640 1 -- 10.20.193.14:0/3796372790 wait complete. 2026-02-24T19:23:45.894 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.882+0000 7f51b6e9f640 10 monclient: build_initial_monmap 2026-02-24T19:23:45.894 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.882+0000 7f51b6e9f640 10 monclient: monmap: 2026-02-24T19:23:45.894 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:45.894 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:23:45.895 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:23:45.895 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:23:45.895 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:45.895 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:23:45.895 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:45.895 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:45.895 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:45.895 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:45.895 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.882+0000 7f51b6e9f640 1 librados: starting msgr at 2026-02-24T19:23:45.895 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.882+0000 7f51b6e9f640 1 librados: starting objecter 2026-02-24T19:23:45.895 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.882+0000 7f51b6e9f640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:23:45.895 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.882+0000 7f51b6e9f640 1 Processor -- start 2026-02-24T19:23:45.895 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.882+0000 7f51b6e9f640 1 -- start start 2026-02-24T19:23:45.896 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.882+0000 7f51b6e9f640 1 librados: setting wanted keys 2026-02-24T19:23:45.896 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.882+0000 7f51b6e9f640 1 librados: calling monclient init 2026-02-24T19:23:45.896 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.882+0000 7f51b6e9f640 10 monclient: init 2026-02-24T19:23:45.896 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.883+0000 7f51b6e9f640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:45.896 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.883+0000 7f51b6e9f640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:23:45.896 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.883+0000 7f51b6e9f640 10 monclient(hunting): picked mon.noname-c con 0x7f51b0058da0 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:45.896 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.883+0000 7f51b6e9f640 10 monclient(hunting): picked mon.noname-a con 0x7f51b00b0410 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:45.896 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.883+0000 7f51b6e9f640 10 monclient(hunting): picked mon.noname-b con 0x7f51b01626a0 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:45.896 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.883+0000 7f51b6e9f640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51b0162290 con 0x7f51b00b0410 2026-02-24T19:23:45.896 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.883+0000 7f51b6e9f640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51b013d8f0 con 0x7f51b01626a0 2026-02-24T19:23:45.896 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.883+0000 7f51b6e9f640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51b013dbd0 con 0x7f51b0058da0 2026-02-24T19:23:45.896 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.883+0000 7f51b6e9f640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:45.896 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.883+0000 7f51b6e9f640 10 monclient(hunting): authenticate will time out at 4000.565403s 2026-02-24T19:23:45.897 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.883+0000 7f51a7fff640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f51b00b0410 0x7f51b013bff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:48908/0 (socket says 10.20.193.14:48908) 2026-02-24T19:23:45.897 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.883+0000 7f51a7fff640 1 -- 10.20.193.14:0/4018306908 learned_addr learned my addr 10.20.193.14:0/4018306908 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:45.897 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.883+0000 7f51a57fa640 10 client.?.objecter ms_handle_connect 0x7f51b00b0410 2026-02-24T19:23:45.897 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.883+0000 7f51a57fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:45.897 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.883+0000 7f51a57fa640 10 client.?.objecter ms_handle_connect 0x7f51b01626a0 2026-02-24T19:23:45.897 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.883+0000 7f51a57fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:45.897 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.883+0000 7f51a57fa640 10 client.?.objecter ms_handle_connect 0x7f51b0058da0 2026-02-24T19:23:45.897 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.883+0000 7f51a57fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:45.897 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.884+0000 7f51a57fa640 1 -- 10.20.193.14:0/4018306908 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1199667175 0 0) 0x7f51b0162290 con 0x7f51b00b0410 2026-02-24T19:23:45.897 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.884+0000 7f51a57fa640 10 monclient(hunting): _negotiate 2026-02-24T19:23:45.897 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.884+0000 7f51a57fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:45.897 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.884+0000 7f51a57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:45.897 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.884+0000 7f51a57fa640 10 monclient(hunting): my global_id is 30708 2026-02-24T19:23:45.898 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.884+0000 7f51a57fa640 1 -- 10.20.193.14:0/4018306908 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5180003610 con 0x7f51b00b0410 2026-02-24T19:23:45.898 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.884+0000 7f51a57fa640 1 -- 10.20.193.14:0/4018306908 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3796067780 0 0) 0x7f51b013d8f0 con 0x7f51b01626a0 2026-02-24T19:23:45.898 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.884+0000 7f51a57fa640 10 monclient(hunting): _negotiate 2026-02-24T19:23:45.898 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.884+0000 7f51a57fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:45.898 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.884+0000 7f51a57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:45.898 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.884+0000 7f51a57fa640 10 monclient(hunting): my global_id is 29029 2026-02-24T19:23:45.898 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.884+0000 7f51a57fa640 1 -- 10.20.193.14:0/4018306908 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51b0162290 con 0x7f51b01626a0 2026-02-24T19:23:45.898 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.885+0000 7f51a57fa640 1 -- 10.20.193.14:0/4018306908 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3680511767 0 0) 0x7f51b013dbd0 con 0x7f51b0058da0 2026-02-24T19:23:45.898 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.885+0000 7f51a57fa640 10 monclient(hunting): _negotiate 2026-02-24T19:23:45.898 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.885+0000 7f51a57fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:45.898 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.885+0000 7f51a57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:45.898 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.885+0000 7f51a57fa640 10 monclient(hunting): my global_id is 28667 2026-02-24T19:23:45.899 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.885+0000 7f51a57fa640 1 -- 10.20.193.14:0/4018306908 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51b013d8f0 con 0x7f51b0058da0 2026-02-24T19:23:45.899 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.887+0000 7f51a57fa640 1 -- 10.20.193.14:0/4018306908 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4155922973 0 0) 0x7f51b0162290 con 0x7f51b01626a0 2026-02-24T19:23:45.899 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.887+0000 7f51a57fa640 1 -- 10.20.193.14:0/4018306908 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f51b013dbd0 con 0x7f51b01626a0 2026-02-24T19:23:45.899 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.887+0000 7f51a57fa640 1 -- 10.20.193.14:0/4018306908 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f51ac0036d0 con 0x7f51b01626a0 2026-02-24T19:23:45.899 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.887+0000 7f51a57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:45.899 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.887+0000 7f51a57fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:23:45.899 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.887+0000 7f51a57fa640 10 monclient(hunting): dump: 2026-02-24T19:23:45.899 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:45.899 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:45.899 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:45.899 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:45.899 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:45.899 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:45.900 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:45.900 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:45.900 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:45.900 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:45.900 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.887+0000 7f51a57fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:23:45.900 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.887+0000 7f51a57fa640 1 -- 10.20.193.14:0/4018306908 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 839189026 0 0) 0x7f5180003610 con 0x7f51b00b0410 2026-02-24T19:23:45.900 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.887+0000 7f51a57fa640 1 -- 10.20.193.14:0/4018306908 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f51b0162290 con 0x7f51b00b0410 2026-02-24T19:23:45.900 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.887+0000 7f51a57fa640 1 -- 10.20.193.14:0/4018306908 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5198003060 con 0x7f51b00b0410 2026-02-24T19:23:45.900 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.887+0000 7f51a57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:45.900 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.887+0000 7f51a57fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:45.900 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.887+0000 7f51a57fa640 10 monclient(hunting): dump: 2026-02-24T19:23:45.900 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:45.901 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:45.901 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:45.901 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:45.901 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:45.901 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:45.901 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:45.901 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:45.901 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:45.901 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:45.901 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.887+0000 7f51a57fa640 1 -- 10.20.193.14:0/4018306908 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 127178686 0 0) 0x7f51b013d8f0 con 0x7f51b0058da0 2026-02-24T19:23:45.901 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.887+0000 7f51a57fa640 1 -- 10.20.193.14:0/4018306908 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5180003610 con 0x7f51b0058da0 2026-02-24T19:23:45.901 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.887+0000 7f51a57fa640 1 -- 10.20.193.14:0/4018306908 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f51a00030b0 con 0x7f51b0058da0 2026-02-24T19:23:45.901 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.887+0000 7f51a57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:45.902 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.887+0000 7f51a57fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:45.902 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.887+0000 7f51a57fa640 10 monclient(hunting): dump: 2026-02-24T19:23:45.902 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:45.902 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:45.902 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:45.902 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:45.902 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:45.902 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:45.902 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:45.902 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:45.902 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:45.902 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:45.902 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.889+0000 7f51a57fa640 1 -- 10.20.193.14:0/4018306908 <== mon.1 v1:10.20.193.44:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1151649564 0 0) 0x7f51b013dbd0 con 0x7f51b01626a0 2026-02-24T19:23:45.903 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.889+0000 7f51a57fa640 1 -- 10.20.193.14:0/4018306908 >> v1:10.20.193.170:6789/0 conn(0x7f51b0058da0 legacy=0x7f51b0161b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:45.903 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.889+0000 7f51a57fa640 1 -- 10.20.193.14:0/4018306908 >> v1:10.20.193.14:6789/0 conn(0x7f51b00b0410 legacy=0x7f51b013bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:45.903 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.889+0000 7f51a57fa640 10 monclient: _finish_hunting 0 2026-02-24T19:23:45.903 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.889+0000 7f51a57fa640 1 monclient: found mon.b 2026-02-24T19:23:45.903 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.889+0000 7f51a57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:45.903 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.889+0000 7f51a57fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:23:45.903 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.889+0000 7f51a57fa640 1 -- 10.20.193.14:0/4018306908 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b013deb0 con 0x7f51b01626a0 2026-02-24T19:23:45.903 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.889+0000 7f51a57fa640 10 monclient: _finish_auth 0 2026-02-24T19:23:45.903 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.889+0000 7f51a57fa640 10 monclient: _check_auth_tickets 2026-02-24T19:23:45.903 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.889+0000 7f51a57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:45.903 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.889+0000 7f51b6e9f640 5 monclient: authenticate success, global_id 29029 2026-02-24T19:23:45.903 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.889+0000 7f51b6e9f640 10 monclient: _renew_subs 2026-02-24T19:23:45.903 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.889+0000 7f51b6e9f640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:23:45.904 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.889+0000 7f51b6e9f640 1 -- 10.20.193.14:0/4018306908 --> v1:10.20.193.44:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f51b013e190 con 0x7f51b01626a0 2026-02-24T19:23:45.904 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.889+0000 7f51b6e9f640 10 client.29029.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:45.904 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.889+0000 7f51b6e9f640 10 monclient: _renew_subs 2026-02-24T19:23:45.904 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.889+0000 7f51b6e9f640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:23:45.904 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.889+0000 7f51b6e9f640 1 -- 10.20.193.14:0/4018306908 --> v1:10.20.193.44:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f51b013bad0 con 0x7f51b01626a0 2026-02-24T19:23:45.904 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.889+0000 7f51b6e9f640 1 librados: init done 2026-02-24T19:23:45.904 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.889+0000 7f51b6e9f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:45.904 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.889+0000 7f51b6e9f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:45.904 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.889+0000 7f51b6e9f640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:23:45.904 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.889+0000 7f51b6e9f640 1 -- 10.20.193.14:0/4018306908 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51b00b3b10 con 0x7f51b01626a0 2026-02-24T19:23:45.905 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.896+0000 7f51a57fa640 1 -- 10.20.193.14:0/4018306908 <== mon.1 v1:10.20.193.44:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f51ac003330 con 0x7f51b01626a0 2026-02-24T19:23:45.906 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.896+0000 7f51a57fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:45.906 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.896+0000 7f51a57fa640 1 -- 10.20.193.14:0/4018306908 <== mon.1 v1:10.20.193.44:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f51ac003cc0 con 0x7f51b01626a0 2026-02-24T19:23:45.906 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.896+0000 7f51a57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:45.906 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.896+0000 7f51a57fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:45.906 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.896+0000 7f51a57fa640 10 monclient: dump: 2026-02-24T19:23:45.906 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:45.906 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:45.906 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:45.906 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:45.906 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:45.906 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:45.906 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:45.907 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:45.907 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:45.907 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:45.907 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.896+0000 7f51a6ffd640 4 set_mon_vals no callback set 2026-02-24T19:23:45.907 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.897+0000 7f51a57fa640 1 -- 10.20.193.14:0/4018306908 <== mon.1 v1:10.20.193.44:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f51ac003ea0 con 0x7f51b01626a0 2026-02-24T19:23:45.907 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.898+0000 7f51b4c14640 10 monclient: get_auth_request con 0x7f5180077e70 auth_method 0 2026-02-24T19:23:45.907 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.898+0000 7f51a57fa640 10 client.29029.objecter ms_handle_connect 0x7f5180077e70 2026-02-24T19:23:45.907 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.899+0000 7f51a57fa640 1 -- 10.20.193.14:0/4018306908 <== mon.1 v1:10.20.193.44:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7f51ac0921c0 con 0x7f51b01626a0 2026-02-24T19:23:45.907 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.899+0000 7f51a57fa640 10 client.29029.objecter ms_dispatch2 0x7f51b0000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:23:45.907 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.899+0000 7f51a57fa640 3 client.29029.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:23:45.907 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.899+0000 7f51a57fa640 3 client.29029.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:23:45.907 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.899+0000 7f51a57fa640 20 client.29029.objecter dump_active .. 0 homeless 2026-02-24T19:23:45.986 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.983+0000 7f51a57fa640 1 -- 10.20.193.14:0/4018306908 <== mon.1 v1:10.20.193.44:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f51ac003cc0 con 0x7f51b01626a0 2026-02-24T19:23:45.986 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.983+0000 7f51a57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:45.986 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:45.983+0000 7f51a57fa640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:23:46.091 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.089+0000 7f51b6e9f640 1 -- 10.20.193.14:0/4018306908 --> v1:10.20.193.14:6800/4014096310 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f51b00b3830 con 0x7f5180077e70 2026-02-24T19:23:46.093 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.090+0000 7f51a57fa640 1 -- 10.20.193.14:0/4018306908 <== mgr.4110 v1:10.20.193.14:6800/4014096310 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+125488 (unknown 2965378022 0 665972070) 0x7f51b00b3830 con 0x7f5180077e70 2026-02-24T19:23:46.094 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:23:46.096 INFO:teuthology.orchestra.run.trial014.stderr:dumped all 2026-02-24T19:23:46.098 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.091+0000 7f51b6e9f640 10 librados: watch_flush enter 2026-02-24T19:23:46.098 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.091+0000 7f51b6e9f640 10 librados: watch_flush exit 2026-02-24T19:23:46.098 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.091+0000 7f51b6e9f640 20 client.29029.objecter shutdown clearing up homeless session... 2026-02-24T19:23:46.098 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.091+0000 7f51b6e9f640 10 client.29029.objecter successfully canceled tick 2026-02-24T19:23:46.098 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.091+0000 7f51b6e9f640 1 -- 10.20.193.14:0/4018306908 >> v1:10.20.193.14:6800/4014096310 conn(0x7f5180077e70 legacy=0x7f5180098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:46.098 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.091+0000 7f51b6e9f640 10 monclient: shutdown 2026-02-24T19:23:46.098 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.091+0000 7f51b6e9f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:46.098 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.091+0000 7f51b6e9f640 1 -- 10.20.193.14:0/4018306908 >> v1:10.20.193.44:6789/0 conn(0x7f51b01626a0 legacy=0x7f51b0135b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:46.098 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.091+0000 7f51b6e9f640 1 -- 10.20.193.14:0/4018306908 shutdown_connections 2026-02-24T19:23:46.098 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.091+0000 7f51b6e9f640 1 -- 10.20.193.14:0/4018306908 >> 10.20.193.14:0/4018306908 conn(0x7f51b00b65f0 msgr2=0x7f51b013fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:46.098 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.091+0000 7f51b6e9f640 1 -- 10.20.193.14:0/4018306908 shutdown_connections 2026-02-24T19:23:46.099 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.091+0000 7f51b6e9f640 1 -- 10.20.193.14:0/4018306908 wait complete. 2026-02-24T19:23:46.099 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.092+0000 7f51b6e9f640 1 librados: shutdown 2026-02-24T19:23:46.102 INFO:teuthology.orchestra.run.trial014.stdout:{"pg_ready":true,"pg_map":{"version":553,"stamp":"2026-02-24T19:23:45.850679+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":56,"num_read_kb":47,"num_write":70,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":122,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":543760,"kb_used_data":112400,"kb_used_omap":24998,"kb_used_meta":406105,"kb_avail":1509405680,"statfs":{"total":1546188226560,"available":1545631416320,"internally_reserved":0,"allocated":115097600,"data_stored":72642430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25598683,"internal_metadata":415851813},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":137,"apply_latency_ms":137,"commit_latency_ns":137000000,"apply_latency_ns":137000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.765573"},"pg_stats":[{"pgid":"28.0","version":"0'0","reported_seq":645,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.282188+0000","last_change":"2026-02-24T19:18:04.433420+0000","last_active":"2026-02-24T19:23:44.282188+0000","last_peered":"2026-02-24T19:23:44.282188+0000","last_clean":"2026-02-24T19:23:44.282188+0000","last_became_active":"2026-02-24T19:18:04.430880+0000","last_became_peered":"2026-02-24T19:18:04.430880+0000","last_unstale":"2026-02-24T19:23:44.282188+0000","last_undegraded":"2026-02-24T19:23:44.282188+0000","last_fullsized":"2026-02-24T19:23:44.282188+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:12:09.744113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1","version":"36'11","reported_seq":670,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.237794+0000","last_change":"2026-02-24T19:18:04.578561+0000","last_active":"2026-02-24T19:23:44.237794+0000","last_peered":"2026-02-24T19:23:44.237794+0000","last_clean":"2026-02-24T19:23:44.237794+0000","last_became_active":"2026-02-24T19:18:04.576194+0000","last_became_peered":"2026-02-24T19:18:04.576194+0000","last_unstale":"2026-02-24T19:23:44.237794+0000","last_undegraded":"2026-02-24T19:23:44.237794+0000","last_fullsized":"2026-02-24T19:23:44.237794+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:49:29.287956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,4],"acting":[12,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":643,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.300938+0000","last_change":"2026-02-24T19:18:03.963505+0000","last_active":"2026-02-24T19:23:44.300938+0000","last_peered":"2026-02-24T19:23:44.300938+0000","last_clean":"2026-02-24T19:23:44.300938+0000","last_became_active":"2026-02-24T19:18:03.958691+0000","last_became_peered":"2026-02-24T19:18:03.958691+0000","last_unstale":"2026-02-24T19:23:44.300938+0000","last_undegraded":"2026-02-24T19:23:44.300938+0000","last_fullsized":"2026-02-24T19:23:44.300938+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:23:22.822755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":645,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.288851+0000","last_change":"2026-02-24T19:18:04.348647+0000","last_active":"2026-02-24T19:23:44.288851+0000","last_peered":"2026-02-24T19:23:44.288851+0000","last_clean":"2026-02-24T19:23:44.288851+0000","last_became_active":"2026-02-24T19:18:04.335655+0000","last_became_peered":"2026-02-24T19:18:04.335655+0000","last_unstale":"2026-02-24T19:23:44.288851+0000","last_undegraded":"2026-02-24T19:23:44.288851+0000","last_fullsized":"2026-02-24T19:23:44.288851+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:38:16.688089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,14],"acting":[5,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":647,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.295062+0000","last_change":"2026-02-24T19:18:05.017788+0000","last_active":"2026-02-24T19:23:44.295062+0000","last_peered":"2026-02-24T19:23:44.295062+0000","last_clean":"2026-02-24T19:23:44.295062+0000","last_became_active":"2026-02-24T19:18:05.015377+0000","last_became_peered":"2026-02-24T19:18:05.015377+0000","last_unstale":"2026-02-24T19:23:44.295062+0000","last_undegraded":"2026-02-24T19:23:44.295062+0000","last_fullsized":"2026-02-24T19:23:44.295062+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:40:20.318316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,10],"acting":[14,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":640,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.246499+0000","last_change":"2026-02-24T19:18:05.237620+0000","last_active":"2026-02-24T19:23:44.246499+0000","last_peered":"2026-02-24T19:23:44.246499+0000","last_clean":"2026-02-24T19:23:44.246499+0000","last_became_active":"2026-02-24T19:18:05.234574+0000","last_became_peered":"2026-02-24T19:18:05.234574+0000","last_unstale":"2026-02-24T19:23:44.246499+0000","last_undegraded":"2026-02-24T19:23:44.246499+0000","last_fullsized":"2026-02-24T19:23:44.246499+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:31:23.754288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":643,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.311726+0000","last_change":"2026-02-24T19:18:03.992879+0000","last_active":"2026-02-24T19:23:44.311726+0000","last_peered":"2026-02-24T19:23:44.311726+0000","last_clean":"2026-02-24T19:23:44.311726+0000","last_became_active":"2026-02-24T19:18:03.990285+0000","last_became_peered":"2026-02-24T19:18:03.990285+0000","last_unstale":"2026-02-24T19:23:44.311726+0000","last_undegraded":"2026-02-24T19:23:44.311726+0000","last_fullsized":"2026-02-24T19:23:44.311726+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:13:12.273444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":647,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.324063+0000","last_change":"2026-02-24T19:18:03.425674+0000","last_active":"2026-02-24T19:23:44.324063+0000","last_peered":"2026-02-24T19:23:44.324063+0000","last_clean":"2026-02-24T19:23:44.324063+0000","last_became_active":"2026-02-24T19:18:03.420675+0000","last_became_peered":"2026-02-24T19:18:03.420675+0000","last_unstale":"2026-02-24T19:23:44.324063+0000","last_undegraded":"2026-02-24T19:23:44.324063+0000","last_fullsized":"2026-02-24T19:23:44.324063+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:20:11.350436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,6],"acting":[15,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":643,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.306211+0000","last_change":"2026-02-24T19:18:03.255478+0000","last_active":"2026-02-24T19:23:44.306211+0000","last_peered":"2026-02-24T19:23:44.306211+0000","last_clean":"2026-02-24T19:23:44.306211+0000","last_became_active":"2026-02-24T19:18:03.252679+0000","last_became_peered":"2026-02-24T19:18:03.252679+0000","last_unstale":"2026-02-24T19:23:44.306211+0000","last_undegraded":"2026-02-24T19:23:44.306211+0000","last_fullsized":"2026-02-24T19:23:44.306211+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:16:26.096508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,13],"acting":[4,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":644,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.242565+0000","last_change":"2026-02-24T19:18:04.558252+0000","last_active":"2026-02-24T19:23:44.242565+0000","last_peered":"2026-02-24T19:23:44.242565+0000","last_clean":"2026-02-24T19:23:44.242565+0000","last_became_active":"2026-02-24T19:18:04.552851+0000","last_became_peered":"2026-02-24T19:18:04.552851+0000","last_unstale":"2026-02-24T19:23:44.242565+0000","last_undegraded":"2026-02-24T19:23:44.242565+0000","last_fullsized":"2026-02-24T19:23:44.242565+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:11:05.672582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,13],"acting":[12,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":643,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.291165+0000","last_change":"2026-02-24T19:18:03.509349+0000","last_active":"2026-02-24T19:23:44.291165+0000","last_peered":"2026-02-24T19:23:44.291165+0000","last_clean":"2026-02-24T19:23:44.291165+0000","last_became_active":"2026-02-24T19:18:03.507201+0000","last_became_peered":"2026-02-24T19:18:03.507201+0000","last_unstale":"2026-02-24T19:23:44.291165+0000","last_undegraded":"2026-02-24T19:23:44.291165+0000","last_fullsized":"2026-02-24T19:23:44.291165+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:24:43.636938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,13],"acting":[8,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":646,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.291806+0000","last_change":"2026-02-24T19:18:03.452428+0000","last_active":"2026-02-24T19:23:44.291806+0000","last_peered":"2026-02-24T19:23:44.291806+0000","last_clean":"2026-02-24T19:23:44.291806+0000","last_became_active":"2026-02-24T19:18:03.433618+0000","last_became_peered":"2026-02-24T19:18:03.433618+0000","last_unstale":"2026-02-24T19:23:44.291806+0000","last_undegraded":"2026-02-24T19:23:44.291806+0000","last_fullsized":"2026-02-24T19:23:44.291806+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:42:16.990633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":641,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-24T19:23:43.111204+0000","last_change":"2026-02-24T19:18:04.459024+0000","last_active":"2026-02-24T19:23:43.111204+0000","last_peered":"2026-02-24T19:23:43.111204+0000","last_clean":"2026-02-24T19:23:43.111204+0000","last_became_active":"2026-02-24T19:18:04.456892+0000","last_became_peered":"2026-02-24T19:18:04.456892+0000","last_unstale":"2026-02-24T19:23:43.111204+0000","last_undegraded":"2026-02-24T19:23:43.111204+0000","last_fullsized":"2026-02-24T19:23:43.111204+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:33:41.389587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":665,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.315349+0000","last_change":"2026-02-24T19:17:26.965063+0000","last_active":"2026-02-24T19:23:44.315349+0000","last_peered":"2026-02-24T19:23:44.315349+0000","last_clean":"2026-02-24T19:23:44.315349+0000","last_became_active":"2026-02-24T19:17:25.636961+0000","last_became_peered":"2026-02-24T19:17:25.636961+0000","last_unstale":"2026-02-24T19:23:44.315349+0000","last_undegraded":"2026-02-24T19:23:44.315349+0000","last_fullsized":"2026-02-24T19:23:44.315349+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:42:49.532270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.076701065999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,0],"acting":[15,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":645,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.289322+0000","last_change":"2026-02-24T19:18:04.060070+0000","last_active":"2026-02-24T19:23:44.289322+0000","last_peered":"2026-02-24T19:23:44.289322+0000","last_clean":"2026-02-24T19:23:44.289322+0000","last_became_active":"2026-02-24T19:18:04.057738+0000","last_became_peered":"2026-02-24T19:18:04.057738+0000","last_unstale":"2026-02-24T19:23:44.289322+0000","last_undegraded":"2026-02-24T19:23:44.289322+0000","last_fullsized":"2026-02-24T19:23:44.289322+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:30:15.992686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":665,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.298064+0000","last_change":"2026-02-24T19:17:27.096285+0000","last_active":"2026-02-24T19:23:44.298064+0000","last_peered":"2026-02-24T19:23:44.298064+0000","last_clean":"2026-02-24T19:23:44.298064+0000","last_became_active":"2026-02-24T19:17:24.847985+0000","last_became_peered":"2026-02-24T19:17:24.847985+0000","last_unstale":"2026-02-24T19:23:44.298064+0000","last_undegraded":"2026-02-24T19:23:44.298064+0000","last_fullsized":"2026-02-24T19:23:44.298064+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:50:14.116609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032556177999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,7],"acting":[14,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":644,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.252410+0000","last_change":"2026-02-24T19:18:04.733866+0000","last_active":"2026-02-24T19:23:44.252410+0000","last_peered":"2026-02-24T19:23:44.252410+0000","last_clean":"2026-02-24T19:23:44.252410+0000","last_became_active":"2026-02-24T19:18:04.731637+0000","last_became_peered":"2026-02-24T19:18:04.731637+0000","last_unstale":"2026-02-24T19:23:44.252410+0000","last_undegraded":"2026-02-24T19:23:44.252410+0000","last_fullsized":"2026-02-24T19:23:44.252410+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:06:08.078529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,14],"acting":[12,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":659,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.311909+0000","last_change":"2026-02-24T19:17:26.898110+0000","last_active":"2026-02-24T19:23:44.311909+0000","last_peered":"2026-02-24T19:23:44.311909+0000","last_clean":"2026-02-24T19:23:44.311909+0000","last_became_active":"2026-02-24T19:17:24.821876+0000","last_became_peered":"2026-02-24T19:17:24.821876+0000","last_unstale":"2026-02-24T19:23:44.311909+0000","last_undegraded":"2026-02-24T19:23:44.311909+0000","last_fullsized":"2026-02-24T19:23:44.311909+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:00:08.087971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.044624814999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":644,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.292944+0000","last_change":"2026-02-24T19:18:04.721916+0000","last_active":"2026-02-24T19:23:44.292944+0000","last_peered":"2026-02-24T19:23:44.292944+0000","last_clean":"2026-02-24T19:23:44.292944+0000","last_became_active":"2026-02-24T19:18:04.719330+0000","last_became_peered":"2026-02-24T19:18:04.719330+0000","last_unstale":"2026-02-24T19:23:44.292944+0000","last_undegraded":"2026-02-24T19:23:44.292944+0000","last_fullsized":"2026-02-24T19:23:44.292944+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:26:21.901912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,6],"acting":[10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":659,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.309461+0000","last_change":"2026-02-24T19:17:26.891122+0000","last_active":"2026-02-24T19:23:44.309461+0000","last_peered":"2026-02-24T19:23:44.309461+0000","last_clean":"2026-02-24T19:23:44.309461+0000","last_became_active":"2026-02-24T19:17:23.991081+0000","last_became_peered":"2026-02-24T19:17:23.991081+0000","last_unstale":"2026-02-24T19:23:44.309461+0000","last_undegraded":"2026-02-24T19:23:44.309461+0000","last_fullsized":"2026-02-24T19:23:44.309461+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:10:30.161691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.042145786999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":647,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.294330+0000","last_change":"2026-02-24T19:18:03.657924+0000","last_active":"2026-02-24T19:23:44.294330+0000","last_peered":"2026-02-24T19:23:44.294330+0000","last_clean":"2026-02-24T19:23:44.294330+0000","last_became_active":"2026-02-24T19:18:03.655492+0000","last_became_peered":"2026-02-24T19:18:03.655492+0000","last_unstale":"2026-02-24T19:23:44.294330+0000","last_undegraded":"2026-02-24T19:23:44.294330+0000","last_fullsized":"2026-02-24T19:23:44.294330+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:07:13.620976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,7],"acting":[14,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.2","version":"31'2","reported_seq":668,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.292709+0000","last_change":"2026-02-24T19:17:26.948217+0000","last_active":"2026-02-24T19:23:44.292709+0000","last_peered":"2026-02-24T19:23:44.292709+0000","last_clean":"2026-02-24T19:23:44.292709+0000","last_became_active":"2026-02-24T19:17:25.045520+0000","last_became_peered":"2026-02-24T19:17:25.045520+0000","last_unstale":"2026-02-24T19:23:44.292709+0000","last_undegraded":"2026-02-24T19:23:44.292709+0000","last_fullsized":"2026-02-24T19:23:44.292709+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:32:11.642822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.069045234999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,10],"acting":[15,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":643,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.313190+0000","last_change":"2026-02-24T19:18:03.350390+0000","last_active":"2026-02-24T19:23:44.313190+0000","last_peered":"2026-02-24T19:23:44.313190+0000","last_clean":"2026-02-24T19:23:44.313190+0000","last_became_active":"2026-02-24T19:18:03.348322+0000","last_became_peered":"2026-02-24T19:18:03.348322+0000","last_unstale":"2026-02-24T19:23:44.313190+0000","last_undegraded":"2026-02-24T19:23:44.313190+0000","last_fullsized":"2026-02-24T19:23:44.313190+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:36:08.115800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":665,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.296510+0000","last_change":"2026-02-24T19:17:27.119087+0000","last_active":"2026-02-24T19:23:44.296510+0000","last_peered":"2026-02-24T19:23:44.296510+0000","last_clean":"2026-02-24T19:23:44.296510+0000","last_became_active":"2026-02-24T19:17:24.834035+0000","last_became_peered":"2026-02-24T19:17:24.834035+0000","last_unstale":"2026-02-24T19:23:44.296510+0000","last_undegraded":"2026-02-24T19:23:44.296510+0000","last_fullsized":"2026-02-24T19:23:44.296510+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:29:27.582878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036343514,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":645,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.393133+0000","last_change":"2026-02-24T19:18:03.457431+0000","last_active":"2026-02-24T19:23:44.393133+0000","last_peered":"2026-02-24T19:23:44.393133+0000","last_clean":"2026-02-24T19:23:44.393133+0000","last_became_active":"2026-02-24T19:18:03.450995+0000","last_became_peered":"2026-02-24T19:18:03.450995+0000","last_unstale":"2026-02-24T19:23:44.393133+0000","last_undegraded":"2026-02-24T19:23:44.393133+0000","last_fullsized":"2026-02-24T19:23:44.393133+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:07:57.911949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,2],"acting":[13,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":665,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.387915+0000","last_change":"2026-02-24T19:17:27.099921+0000","last_active":"2026-02-24T19:23:44.387915+0000","last_peered":"2026-02-24T19:23:44.387915+0000","last_clean":"2026-02-24T19:23:44.387915+0000","last_became_active":"2026-02-24T19:17:24.560197+0000","last_became_peered":"2026-02-24T19:17:24.560197+0000","last_unstale":"2026-02-24T19:23:44.387915+0000","last_undegraded":"2026-02-24T19:23:44.387915+0000","last_fullsized":"2026-02-24T19:23:44.387915+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:28:40.195905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038521284000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":643,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.303578+0000","last_change":"2026-02-24T19:18:04.002274+0000","last_active":"2026-02-24T19:23:44.303578+0000","last_peered":"2026-02-24T19:23:44.303578+0000","last_clean":"2026-02-24T19:23:44.303578+0000","last_became_active":"2026-02-24T19:18:03.998754+0000","last_became_peered":"2026-02-24T19:18:03.998754+0000","last_unstale":"2026-02-24T19:23:44.303578+0000","last_undegraded":"2026-02-24T19:23:44.303578+0000","last_fullsized":"2026-02-24T19:23:44.303578+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:03:56.409494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"29'1","reported_seq":667,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.296573+0000","last_change":"2026-02-24T19:17:26.955767+0000","last_active":"2026-02-24T19:23:44.296573+0000","last_peered":"2026-02-24T19:23:44.296573+0000","last_clean":"2026-02-24T19:23:44.296573+0000","last_became_active":"2026-02-24T19:17:24.838239+0000","last_became_peered":"2026-02-24T19:17:24.838239+0000","last_unstale":"2026-02-24T19:23:44.296573+0000","last_undegraded":"2026-02-24T19:23:44.296573+0000","last_fullsized":"2026-02-24T19:23:44.296573+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:54:28.324309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070474251000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"1.0","version":"29'32","reported_seq":706,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.235139+0000","last_change":"2026-02-24T19:17:18.365341+0000","last_active":"2026-02-24T19:23:44.235139+0000","last_peered":"2026-02-24T19:23:44.235139+0000","last_clean":"2026-02-24T19:23:44.235139+0000","last_became_active":"2026-02-24T19:17:18.351934+0000","last_became_peered":"2026-02-24T19:17:18.351934+0000","last_unstale":"2026-02-24T19:23:44.235139+0000","last_undegraded":"2026-02-24T19:23:44.235139+0000","last_fullsized":"2026-02-24T19:23:44.235139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:15.908436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:15.908436+0000","last_clean_scrub_stamp":"2026-02-24T19:17:15.908436+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:23:17.271649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":641,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-24T19:23:43.113897+0000","last_change":"2026-02-24T19:18:03.588627+0000","last_active":"2026-02-24T19:23:43.113897+0000","last_peered":"2026-02-24T19:23:43.113897+0000","last_clean":"2026-02-24T19:23:43.113897+0000","last_became_active":"2026-02-24T19:18:03.586391+0000","last_became_peered":"2026-02-24T19:18:03.586391+0000","last_unstale":"2026-02-24T19:23:43.113897+0000","last_undegraded":"2026-02-24T19:23:43.113897+0000","last_fullsized":"2026-02-24T19:23:43.113897+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:55:35.275201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":644,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.255366+0000","last_change":"2026-02-24T19:18:04.537088+0000","last_active":"2026-02-24T19:23:44.255366+0000","last_peered":"2026-02-24T19:23:44.255366+0000","last_clean":"2026-02-24T19:23:44.255366+0000","last_became_active":"2026-02-24T19:18:04.535003+0000","last_became_peered":"2026-02-24T19:18:04.535003+0000","last_unstale":"2026-02-24T19:23:44.255366+0000","last_undegraded":"2026-02-24T19:23:44.255366+0000","last_fullsized":"2026-02-24T19:23:44.255366+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T07:11:21.119347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,1],"acting":[12,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":643,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.302787+0000","last_change":"2026-02-24T19:18:03.817017+0000","last_active":"2026-02-24T19:23:44.302787+0000","last_peered":"2026-02-24T19:23:44.302787+0000","last_clean":"2026-02-24T19:23:44.302787+0000","last_became_active":"2026-02-24T19:18:03.813130+0000","last_became_peered":"2026-02-24T19:18:03.813130+0000","last_unstale":"2026-02-24T19:23:44.302787+0000","last_undegraded":"2026-02-24T19:23:44.302787+0000","last_fullsized":"2026-02-24T19:23:44.302787+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:19:34.966492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9],"acting":[0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":641,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-24T19:23:43.109749+0000","last_change":"2026-02-24T19:18:04.181930+0000","last_active":"2026-02-24T19:23:43.109749+0000","last_peered":"2026-02-24T19:23:43.109749+0000","last_clean":"2026-02-24T19:23:43.109749+0000","last_became_active":"2026-02-24T19:18:04.175135+0000","last_became_peered":"2026-02-24T19:18:04.175135+0000","last_unstale":"2026-02-24T19:23:43.109749+0000","last_undegraded":"2026-02-24T19:23:43.109749+0000","last_fullsized":"2026-02-24T19:23:43.109749+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:56:14.603348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":642,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.299095+0000","last_change":"2026-02-24T19:18:03.687215+0000","last_active":"2026-02-24T19:23:44.299095+0000","last_peered":"2026-02-24T19:23:44.299095+0000","last_clean":"2026-02-24T19:23:44.299095+0000","last_became_active":"2026-02-24T19:18:03.684548+0000","last_became_peered":"2026-02-24T19:18:03.684548+0000","last_unstale":"2026-02-24T19:23:44.299095+0000","last_undegraded":"2026-02-24T19:23:44.299095+0000","last_fullsized":"2026-02-24T19:23:44.299095+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:49:54.756086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,13],"acting":[7,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":642,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.296515+0000","last_change":"2026-02-24T19:18:03.881093+0000","last_active":"2026-02-24T19:23:44.296515+0000","last_peered":"2026-02-24T19:23:44.296515+0000","last_clean":"2026-02-24T19:23:44.296515+0000","last_became_active":"2026-02-24T19:18:03.879055+0000","last_became_peered":"2026-02-24T19:18:03.879055+0000","last_unstale":"2026-02-24T19:23:44.296515+0000","last_undegraded":"2026-02-24T19:23:44.296515+0000","last_fullsized":"2026-02-24T19:23:44.296515+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:01:48.589688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,12],"acting":[7,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":643,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.304957+0000","last_change":"2026-02-24T19:18:03.674911+0000","last_active":"2026-02-24T19:23:44.304957+0000","last_peered":"2026-02-24T19:23:44.304957+0000","last_clean":"2026-02-24T19:23:44.304957+0000","last_became_active":"2026-02-24T19:18:03.672857+0000","last_became_peered":"2026-02-24T19:18:03.672857+0000","last_unstale":"2026-02-24T19:23:44.304957+0000","last_undegraded":"2026-02-24T19:23:44.304957+0000","last_fullsized":"2026-02-24T19:23:44.304957+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:10:42.261455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":644,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.285157+0000","last_change":"2026-02-24T19:18:05.058931+0000","last_active":"2026-02-24T19:23:44.285157+0000","last_peered":"2026-02-24T19:23:44.285157+0000","last_clean":"2026-02-24T19:23:44.285157+0000","last_became_active":"2026-02-24T19:18:05.049751+0000","last_became_peered":"2026-02-24T19:18:05.049751+0000","last_unstale":"2026-02-24T19:23:44.285157+0000","last_undegraded":"2026-02-24T19:23:44.285157+0000","last_fullsized":"2026-02-24T19:23:44.285157+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:06:49.580678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":641,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-24T19:23:43.114731+0000","last_change":"2026-02-24T19:18:03.634334+0000","last_active":"2026-02-24T19:23:43.114731+0000","last_peered":"2026-02-24T19:23:43.114731+0000","last_clean":"2026-02-24T19:23:43.114731+0000","last_became_active":"2026-02-24T19:18:03.612739+0000","last_became_peered":"2026-02-24T19:18:03.612739+0000","last_unstale":"2026-02-24T19:23:43.114731+0000","last_undegraded":"2026-02-24T19:23:43.114731+0000","last_fullsized":"2026-02-24T19:23:43.114731+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:01:31.700321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":647,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.314295+0000","last_change":"2026-02-24T19:18:03.344644+0000","last_active":"2026-02-24T19:23:44.314295+0000","last_peered":"2026-02-24T19:23:44.314295+0000","last_clean":"2026-02-24T19:23:44.314295+0000","last_became_active":"2026-02-24T19:18:03.341693+0000","last_became_peered":"2026-02-24T19:18:03.341693+0000","last_unstale":"2026-02-24T19:23:44.314295+0000","last_undegraded":"2026-02-24T19:23:44.314295+0000","last_fullsized":"2026-02-24T19:23:44.314295+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:18:49.303930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,4],"acting":[15,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":642,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.301883+0000","last_change":"2026-02-24T19:18:03.403726+0000","last_active":"2026-02-24T19:23:44.301883+0000","last_peered":"2026-02-24T19:23:44.301883+0000","last_clean":"2026-02-24T19:23:44.301883+0000","last_became_active":"2026-02-24T19:18:03.401642+0000","last_became_peered":"2026-02-24T19:18:03.401642+0000","last_unstale":"2026-02-24T19:23:44.301883+0000","last_undegraded":"2026-02-24T19:23:44.301883+0000","last_fullsized":"2026-02-24T19:23:44.301883+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:18:07.075632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,15],"acting":[7,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":640,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.242401+0000","last_change":"2026-02-24T19:18:03.708894+0000","last_active":"2026-02-24T19:23:44.242401+0000","last_peered":"2026-02-24T19:23:44.242401+0000","last_clean":"2026-02-24T19:23:44.242401+0000","last_became_active":"2026-02-24T19:18:03.706699+0000","last_became_peered":"2026-02-24T19:18:03.706699+0000","last_unstale":"2026-02-24T19:23:44.242401+0000","last_undegraded":"2026-02-24T19:23:44.242401+0000","last_fullsized":"2026-02-24T19:23:44.242401+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:17:30.885035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9],"acting":[2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":16}],"osd_stats":[{"osd":15,"up_from":21,"seq":90194313296,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33932,"kb_used_data":6972,"kb_used_omap":215,"kb_used_meta":26728,"kb_avail":94337908,"statfs":{"total":96636764160,"available":96602017792,"internally_reserved":0,"allocated":7139328,"data_stored":4486209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":220689,"internal_metadata":27369967},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":14,"up_from":21,"seq":90194313296,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33944,"kb_used_data":6984,"kb_used_omap":217,"kb_used_meta":26726,"kb_avail":94337896,"statfs":{"total":96636764160,"available":96602005504,"internally_reserved":0,"allocated":7151616,"data_stored":4495856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":222600,"internal_metadata":27368056},"hb_peers":[0,1,2,3,5,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313296,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33928,"kb_used_data":6968,"kb_used_omap":220,"kb_used_meta":26723,"kb_avail":94337912,"statfs":{"total":96636764160,"available":96602021888,"internally_reserved":0,"allocated":7135232,"data_stored":4486190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":225674,"internal_metadata":27364982},"hb_peers":[0,1,2,3,4,6,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313296,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33944,"kb_used_data":6984,"kb_used_omap":4987,"kb_used_meta":21956,"kb_avail":94337896,"statfs":{"total":96636764160,"available":96602005504,"internally_reserved":0,"allocated":7151616,"data_stored":4495856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5106839,"internal_metadata":22483817},"hb_peers":[1,2,3,4,6,7,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":21,"seq":90194313296,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33944,"kb_used_data":6984,"kb_used_omap":214,"kb_used_meta":26729,"kb_avail":94337896,"statfs":{"total":96636764160,"available":96602005504,"internally_reserved":0,"allocated":7151616,"data_stored":4495856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":219418,"internal_metadata":27371238},"hb_peers":[0,2,3,5,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313296,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34336,"kb_used_data":7376,"kb_used_omap":215,"kb_used_meta":26728,"kb_avail":94337504,"statfs":{"total":96636764160,"available":96601604096,"internally_reserved":0,"allocated":7553024,"data_stored":4893696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":220337,"internal_metadata":27370319},"hb_peers":[0,1,3,4,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313297,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33944,"kb_used_data":6984,"kb_used_omap":3017,"kb_used_meta":23926,"kb_avail":94337896,"statfs":{"total":96636764160,"available":96602005504,"internally_reserved":0,"allocated":7151616,"data_stored":4495856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3090288,"internal_metadata":24500368},"hb_peers":[1,2,4,5,6,7,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313296,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33948,"kb_used_data":6988,"kb_used_omap":3009,"kb_used_meta":23934,"kb_avail":94337892,"statfs":{"total":96636764160,"available":96602001408,"internally_reserved":0,"allocated":7155712,"data_stored":4495861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3081227,"internal_metadata":24509429},"hb_peers":[0,1,2,3,5,6,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313296,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33928,"kb_used_data":6968,"kb_used_omap":214,"kb_used_meta":26729,"kb_avail":94337912,"statfs":{"total":96636764160,"available":96602021888,"internally_reserved":0,"allocated":7135232,"data_stored":4486190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":220104,"internal_metadata":27370552},"hb_peers":[0,2,3,4,6,7,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":21,"seq":90194313297,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33928,"kb_used_data":6968,"kb_used_omap":3010,"kb_used_meta":23933,"kb_avail":94337912,"statfs":{"total":96636764160,"available":96602021888,"internally_reserved":0,"allocated":7135232,"data_stored":4486190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3082635,"internal_metadata":24508021},"hb_peers":[0,1,2,3,4,5,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[]},{"osd":7,"up_from":21,"seq":90194313297,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34320,"kb_used_data":7360,"kb_used_omap":214,"kb_used_meta":26729,"kb_avail":94337520,"statfs":{"total":96636764160,"available":96601620480,"internally_reserved":0,"allocated":7536640,"data_stored":4884030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":219803,"internal_metadata":27370853},"hb_peers":[0,2,3,4,5,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313296,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33928,"kb_used_data":6968,"kb_used_omap":3023,"kb_used_meta":23920,"kb_avail":94337912,"statfs":{"total":96636764160,"available":96602021888,"internally_reserved":0,"allocated":7135232,"data_stored":4486190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3095598,"internal_metadata":24495058},"hb_peers":[1,3,4,5,6,7,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313297,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33928,"kb_used_data":6968,"kb_used_omap":3022,"kb_used_meta":23921,"kb_avail":94337912,"statfs":{"total":96636764160,"available":96602021888,"internally_reserved":0,"allocated":7135232,"data_stored":4486190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3095242,"internal_metadata":24495414},"hb_peers":[0,1,3,4,5,6,7,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":10,"up_from":21,"seq":90194313296,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33948,"kb_used_data":6988,"kb_used_omap":175,"kb_used_meta":26768,"kb_avail":94337892,"statfs":{"total":96636764160,"available":96602001408,"internally_reserved":0,"allocated":7155712,"data_stored":4495875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179931,"internal_metadata":27410725},"hb_peers":[0,1,2,4,5,6,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313296,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33928,"kb_used_data":6968,"kb_used_omap":3024,"kb_used_meta":23919,"kb_avail":94337912,"statfs":{"total":96636764160,"available":96602021888,"internally_reserved":0,"allocated":7135232,"data_stored":4486190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3096829,"internal_metadata":24493827},"hb_peers":[0,1,2,3,5,6,7,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313296,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33932,"kb_used_data":6972,"kb_used_omap":216,"kb_used_meta":26727,"kb_avail":94337908,"statfs":{"total":96636764160,"available":96602017792,"internally_reserved":0,"allocated":7139328,"data_stored":4486195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":221469,"internal_metadata":27369187},"hb_peers":[0,1,2,3,4,5,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T19:23:46.107 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T19:23:46.177 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.174+0000 7feeadbc3640 10 monclient: get_monmap_and_config 2026-02-24T19:23:46.177 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.174+0000 7feeadbc3640 10 monclient: build_initial_monmap 2026-02-24T19:23:46.177 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.174+0000 7feeadbc3640 10 monclient: monmap: 2026-02-24T19:23:46.177 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:46.177 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:46.177 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:23:46.176198+0000 2026-02-24T19:23:46.177 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:23:46.176198+0000 2026-02-24T19:23:46.178 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:46.178 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:46.178 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:46.178 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:46.178 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:46.178 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:46.180 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.175+0000 7feeadbc3640 1 Processor -- start 2026-02-24T19:23:46.180 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.175+0000 7feeadbc3640 1 -- start start 2026-02-24T19:23:46.180 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.175+0000 7feeadbc3640 10 monclient: init 2026-02-24T19:23:46.180 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.175+0000 7feeadbc3640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:46.180 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.175+0000 7feeadbc3640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:23:46.180 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.175+0000 7feeadbc3640 10 monclient(hunting): picked mon.noname-c con 0x7feea8058da0 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:46.180 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.175+0000 7feeadbc3640 10 monclient(hunting): picked mon.noname-b con 0x7feea80b0410 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:46.181 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.175+0000 7feeadbc3640 10 monclient(hunting): picked mon.noname-a con 0x7feea81626a0 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:46.181 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.175+0000 7feeadbc3640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feea81655c0 con 0x7feea81626a0 2026-02-24T19:23:46.181 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.175+0000 7feeadbc3640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feea80b12b0 con 0x7feea80b0410 2026-02-24T19:23:46.181 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.175+0000 7feeadbc3640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feea80b1590 con 0x7feea8058da0 2026-02-24T19:23:46.181 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.175+0000 7feeadbc3640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:46.181 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.175+0000 7feeadbc3640 10 monclient(hunting): authenticate will time out at 4000.857851s 2026-02-24T19:23:46.181 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.176+0000 7feea7fff640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7feea81626a0 0x7feea81c6d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:48924/0 (socket says 10.20.193.14:48924) 2026-02-24T19:23:46.181 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.176+0000 7feea7fff640 1 -- 10.20.193.14:0/3684740843 learned_addr learned my addr 10.20.193.14:0/3684740843 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:46.181 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.177+0000 7feea67fc640 1 -- 10.20.193.14:0/3684740843 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 555140827 0 0) 0x7feea81655c0 con 0x7feea81626a0 2026-02-24T19:23:46.181 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.177+0000 7feea67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:23:46.181 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.177+0000 7feea67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:46.181 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.177+0000 7feea67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:46.182 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.177+0000 7feea67fc640 10 monclient(hunting): my global_id is 30711 2026-02-24T19:23:46.182 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.177+0000 7feea67fc640 1 -- 10.20.193.14:0/3684740843 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee8c003610 con 0x7feea81626a0 2026-02-24T19:23:46.182 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.177+0000 7feea67fc640 1 -- 10.20.193.14:0/3684740843 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4160042153 0 0) 0x7feea80b1590 con 0x7feea8058da0 2026-02-24T19:23:46.182 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.177+0000 7feea67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:23:46.182 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.177+0000 7feea67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:46.182 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.177+0000 7feea67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:46.182 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.177+0000 7feea67fc640 10 monclient(hunting): my global_id is 28670 2026-02-24T19:23:46.182 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.177+0000 7feea67fc640 1 -- 10.20.193.14:0/3684740843 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feea81655c0 con 0x7feea8058da0 2026-02-24T19:23:46.187 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.179+0000 7feea67fc640 1 -- 10.20.193.14:0/3684740843 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2534148187 0 0) 0x7feea80b12b0 con 0x7feea80b0410 2026-02-24T19:23:46.187 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.179+0000 7feea67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:23:46.187 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.179+0000 7feea67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:46.187 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.179+0000 7feea67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:46.187 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.179+0000 7feea67fc640 10 monclient(hunting): my global_id is 29032 2026-02-24T19:23:46.187 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.179+0000 7feea67fc640 1 -- 10.20.193.14:0/3684740843 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feea80b1590 con 0x7feea80b0410 2026-02-24T19:23:46.187 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.179+0000 7feea67fc640 1 -- 10.20.193.14:0/3684740843 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1185394739 0 0) 0x7feea81655c0 con 0x7feea8058da0 2026-02-24T19:23:46.188 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.179+0000 7feea67fc640 1 -- 10.20.193.14:0/3684740843 >> v1:10.20.193.44:6789/0 conn(0x7feea80b0410 legacy=0x7feea8164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:46.188 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.179+0000 7feea67fc640 1 -- 10.20.193.14:0/3684740843 >> v1:10.20.193.14:6789/0 conn(0x7feea81626a0 legacy=0x7feea81c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:46.188 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.179+0000 7feea67fc640 10 monclient: _finish_hunting 0 2026-02-24T19:23:46.188 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.179+0000 7feea67fc640 1 monclient: found mon.noname-c 2026-02-24T19:23:46.188 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.179+0000 7feea67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:46.188 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.179+0000 7feea67fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.170:6789/0 2026-02-24T19:23:46.188 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.179+0000 7feea67fc640 1 -- 10.20.193.14:0/3684740843 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feea80b1870 con 0x7feea8058da0 2026-02-24T19:23:46.188 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.179+0000 7feea67fc640 10 monclient: _finish_auth 0 2026-02-24T19:23:46.188 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.179+0000 7feea67fc640 10 monclient: _check_auth_tickets 2026-02-24T19:23:46.188 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.179+0000 7feea67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:46.188 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.179+0000 7feea67fc640 1 -- 10.20.193.14:0/3684740843 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fee94002df0 con 0x7feea8058da0 2026-02-24T19:23:46.188 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.179+0000 7feeadbc3640 5 monclient: authenticate success, global_id 28670 2026-02-24T19:23:46.189 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.179+0000 7feeadbc3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:46.189 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.179+0000 7feea67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:46.189 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.179+0000 7feea67fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:23:46.189 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.179+0000 7feea67fc640 10 monclient: dump: 2026-02-24T19:23:46.189 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:46.189 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:46.189 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:46.189 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:46.189 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:46.189 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:46.189 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:46.189 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:46.190 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:46.190 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:46.190 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.179+0000 7feeadbc3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:46.190 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.180+0000 7feea67fc640 1 -- 10.20.193.14:0/3684740843 <== mon.2 v1:10.20.193.170:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fee94002fc0 con 0x7feea8058da0 2026-02-24T19:23:46.190 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.180+0000 7feea67fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:46.190 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.180+0000 7feea67fc640 1 -- 10.20.193.14:0/3684740843 <== mon.2 v1:10.20.193.170:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fee94003400 con 0x7feea8058da0 2026-02-24T19:23:46.190 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.180+0000 7feeadbc3640 10 monclient: get_monmap_and_config success 2026-02-24T19:23:46.190 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.180+0000 7feeadbc3640 4 set_mon_vals no callback set 2026-02-24T19:23:46.190 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.180+0000 7feea67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:46.190 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.180+0000 7feea67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:46.190 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.180+0000 7feea67fc640 10 monclient: dump: 2026-02-24T19:23:46.190 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:46.190 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:46.191 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:46.191 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:46.191 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:46.191 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:46.191 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:46.191 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:46.191 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:46.191 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:46.191 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.180+0000 7feeadbc3640 10 monclient: shutdown 2026-02-24T19:23:46.191 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.180+0000 7feeadbc3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:46.191 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.180+0000 7feeadbc3640 1 -- 10.20.193.14:0/3684740843 >> v1:10.20.193.170:6789/0 conn(0x7feea8058da0 legacy=0x7feea81647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:46.191 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.180+0000 7feeadbc3640 1 -- 10.20.193.14:0/3684740843 shutdown_connections 2026-02-24T19:23:46.191 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.180+0000 7feeadbc3640 1 -- 10.20.193.14:0/3684740843 >> 10.20.193.14:0/3684740843 conn(0x7feea80b65f0 msgr2=0x7feea80b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:46.192 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.180+0000 7feeadbc3640 1 -- 10.20.193.14:0/3684740843 shutdown_connections 2026-02-24T19:23:46.192 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.180+0000 7feeadbc3640 1 -- 10.20.193.14:0/3684740843 wait complete. 2026-02-24T19:23:46.192 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.181+0000 7feeadbc3640 10 monclient: build_initial_monmap 2026-02-24T19:23:46.192 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.181+0000 7feeadbc3640 10 monclient: monmap: 2026-02-24T19:23:46.192 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:46.192 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:23:46.192 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:23:46.192 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:23:46.192 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:46.192 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:23:46.192 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:46.192 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:46.192 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:46.193 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:46.193 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.181+0000 7feeadbc3640 1 librados: starting msgr at 2026-02-24T19:23:46.193 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.181+0000 7feeadbc3640 1 librados: starting objecter 2026-02-24T19:23:46.193 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.181+0000 7feeadbc3640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:23:46.193 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.181+0000 7feeadbc3640 1 Processor -- start 2026-02-24T19:23:46.193 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.181+0000 7feeadbc3640 1 -- start start 2026-02-24T19:23:46.193 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.181+0000 7feeadbc3640 1 librados: setting wanted keys 2026-02-24T19:23:46.193 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.181+0000 7feeadbc3640 1 librados: calling monclient init 2026-02-24T19:23:46.193 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.181+0000 7feeadbc3640 10 monclient: init 2026-02-24T19:23:46.193 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.181+0000 7feeadbc3640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:46.193 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.181+0000 7feeadbc3640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:23:46.193 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.181+0000 7feeadbc3640 10 monclient(hunting): picked mon.noname-b con 0x7feea8058da0 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:46.193 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.181+0000 7feeadbc3640 10 monclient(hunting): picked mon.noname-c con 0x7feea80b0410 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:46.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.181+0000 7feeadbc3640 10 monclient(hunting): picked mon.noname-a con 0x7feea81626a0 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:46.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.181+0000 7feeadbc3640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feea805c8e0 con 0x7feea81626a0 2026-02-24T19:23:46.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.181+0000 7feeadbc3640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feea805cbc0 con 0x7feea8058da0 2026-02-24T19:23:46.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.181+0000 7feeadbc3640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feea805cea0 con 0x7feea80b0410 2026-02-24T19:23:46.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.181+0000 7feeadbc3640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:46.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.181+0000 7feeadbc3640 10 monclient(hunting): authenticate will time out at 4000.863998s 2026-02-24T19:23:46.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.182+0000 7feea77fe640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7feea8058da0 0x7feea814cba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:59648/0 (socket says 10.20.193.14:59648) 2026-02-24T19:23:46.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.182+0000 7feea77fe640 1 -- 10.20.193.14:0/3845130008 learned_addr learned my addr 10.20.193.14:0/3845130008 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:46.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.182+0000 7fee83fff640 10 client.?.objecter ms_handle_connect 0x7feea8058da0 2026-02-24T19:23:46.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.182+0000 7fee83fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:46.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.182+0000 7fee83fff640 10 client.?.objecter ms_handle_connect 0x7feea80b0410 2026-02-24T19:23:46.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.182+0000 7fee83fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:46.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.182+0000 7fee83fff640 10 client.?.objecter ms_handle_connect 0x7feea81626a0 2026-02-24T19:23:46.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.182+0000 7fee83fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:46.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.183+0000 7fee83fff640 1 -- 10.20.193.14:0/3845130008 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2305103355 0 0) 0x7feea805cbc0 con 0x7feea8058da0 2026-02-24T19:23:46.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.183+0000 7fee83fff640 10 monclient(hunting): _negotiate 2026-02-24T19:23:46.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.183+0000 7fee83fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:46.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.183+0000 7fee83fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:46.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.183+0000 7fee83fff640 10 monclient(hunting): my global_id is 29035 2026-02-24T19:23:46.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.183+0000 7fee83fff640 1 -- 10.20.193.14:0/3845130008 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee78003610 con 0x7feea8058da0 2026-02-24T19:23:46.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.183+0000 7fee83fff640 1 -- 10.20.193.14:0/3845130008 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 982676172 0 0) 0x7feea805cea0 con 0x7feea80b0410 2026-02-24T19:23:46.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.183+0000 7fee83fff640 10 monclient(hunting): _negotiate 2026-02-24T19:23:46.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.183+0000 7fee83fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:46.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.183+0000 7fee83fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:46.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.183+0000 7fee83fff640 10 monclient(hunting): my global_id is 28673 2026-02-24T19:23:46.196 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.183+0000 7fee83fff640 1 -- 10.20.193.14:0/3845130008 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feea805cbc0 con 0x7feea80b0410 2026-02-24T19:23:46.196 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.183+0000 7fee83fff640 1 -- 10.20.193.14:0/3845130008 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 334740393 0 0) 0x7feea805c8e0 con 0x7feea81626a0 2026-02-24T19:23:46.196 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.183+0000 7fee83fff640 10 monclient(hunting): _negotiate 2026-02-24T19:23:46.196 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.183+0000 7fee83fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:46.196 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.183+0000 7fee83fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:46.196 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.183+0000 7fee83fff640 10 monclient(hunting): my global_id is 30714 2026-02-24T19:23:46.196 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.183+0000 7fee83fff640 1 -- 10.20.193.14:0/3845130008 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feea805cea0 con 0x7feea81626a0 2026-02-24T19:23:46.199 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.185+0000 7fee83fff640 1 -- 10.20.193.14:0/3845130008 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1466978410 0 0) 0x7feea805cbc0 con 0x7feea80b0410 2026-02-24T19:23:46.199 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.185+0000 7fee83fff640 1 -- 10.20.193.14:0/3845130008 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feea805c8e0 con 0x7feea80b0410 2026-02-24T19:23:46.199 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.185+0000 7fee83fff640 1 -- 10.20.193.14:0/3845130008 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fee980030d0 con 0x7feea80b0410 2026-02-24T19:23:46.199 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.185+0000 7fee83fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:46.199 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.185+0000 7fee83fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:23:46.199 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.185+0000 7fee83fff640 10 monclient(hunting): dump: 2026-02-24T19:23:46.199 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:46.199 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:46.199 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:46.199 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:46.199 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:46.200 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:46.200 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:46.200 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:46.200 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:46.200 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:46.200 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.186+0000 7fee83fff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:23:46.200 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.186+0000 7fee83fff640 1 -- 10.20.193.14:0/3845130008 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2182463170 0 0) 0x7fee78003610 con 0x7feea8058da0 2026-02-24T19:23:46.200 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.186+0000 7fee83fff640 1 -- 10.20.193.14:0/3845130008 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feea805cbc0 con 0x7feea8058da0 2026-02-24T19:23:46.200 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.186+0000 7fee83fff640 1 -- 10.20.193.14:0/3845130008 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fee94003310 con 0x7feea8058da0 2026-02-24T19:23:46.200 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.186+0000 7fee83fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:46.200 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.186+0000 7fee83fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:46.200 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.186+0000 7fee83fff640 10 monclient(hunting): dump: 2026-02-24T19:23:46.201 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:46.201 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:46.201 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:46.201 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:46.201 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:46.201 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:46.201 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:46.201 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:46.201 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:46.201 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:46.201 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.186+0000 7fee83fff640 1 -- 10.20.193.14:0/3845130008 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4148367569 0 0) 0x7feea805cea0 con 0x7feea81626a0 2026-02-24T19:23:46.201 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.186+0000 7fee83fff640 1 -- 10.20.193.14:0/3845130008 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fee78003610 con 0x7feea81626a0 2026-02-24T19:23:46.201 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.186+0000 7fee83fff640 1 -- 10.20.193.14:0/3845130008 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fee9c003250 con 0x7feea81626a0 2026-02-24T19:23:46.202 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.186+0000 7fee83fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:46.202 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.186+0000 7fee83fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:46.202 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.186+0000 7fee83fff640 10 monclient(hunting): dump: 2026-02-24T19:23:46.202 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:46.202 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:46.202 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:46.202 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:46.202 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:46.202 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:46.202 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:46.202 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:46.202 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:46.202 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:46.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.187+0000 7fee83fff640 1 -- 10.20.193.14:0/3845130008 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1395616451 0 0) 0x7feea805c8e0 con 0x7feea80b0410 2026-02-24T19:23:46.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.187+0000 7fee83fff640 1 -- 10.20.193.14:0/3845130008 >> v1:10.20.193.44:6789/0 conn(0x7feea8058da0 legacy=0x7feea814cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:46.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.187+0000 7fee83fff640 1 -- 10.20.193.14:0/3845130008 >> v1:10.20.193.14:6789/0 conn(0x7feea81626a0 legacy=0x7feea80a7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:46.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.187+0000 7fee83fff640 10 monclient: _finish_hunting 0 2026-02-24T19:23:46.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.187+0000 7fee83fff640 1 monclient: found mon.c 2026-02-24T19:23:46.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.187+0000 7fee83fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:46.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.187+0000 7fee83fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:46.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.187+0000 7fee83fff640 1 -- 10.20.193.14:0/3845130008 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feea805d180 con 0x7feea80b0410 2026-02-24T19:23:46.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.187+0000 7fee83fff640 10 monclient: _finish_auth 0 2026-02-24T19:23:46.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.187+0000 7fee83fff640 10 monclient: _check_auth_tickets 2026-02-24T19:23:46.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.187+0000 7fee83fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:46.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.187+0000 7feeadbc3640 5 monclient: authenticate success, global_id 28673 2026-02-24T19:23:46.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.187+0000 7feeadbc3640 10 monclient: _renew_subs 2026-02-24T19:23:46.204 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.187+0000 7feeadbc3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:46.204 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.187+0000 7feeadbc3640 1 -- 10.20.193.14:0/3845130008 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7feea805d460 con 0x7feea80b0410 2026-02-24T19:23:46.204 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.187+0000 7feeadbc3640 10 client.28673.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:46.204 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.187+0000 7feeadbc3640 10 monclient: _renew_subs 2026-02-24T19:23:46.204 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.187+0000 7feeadbc3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:46.204 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.187+0000 7feeadbc3640 1 -- 10.20.193.14:0/3845130008 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7feea8138860 con 0x7feea80b0410 2026-02-24T19:23:46.204 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.187+0000 7feeadbc3640 1 librados: init done 2026-02-24T19:23:46.204 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.188+0000 7feeadbc3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:46.204 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.188+0000 7feeadbc3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:46.204 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.188+0000 7feeadbc3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:46.204 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.188+0000 7feeadbc3640 1 -- 10.20.193.14:0/3845130008 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feea8164070 con 0x7feea80b0410 2026-02-24T19:23:46.282 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.279+0000 7fee83fff640 1 -- 10.20.193.14:0/3845130008 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fee98003270 con 0x7feea80b0410 2026-02-24T19:23:46.282 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.279+0000 7fee83fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:46.282 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.279+0000 7fee83fff640 1 -- 10.20.193.14:0/3845130008 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fee980039b0 con 0x7feea80b0410 2026-02-24T19:23:46.282 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.279+0000 7fee83fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:46.282 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.279+0000 7fee83fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:46.282 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.279+0000 7fee83fff640 10 monclient: dump: 2026-02-24T19:23:46.282 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:46.282 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:46.282 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:46.283 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:46.283 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:46.283 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:46.283 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:46.283 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:46.283 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:46.283 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:46.283 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.279+0000 7feea5ffb640 4 set_mon_vals no callback set 2026-02-24T19:23:46.284 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.280+0000 7fee83fff640 1 -- 10.20.193.14:0/3845130008 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7fee9801c820 con 0x7feea80b0410 2026-02-24T19:23:46.284 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.280+0000 7feea77fe640 10 monclient: get_auth_request con 0x7fee78077e20 auth_method 0 2026-02-24T19:23:46.284 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.280+0000 7fee83fff640 10 client.28673.objecter ms_handle_connect 0x7fee78077e20 2026-02-24T19:23:46.284 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.281+0000 7fee83fff640 1 -- 10.20.193.14:0/3845130008 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7fee98092020 con 0x7feea80b0410 2026-02-24T19:23:46.284 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.281+0000 7fee83fff640 10 client.28673.objecter ms_dispatch2 0x7feea8000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:23:46.284 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.281+0000 7fee83fff640 3 client.28673.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:23:46.285 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.281+0000 7fee83fff640 3 client.28673.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:23:46.285 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.281+0000 7fee83fff640 20 client.28673.objecter dump_active .. 0 homeless 2026-02-24T19:23:46.285 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.283+0000 7fee83fff640 1 -- 10.20.193.14:0/3845130008 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7feea8164070 con 0x7feea80b0410 2026-02-24T19:23:46.285 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.283+0000 7fee83fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:46.285 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.283+0000 7fee83fff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:23:46.392 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.389+0000 7feeadbc3640 1 -- 10.20.193.14:0/3845130008 --> v1:10.20.193.14:6800/4014096310 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feea804b790 con 0x7fee78077e20 2026-02-24T19:23:46.393 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.391+0000 7fee83fff640 1 -- 10.20.193.14:0/3845130008 <== mgr.4110 v1:10.20.193.14:6800/4014096310 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+125488 (unknown 2965378022 0 665972070) 0x7feea804b790 con 0x7fee78077e20 2026-02-24T19:23:46.394 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:23:46.395 INFO:teuthology.orchestra.run.trial014.stderr:dumped all 2026-02-24T19:23:46.396 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.392+0000 7feeadbc3640 10 librados: watch_flush enter 2026-02-24T19:23:46.396 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.392+0000 7feeadbc3640 10 librados: watch_flush exit 2026-02-24T19:23:46.397 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.392+0000 7feeadbc3640 20 client.28673.objecter shutdown clearing up homeless session... 2026-02-24T19:23:46.397 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.392+0000 7feeadbc3640 10 client.28673.objecter successfully canceled tick 2026-02-24T19:23:46.397 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.392+0000 7feeadbc3640 1 -- 10.20.193.14:0/3845130008 >> v1:10.20.193.14:6800/4014096310 conn(0x7fee78077e20 legacy=0x7fee780982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:46.397 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.392+0000 7feeadbc3640 10 monclient: shutdown 2026-02-24T19:23:46.397 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.392+0000 7feeadbc3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:46.397 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.392+0000 7feeadbc3640 1 -- 10.20.193.14:0/3845130008 >> v1:10.20.193.170:6789/0 conn(0x7feea80b0410 legacy=0x7feea8137f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:46.397 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.392+0000 7feeadbc3640 1 -- 10.20.193.14:0/3845130008 shutdown_connections 2026-02-24T19:23:46.397 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.392+0000 7feeadbc3640 1 -- 10.20.193.14:0/3845130008 >> 10.20.193.14:0/3845130008 conn(0x7feea80b65f0 msgr2=0x7feea8059bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:46.397 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.392+0000 7feeadbc3640 1 -- 10.20.193.14:0/3845130008 shutdown_connections 2026-02-24T19:23:46.397 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.392+0000 7feeadbc3640 1 -- 10.20.193.14:0/3845130008 wait complete. 2026-02-24T19:23:46.397 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.393+0000 7feeadbc3640 1 librados: shutdown 2026-02-24T19:23:46.403 INFO:teuthology.orchestra.run.trial014.stdout:{"pg_ready":true,"pg_map":{"version":553,"stamp":"2026-02-24T19:23:45.850679+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":56,"num_read_kb":47,"num_write":70,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":122,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":543760,"kb_used_data":112400,"kb_used_omap":24998,"kb_used_meta":406105,"kb_avail":1509405680,"statfs":{"total":1546188226560,"available":1545631416320,"internally_reserved":0,"allocated":115097600,"data_stored":72642430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25598683,"internal_metadata":415851813},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":137,"apply_latency_ms":137,"commit_latency_ns":137000000,"apply_latency_ns":137000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.765573"},"pg_stats":[{"pgid":"28.0","version":"0'0","reported_seq":645,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.282188+0000","last_change":"2026-02-24T19:18:04.433420+0000","last_active":"2026-02-24T19:23:44.282188+0000","last_peered":"2026-02-24T19:23:44.282188+0000","last_clean":"2026-02-24T19:23:44.282188+0000","last_became_active":"2026-02-24T19:18:04.430880+0000","last_became_peered":"2026-02-24T19:18:04.430880+0000","last_unstale":"2026-02-24T19:23:44.282188+0000","last_undegraded":"2026-02-24T19:23:44.282188+0000","last_fullsized":"2026-02-24T19:23:44.282188+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:12:09.744113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1","version":"36'11","reported_seq":670,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.237794+0000","last_change":"2026-02-24T19:18:04.578561+0000","last_active":"2026-02-24T19:23:44.237794+0000","last_peered":"2026-02-24T19:23:44.237794+0000","last_clean":"2026-02-24T19:23:44.237794+0000","last_became_active":"2026-02-24T19:18:04.576194+0000","last_became_peered":"2026-02-24T19:18:04.576194+0000","last_unstale":"2026-02-24T19:23:44.237794+0000","last_undegraded":"2026-02-24T19:23:44.237794+0000","last_fullsized":"2026-02-24T19:23:44.237794+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:49:29.287956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,4],"acting":[12,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":643,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.300938+0000","last_change":"2026-02-24T19:18:03.963505+0000","last_active":"2026-02-24T19:23:44.300938+0000","last_peered":"2026-02-24T19:23:44.300938+0000","last_clean":"2026-02-24T19:23:44.300938+0000","last_became_active":"2026-02-24T19:18:03.958691+0000","last_became_peered":"2026-02-24T19:18:03.958691+0000","last_unstale":"2026-02-24T19:23:44.300938+0000","last_undegraded":"2026-02-24T19:23:44.300938+0000","last_fullsized":"2026-02-24T19:23:44.300938+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:23:22.822755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":645,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.288851+0000","last_change":"2026-02-24T19:18:04.348647+0000","last_active":"2026-02-24T19:23:44.288851+0000","last_peered":"2026-02-24T19:23:44.288851+0000","last_clean":"2026-02-24T19:23:44.288851+0000","last_became_active":"2026-02-24T19:18:04.335655+0000","last_became_peered":"2026-02-24T19:18:04.335655+0000","last_unstale":"2026-02-24T19:23:44.288851+0000","last_undegraded":"2026-02-24T19:23:44.288851+0000","last_fullsized":"2026-02-24T19:23:44.288851+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:38:16.688089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,14],"acting":[5,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":647,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.295062+0000","last_change":"2026-02-24T19:18:05.017788+0000","last_active":"2026-02-24T19:23:44.295062+0000","last_peered":"2026-02-24T19:23:44.295062+0000","last_clean":"2026-02-24T19:23:44.295062+0000","last_became_active":"2026-02-24T19:18:05.015377+0000","last_became_peered":"2026-02-24T19:18:05.015377+0000","last_unstale":"2026-02-24T19:23:44.295062+0000","last_undegraded":"2026-02-24T19:23:44.295062+0000","last_fullsized":"2026-02-24T19:23:44.295062+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:40:20.318316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,10],"acting":[14,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":640,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.246499+0000","last_change":"2026-02-24T19:18:05.237620+0000","last_active":"2026-02-24T19:23:44.246499+0000","last_peered":"2026-02-24T19:23:44.246499+0000","last_clean":"2026-02-24T19:23:44.246499+0000","last_became_active":"2026-02-24T19:18:05.234574+0000","last_became_peered":"2026-02-24T19:18:05.234574+0000","last_unstale":"2026-02-24T19:23:44.246499+0000","last_undegraded":"2026-02-24T19:23:44.246499+0000","last_fullsized":"2026-02-24T19:23:44.246499+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:31:23.754288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":643,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.311726+0000","last_change":"2026-02-24T19:18:03.992879+0000","last_active":"2026-02-24T19:23:44.311726+0000","last_peered":"2026-02-24T19:23:44.311726+0000","last_clean":"2026-02-24T19:23:44.311726+0000","last_became_active":"2026-02-24T19:18:03.990285+0000","last_became_peered":"2026-02-24T19:18:03.990285+0000","last_unstale":"2026-02-24T19:23:44.311726+0000","last_undegraded":"2026-02-24T19:23:44.311726+0000","last_fullsized":"2026-02-24T19:23:44.311726+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:13:12.273444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":647,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.324063+0000","last_change":"2026-02-24T19:18:03.425674+0000","last_active":"2026-02-24T19:23:44.324063+0000","last_peered":"2026-02-24T19:23:44.324063+0000","last_clean":"2026-02-24T19:23:44.324063+0000","last_became_active":"2026-02-24T19:18:03.420675+0000","last_became_peered":"2026-02-24T19:18:03.420675+0000","last_unstale":"2026-02-24T19:23:44.324063+0000","last_undegraded":"2026-02-24T19:23:44.324063+0000","last_fullsized":"2026-02-24T19:23:44.324063+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:20:11.350436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,6],"acting":[15,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":643,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.306211+0000","last_change":"2026-02-24T19:18:03.255478+0000","last_active":"2026-02-24T19:23:44.306211+0000","last_peered":"2026-02-24T19:23:44.306211+0000","last_clean":"2026-02-24T19:23:44.306211+0000","last_became_active":"2026-02-24T19:18:03.252679+0000","last_became_peered":"2026-02-24T19:18:03.252679+0000","last_unstale":"2026-02-24T19:23:44.306211+0000","last_undegraded":"2026-02-24T19:23:44.306211+0000","last_fullsized":"2026-02-24T19:23:44.306211+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:16:26.096508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,13],"acting":[4,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":644,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.242565+0000","last_change":"2026-02-24T19:18:04.558252+0000","last_active":"2026-02-24T19:23:44.242565+0000","last_peered":"2026-02-24T19:23:44.242565+0000","last_clean":"2026-02-24T19:23:44.242565+0000","last_became_active":"2026-02-24T19:18:04.552851+0000","last_became_peered":"2026-02-24T19:18:04.552851+0000","last_unstale":"2026-02-24T19:23:44.242565+0000","last_undegraded":"2026-02-24T19:23:44.242565+0000","last_fullsized":"2026-02-24T19:23:44.242565+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:11:05.672582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,13],"acting":[12,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":643,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.291165+0000","last_change":"2026-02-24T19:18:03.509349+0000","last_active":"2026-02-24T19:23:44.291165+0000","last_peered":"2026-02-24T19:23:44.291165+0000","last_clean":"2026-02-24T19:23:44.291165+0000","last_became_active":"2026-02-24T19:18:03.507201+0000","last_became_peered":"2026-02-24T19:18:03.507201+0000","last_unstale":"2026-02-24T19:23:44.291165+0000","last_undegraded":"2026-02-24T19:23:44.291165+0000","last_fullsized":"2026-02-24T19:23:44.291165+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:24:43.636938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,13],"acting":[8,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":646,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.291806+0000","last_change":"2026-02-24T19:18:03.452428+0000","last_active":"2026-02-24T19:23:44.291806+0000","last_peered":"2026-02-24T19:23:44.291806+0000","last_clean":"2026-02-24T19:23:44.291806+0000","last_became_active":"2026-02-24T19:18:03.433618+0000","last_became_peered":"2026-02-24T19:18:03.433618+0000","last_unstale":"2026-02-24T19:23:44.291806+0000","last_undegraded":"2026-02-24T19:23:44.291806+0000","last_fullsized":"2026-02-24T19:23:44.291806+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:42:16.990633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":641,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-24T19:23:43.111204+0000","last_change":"2026-02-24T19:18:04.459024+0000","last_active":"2026-02-24T19:23:43.111204+0000","last_peered":"2026-02-24T19:23:43.111204+0000","last_clean":"2026-02-24T19:23:43.111204+0000","last_became_active":"2026-02-24T19:18:04.456892+0000","last_became_peered":"2026-02-24T19:18:04.456892+0000","last_unstale":"2026-02-24T19:23:43.111204+0000","last_undegraded":"2026-02-24T19:23:43.111204+0000","last_fullsized":"2026-02-24T19:23:43.111204+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:33:41.389587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":665,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.315349+0000","last_change":"2026-02-24T19:17:26.965063+0000","last_active":"2026-02-24T19:23:44.315349+0000","last_peered":"2026-02-24T19:23:44.315349+0000","last_clean":"2026-02-24T19:23:44.315349+0000","last_became_active":"2026-02-24T19:17:25.636961+0000","last_became_peered":"2026-02-24T19:17:25.636961+0000","last_unstale":"2026-02-24T19:23:44.315349+0000","last_undegraded":"2026-02-24T19:23:44.315349+0000","last_fullsized":"2026-02-24T19:23:44.315349+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:42:49.532270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.076701065999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,0],"acting":[15,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":645,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.289322+0000","last_change":"2026-02-24T19:18:04.060070+0000","last_active":"2026-02-24T19:23:44.289322+0000","last_peered":"2026-02-24T19:23:44.289322+0000","last_clean":"2026-02-24T19:23:44.289322+0000","last_became_active":"2026-02-24T19:18:04.057738+0000","last_became_peered":"2026-02-24T19:18:04.057738+0000","last_unstale":"2026-02-24T19:23:44.289322+0000","last_undegraded":"2026-02-24T19:23:44.289322+0000","last_fullsized":"2026-02-24T19:23:44.289322+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:30:15.992686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":665,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.298064+0000","last_change":"2026-02-24T19:17:27.096285+0000","last_active":"2026-02-24T19:23:44.298064+0000","last_peered":"2026-02-24T19:23:44.298064+0000","last_clean":"2026-02-24T19:23:44.298064+0000","last_became_active":"2026-02-24T19:17:24.847985+0000","last_became_peered":"2026-02-24T19:17:24.847985+0000","last_unstale":"2026-02-24T19:23:44.298064+0000","last_undegraded":"2026-02-24T19:23:44.298064+0000","last_fullsized":"2026-02-24T19:23:44.298064+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:50:14.116609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032556177999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,7],"acting":[14,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":644,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.252410+0000","last_change":"2026-02-24T19:18:04.733866+0000","last_active":"2026-02-24T19:23:44.252410+0000","last_peered":"2026-02-24T19:23:44.252410+0000","last_clean":"2026-02-24T19:23:44.252410+0000","last_became_active":"2026-02-24T19:18:04.731637+0000","last_became_peered":"2026-02-24T19:18:04.731637+0000","last_unstale":"2026-02-24T19:23:44.252410+0000","last_undegraded":"2026-02-24T19:23:44.252410+0000","last_fullsized":"2026-02-24T19:23:44.252410+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:06:08.078529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,14],"acting":[12,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":659,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.311909+0000","last_change":"2026-02-24T19:17:26.898110+0000","last_active":"2026-02-24T19:23:44.311909+0000","last_peered":"2026-02-24T19:23:44.311909+0000","last_clean":"2026-02-24T19:23:44.311909+0000","last_became_active":"2026-02-24T19:17:24.821876+0000","last_became_peered":"2026-02-24T19:17:24.821876+0000","last_unstale":"2026-02-24T19:23:44.311909+0000","last_undegraded":"2026-02-24T19:23:44.311909+0000","last_fullsized":"2026-02-24T19:23:44.311909+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:00:08.087971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.044624814999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":644,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.292944+0000","last_change":"2026-02-24T19:18:04.721916+0000","last_active":"2026-02-24T19:23:44.292944+0000","last_peered":"2026-02-24T19:23:44.292944+0000","last_clean":"2026-02-24T19:23:44.292944+0000","last_became_active":"2026-02-24T19:18:04.719330+0000","last_became_peered":"2026-02-24T19:18:04.719330+0000","last_unstale":"2026-02-24T19:23:44.292944+0000","last_undegraded":"2026-02-24T19:23:44.292944+0000","last_fullsized":"2026-02-24T19:23:44.292944+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:26:21.901912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,6],"acting":[10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":659,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.309461+0000","last_change":"2026-02-24T19:17:26.891122+0000","last_active":"2026-02-24T19:23:44.309461+0000","last_peered":"2026-02-24T19:23:44.309461+0000","last_clean":"2026-02-24T19:23:44.309461+0000","last_became_active":"2026-02-24T19:17:23.991081+0000","last_became_peered":"2026-02-24T19:17:23.991081+0000","last_unstale":"2026-02-24T19:23:44.309461+0000","last_undegraded":"2026-02-24T19:23:44.309461+0000","last_fullsized":"2026-02-24T19:23:44.309461+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:10:30.161691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.042145786999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":647,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.294330+0000","last_change":"2026-02-24T19:18:03.657924+0000","last_active":"2026-02-24T19:23:44.294330+0000","last_peered":"2026-02-24T19:23:44.294330+0000","last_clean":"2026-02-24T19:23:44.294330+0000","last_became_active":"2026-02-24T19:18:03.655492+0000","last_became_peered":"2026-02-24T19:18:03.655492+0000","last_unstale":"2026-02-24T19:23:44.294330+0000","last_undegraded":"2026-02-24T19:23:44.294330+0000","last_fullsized":"2026-02-24T19:23:44.294330+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:07:13.620976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,7],"acting":[14,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.2","version":"31'2","reported_seq":668,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.292709+0000","last_change":"2026-02-24T19:17:26.948217+0000","last_active":"2026-02-24T19:23:44.292709+0000","last_peered":"2026-02-24T19:23:44.292709+0000","last_clean":"2026-02-24T19:23:44.292709+0000","last_became_active":"2026-02-24T19:17:25.045520+0000","last_became_peered":"2026-02-24T19:17:25.045520+0000","last_unstale":"2026-02-24T19:23:44.292709+0000","last_undegraded":"2026-02-24T19:23:44.292709+0000","last_fullsized":"2026-02-24T19:23:44.292709+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:32:11.642822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.069045234999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,10],"acting":[15,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":643,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.313190+0000","last_change":"2026-02-24T19:18:03.350390+0000","last_active":"2026-02-24T19:23:44.313190+0000","last_peered":"2026-02-24T19:23:44.313190+0000","last_clean":"2026-02-24T19:23:44.313190+0000","last_became_active":"2026-02-24T19:18:03.348322+0000","last_became_peered":"2026-02-24T19:18:03.348322+0000","last_unstale":"2026-02-24T19:23:44.313190+0000","last_undegraded":"2026-02-24T19:23:44.313190+0000","last_fullsized":"2026-02-24T19:23:44.313190+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:36:08.115800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":665,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.296510+0000","last_change":"2026-02-24T19:17:27.119087+0000","last_active":"2026-02-24T19:23:44.296510+0000","last_peered":"2026-02-24T19:23:44.296510+0000","last_clean":"2026-02-24T19:23:44.296510+0000","last_became_active":"2026-02-24T19:17:24.834035+0000","last_became_peered":"2026-02-24T19:17:24.834035+0000","last_unstale":"2026-02-24T19:23:44.296510+0000","last_undegraded":"2026-02-24T19:23:44.296510+0000","last_fullsized":"2026-02-24T19:23:44.296510+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:29:27.582878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036343514,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":645,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.393133+0000","last_change":"2026-02-24T19:18:03.457431+0000","last_active":"2026-02-24T19:23:44.393133+0000","last_peered":"2026-02-24T19:23:44.393133+0000","last_clean":"2026-02-24T19:23:44.393133+0000","last_became_active":"2026-02-24T19:18:03.450995+0000","last_became_peered":"2026-02-24T19:18:03.450995+0000","last_unstale":"2026-02-24T19:23:44.393133+0000","last_undegraded":"2026-02-24T19:23:44.393133+0000","last_fullsized":"2026-02-24T19:23:44.393133+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:07:57.911949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,2],"acting":[13,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":665,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.387915+0000","last_change":"2026-02-24T19:17:27.099921+0000","last_active":"2026-02-24T19:23:44.387915+0000","last_peered":"2026-02-24T19:23:44.387915+0000","last_clean":"2026-02-24T19:23:44.387915+0000","last_became_active":"2026-02-24T19:17:24.560197+0000","last_became_peered":"2026-02-24T19:17:24.560197+0000","last_unstale":"2026-02-24T19:23:44.387915+0000","last_undegraded":"2026-02-24T19:23:44.387915+0000","last_fullsized":"2026-02-24T19:23:44.387915+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:28:40.195905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038521284000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":643,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.303578+0000","last_change":"2026-02-24T19:18:04.002274+0000","last_active":"2026-02-24T19:23:44.303578+0000","last_peered":"2026-02-24T19:23:44.303578+0000","last_clean":"2026-02-24T19:23:44.303578+0000","last_became_active":"2026-02-24T19:18:03.998754+0000","last_became_peered":"2026-02-24T19:18:03.998754+0000","last_unstale":"2026-02-24T19:23:44.303578+0000","last_undegraded":"2026-02-24T19:23:44.303578+0000","last_fullsized":"2026-02-24T19:23:44.303578+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:03:56.409494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"29'1","reported_seq":667,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.296573+0000","last_change":"2026-02-24T19:17:26.955767+0000","last_active":"2026-02-24T19:23:44.296573+0000","last_peered":"2026-02-24T19:23:44.296573+0000","last_clean":"2026-02-24T19:23:44.296573+0000","last_became_active":"2026-02-24T19:17:24.838239+0000","last_became_peered":"2026-02-24T19:17:24.838239+0000","last_unstale":"2026-02-24T19:23:44.296573+0000","last_undegraded":"2026-02-24T19:23:44.296573+0000","last_fullsized":"2026-02-24T19:23:44.296573+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:54:28.324309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070474251000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"1.0","version":"29'32","reported_seq":706,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.235139+0000","last_change":"2026-02-24T19:17:18.365341+0000","last_active":"2026-02-24T19:23:44.235139+0000","last_peered":"2026-02-24T19:23:44.235139+0000","last_clean":"2026-02-24T19:23:44.235139+0000","last_became_active":"2026-02-24T19:17:18.351934+0000","last_became_peered":"2026-02-24T19:17:18.351934+0000","last_unstale":"2026-02-24T19:23:44.235139+0000","last_undegraded":"2026-02-24T19:23:44.235139+0000","last_fullsized":"2026-02-24T19:23:44.235139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:15.908436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:15.908436+0000","last_clean_scrub_stamp":"2026-02-24T19:17:15.908436+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:23:17.271649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":641,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-24T19:23:43.113897+0000","last_change":"2026-02-24T19:18:03.588627+0000","last_active":"2026-02-24T19:23:43.113897+0000","last_peered":"2026-02-24T19:23:43.113897+0000","last_clean":"2026-02-24T19:23:43.113897+0000","last_became_active":"2026-02-24T19:18:03.586391+0000","last_became_peered":"2026-02-24T19:18:03.586391+0000","last_unstale":"2026-02-24T19:23:43.113897+0000","last_undegraded":"2026-02-24T19:23:43.113897+0000","last_fullsized":"2026-02-24T19:23:43.113897+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:55:35.275201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":644,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.255366+0000","last_change":"2026-02-24T19:18:04.537088+0000","last_active":"2026-02-24T19:23:44.255366+0000","last_peered":"2026-02-24T19:23:44.255366+0000","last_clean":"2026-02-24T19:23:44.255366+0000","last_became_active":"2026-02-24T19:18:04.535003+0000","last_became_peered":"2026-02-24T19:18:04.535003+0000","last_unstale":"2026-02-24T19:23:44.255366+0000","last_undegraded":"2026-02-24T19:23:44.255366+0000","last_fullsized":"2026-02-24T19:23:44.255366+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T07:11:21.119347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,1],"acting":[12,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":643,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.302787+0000","last_change":"2026-02-24T19:18:03.817017+0000","last_active":"2026-02-24T19:23:44.302787+0000","last_peered":"2026-02-24T19:23:44.302787+0000","last_clean":"2026-02-24T19:23:44.302787+0000","last_became_active":"2026-02-24T19:18:03.813130+0000","last_became_peered":"2026-02-24T19:18:03.813130+0000","last_unstale":"2026-02-24T19:23:44.302787+0000","last_undegraded":"2026-02-24T19:23:44.302787+0000","last_fullsized":"2026-02-24T19:23:44.302787+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:19:34.966492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9],"acting":[0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":641,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-24T19:23:43.109749+0000","last_change":"2026-02-24T19:18:04.181930+0000","last_active":"2026-02-24T19:23:43.109749+0000","last_peered":"2026-02-24T19:23:43.109749+0000","last_clean":"2026-02-24T19:23:43.109749+0000","last_became_active":"2026-02-24T19:18:04.175135+0000","last_became_peered":"2026-02-24T19:18:04.175135+0000","last_unstale":"2026-02-24T19:23:43.109749+0000","last_undegraded":"2026-02-24T19:23:43.109749+0000","last_fullsized":"2026-02-24T19:23:43.109749+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:56:14.603348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":642,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.299095+0000","last_change":"2026-02-24T19:18:03.687215+0000","last_active":"2026-02-24T19:23:44.299095+0000","last_peered":"2026-02-24T19:23:44.299095+0000","last_clean":"2026-02-24T19:23:44.299095+0000","last_became_active":"2026-02-24T19:18:03.684548+0000","last_became_peered":"2026-02-24T19:18:03.684548+0000","last_unstale":"2026-02-24T19:23:44.299095+0000","last_undegraded":"2026-02-24T19:23:44.299095+0000","last_fullsized":"2026-02-24T19:23:44.299095+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:49:54.756086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,13],"acting":[7,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":642,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.296515+0000","last_change":"2026-02-24T19:18:03.881093+0000","last_active":"2026-02-24T19:23:44.296515+0000","last_peered":"2026-02-24T19:23:44.296515+0000","last_clean":"2026-02-24T19:23:44.296515+0000","last_became_active":"2026-02-24T19:18:03.879055+0000","last_became_peered":"2026-02-24T19:18:03.879055+0000","last_unstale":"2026-02-24T19:23:44.296515+0000","last_undegraded":"2026-02-24T19:23:44.296515+0000","last_fullsized":"2026-02-24T19:23:44.296515+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:01:48.589688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,12],"acting":[7,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":643,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.304957+0000","last_change":"2026-02-24T19:18:03.674911+0000","last_active":"2026-02-24T19:23:44.304957+0000","last_peered":"2026-02-24T19:23:44.304957+0000","last_clean":"2026-02-24T19:23:44.304957+0000","last_became_active":"2026-02-24T19:18:03.672857+0000","last_became_peered":"2026-02-24T19:18:03.672857+0000","last_unstale":"2026-02-24T19:23:44.304957+0000","last_undegraded":"2026-02-24T19:23:44.304957+0000","last_fullsized":"2026-02-24T19:23:44.304957+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:10:42.261455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":644,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.285157+0000","last_change":"2026-02-24T19:18:05.058931+0000","last_active":"2026-02-24T19:23:44.285157+0000","last_peered":"2026-02-24T19:23:44.285157+0000","last_clean":"2026-02-24T19:23:44.285157+0000","last_became_active":"2026-02-24T19:18:05.049751+0000","last_became_peered":"2026-02-24T19:18:05.049751+0000","last_unstale":"2026-02-24T19:23:44.285157+0000","last_undegraded":"2026-02-24T19:23:44.285157+0000","last_fullsized":"2026-02-24T19:23:44.285157+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:06:49.580678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":641,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-24T19:23:43.114731+0000","last_change":"2026-02-24T19:18:03.634334+0000","last_active":"2026-02-24T19:23:43.114731+0000","last_peered":"2026-02-24T19:23:43.114731+0000","last_clean":"2026-02-24T19:23:43.114731+0000","last_became_active":"2026-02-24T19:18:03.612739+0000","last_became_peered":"2026-02-24T19:18:03.612739+0000","last_unstale":"2026-02-24T19:23:43.114731+0000","last_undegraded":"2026-02-24T19:23:43.114731+0000","last_fullsized":"2026-02-24T19:23:43.114731+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:01:31.700321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":647,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.314295+0000","last_change":"2026-02-24T19:18:03.344644+0000","last_active":"2026-02-24T19:23:44.314295+0000","last_peered":"2026-02-24T19:23:44.314295+0000","last_clean":"2026-02-24T19:23:44.314295+0000","last_became_active":"2026-02-24T19:18:03.341693+0000","last_became_peered":"2026-02-24T19:18:03.341693+0000","last_unstale":"2026-02-24T19:23:44.314295+0000","last_undegraded":"2026-02-24T19:23:44.314295+0000","last_fullsized":"2026-02-24T19:23:44.314295+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:18:49.303930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,4],"acting":[15,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":642,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.301883+0000","last_change":"2026-02-24T19:18:03.403726+0000","last_active":"2026-02-24T19:23:44.301883+0000","last_peered":"2026-02-24T19:23:44.301883+0000","last_clean":"2026-02-24T19:23:44.301883+0000","last_became_active":"2026-02-24T19:18:03.401642+0000","last_became_peered":"2026-02-24T19:18:03.401642+0000","last_unstale":"2026-02-24T19:23:44.301883+0000","last_undegraded":"2026-02-24T19:23:44.301883+0000","last_fullsized":"2026-02-24T19:23:44.301883+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:18:07.075632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,15],"acting":[7,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":640,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.242401+0000","last_change":"2026-02-24T19:18:03.708894+0000","last_active":"2026-02-24T19:23:44.242401+0000","last_peered":"2026-02-24T19:23:44.242401+0000","last_clean":"2026-02-24T19:23:44.242401+0000","last_became_active":"2026-02-24T19:18:03.706699+0000","last_became_peered":"2026-02-24T19:18:03.706699+0000","last_unstale":"2026-02-24T19:23:44.242401+0000","last_undegraded":"2026-02-24T19:23:44.242401+0000","last_fullsized":"2026-02-24T19:23:44.242401+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:17:30.885035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9],"acting":[2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":16}],"osd_stats":[{"osd":15,"up_from":21,"seq":90194313296,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33932,"kb_used_data":6972,"kb_used_omap":215,"kb_used_meta":26728,"kb_avail":94337908,"statfs":{"total":96636764160,"available":96602017792,"internally_reserved":0,"allocated":7139328,"data_stored":4486209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":220689,"internal_metadata":27369967},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":14,"up_from":21,"seq":90194313296,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33944,"kb_used_data":6984,"kb_used_omap":217,"kb_used_meta":26726,"kb_avail":94337896,"statfs":{"total":96636764160,"available":96602005504,"internally_reserved":0,"allocated":7151616,"data_stored":4495856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":222600,"internal_metadata":27368056},"hb_peers":[0,1,2,3,5,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313296,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33928,"kb_used_data":6968,"kb_used_omap":220,"kb_used_meta":26723,"kb_avail":94337912,"statfs":{"total":96636764160,"available":96602021888,"internally_reserved":0,"allocated":7135232,"data_stored":4486190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":225674,"internal_metadata":27364982},"hb_peers":[0,1,2,3,4,6,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313296,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33944,"kb_used_data":6984,"kb_used_omap":4987,"kb_used_meta":21956,"kb_avail":94337896,"statfs":{"total":96636764160,"available":96602005504,"internally_reserved":0,"allocated":7151616,"data_stored":4495856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5106839,"internal_metadata":22483817},"hb_peers":[1,2,3,4,6,7,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":21,"seq":90194313296,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33944,"kb_used_data":6984,"kb_used_omap":214,"kb_used_meta":26729,"kb_avail":94337896,"statfs":{"total":96636764160,"available":96602005504,"internally_reserved":0,"allocated":7151616,"data_stored":4495856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":219418,"internal_metadata":27371238},"hb_peers":[0,2,3,5,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313296,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34336,"kb_used_data":7376,"kb_used_omap":215,"kb_used_meta":26728,"kb_avail":94337504,"statfs":{"total":96636764160,"available":96601604096,"internally_reserved":0,"allocated":7553024,"data_stored":4893696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":220337,"internal_metadata":27370319},"hb_peers":[0,1,3,4,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313297,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33944,"kb_used_data":6984,"kb_used_omap":3017,"kb_used_meta":23926,"kb_avail":94337896,"statfs":{"total":96636764160,"available":96602005504,"internally_reserved":0,"allocated":7151616,"data_stored":4495856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3090288,"internal_metadata":24500368},"hb_peers":[1,2,4,5,6,7,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313296,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33948,"kb_used_data":6988,"kb_used_omap":3009,"kb_used_meta":23934,"kb_avail":94337892,"statfs":{"total":96636764160,"available":96602001408,"internally_reserved":0,"allocated":7155712,"data_stored":4495861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3081227,"internal_metadata":24509429},"hb_peers":[0,1,2,3,5,6,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313296,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33928,"kb_used_data":6968,"kb_used_omap":214,"kb_used_meta":26729,"kb_avail":94337912,"statfs":{"total":96636764160,"available":96602021888,"internally_reserved":0,"allocated":7135232,"data_stored":4486190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":220104,"internal_metadata":27370552},"hb_peers":[0,2,3,4,6,7,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":21,"seq":90194313297,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33928,"kb_used_data":6968,"kb_used_omap":3010,"kb_used_meta":23933,"kb_avail":94337912,"statfs":{"total":96636764160,"available":96602021888,"internally_reserved":0,"allocated":7135232,"data_stored":4486190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3082635,"internal_metadata":24508021},"hb_peers":[0,1,2,3,4,5,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[]},{"osd":7,"up_from":21,"seq":90194313297,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34320,"kb_used_data":7360,"kb_used_omap":214,"kb_used_meta":26729,"kb_avail":94337520,"statfs":{"total":96636764160,"available":96601620480,"internally_reserved":0,"allocated":7536640,"data_stored":4884030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":219803,"internal_metadata":27370853},"hb_peers":[0,2,3,4,5,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313296,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33928,"kb_used_data":6968,"kb_used_omap":3023,"kb_used_meta":23920,"kb_avail":94337912,"statfs":{"total":96636764160,"available":96602021888,"internally_reserved":0,"allocated":7135232,"data_stored":4486190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3095598,"internal_metadata":24495058},"hb_peers":[1,3,4,5,6,7,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313297,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33928,"kb_used_data":6968,"kb_used_omap":3022,"kb_used_meta":23921,"kb_avail":94337912,"statfs":{"total":96636764160,"available":96602021888,"internally_reserved":0,"allocated":7135232,"data_stored":4486190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3095242,"internal_metadata":24495414},"hb_peers":[0,1,3,4,5,6,7,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":10,"up_from":21,"seq":90194313296,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33948,"kb_used_data":6988,"kb_used_omap":175,"kb_used_meta":26768,"kb_avail":94337892,"statfs":{"total":96636764160,"available":96602001408,"internally_reserved":0,"allocated":7155712,"data_stored":4495875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179931,"internal_metadata":27410725},"hb_peers":[0,1,2,4,5,6,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313296,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33928,"kb_used_data":6968,"kb_used_omap":3024,"kb_used_meta":23919,"kb_avail":94337912,"statfs":{"total":96636764160,"available":96602021888,"internally_reserved":0,"allocated":7135232,"data_stored":4486190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3096829,"internal_metadata":24493827},"hb_peers":[0,1,2,3,5,6,7,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313296,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33932,"kb_used_data":6972,"kb_used_omap":216,"kb_used_meta":26727,"kb_avail":94337908,"statfs":{"total":96636764160,"available":96602017792,"internally_reserved":0,"allocated":7139328,"data_stored":4486195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":221469,"internal_metadata":27369187},"hb_peers":[0,1,2,3,4,5,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T19:23:46.407 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-24T19:23:46.407 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T19:23:46.476 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.473+0000 7f98238cd640 10 monclient: get_monmap_and_config 2026-02-24T19:23:46.476 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.473+0000 7f98238cd640 10 monclient: build_initial_monmap 2026-02-24T19:23:46.476 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.473+0000 7f98238cd640 10 monclient: monmap: 2026-02-24T19:23:46.476 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:46.476 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:46.476 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:23:46.475293+0000 2026-02-24T19:23:46.477 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:23:46.475293+0000 2026-02-24T19:23:46.477 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:46.477 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:46.477 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:46.477 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:46.477 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:46.477 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:46.479 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.474+0000 7f98238cd640 1 Processor -- start 2026-02-24T19:23:46.479 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.474+0000 7f98238cd640 1 -- start start 2026-02-24T19:23:46.479 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.474+0000 7f98238cd640 10 monclient: init 2026-02-24T19:23:46.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.474+0000 7f98238cd640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:46.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.474+0000 7f98238cd640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:23:46.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.474+0000 7f98238cd640 10 monclient(hunting): picked mon.noname-c con 0x7f981c058da0 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:46.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.474+0000 7f98238cd640 10 monclient(hunting): picked mon.noname-b con 0x7f981c0b0410 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:46.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.474+0000 7f98238cd640 10 monclient(hunting): picked mon.noname-a con 0x7f981c1626a0 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:46.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.474+0000 7f98238cd640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f981c1655c0 con 0x7f981c1626a0 2026-02-24T19:23:46.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.474+0000 7f98238cd640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f981c0b12b0 con 0x7f981c0b0410 2026-02-24T19:23:46.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.474+0000 7f98238cd640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f981c0b1590 con 0x7f981c058da0 2026-02-24T19:23:46.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.474+0000 7f98238cd640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:46.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.474+0000 7f98238cd640 10 monclient(hunting): authenticate will time out at 4001.156745s 2026-02-24T19:23:46.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.475+0000 7f9821e43640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f981c1626a0 0x7f981c1c6d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:48946/0 (socket says 10.20.193.14:48946) 2026-02-24T19:23:46.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.475+0000 7f9821e43640 1 -- 10.20.193.14:0/298635032 learned_addr learned my addr 10.20.193.14:0/298635032 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:46.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.476+0000 7f980bfff640 1 -- 10.20.193.14:0/298635032 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 301010174 0 0) 0x7f981c1655c0 con 0x7f981c1626a0 2026-02-24T19:23:46.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.476+0000 7f980bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:23:46.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.476+0000 7f980bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:46.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.476+0000 7f980bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:46.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.476+0000 7f980bfff640 10 monclient(hunting): my global_id is 30717 2026-02-24T19:23:46.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.476+0000 7f980bfff640 1 -- 10.20.193.14:0/298635032 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9804003610 con 0x7f981c1626a0 2026-02-24T19:23:46.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.476+0000 7f980bfff640 1 -- 10.20.193.14:0/298635032 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3443487424 0 0) 0x7f981c0b12b0 con 0x7f981c0b0410 2026-02-24T19:23:46.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.476+0000 7f980bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:23:46.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.476+0000 7f980bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:46.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.476+0000 7f980bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:46.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.476+0000 7f980bfff640 10 monclient(hunting): my global_id is 29038 2026-02-24T19:23:46.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.476+0000 7f980bfff640 1 -- 10.20.193.14:0/298635032 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f981c1655c0 con 0x7f981c0b0410 2026-02-24T19:23:46.482 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.476+0000 7f980bfff640 1 -- 10.20.193.14:0/298635032 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2744860559 0 0) 0x7f981c0b1590 con 0x7f981c058da0 2026-02-24T19:23:46.482 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.476+0000 7f980bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:23:46.482 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.476+0000 7f980bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:46.482 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.476+0000 7f980bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:46.482 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.476+0000 7f980bfff640 10 monclient(hunting): my global_id is 28676 2026-02-24T19:23:46.482 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.476+0000 7f980bfff640 1 -- 10.20.193.14:0/298635032 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f981c0b12b0 con 0x7f981c058da0 2026-02-24T19:23:46.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.478+0000 7f980bfff640 1 -- 10.20.193.14:0/298635032 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2629159959 0 0) 0x7f9804003610 con 0x7f981c1626a0 2026-02-24T19:23:46.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.478+0000 7f980bfff640 1 -- 10.20.193.14:0/298635032 >> v1:10.20.193.170:6789/0 conn(0x7f981c058da0 legacy=0x7f981c1647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:46.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.478+0000 7f980bfff640 1 -- 10.20.193.14:0/298635032 >> v1:10.20.193.44:6789/0 conn(0x7f981c0b0410 legacy=0x7f981c164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:46.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.478+0000 7f980bfff640 10 monclient: _finish_hunting 0 2026-02-24T19:23:46.487 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.478+0000 7f980bfff640 1 monclient: found mon.noname-a 2026-02-24T19:23:46.487 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.478+0000 7f980bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:46.487 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.478+0000 7f980bfff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:23:46.487 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.478+0000 7f980bfff640 1 -- 10.20.193.14:0/298635032 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f981c0b1870 con 0x7f981c1626a0 2026-02-24T19:23:46.487 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.478+0000 7f980bfff640 10 monclient: _finish_auth 0 2026-02-24T19:23:46.487 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.478+0000 7f980bfff640 10 monclient: _check_auth_tickets 2026-02-24T19:23:46.487 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.478+0000 7f980bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:46.487 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.478+0000 7f980bfff640 1 -- 10.20.193.14:0/298635032 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f9818003170 con 0x7f981c1626a0 2026-02-24T19:23:46.487 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.478+0000 7f980bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:46.487 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.478+0000 7f980bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:23:46.487 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.478+0000 7f980bfff640 10 monclient: dump: 2026-02-24T19:23:46.487 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:46.488 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:46.488 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:46.488 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:46.488 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:46.488 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:46.488 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:46.488 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:46.488 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:46.488 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:46.488 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.478+0000 7f98238cd640 5 monclient: authenticate success, global_id 30717 2026-02-24T19:23:46.488 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.478+0000 7f98238cd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:46.489 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.479+0000 7f980bfff640 1 -- 10.20.193.14:0/298635032 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9818003340 con 0x7f981c1626a0 2026-02-24T19:23:46.489 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.479+0000 7f980bfff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:46.489 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.479+0000 7f980bfff640 1 -- 10.20.193.14:0/298635032 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f9818003780 con 0x7f981c1626a0 2026-02-24T19:23:46.489 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.479+0000 7f980bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:46.489 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.479+0000 7f980bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:46.489 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.479+0000 7f980bfff640 10 monclient: dump: 2026-02-24T19:23:46.489 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:46.489 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:46.489 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:46.489 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:46.489 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:46.489 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:46.489 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:46.490 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:46.490 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:46.490 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:46.490 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.479+0000 7f98238cd640 10 monclient: get_monmap_and_config success 2026-02-24T19:23:46.490 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.479+0000 7f98238cd640 4 set_mon_vals no callback set 2026-02-24T19:23:46.490 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.479+0000 7f98238cd640 10 monclient: shutdown 2026-02-24T19:23:46.490 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.479+0000 7f98238cd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:46.490 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.479+0000 7f98238cd640 1 -- 10.20.193.14:0/298635032 >> v1:10.20.193.14:6789/0 conn(0x7f981c1626a0 legacy=0x7f981c1c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:46.490 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.479+0000 7f98238cd640 1 -- 10.20.193.14:0/298635032 shutdown_connections 2026-02-24T19:23:46.490 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.479+0000 7f98238cd640 1 -- 10.20.193.14:0/298635032 >> 10.20.193.14:0/298635032 conn(0x7f981c0b65f0 msgr2=0x7f981c0b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:46.490 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.479+0000 7f98238cd640 1 -- 10.20.193.14:0/298635032 shutdown_connections 2026-02-24T19:23:46.490 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.479+0000 7f98238cd640 1 -- 10.20.193.14:0/298635032 wait complete. 2026-02-24T19:23:46.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.480+0000 7f98238cd640 10 monclient: build_initial_monmap 2026-02-24T19:23:46.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.480+0000 7f98238cd640 10 monclient: monmap: 2026-02-24T19:23:46.491 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:46.491 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:23:46.491 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:23:46.491 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:23:46.491 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:46.491 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:23:46.491 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:46.491 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:46.491 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:46.491 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:46.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.480+0000 7f98238cd640 1 librados: starting msgr at 2026-02-24T19:23:46.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.480+0000 7f98238cd640 1 librados: starting objecter 2026-02-24T19:23:46.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.480+0000 7f98238cd640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:23:46.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.480+0000 7f98238cd640 1 Processor -- start 2026-02-24T19:23:46.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.480+0000 7f98238cd640 1 -- start start 2026-02-24T19:23:46.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.480+0000 7f98238cd640 1 librados: setting wanted keys 2026-02-24T19:23:46.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.480+0000 7f98238cd640 1 librados: calling monclient init 2026-02-24T19:23:46.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.480+0000 7f98238cd640 10 monclient: init 2026-02-24T19:23:46.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.480+0000 7f98238cd640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:46.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.480+0000 7f98238cd640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:23:46.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.480+0000 7f98238cd640 10 monclient(hunting): picked mon.noname-b con 0x7f981c058da0 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:46.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.480+0000 7f98238cd640 10 monclient(hunting): picked mon.noname-c con 0x7f981c0b0410 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:46.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.480+0000 7f98238cd640 10 monclient(hunting): picked mon.noname-a con 0x7f981c1626a0 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:46.493 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.480+0000 7f98238cd640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f981c138380 con 0x7f981c1626a0 2026-02-24T19:23:46.493 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.480+0000 7f98238cd640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f981c138660 con 0x7f981c058da0 2026-02-24T19:23:46.493 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.480+0000 7f98238cd640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f981c138940 con 0x7f981c0b0410 2026-02-24T19:23:46.493 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.480+0000 7f98238cd640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:46.493 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.480+0000 7f98238cd640 10 monclient(hunting): authenticate will time out at 4001.162991s 2026-02-24T19:23:46.493 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.481+0000 7f9821e43640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f981c1626a0 0x7f981c1fc0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:48954/0 (socket says 10.20.193.14:48954) 2026-02-24T19:23:46.493 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.481+0000 7f9821e43640 1 -- 10.20.193.14:0/3903005872 learned_addr learned my addr 10.20.193.14:0/3903005872 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:46.493 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.481+0000 7f9809ffb640 10 client.?.objecter ms_handle_connect 0x7f981c1626a0 2026-02-24T19:23:46.493 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.481+0000 7f9809ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:46.493 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.481+0000 7f9809ffb640 10 client.?.objecter ms_handle_connect 0x7f981c0b0410 2026-02-24T19:23:46.493 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.481+0000 7f9809ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:46.493 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.481+0000 7f9809ffb640 10 client.?.objecter ms_handle_connect 0x7f981c058da0 2026-02-24T19:23:46.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.481+0000 7f9809ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:46.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.482+0000 7f9809ffb640 1 -- 10.20.193.14:0/3903005872 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 532023477 0 0) 0x7f981c138380 con 0x7f981c1626a0 2026-02-24T19:23:46.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.482+0000 7f9809ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:23:46.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.482+0000 7f9809ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:46.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.482+0000 7f9809ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:46.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.482+0000 7f9809ffb640 10 monclient(hunting): my global_id is 30720 2026-02-24T19:23:46.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.482+0000 7f9809ffb640 1 -- 10.20.193.14:0/3903005872 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97ec003610 con 0x7f981c1626a0 2026-02-24T19:23:46.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.482+0000 7f9809ffb640 1 -- 10.20.193.14:0/3903005872 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 478362188 0 0) 0x7f981c138940 con 0x7f981c0b0410 2026-02-24T19:23:46.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.482+0000 7f9809ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:23:46.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.482+0000 7f9809ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:46.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.482+0000 7f9809ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:46.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.482+0000 7f9809ffb640 10 monclient(hunting): my global_id is 28679 2026-02-24T19:23:46.495 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.482+0000 7f9809ffb640 1 -- 10.20.193.14:0/3903005872 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f981c138380 con 0x7f981c0b0410 2026-02-24T19:23:46.495 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.482+0000 7f9809ffb640 1 -- 10.20.193.14:0/3903005872 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1299286487 0 0) 0x7f981c138660 con 0x7f981c058da0 2026-02-24T19:23:46.495 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.482+0000 7f9809ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:23:46.495 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.482+0000 7f9809ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:46.495 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.482+0000 7f9809ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:46.495 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.482+0000 7f9809ffb640 10 monclient(hunting): my global_id is 29041 2026-02-24T19:23:46.495 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.482+0000 7f9809ffb640 1 -- 10.20.193.14:0/3903005872 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f981c138940 con 0x7f981c058da0 2026-02-24T19:23:46.498 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.484+0000 7f9809ffb640 1 -- 10.20.193.14:0/3903005872 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 143656072 0 0) 0x7f97ec003610 con 0x7f981c1626a0 2026-02-24T19:23:46.498 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.484+0000 7f9809ffb640 1 -- 10.20.193.14:0/3903005872 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f981c138660 con 0x7f981c1626a0 2026-02-24T19:23:46.498 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.484+0000 7f9809ffb640 1 -- 10.20.193.14:0/3903005872 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f9818003690 con 0x7f981c1626a0 2026-02-24T19:23:46.498 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.484+0000 7f9809ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:46.498 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.484+0000 7f9809ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:23:46.498 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.484+0000 7f9809ffb640 10 monclient(hunting): dump: 2026-02-24T19:23:46.498 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:46.498 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:46.499 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:46.499 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:46.499 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:46.499 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:46.499 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:46.499 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:46.499 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:46.499 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:46.499 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.484+0000 7f9809ffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:23:46.499 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.485+0000 7f9809ffb640 1 -- 10.20.193.14:0/3903005872 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 20806759 0 0) 0x7f981c138940 con 0x7f981c058da0 2026-02-24T19:23:46.499 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.485+0000 7f9809ffb640 1 -- 10.20.193.14:0/3903005872 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f97ec003610 con 0x7f981c058da0 2026-02-24T19:23:46.499 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.485+0000 7f9809ffb640 1 -- 10.20.193.14:0/3903005872 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f980c002fd0 con 0x7f981c058da0 2026-02-24T19:23:46.500 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.485+0000 7f9809ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:46.500 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.485+0000 7f9809ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:46.500 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.485+0000 7f9809ffb640 10 monclient(hunting): dump: 2026-02-24T19:23:46.500 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:46.500 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:46.500 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:46.500 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:46.500 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:46.500 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:46.500 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:46.500 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:46.500 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:46.501 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:46.501 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.485+0000 7f9809ffb640 1 -- 10.20.193.14:0/3903005872 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1787679017 0 0) 0x7f981c138380 con 0x7f981c0b0410 2026-02-24T19:23:46.501 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.485+0000 7f9809ffb640 1 -- 10.20.193.14:0/3903005872 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f981c138940 con 0x7f981c0b0410 2026-02-24T19:23:46.501 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.485+0000 7f9809ffb640 1 -- 10.20.193.14:0/3903005872 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f98100030b0 con 0x7f981c0b0410 2026-02-24T19:23:46.501 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.485+0000 7f9809ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:46.501 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.485+0000 7f9809ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:46.501 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.485+0000 7f9809ffb640 10 monclient(hunting): dump: 2026-02-24T19:23:46.501 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:46.501 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:46.501 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:46.501 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:46.501 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:46.502 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:46.502 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:46.502 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:46.502 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:46.502 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:46.502 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.486+0000 7f9809ffb640 1 -- 10.20.193.14:0/3903005872 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2112643966 0 0) 0x7f981c138660 con 0x7f981c1626a0 2026-02-24T19:23:46.502 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.486+0000 7f9809ffb640 1 -- 10.20.193.14:0/3903005872 >> v1:10.20.193.170:6789/0 conn(0x7f981c0b0410 legacy=0x7f981c1327a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:46.502 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.486+0000 7f9809ffb640 1 -- 10.20.193.14:0/3903005872 >> v1:10.20.193.44:6789/0 conn(0x7f981c058da0 legacy=0x7f981c1f9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:46.502 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.486+0000 7f9809ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:23:46.502 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.486+0000 7f9809ffb640 1 monclient: found mon.a 2026-02-24T19:23:46.502 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.486+0000 7f9809ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:46.502 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.486+0000 7f9809ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:46.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.486+0000 7f9809ffb640 1 -- 10.20.193.14:0/3903005872 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f981c138c20 con 0x7f981c1626a0 2026-02-24T19:23:46.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.486+0000 7f9809ffb640 10 monclient: _finish_auth 0 2026-02-24T19:23:46.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.486+0000 7f9809ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:23:46.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.486+0000 7f9809ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:46.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.486+0000 7f98238cd640 5 monclient: authenticate success, global_id 30720 2026-02-24T19:23:46.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.486+0000 7f98238cd640 10 monclient: _renew_subs 2026-02-24T19:23:46.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.486+0000 7f98238cd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:46.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.486+0000 7f98238cd640 1 -- 10.20.193.14:0/3903005872 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f981c138f00 con 0x7f981c1626a0 2026-02-24T19:23:46.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.486+0000 7f98238cd640 10 client.30720.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:46.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.486+0000 7f98238cd640 10 monclient: _renew_subs 2026-02-24T19:23:46.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.486+0000 7f98238cd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:46.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.486+0000 7f98238cd640 1 -- 10.20.193.14:0/3903005872 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f981c139700 con 0x7f981c1626a0 2026-02-24T19:23:46.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.486+0000 7f98238cd640 1 librados: init done 2026-02-24T19:23:46.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.487+0000 7f98238cd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:46.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.487+0000 7f98238cd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:46.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.487+0000 7f98238cd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:46.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.487+0000 7f98238cd640 1 -- 10.20.193.14:0/3903005872 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f981c163ee0 con 0x7f981c1626a0 2026-02-24T19:23:46.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.495+0000 7f9809ffb640 1 -- 10.20.193.14:0/3903005872 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9818003300 con 0x7f981c1626a0 2026-02-24T19:23:46.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.495+0000 7f9809ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:46.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.495+0000 7f9809ffb640 1 -- 10.20.193.14:0/3903005872 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f98180050a0 con 0x7f981c1626a0 2026-02-24T19:23:46.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.495+0000 7f9809ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:46.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.495+0000 7f9809ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:46.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.495+0000 7f980b7fe640 4 set_mon_vals no callback set 2026-02-24T19:23:46.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.495+0000 7f9809ffb640 10 monclient: dump: 2026-02-24T19:23:46.504 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:46.504 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:46.505 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:46.505 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:46.505 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:46.505 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:46.505 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:46.505 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:46.505 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:46.505 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:46.506 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.496+0000 7f9809ffb640 1 -- 10.20.193.14:0/3903005872 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f981801df10 con 0x7f981c1626a0 2026-02-24T19:23:46.506 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.496+0000 7f9821642640 10 monclient: get_auth_request con 0x7f97ec077e70 auth_method 0 2026-02-24T19:23:46.506 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.496+0000 7f9809ffb640 10 client.30720.objecter ms_handle_connect 0x7f97ec077e70 2026-02-24T19:23:46.506 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.497+0000 7f9809ffb640 1 -- 10.20.193.14:0/3903005872 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7f9818093420 con 0x7f981c1626a0 2026-02-24T19:23:46.507 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.497+0000 7f9809ffb640 10 client.30720.objecter ms_dispatch2 0x7f981c000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:23:46.507 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.497+0000 7f9809ffb640 3 client.30720.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:23:46.507 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.497+0000 7f9809ffb640 3 client.30720.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:23:46.507 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.498+0000 7f9809ffb640 20 client.30720.objecter dump_active .. 0 homeless 2026-02-24T19:23:46.585 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.583+0000 7f9809ffb640 1 -- 10.20.193.14:0/3903005872 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f981c163ee0 con 0x7f981c1626a0 2026-02-24T19:23:46.586 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.583+0000 7f9809ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:46.586 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.583+0000 7f9809ffb640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:23:46.688 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.686+0000 7f98238cd640 1 -- 10.20.193.14:0/3903005872 --> v1:10.20.193.14:6800/4014096310 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f981c0b6d40 con 0x7f97ec077e70 2026-02-24T19:23:46.690 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.687+0000 7f9809ffb640 1 -- 10.20.193.14:0/3903005872 <== mgr.4110 v1:10.20.193.14:6800/4014096310 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+125488 (unknown 2965378022 0 665972070) 0x7f981c0b6d40 con 0x7f97ec077e70 2026-02-24T19:23:46.691 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:23:46.692 INFO:teuthology.orchestra.run.trial014.stderr:dumped all 2026-02-24T19:23:46.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.688+0000 7f98238cd640 10 librados: watch_flush enter 2026-02-24T19:23:46.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.688+0000 7f98238cd640 10 librados: watch_flush exit 2026-02-24T19:23:46.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.688+0000 7f98238cd640 20 client.30720.objecter shutdown clearing up homeless session... 2026-02-24T19:23:46.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.688+0000 7f98238cd640 10 client.30720.objecter successfully canceled tick 2026-02-24T19:23:46.694 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.688+0000 7f98238cd640 1 -- 10.20.193.14:0/3903005872 >> v1:10.20.193.14:6800/4014096310 conn(0x7f97ec077e70 legacy=0x7f97ec098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:46.694 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.688+0000 7f98238cd640 10 monclient: shutdown 2026-02-24T19:23:46.694 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.688+0000 7f98238cd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:46.694 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.688+0000 7f98238cd640 1 -- 10.20.193.14:0/3903005872 >> v1:10.20.193.14:6789/0 conn(0x7f981c1626a0 legacy=0x7f981c1fc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:46.694 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.689+0000 7f98238cd640 1 -- 10.20.193.14:0/3903005872 shutdown_connections 2026-02-24T19:23:46.694 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.689+0000 7f98238cd640 1 -- 10.20.193.14:0/3903005872 >> 10.20.193.14:0/3903005872 conn(0x7f981c0b65f0 msgr2=0x7f981c055b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:46.694 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.689+0000 7f98238cd640 1 -- 10.20.193.14:0/3903005872 shutdown_connections 2026-02-24T19:23:46.694 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.689+0000 7f98238cd640 1 -- 10.20.193.14:0/3903005872 wait complete. 2026-02-24T19:23:46.694 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.689+0000 7f98238cd640 1 librados: shutdown 2026-02-24T19:23:46.700 INFO:teuthology.orchestra.run.trial014.stdout:{"pg_ready":true,"pg_map":{"version":553,"stamp":"2026-02-24T19:23:45.850679+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":56,"num_read_kb":47,"num_write":70,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":122,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":543760,"kb_used_data":112400,"kb_used_omap":24998,"kb_used_meta":406105,"kb_avail":1509405680,"statfs":{"total":1546188226560,"available":1545631416320,"internally_reserved":0,"allocated":115097600,"data_stored":72642430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25598683,"internal_metadata":415851813},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":137,"apply_latency_ms":137,"commit_latency_ns":137000000,"apply_latency_ns":137000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.765573"},"pg_stats":[{"pgid":"28.0","version":"0'0","reported_seq":645,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.282188+0000","last_change":"2026-02-24T19:18:04.433420+0000","last_active":"2026-02-24T19:23:44.282188+0000","last_peered":"2026-02-24T19:23:44.282188+0000","last_clean":"2026-02-24T19:23:44.282188+0000","last_became_active":"2026-02-24T19:18:04.430880+0000","last_became_peered":"2026-02-24T19:18:04.430880+0000","last_unstale":"2026-02-24T19:23:44.282188+0000","last_undegraded":"2026-02-24T19:23:44.282188+0000","last_fullsized":"2026-02-24T19:23:44.282188+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:12:09.744113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1","version":"36'11","reported_seq":670,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.237794+0000","last_change":"2026-02-24T19:18:04.578561+0000","last_active":"2026-02-24T19:23:44.237794+0000","last_peered":"2026-02-24T19:23:44.237794+0000","last_clean":"2026-02-24T19:23:44.237794+0000","last_became_active":"2026-02-24T19:18:04.576194+0000","last_became_peered":"2026-02-24T19:18:04.576194+0000","last_unstale":"2026-02-24T19:23:44.237794+0000","last_undegraded":"2026-02-24T19:23:44.237794+0000","last_fullsized":"2026-02-24T19:23:44.237794+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:49:29.287956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,4],"acting":[12,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":643,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.300938+0000","last_change":"2026-02-24T19:18:03.963505+0000","last_active":"2026-02-24T19:23:44.300938+0000","last_peered":"2026-02-24T19:23:44.300938+0000","last_clean":"2026-02-24T19:23:44.300938+0000","last_became_active":"2026-02-24T19:18:03.958691+0000","last_became_peered":"2026-02-24T19:18:03.958691+0000","last_unstale":"2026-02-24T19:23:44.300938+0000","last_undegraded":"2026-02-24T19:23:44.300938+0000","last_fullsized":"2026-02-24T19:23:44.300938+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:23:22.822755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":645,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.288851+0000","last_change":"2026-02-24T19:18:04.348647+0000","last_active":"2026-02-24T19:23:44.288851+0000","last_peered":"2026-02-24T19:23:44.288851+0000","last_clean":"2026-02-24T19:23:44.288851+0000","last_became_active":"2026-02-24T19:18:04.335655+0000","last_became_peered":"2026-02-24T19:18:04.335655+0000","last_unstale":"2026-02-24T19:23:44.288851+0000","last_undegraded":"2026-02-24T19:23:44.288851+0000","last_fullsized":"2026-02-24T19:23:44.288851+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:38:16.688089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,14],"acting":[5,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":647,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.295062+0000","last_change":"2026-02-24T19:18:05.017788+0000","last_active":"2026-02-24T19:23:44.295062+0000","last_peered":"2026-02-24T19:23:44.295062+0000","last_clean":"2026-02-24T19:23:44.295062+0000","last_became_active":"2026-02-24T19:18:05.015377+0000","last_became_peered":"2026-02-24T19:18:05.015377+0000","last_unstale":"2026-02-24T19:23:44.295062+0000","last_undegraded":"2026-02-24T19:23:44.295062+0000","last_fullsized":"2026-02-24T19:23:44.295062+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:40:20.318316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,10],"acting":[14,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":640,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.246499+0000","last_change":"2026-02-24T19:18:05.237620+0000","last_active":"2026-02-24T19:23:44.246499+0000","last_peered":"2026-02-24T19:23:44.246499+0000","last_clean":"2026-02-24T19:23:44.246499+0000","last_became_active":"2026-02-24T19:18:05.234574+0000","last_became_peered":"2026-02-24T19:18:05.234574+0000","last_unstale":"2026-02-24T19:23:44.246499+0000","last_undegraded":"2026-02-24T19:23:44.246499+0000","last_fullsized":"2026-02-24T19:23:44.246499+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:31:23.754288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":643,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.311726+0000","last_change":"2026-02-24T19:18:03.992879+0000","last_active":"2026-02-24T19:23:44.311726+0000","last_peered":"2026-02-24T19:23:44.311726+0000","last_clean":"2026-02-24T19:23:44.311726+0000","last_became_active":"2026-02-24T19:18:03.990285+0000","last_became_peered":"2026-02-24T19:18:03.990285+0000","last_unstale":"2026-02-24T19:23:44.311726+0000","last_undegraded":"2026-02-24T19:23:44.311726+0000","last_fullsized":"2026-02-24T19:23:44.311726+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:13:12.273444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":647,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.324063+0000","last_change":"2026-02-24T19:18:03.425674+0000","last_active":"2026-02-24T19:23:44.324063+0000","last_peered":"2026-02-24T19:23:44.324063+0000","last_clean":"2026-02-24T19:23:44.324063+0000","last_became_active":"2026-02-24T19:18:03.420675+0000","last_became_peered":"2026-02-24T19:18:03.420675+0000","last_unstale":"2026-02-24T19:23:44.324063+0000","last_undegraded":"2026-02-24T19:23:44.324063+0000","last_fullsized":"2026-02-24T19:23:44.324063+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:20:11.350436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,6],"acting":[15,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":643,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.306211+0000","last_change":"2026-02-24T19:18:03.255478+0000","last_active":"2026-02-24T19:23:44.306211+0000","last_peered":"2026-02-24T19:23:44.306211+0000","last_clean":"2026-02-24T19:23:44.306211+0000","last_became_active":"2026-02-24T19:18:03.252679+0000","last_became_peered":"2026-02-24T19:18:03.252679+0000","last_unstale":"2026-02-24T19:23:44.306211+0000","last_undegraded":"2026-02-24T19:23:44.306211+0000","last_fullsized":"2026-02-24T19:23:44.306211+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:16:26.096508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,13],"acting":[4,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":644,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.242565+0000","last_change":"2026-02-24T19:18:04.558252+0000","last_active":"2026-02-24T19:23:44.242565+0000","last_peered":"2026-02-24T19:23:44.242565+0000","last_clean":"2026-02-24T19:23:44.242565+0000","last_became_active":"2026-02-24T19:18:04.552851+0000","last_became_peered":"2026-02-24T19:18:04.552851+0000","last_unstale":"2026-02-24T19:23:44.242565+0000","last_undegraded":"2026-02-24T19:23:44.242565+0000","last_fullsized":"2026-02-24T19:23:44.242565+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:11:05.672582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,13],"acting":[12,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":643,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.291165+0000","last_change":"2026-02-24T19:18:03.509349+0000","last_active":"2026-02-24T19:23:44.291165+0000","last_peered":"2026-02-24T19:23:44.291165+0000","last_clean":"2026-02-24T19:23:44.291165+0000","last_became_active":"2026-02-24T19:18:03.507201+0000","last_became_peered":"2026-02-24T19:18:03.507201+0000","last_unstale":"2026-02-24T19:23:44.291165+0000","last_undegraded":"2026-02-24T19:23:44.291165+0000","last_fullsized":"2026-02-24T19:23:44.291165+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:24:43.636938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,13],"acting":[8,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":646,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.291806+0000","last_change":"2026-02-24T19:18:03.452428+0000","last_active":"2026-02-24T19:23:44.291806+0000","last_peered":"2026-02-24T19:23:44.291806+0000","last_clean":"2026-02-24T19:23:44.291806+0000","last_became_active":"2026-02-24T19:18:03.433618+0000","last_became_peered":"2026-02-24T19:18:03.433618+0000","last_unstale":"2026-02-24T19:23:44.291806+0000","last_undegraded":"2026-02-24T19:23:44.291806+0000","last_fullsized":"2026-02-24T19:23:44.291806+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:42:16.990633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":641,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-24T19:23:43.111204+0000","last_change":"2026-02-24T19:18:04.459024+0000","last_active":"2026-02-24T19:23:43.111204+0000","last_peered":"2026-02-24T19:23:43.111204+0000","last_clean":"2026-02-24T19:23:43.111204+0000","last_became_active":"2026-02-24T19:18:04.456892+0000","last_became_peered":"2026-02-24T19:18:04.456892+0000","last_unstale":"2026-02-24T19:23:43.111204+0000","last_undegraded":"2026-02-24T19:23:43.111204+0000","last_fullsized":"2026-02-24T19:23:43.111204+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:33:41.389587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":665,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.315349+0000","last_change":"2026-02-24T19:17:26.965063+0000","last_active":"2026-02-24T19:23:44.315349+0000","last_peered":"2026-02-24T19:23:44.315349+0000","last_clean":"2026-02-24T19:23:44.315349+0000","last_became_active":"2026-02-24T19:17:25.636961+0000","last_became_peered":"2026-02-24T19:17:25.636961+0000","last_unstale":"2026-02-24T19:23:44.315349+0000","last_undegraded":"2026-02-24T19:23:44.315349+0000","last_fullsized":"2026-02-24T19:23:44.315349+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:42:49.532270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.076701065999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,0],"acting":[15,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":645,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.289322+0000","last_change":"2026-02-24T19:18:04.060070+0000","last_active":"2026-02-24T19:23:44.289322+0000","last_peered":"2026-02-24T19:23:44.289322+0000","last_clean":"2026-02-24T19:23:44.289322+0000","last_became_active":"2026-02-24T19:18:04.057738+0000","last_became_peered":"2026-02-24T19:18:04.057738+0000","last_unstale":"2026-02-24T19:23:44.289322+0000","last_undegraded":"2026-02-24T19:23:44.289322+0000","last_fullsized":"2026-02-24T19:23:44.289322+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:30:15.992686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":665,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.298064+0000","last_change":"2026-02-24T19:17:27.096285+0000","last_active":"2026-02-24T19:23:44.298064+0000","last_peered":"2026-02-24T19:23:44.298064+0000","last_clean":"2026-02-24T19:23:44.298064+0000","last_became_active":"2026-02-24T19:17:24.847985+0000","last_became_peered":"2026-02-24T19:17:24.847985+0000","last_unstale":"2026-02-24T19:23:44.298064+0000","last_undegraded":"2026-02-24T19:23:44.298064+0000","last_fullsized":"2026-02-24T19:23:44.298064+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:50:14.116609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032556177999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,7],"acting":[14,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":644,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.252410+0000","last_change":"2026-02-24T19:18:04.733866+0000","last_active":"2026-02-24T19:23:44.252410+0000","last_peered":"2026-02-24T19:23:44.252410+0000","last_clean":"2026-02-24T19:23:44.252410+0000","last_became_active":"2026-02-24T19:18:04.731637+0000","last_became_peered":"2026-02-24T19:18:04.731637+0000","last_unstale":"2026-02-24T19:23:44.252410+0000","last_undegraded":"2026-02-24T19:23:44.252410+0000","last_fullsized":"2026-02-24T19:23:44.252410+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:06:08.078529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,14],"acting":[12,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":659,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.311909+0000","last_change":"2026-02-24T19:17:26.898110+0000","last_active":"2026-02-24T19:23:44.311909+0000","last_peered":"2026-02-24T19:23:44.311909+0000","last_clean":"2026-02-24T19:23:44.311909+0000","last_became_active":"2026-02-24T19:17:24.821876+0000","last_became_peered":"2026-02-24T19:17:24.821876+0000","last_unstale":"2026-02-24T19:23:44.311909+0000","last_undegraded":"2026-02-24T19:23:44.311909+0000","last_fullsized":"2026-02-24T19:23:44.311909+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:00:08.087971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.044624814999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":644,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.292944+0000","last_change":"2026-02-24T19:18:04.721916+0000","last_active":"2026-02-24T19:23:44.292944+0000","last_peered":"2026-02-24T19:23:44.292944+0000","last_clean":"2026-02-24T19:23:44.292944+0000","last_became_active":"2026-02-24T19:18:04.719330+0000","last_became_peered":"2026-02-24T19:18:04.719330+0000","last_unstale":"2026-02-24T19:23:44.292944+0000","last_undegraded":"2026-02-24T19:23:44.292944+0000","last_fullsized":"2026-02-24T19:23:44.292944+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:26:21.901912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,6],"acting":[10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":659,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.309461+0000","last_change":"2026-02-24T19:17:26.891122+0000","last_active":"2026-02-24T19:23:44.309461+0000","last_peered":"2026-02-24T19:23:44.309461+0000","last_clean":"2026-02-24T19:23:44.309461+0000","last_became_active":"2026-02-24T19:17:23.991081+0000","last_became_peered":"2026-02-24T19:17:23.991081+0000","last_unstale":"2026-02-24T19:23:44.309461+0000","last_undegraded":"2026-02-24T19:23:44.309461+0000","last_fullsized":"2026-02-24T19:23:44.309461+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:10:30.161691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.042145786999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":647,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.294330+0000","last_change":"2026-02-24T19:18:03.657924+0000","last_active":"2026-02-24T19:23:44.294330+0000","last_peered":"2026-02-24T19:23:44.294330+0000","last_clean":"2026-02-24T19:23:44.294330+0000","last_became_active":"2026-02-24T19:18:03.655492+0000","last_became_peered":"2026-02-24T19:18:03.655492+0000","last_unstale":"2026-02-24T19:23:44.294330+0000","last_undegraded":"2026-02-24T19:23:44.294330+0000","last_fullsized":"2026-02-24T19:23:44.294330+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:07:13.620976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,7],"acting":[14,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.2","version":"31'2","reported_seq":668,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.292709+0000","last_change":"2026-02-24T19:17:26.948217+0000","last_active":"2026-02-24T19:23:44.292709+0000","last_peered":"2026-02-24T19:23:44.292709+0000","last_clean":"2026-02-24T19:23:44.292709+0000","last_became_active":"2026-02-24T19:17:25.045520+0000","last_became_peered":"2026-02-24T19:17:25.045520+0000","last_unstale":"2026-02-24T19:23:44.292709+0000","last_undegraded":"2026-02-24T19:23:44.292709+0000","last_fullsized":"2026-02-24T19:23:44.292709+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:32:11.642822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.069045234999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,10],"acting":[15,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":643,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.313190+0000","last_change":"2026-02-24T19:18:03.350390+0000","last_active":"2026-02-24T19:23:44.313190+0000","last_peered":"2026-02-24T19:23:44.313190+0000","last_clean":"2026-02-24T19:23:44.313190+0000","last_became_active":"2026-02-24T19:18:03.348322+0000","last_became_peered":"2026-02-24T19:18:03.348322+0000","last_unstale":"2026-02-24T19:23:44.313190+0000","last_undegraded":"2026-02-24T19:23:44.313190+0000","last_fullsized":"2026-02-24T19:23:44.313190+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:36:08.115800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":665,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.296510+0000","last_change":"2026-02-24T19:17:27.119087+0000","last_active":"2026-02-24T19:23:44.296510+0000","last_peered":"2026-02-24T19:23:44.296510+0000","last_clean":"2026-02-24T19:23:44.296510+0000","last_became_active":"2026-02-24T19:17:24.834035+0000","last_became_peered":"2026-02-24T19:17:24.834035+0000","last_unstale":"2026-02-24T19:23:44.296510+0000","last_undegraded":"2026-02-24T19:23:44.296510+0000","last_fullsized":"2026-02-24T19:23:44.296510+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:29:27.582878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036343514,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":645,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.393133+0000","last_change":"2026-02-24T19:18:03.457431+0000","last_active":"2026-02-24T19:23:44.393133+0000","last_peered":"2026-02-24T19:23:44.393133+0000","last_clean":"2026-02-24T19:23:44.393133+0000","last_became_active":"2026-02-24T19:18:03.450995+0000","last_became_peered":"2026-02-24T19:18:03.450995+0000","last_unstale":"2026-02-24T19:23:44.393133+0000","last_undegraded":"2026-02-24T19:23:44.393133+0000","last_fullsized":"2026-02-24T19:23:44.393133+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:07:57.911949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,2],"acting":[13,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":665,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.387915+0000","last_change":"2026-02-24T19:17:27.099921+0000","last_active":"2026-02-24T19:23:44.387915+0000","last_peered":"2026-02-24T19:23:44.387915+0000","last_clean":"2026-02-24T19:23:44.387915+0000","last_became_active":"2026-02-24T19:17:24.560197+0000","last_became_peered":"2026-02-24T19:17:24.560197+0000","last_unstale":"2026-02-24T19:23:44.387915+0000","last_undegraded":"2026-02-24T19:23:44.387915+0000","last_fullsized":"2026-02-24T19:23:44.387915+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:28:40.195905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038521284000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":643,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.303578+0000","last_change":"2026-02-24T19:18:04.002274+0000","last_active":"2026-02-24T19:23:44.303578+0000","last_peered":"2026-02-24T19:23:44.303578+0000","last_clean":"2026-02-24T19:23:44.303578+0000","last_became_active":"2026-02-24T19:18:03.998754+0000","last_became_peered":"2026-02-24T19:18:03.998754+0000","last_unstale":"2026-02-24T19:23:44.303578+0000","last_undegraded":"2026-02-24T19:23:44.303578+0000","last_fullsized":"2026-02-24T19:23:44.303578+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:03:56.409494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"29'1","reported_seq":667,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.296573+0000","last_change":"2026-02-24T19:17:26.955767+0000","last_active":"2026-02-24T19:23:44.296573+0000","last_peered":"2026-02-24T19:23:44.296573+0000","last_clean":"2026-02-24T19:23:44.296573+0000","last_became_active":"2026-02-24T19:17:24.838239+0000","last_became_peered":"2026-02-24T19:17:24.838239+0000","last_unstale":"2026-02-24T19:23:44.296573+0000","last_undegraded":"2026-02-24T19:23:44.296573+0000","last_fullsized":"2026-02-24T19:23:44.296573+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:54:28.324309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070474251000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"1.0","version":"29'32","reported_seq":706,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.235139+0000","last_change":"2026-02-24T19:17:18.365341+0000","last_active":"2026-02-24T19:23:44.235139+0000","last_peered":"2026-02-24T19:23:44.235139+0000","last_clean":"2026-02-24T19:23:44.235139+0000","last_became_active":"2026-02-24T19:17:18.351934+0000","last_became_peered":"2026-02-24T19:17:18.351934+0000","last_unstale":"2026-02-24T19:23:44.235139+0000","last_undegraded":"2026-02-24T19:23:44.235139+0000","last_fullsized":"2026-02-24T19:23:44.235139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:15.908436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:15.908436+0000","last_clean_scrub_stamp":"2026-02-24T19:17:15.908436+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:23:17.271649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":641,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-24T19:23:43.113897+0000","last_change":"2026-02-24T19:18:03.588627+0000","last_active":"2026-02-24T19:23:43.113897+0000","last_peered":"2026-02-24T19:23:43.113897+0000","last_clean":"2026-02-24T19:23:43.113897+0000","last_became_active":"2026-02-24T19:18:03.586391+0000","last_became_peered":"2026-02-24T19:18:03.586391+0000","last_unstale":"2026-02-24T19:23:43.113897+0000","last_undegraded":"2026-02-24T19:23:43.113897+0000","last_fullsized":"2026-02-24T19:23:43.113897+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:55:35.275201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":644,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.255366+0000","last_change":"2026-02-24T19:18:04.537088+0000","last_active":"2026-02-24T19:23:44.255366+0000","last_peered":"2026-02-24T19:23:44.255366+0000","last_clean":"2026-02-24T19:23:44.255366+0000","last_became_active":"2026-02-24T19:18:04.535003+0000","last_became_peered":"2026-02-24T19:18:04.535003+0000","last_unstale":"2026-02-24T19:23:44.255366+0000","last_undegraded":"2026-02-24T19:23:44.255366+0000","last_fullsized":"2026-02-24T19:23:44.255366+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T07:11:21.119347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,1],"acting":[12,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":643,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.302787+0000","last_change":"2026-02-24T19:18:03.817017+0000","last_active":"2026-02-24T19:23:44.302787+0000","last_peered":"2026-02-24T19:23:44.302787+0000","last_clean":"2026-02-24T19:23:44.302787+0000","last_became_active":"2026-02-24T19:18:03.813130+0000","last_became_peered":"2026-02-24T19:18:03.813130+0000","last_unstale":"2026-02-24T19:23:44.302787+0000","last_undegraded":"2026-02-24T19:23:44.302787+0000","last_fullsized":"2026-02-24T19:23:44.302787+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:19:34.966492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9],"acting":[0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":641,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-24T19:23:43.109749+0000","last_change":"2026-02-24T19:18:04.181930+0000","last_active":"2026-02-24T19:23:43.109749+0000","last_peered":"2026-02-24T19:23:43.109749+0000","last_clean":"2026-02-24T19:23:43.109749+0000","last_became_active":"2026-02-24T19:18:04.175135+0000","last_became_peered":"2026-02-24T19:18:04.175135+0000","last_unstale":"2026-02-24T19:23:43.109749+0000","last_undegraded":"2026-02-24T19:23:43.109749+0000","last_fullsized":"2026-02-24T19:23:43.109749+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:56:14.603348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":642,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.299095+0000","last_change":"2026-02-24T19:18:03.687215+0000","last_active":"2026-02-24T19:23:44.299095+0000","last_peered":"2026-02-24T19:23:44.299095+0000","last_clean":"2026-02-24T19:23:44.299095+0000","last_became_active":"2026-02-24T19:18:03.684548+0000","last_became_peered":"2026-02-24T19:18:03.684548+0000","last_unstale":"2026-02-24T19:23:44.299095+0000","last_undegraded":"2026-02-24T19:23:44.299095+0000","last_fullsized":"2026-02-24T19:23:44.299095+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:49:54.756086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,13],"acting":[7,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":642,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.296515+0000","last_change":"2026-02-24T19:18:03.881093+0000","last_active":"2026-02-24T19:23:44.296515+0000","last_peered":"2026-02-24T19:23:44.296515+0000","last_clean":"2026-02-24T19:23:44.296515+0000","last_became_active":"2026-02-24T19:18:03.879055+0000","last_became_peered":"2026-02-24T19:18:03.879055+0000","last_unstale":"2026-02-24T19:23:44.296515+0000","last_undegraded":"2026-02-24T19:23:44.296515+0000","last_fullsized":"2026-02-24T19:23:44.296515+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:01:48.589688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,12],"acting":[7,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":643,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.304957+0000","last_change":"2026-02-24T19:18:03.674911+0000","last_active":"2026-02-24T19:23:44.304957+0000","last_peered":"2026-02-24T19:23:44.304957+0000","last_clean":"2026-02-24T19:23:44.304957+0000","last_became_active":"2026-02-24T19:18:03.672857+0000","last_became_peered":"2026-02-24T19:18:03.672857+0000","last_unstale":"2026-02-24T19:23:44.304957+0000","last_undegraded":"2026-02-24T19:23:44.304957+0000","last_fullsized":"2026-02-24T19:23:44.304957+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:10:42.261455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":644,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.285157+0000","last_change":"2026-02-24T19:18:05.058931+0000","last_active":"2026-02-24T19:23:44.285157+0000","last_peered":"2026-02-24T19:23:44.285157+0000","last_clean":"2026-02-24T19:23:44.285157+0000","last_became_active":"2026-02-24T19:18:05.049751+0000","last_became_peered":"2026-02-24T19:18:05.049751+0000","last_unstale":"2026-02-24T19:23:44.285157+0000","last_undegraded":"2026-02-24T19:23:44.285157+0000","last_fullsized":"2026-02-24T19:23:44.285157+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:06:49.580678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":641,"reported_epoch":351,"state":"active+clean","last_fresh":"2026-02-24T19:23:43.114731+0000","last_change":"2026-02-24T19:18:03.634334+0000","last_active":"2026-02-24T19:23:43.114731+0000","last_peered":"2026-02-24T19:23:43.114731+0000","last_clean":"2026-02-24T19:23:43.114731+0000","last_became_active":"2026-02-24T19:18:03.612739+0000","last_became_peered":"2026-02-24T19:18:03.612739+0000","last_unstale":"2026-02-24T19:23:43.114731+0000","last_undegraded":"2026-02-24T19:23:43.114731+0000","last_fullsized":"2026-02-24T19:23:43.114731+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:01:31.700321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":647,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.314295+0000","last_change":"2026-02-24T19:18:03.344644+0000","last_active":"2026-02-24T19:23:44.314295+0000","last_peered":"2026-02-24T19:23:44.314295+0000","last_clean":"2026-02-24T19:23:44.314295+0000","last_became_active":"2026-02-24T19:18:03.341693+0000","last_became_peered":"2026-02-24T19:18:03.341693+0000","last_unstale":"2026-02-24T19:23:44.314295+0000","last_undegraded":"2026-02-24T19:23:44.314295+0000","last_fullsized":"2026-02-24T19:23:44.314295+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:18:49.303930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,4],"acting":[15,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":642,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.301883+0000","last_change":"2026-02-24T19:18:03.403726+0000","last_active":"2026-02-24T19:23:44.301883+0000","last_peered":"2026-02-24T19:23:44.301883+0000","last_clean":"2026-02-24T19:23:44.301883+0000","last_became_active":"2026-02-24T19:18:03.401642+0000","last_became_peered":"2026-02-24T19:18:03.401642+0000","last_unstale":"2026-02-24T19:23:44.301883+0000","last_undegraded":"2026-02-24T19:23:44.301883+0000","last_fullsized":"2026-02-24T19:23:44.301883+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:18:07.075632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,15],"acting":[7,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":640,"reported_epoch":352,"state":"active+clean","last_fresh":"2026-02-24T19:23:44.242401+0000","last_change":"2026-02-24T19:18:03.708894+0000","last_active":"2026-02-24T19:23:44.242401+0000","last_peered":"2026-02-24T19:23:44.242401+0000","last_clean":"2026-02-24T19:23:44.242401+0000","last_became_active":"2026-02-24T19:18:03.706699+0000","last_became_peered":"2026-02-24T19:18:03.706699+0000","last_unstale":"2026-02-24T19:23:44.242401+0000","last_undegraded":"2026-02-24T19:23:44.242401+0000","last_fullsized":"2026-02-24T19:23:44.242401+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:17:30.885035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9],"acting":[2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":16}],"osd_stats":[{"osd":15,"up_from":21,"seq":90194313296,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33932,"kb_used_data":6972,"kb_used_omap":215,"kb_used_meta":26728,"kb_avail":94337908,"statfs":{"total":96636764160,"available":96602017792,"internally_reserved":0,"allocated":7139328,"data_stored":4486209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":220689,"internal_metadata":27369967},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":14,"up_from":21,"seq":90194313296,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33944,"kb_used_data":6984,"kb_used_omap":217,"kb_used_meta":26726,"kb_avail":94337896,"statfs":{"total":96636764160,"available":96602005504,"internally_reserved":0,"allocated":7151616,"data_stored":4495856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":222600,"internal_metadata":27368056},"hb_peers":[0,1,2,3,5,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313296,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33928,"kb_used_data":6968,"kb_used_omap":220,"kb_used_meta":26723,"kb_avail":94337912,"statfs":{"total":96636764160,"available":96602021888,"internally_reserved":0,"allocated":7135232,"data_stored":4486190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":225674,"internal_metadata":27364982},"hb_peers":[0,1,2,3,4,6,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313296,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33944,"kb_used_data":6984,"kb_used_omap":4987,"kb_used_meta":21956,"kb_avail":94337896,"statfs":{"total":96636764160,"available":96602005504,"internally_reserved":0,"allocated":7151616,"data_stored":4495856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5106839,"internal_metadata":22483817},"hb_peers":[1,2,3,4,6,7,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":21,"seq":90194313296,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33944,"kb_used_data":6984,"kb_used_omap":214,"kb_used_meta":26729,"kb_avail":94337896,"statfs":{"total":96636764160,"available":96602005504,"internally_reserved":0,"allocated":7151616,"data_stored":4495856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":219418,"internal_metadata":27371238},"hb_peers":[0,2,3,5,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313296,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34336,"kb_used_data":7376,"kb_used_omap":215,"kb_used_meta":26728,"kb_avail":94337504,"statfs":{"total":96636764160,"available":96601604096,"internally_reserved":0,"allocated":7553024,"data_stored":4893696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":220337,"internal_metadata":27370319},"hb_peers":[0,1,3,4,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313297,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33944,"kb_used_data":6984,"kb_used_omap":3017,"kb_used_meta":23926,"kb_avail":94337896,"statfs":{"total":96636764160,"available":96602005504,"internally_reserved":0,"allocated":7151616,"data_stored":4495856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3090288,"internal_metadata":24500368},"hb_peers":[1,2,4,5,6,7,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313296,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33948,"kb_used_data":6988,"kb_used_omap":3009,"kb_used_meta":23934,"kb_avail":94337892,"statfs":{"total":96636764160,"available":96602001408,"internally_reserved":0,"allocated":7155712,"data_stored":4495861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3081227,"internal_metadata":24509429},"hb_peers":[0,1,2,3,5,6,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313296,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33928,"kb_used_data":6968,"kb_used_omap":214,"kb_used_meta":26729,"kb_avail":94337912,"statfs":{"total":96636764160,"available":96602021888,"internally_reserved":0,"allocated":7135232,"data_stored":4486190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":220104,"internal_metadata":27370552},"hb_peers":[0,2,3,4,6,7,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":21,"seq":90194313297,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33928,"kb_used_data":6968,"kb_used_omap":3010,"kb_used_meta":23933,"kb_avail":94337912,"statfs":{"total":96636764160,"available":96602021888,"internally_reserved":0,"allocated":7135232,"data_stored":4486190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3082635,"internal_metadata":24508021},"hb_peers":[0,1,2,3,4,5,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[]},{"osd":7,"up_from":21,"seq":90194313297,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34320,"kb_used_data":7360,"kb_used_omap":214,"kb_used_meta":26729,"kb_avail":94337520,"statfs":{"total":96636764160,"available":96601620480,"internally_reserved":0,"allocated":7536640,"data_stored":4884030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":219803,"internal_metadata":27370853},"hb_peers":[0,2,3,4,5,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313296,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33928,"kb_used_data":6968,"kb_used_omap":3023,"kb_used_meta":23920,"kb_avail":94337912,"statfs":{"total":96636764160,"available":96602021888,"internally_reserved":0,"allocated":7135232,"data_stored":4486190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3095598,"internal_metadata":24495058},"hb_peers":[1,3,4,5,6,7,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313297,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33928,"kb_used_data":6968,"kb_used_omap":3022,"kb_used_meta":23921,"kb_avail":94337912,"statfs":{"total":96636764160,"available":96602021888,"internally_reserved":0,"allocated":7135232,"data_stored":4486190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3095242,"internal_metadata":24495414},"hb_peers":[0,1,3,4,5,6,7,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":10,"up_from":21,"seq":90194313296,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33948,"kb_used_data":6988,"kb_used_omap":175,"kb_used_meta":26768,"kb_avail":94337892,"statfs":{"total":96636764160,"available":96602001408,"internally_reserved":0,"allocated":7155712,"data_stored":4495875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179931,"internal_metadata":27410725},"hb_peers":[0,1,2,4,5,6,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313296,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33928,"kb_used_data":6968,"kb_used_omap":3024,"kb_used_meta":23919,"kb_avail":94337912,"statfs":{"total":96636764160,"available":96602021888,"internally_reserved":0,"allocated":7135232,"data_stored":4486190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3096829,"internal_metadata":24493827},"hb_peers":[0,1,2,3,5,6,7,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313296,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33932,"kb_used_data":6972,"kb_used_omap":216,"kb_used_meta":26727,"kb_avail":94337908,"statfs":{"total":96636764160,"available":96602017792,"internally_reserved":0,"allocated":7139328,"data_stored":4486195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":221469,"internal_metadata":27369187},"hb_peers":[0,1,2,3,4,5,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T19:23:46.703 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-24T19:23:46.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.768+0000 7f4931a16640 10 monclient: get_monmap_and_config 2026-02-24T19:23:46.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.768+0000 7f4931a16640 10 monclient: build_initial_monmap 2026-02-24T19:23:46.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.768+0000 7f4931a16640 10 monclient: monmap: 2026-02-24T19:23:46.771 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:46.771 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:46.771 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:23:46.770137+0000 2026-02-24T19:23:46.771 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:23:46.770137+0000 2026-02-24T19:23:46.771 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:46.772 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:46.772 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:46.772 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:46.772 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:46.772 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:46.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.769+0000 7f4931a16640 1 Processor -- start 2026-02-24T19:23:46.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.769+0000 7f4931a16640 1 -- start start 2026-02-24T19:23:46.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.769+0000 7f4931a16640 10 monclient: init 2026-02-24T19:23:46.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.769+0000 7f4931a16640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:46.774 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.769+0000 7f4931a16640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:23:46.774 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.769+0000 7f4931a16640 10 monclient(hunting): picked mon.noname-a con 0x7f492c055bf0 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:46.774 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.769+0000 7f4931a16640 10 monclient(hunting): picked mon.noname-b con 0x7f492c164040 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:46.774 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.769+0000 7f4931a16640 10 monclient(hunting): picked mon.noname-c con 0x7f492c055fc0 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:46.774 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.769+0000 7f4931a16640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f492c0b3a00 con 0x7f492c055bf0 2026-02-24T19:23:46.774 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.769+0000 7f4931a16640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f492c0b3c70 con 0x7f492c164040 2026-02-24T19:23:46.774 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.769+0000 7f4931a16640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f492c0b3f50 con 0x7f492c055fc0 2026-02-24T19:23:46.774 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.769+0000 7f4931a16640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:46.774 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.769+0000 7f4931a16640 10 monclient(hunting): authenticate will time out at 4001.451689s 2026-02-24T19:23:46.774 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.770+0000 7f492affd640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f492c055bf0 0x7f492c0b1f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:48970/0 (socket says 10.20.193.14:48970) 2026-02-24T19:23:46.774 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.770+0000 7f492affd640 1 -- 10.20.193.14:0/1185394512 learned_addr learned my addr 10.20.193.14:0/1185394512 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:46.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.771+0000 7f4929ffb640 1 -- 10.20.193.14:0/1185394512 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1015646802 0 0) 0x7f492c0b3f50 con 0x7f492c055fc0 2026-02-24T19:23:46.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.771+0000 7f4929ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:23:46.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.771+0000 7f4929ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:46.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.771+0000 7f4929ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:46.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.771+0000 7f4929ffb640 10 monclient(hunting): my global_id is 28682 2026-02-24T19:23:46.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.771+0000 7f4929ffb640 1 -- 10.20.193.14:0/1185394512 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4918003610 con 0x7f492c055fc0 2026-02-24T19:23:46.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.771+0000 7f4929ffb640 1 -- 10.20.193.14:0/1185394512 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 418738526 0 0) 0x7f492c0b3a00 con 0x7f492c055bf0 2026-02-24T19:23:46.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.771+0000 7f4929ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:23:46.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.771+0000 7f4929ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:46.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.771+0000 7f4929ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:46.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.771+0000 7f4929ffb640 10 monclient(hunting): my global_id is 30723 2026-02-24T19:23:46.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.771+0000 7f4929ffb640 1 -- 10.20.193.14:0/1185394512 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f492c0b3f50 con 0x7f492c055bf0 2026-02-24T19:23:46.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.771+0000 7f4929ffb640 1 -- 10.20.193.14:0/1185394512 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3788474642 0 0) 0x7f492c0b3c70 con 0x7f492c164040 2026-02-24T19:23:46.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.771+0000 7f4929ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:23:46.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.771+0000 7f4929ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:46.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.771+0000 7f4929ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:46.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.771+0000 7f4929ffb640 10 monclient(hunting): my global_id is 29044 2026-02-24T19:23:46.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.771+0000 7f4929ffb640 1 -- 10.20.193.14:0/1185394512 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f492c0b3a00 con 0x7f492c164040 2026-02-24T19:23:46.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.773+0000 7f4929ffb640 1 -- 10.20.193.14:0/1185394512 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 495479668 0 0) 0x7f4918003610 con 0x7f492c055fc0 2026-02-24T19:23:46.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.773+0000 7f4929ffb640 1 -- 10.20.193.14:0/1185394512 >> v1:10.20.193.44:6789/0 conn(0x7f492c164040 legacy=0x7f492c056690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:46.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.773+0000 7f4929ffb640 1 -- 10.20.193.14:0/1185394512 >> v1:10.20.193.14:6789/0 conn(0x7f492c055bf0 legacy=0x7f492c0b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:46.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.773+0000 7f4929ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:23:46.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.773+0000 7f4929ffb640 1 monclient: found mon.noname-c 2026-02-24T19:23:46.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.773+0000 7f4929ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:46.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.773+0000 7f4929ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.170:6789/0 2026-02-24T19:23:46.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.773+0000 7f4929ffb640 1 -- 10.20.193.14:0/1185394512 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f492c0b4230 con 0x7f492c055fc0 2026-02-24T19:23:46.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.773+0000 7f4929ffb640 10 monclient: _finish_auth 0 2026-02-24T19:23:46.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.773+0000 7f4929ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:23:46.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.773+0000 7f4929ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:46.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.773+0000 7f4929ffb640 1 -- 10.20.193.14:0/1185394512 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f491c003170 con 0x7f492c055fc0 2026-02-24T19:23:46.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.773+0000 7f4929ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:46.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.773+0000 7f4929ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:23:46.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.773+0000 7f4929ffb640 10 monclient: dump: 2026-02-24T19:23:46.783 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:46.783 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:46.783 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:46.783 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:46.783 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:46.783 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:46.783 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:46.783 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:46.783 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:46.783 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:46.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.773+0000 7f4931a16640 5 monclient: authenticate success, global_id 28682 2026-02-24T19:23:46.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.773+0000 7f4931a16640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:46.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.774+0000 7f4929ffb640 1 -- 10.20.193.14:0/1185394512 <== mon.2 v1:10.20.193.170:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f491c003340 con 0x7f492c055fc0 2026-02-24T19:23:46.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.774+0000 7f4929ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:46.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.774+0000 7f4929ffb640 1 -- 10.20.193.14:0/1185394512 <== mon.2 v1:10.20.193.170:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f491c003780 con 0x7f492c055fc0 2026-02-24T19:23:46.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.774+0000 7f4929ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:46.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.774+0000 7f4929ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:46.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.774+0000 7f4929ffb640 10 monclient: dump: 2026-02-24T19:23:46.784 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:46.784 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:46.784 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:46.784 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:46.784 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:46.784 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:46.785 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:46.785 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:46.785 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:46.785 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:46.785 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.774+0000 7f4931a16640 10 monclient: get_monmap_and_config success 2026-02-24T19:23:46.785 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.774+0000 7f4931a16640 4 set_mon_vals no callback set 2026-02-24T19:23:46.785 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.774+0000 7f4931a16640 10 monclient: shutdown 2026-02-24T19:23:46.785 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.774+0000 7f4931a16640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:46.785 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.774+0000 7f4931a16640 1 -- 10.20.193.14:0/1185394512 >> v1:10.20.193.170:6789/0 conn(0x7f492c055fc0 legacy=0x7f492c0b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:46.785 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.774+0000 7f4931a16640 1 -- 10.20.193.14:0/1185394512 shutdown_connections 2026-02-24T19:23:46.785 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.774+0000 7f4931a16640 1 -- 10.20.193.14:0/1185394512 >> 10.20.193.14:0/1185394512 conn(0x7f492c0b7bb0 msgr2=0x7f492c0b7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:46.785 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.774+0000 7f4931a16640 1 -- 10.20.193.14:0/1185394512 shutdown_connections 2026-02-24T19:23:46.786 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.774+0000 7f4931a16640 1 -- 10.20.193.14:0/1185394512 wait complete. 2026-02-24T19:23:46.786 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.775+0000 7f4931a16640 10 monclient: build_initial_monmap 2026-02-24T19:23:46.786 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.775+0000 7f4931a16640 10 monclient: monmap: 2026-02-24T19:23:46.786 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:46.786 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:23:46.786 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:23:46.786 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:23:46.786 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:46.786 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:23:46.786 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:46.786 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:46.786 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:46.787 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:46.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.775+0000 7f4931a16640 1 librados: starting msgr at 2026-02-24T19:23:46.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.775+0000 7f4931a16640 1 librados: starting objecter 2026-02-24T19:23:46.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.775+0000 7f4931a16640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:23:46.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.775+0000 7f4931a16640 1 Processor -- start 2026-02-24T19:23:46.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.775+0000 7f4931a16640 1 -- start start 2026-02-24T19:23:46.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.775+0000 7f4931a16640 1 librados: setting wanted keys 2026-02-24T19:23:46.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.775+0000 7f4931a16640 1 librados: calling monclient init 2026-02-24T19:23:46.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.775+0000 7f4931a16640 10 monclient: init 2026-02-24T19:23:46.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.775+0000 7f4931a16640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:46.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.775+0000 7f4931a16640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:23:46.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.775+0000 7f4931a16640 10 monclient(hunting): picked mon.noname-c con 0x7f492c055bf0 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:46.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.775+0000 7f4931a16640 10 monclient(hunting): picked mon.noname-b con 0x7f492c055fc0 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:46.788 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.775+0000 7f4931a16640 10 monclient(hunting): picked mon.noname-a con 0x7f492c164040 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:46.788 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.775+0000 7f4931a16640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f492c15e270 con 0x7f492c164040 2026-02-24T19:23:46.788 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.775+0000 7f4931a16640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f492c0b88e0 con 0x7f492c055fc0 2026-02-24T19:23:46.788 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.775+0000 7f4931a16640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f492c15e500 con 0x7f492c055bf0 2026-02-24T19:23:46.788 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.775+0000 7f4931a16640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:46.788 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.775+0000 7f4931a16640 10 monclient(hunting): authenticate will time out at 4001.457754s 2026-02-24T19:23:46.788 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.776+0000 7f492affd640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7f492c055bf0 0x7f492c160480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:42228/0 (socket says 10.20.193.14:42228) 2026-02-24T19:23:46.788 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.776+0000 7f492affd640 1 -- 10.20.193.14:0/4082727654 learned_addr learned my addr 10.20.193.14:0/4082727654 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:46.788 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.776+0000 7f4903fff640 10 client.?.objecter ms_handle_connect 0x7f492c055bf0 2026-02-24T19:23:46.788 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.776+0000 7f4903fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:46.788 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.776+0000 7f4903fff640 10 client.?.objecter ms_handle_connect 0x7f492c164040 2026-02-24T19:23:46.788 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.776+0000 7f4903fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:46.789 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.777+0000 7f4903fff640 10 client.?.objecter ms_handle_connect 0x7f492c055fc0 2026-02-24T19:23:46.789 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.777+0000 7f4903fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:46.789 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.777+0000 7f4903fff640 1 -- 10.20.193.14:0/4082727654 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1858531538 0 0) 0x7f492c15e500 con 0x7f492c055bf0 2026-02-24T19:23:46.789 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.777+0000 7f4903fff640 10 monclient(hunting): _negotiate 2026-02-24T19:23:46.789 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.777+0000 7f4903fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:46.789 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.777+0000 7f4903fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:46.789 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.777+0000 7f4903fff640 10 monclient(hunting): my global_id is 28685 2026-02-24T19:23:46.789 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.777+0000 7f4903fff640 1 -- 10.20.193.14:0/4082727654 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48fc003610 con 0x7f492c055bf0 2026-02-24T19:23:46.789 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.777+0000 7f4903fff640 1 -- 10.20.193.14:0/4082727654 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 884546192 0 0) 0x7f492c15e270 con 0x7f492c164040 2026-02-24T19:23:46.789 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.777+0000 7f4903fff640 10 monclient(hunting): _negotiate 2026-02-24T19:23:46.789 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.777+0000 7f4903fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:46.789 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.777+0000 7f4903fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:46.789 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.777+0000 7f4903fff640 10 monclient(hunting): my global_id is 30726 2026-02-24T19:23:46.790 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.777+0000 7f4903fff640 1 -- 10.20.193.14:0/4082727654 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f492c15e500 con 0x7f492c164040 2026-02-24T19:23:46.793 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.778+0000 7f4903fff640 1 -- 10.20.193.14:0/4082727654 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 927887079 0 0) 0x7f492c0b88e0 con 0x7f492c055fc0 2026-02-24T19:23:46.793 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.778+0000 7f4903fff640 10 monclient(hunting): _negotiate 2026-02-24T19:23:46.793 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.778+0000 7f4903fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:46.793 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.778+0000 7f4903fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:46.793 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.778+0000 7f4903fff640 10 monclient(hunting): my global_id is 29047 2026-02-24T19:23:46.793 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.778+0000 7f4903fff640 1 -- 10.20.193.14:0/4082727654 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f492c15e270 con 0x7f492c055fc0 2026-02-24T19:23:46.793 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.779+0000 7f4903fff640 1 -- 10.20.193.14:0/4082727654 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3707456088 0 0) 0x7f48fc003610 con 0x7f492c055bf0 2026-02-24T19:23:46.793 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.779+0000 7f4903fff640 1 -- 10.20.193.14:0/4082727654 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f492c0b88e0 con 0x7f492c055bf0 2026-02-24T19:23:46.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.779+0000 7f4903fff640 1 -- 10.20.193.14:0/4082727654 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4920003170 con 0x7f492c055bf0 2026-02-24T19:23:46.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.780+0000 7f4903fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:46.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.780+0000 7f4903fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:23:46.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.780+0000 7f4903fff640 10 monclient(hunting): dump: 2026-02-24T19:23:46.794 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:46.794 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:46.794 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:46.794 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:46.794 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:46.794 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:46.794 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:46.794 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:46.795 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:46.795 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:46.795 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.780+0000 7f4903fff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:23:46.795 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.780+0000 7f4903fff640 1 -- 10.20.193.14:0/4082727654 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3287460608 0 0) 0x7f492c15e500 con 0x7f492c164040 2026-02-24T19:23:46.795 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.780+0000 7f4903fff640 1 -- 10.20.193.14:0/4082727654 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f48fc003610 con 0x7f492c164040 2026-02-24T19:23:46.795 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.780+0000 7f4903fff640 1 -- 10.20.193.14:0/4082727654 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f491c0034f0 con 0x7f492c164040 2026-02-24T19:23:46.795 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.780+0000 7f4903fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:46.795 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.780+0000 7f4903fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:46.795 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.780+0000 7f4903fff640 10 monclient(hunting): dump: 2026-02-24T19:23:46.795 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:46.795 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:46.795 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:46.796 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:46.796 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:46.796 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:46.796 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:46.796 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:46.796 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:46.796 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:46.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.780+0000 7f4903fff640 1 -- 10.20.193.14:0/4082727654 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3587686175 0 0) 0x7f492c15e270 con 0x7f492c055fc0 2026-02-24T19:23:46.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.780+0000 7f4903fff640 1 -- 10.20.193.14:0/4082727654 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f492c15e500 con 0x7f492c055fc0 2026-02-24T19:23:46.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.780+0000 7f4903fff640 1 -- 10.20.193.14:0/4082727654 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4914002fb0 con 0x7f492c055fc0 2026-02-24T19:23:46.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.780+0000 7f4903fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:46.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.780+0000 7f4903fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:46.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.780+0000 7f4903fff640 10 monclient(hunting): dump: 2026-02-24T19:23:46.797 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:46.797 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:46.797 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:46.797 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:46.797 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:46.797 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:46.797 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:46.797 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:46.797 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:46.797 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:46.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.781+0000 7f4903fff640 1 -- 10.20.193.14:0/4082727654 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2463426745 0 0) 0x7f492c0b88e0 con 0x7f492c055bf0 2026-02-24T19:23:46.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.781+0000 7f4903fff640 1 -- 10.20.193.14:0/4082727654 >> v1:10.20.193.44:6789/0 conn(0x7f492c055fc0 legacy=0x7f492c15db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:46.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.781+0000 7f4903fff640 1 -- 10.20.193.14:0/4082727654 >> v1:10.20.193.14:6789/0 conn(0x7f492c164040 legacy=0x7f492c1621f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:46.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.781+0000 7f4903fff640 10 monclient: _finish_hunting 0 2026-02-24T19:23:46.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.781+0000 7f4903fff640 1 monclient: found mon.c 2026-02-24T19:23:46.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.781+0000 7f4903fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:46.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.781+0000 7f4903fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:46.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.781+0000 7f4903fff640 1 -- 10.20.193.14:0/4082727654 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f492c15e7e0 con 0x7f492c055bf0 2026-02-24T19:23:46.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.781+0000 7f4903fff640 10 monclient: _finish_auth 0 2026-02-24T19:23:46.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.781+0000 7f4903fff640 10 monclient: _check_auth_tickets 2026-02-24T19:23:46.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.781+0000 7f4903fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:46.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.781+0000 7f4931a16640 5 monclient: authenticate success, global_id 28685 2026-02-24T19:23:46.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.781+0000 7f4931a16640 10 monclient: _renew_subs 2026-02-24T19:23:46.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.781+0000 7f4931a16640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:46.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.781+0000 7f4931a16640 1 -- 10.20.193.14:0/4082727654 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f492c15eac0 con 0x7f492c055bf0 2026-02-24T19:23:46.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.781+0000 7f4931a16640 10 client.28685.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:46.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.781+0000 7f4931a16640 10 monclient: _renew_subs 2026-02-24T19:23:46.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.781+0000 7f4931a16640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:46.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.781+0000 7f4931a16640 1 -- 10.20.193.14:0/4082727654 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f492c0b8e60 con 0x7f492c055bf0 2026-02-24T19:23:46.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.781+0000 7f4931a16640 1 librados: init done 2026-02-24T19:23:46.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.782+0000 7f4931a16640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:46.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.782+0000 7f4931a16640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:46.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.782+0000 7f4931a16640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:46.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.782+0000 7f4931a16640 1 -- 10.20.193.14:0/4082727654 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f492c052bc0 con 0x7f492c055bf0 2026-02-24T19:23:46.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.789+0000 7f4903fff640 1 -- 10.20.193.14:0/4082727654 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f49200034c0 con 0x7f492c055bf0 2026-02-24T19:23:46.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.789+0000 7f4903fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:46.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.789+0000 7f4903fff640 1 -- 10.20.193.14:0/4082727654 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4920004d20 con 0x7f492c055bf0 2026-02-24T19:23:46.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.789+0000 7f4903fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:46.800 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.789+0000 7f4903fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:46.800 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.789+0000 7f49297fa640 4 set_mon_vals no callback set 2026-02-24T19:23:46.800 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.789+0000 7f4903fff640 10 monclient: dump: 2026-02-24T19:23:46.800 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:46.800 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:46.800 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:46.800 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:46.800 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:46.800 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:46.800 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:46.800 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:46.800 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:46.801 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:46.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.790+0000 7f4903fff640 1 -- 10.20.193.14:0/4082727654 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f492001db90 con 0x7f492c055bf0 2026-02-24T19:23:46.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.790+0000 7f492a7fc640 10 monclient: get_auth_request con 0x7f48fc077e20 auth_method 0 2026-02-24T19:23:46.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.790+0000 7f4903fff640 10 client.28685.objecter ms_handle_connect 0x7f48fc077e20 2026-02-24T19:23:46.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.791+0000 7f4903fff640 1 -- 10.20.193.14:0/4082727654 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7f49200933f0 con 0x7f492c055bf0 2026-02-24T19:23:46.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.791+0000 7f4903fff640 10 client.28685.objecter ms_dispatch2 0x7f492c000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:23:46.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.791+0000 7f4903fff640 3 client.28685.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:23:46.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.791+0000 7f4903fff640 3 client.28685.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:23:46.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.791+0000 7f4903fff640 20 client.28685.objecter dump_active .. 0 homeless 2026-02-24T19:23:46.878 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.875+0000 7f4903fff640 1 -- 10.20.193.14:0/4082727654 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f492c052bc0 con 0x7f492c055bf0 2026-02-24T19:23:46.878 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.875+0000 7f4903fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:46.878 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.875+0000 7f4903fff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:23:46.984 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.981+0000 7f4931a16640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:23:46.984 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.981+0000 7f4931a16640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:23:46.984 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.981+0000 7f4931a16640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:46.984 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:46.981+0000 7f4931a16640 1 -- 10.20.193.14:0/4082727654 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f492c160c90 con 0x7f492c055bf0 2026-02-24T19:23:47.032 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:47.030+0000 7f4903fff640 1 -- 10.20.193.14:0/4082727654 <== mon.2 v1:10.20.193.170:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v354) ==== 74+0+23465 (unknown 1927433921 0 1917626030) 0x7f492005de20 con 0x7f492c055bf0 2026-02-24T19:23:47.033 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:47.030+0000 7f4903fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:23:47.033 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:47.030+0000 7f4903fff640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:23:47.033 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:23:47.033 INFO:teuthology.orchestra.run.trial014.stdout:{"epoch":354,"fsid":"829a649b-54c9-463b-96b9-ffa203d49fa7","created":"2026-02-24T19:16:40.561511+0000","modified":"2026-02-24T19:23:45.833535+0000","last_up_change":"2026-02-24T19:17:13.710334+0000","last_in_change":"2026-02-24T19:16:47.437972+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":96,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":268,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T19:17:15.661742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-24T19:17:21.746458+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":31,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":5.9899997711181641,"score_stable":5.9899997711181641,"optimal_score":0.68999999761581421,"raw_score_acting":4.130000114440918,"raw_score_stable":4.130000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"ceph_test_rados_api_asio","create_time":"2026-02-24T19:18:00.131162+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9a3fd69b-7f2a-443b-9ae1-673acfad8b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":351,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6806","nonce":3263337386}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6810","nonce":3263337386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6813","nonce":3263337386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6812","nonce":3263337386}]},"public_addr":"10.20.193.14:6806/3263337386","cluster_addr":"10.20.193.14:6810/3263337386","heartbeat_back_addr":"10.20.193.14:6813/3263337386","heartbeat_front_addr":"10.20.193.14:6812/3263337386","state":["exists","up"]},{"osd":1,"uuid":"7dca8ec5-5aa3-420d-bf78-1331d974dafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":351,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6804","nonce":1955152616}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6805","nonce":1955152616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6807","nonce":1955152616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6806","nonce":1955152616}]},"public_addr":"10.20.193.44:6804/1955152616","cluster_addr":"10.20.193.44:6805/1955152616","heartbeat_back_addr":"10.20.193.44:6807/1955152616","heartbeat_front_addr":"10.20.193.44:6806/1955152616","state":["exists","up"]},{"osd":2,"uuid":"5a7b7c02-22f9-4eb1-a1b0-afb106604416","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":351,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6804","nonce":993713135}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6805","nonce":993713135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6807","nonce":993713135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6806","nonce":993713135}]},"public_addr":"10.20.193.170:6804/993713135","cluster_addr":"10.20.193.170:6805/993713135","heartbeat_back_addr":"10.20.193.170:6807/993713135","heartbeat_front_addr":"10.20.193.170:6806/993713135","state":["exists","up"]},{"osd":3,"uuid":"695eeb19-d0a7-4b16-8d9a-ec59206d7ecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":351,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6800","nonce":3081016231}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6801","nonce":3081016231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6803","nonce":3081016231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6802","nonce":3081016231}]},"public_addr":"10.20.193.195:6800/3081016231","cluster_addr":"10.20.193.195:6801/3081016231","heartbeat_back_addr":"10.20.193.195:6803/3081016231","heartbeat_front_addr":"10.20.193.195:6802/3081016231","state":["exists","up"]},{"osd":4,"uuid":"09ca59ec-7e76-44ba-bf1a-1b752732db60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":351,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6805","nonce":4020872388}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6807","nonce":4020872388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6811","nonce":4020872388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6808","nonce":4020872388}]},"public_addr":"10.20.193.14:6805/4020872388","cluster_addr":"10.20.193.14:6807/4020872388","heartbeat_back_addr":"10.20.193.14:6811/4020872388","heartbeat_front_addr":"10.20.193.14:6808/4020872388","state":["exists","up"]},{"osd":5,"uuid":"64319106-a5b4-4775-b122-8c50216df3a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":351,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6811","nonce":2261252351}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6813","nonce":2261252351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6815","nonce":2261252351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6814","nonce":2261252351}]},"public_addr":"10.20.193.44:6811/2261252351","cluster_addr":"10.20.193.44:6813/2261252351","heartbeat_back_addr":"10.20.193.44:6815/2261252351","heartbeat_front_addr":"10.20.193.44:6814/2261252351","state":["exists","up"]},{"osd":6,"uuid":"19f0033c-abbd-406a-8eae-94e7e81da9ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":351,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6800","nonce":3031579126}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6801","nonce":3031579126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6803","nonce":3031579126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6802","nonce":3031579126}]},"public_addr":"10.20.193.170:6800/3031579126","cluster_addr":"10.20.193.170:6801/3031579126","heartbeat_back_addr":"10.20.193.170:6803/3031579126","heartbeat_front_addr":"10.20.193.170:6802/3031579126","state":["exists","up"]},{"osd":7,"uuid":"7cdd3b9b-4146-45b9-aaf6-df379c7a1e0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":351,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6808","nonce":798109025}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6810","nonce":798109025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6815","nonce":798109025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6812","nonce":798109025}]},"public_addr":"10.20.193.195:6808/798109025","cluster_addr":"10.20.193.195:6810/798109025","heartbeat_back_addr":"10.20.193.195:6815/798109025","heartbeat_front_addr":"10.20.193.195:6812/798109025","state":["exists","up"]},{"osd":8,"uuid":"a4833012-c50c-4a6e-b754-cf18fc6117fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":351,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6809","nonce":1223168292}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6814","nonce":1223168292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6816","nonce":1223168292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6815","nonce":1223168292}]},"public_addr":"10.20.193.14:6809/1223168292","cluster_addr":"10.20.193.14:6814/1223168292","heartbeat_back_addr":"10.20.193.14:6816/1223168292","heartbeat_front_addr":"10.20.193.14:6815/1223168292","state":["exists","up"]},{"osd":9,"uuid":"322914a2-9ba3-44b8-98ec-958b00c92f0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":351,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6808","nonce":4259724385}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6809","nonce":4259724385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6812","nonce":4259724385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6810","nonce":4259724385}]},"public_addr":"10.20.193.44:6808/4259724385","cluster_addr":"10.20.193.44:6809/4259724385","heartbeat_back_addr":"10.20.193.44:6812/4259724385","heartbeat_front_addr":"10.20.193.44:6810/4259724385","state":["exists","up"]},{"osd":10,"uuid":"dbfdf855-de28-491b-9112-8009ab155fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":351,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6808","nonce":983512563}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6810","nonce":983512563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6813","nonce":983512563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6811","nonce":983512563}]},"public_addr":"10.20.193.170:6808/983512563","cluster_addr":"10.20.193.170:6810/983512563","heartbeat_back_addr":"10.20.193.170:6813/983512563","heartbeat_front_addr":"10.20.193.170:6811/983512563","state":["exists","up"]},{"osd":11,"uuid":"253e9d0b-391d-4647-bd89-6ab4b57909aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":351,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6804","nonce":2798179318}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6805","nonce":2798179318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6807","nonce":2798179318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6806","nonce":2798179318}]},"public_addr":"10.20.193.195:6804/2798179318","cluster_addr":"10.20.193.195:6805/2798179318","heartbeat_back_addr":"10.20.193.195:6807/2798179318","heartbeat_front_addr":"10.20.193.195:6806/2798179318","state":["exists","up"]},{"osd":12,"uuid":"7b7d5fca-4759-46e5-a681-45509749b265","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":351,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6801","nonce":1483397197}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6802","nonce":1483397197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6804","nonce":1483397197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.14:6803","nonce":1483397197}]},"public_addr":"10.20.193.14:6801/1483397197","cluster_addr":"10.20.193.14:6802/1483397197","heartbeat_back_addr":"10.20.193.14:6804/1483397197","heartbeat_front_addr":"10.20.193.14:6803/1483397197","state":["exists","up"]},{"osd":13,"uuid":"8d1f12c8-5787-425d-a4a6-ac820bbf6e8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":348,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6800","nonce":3795416779}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6801","nonce":3795416779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6803","nonce":3795416779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.44:6802","nonce":3795416779}]},"public_addr":"10.20.193.44:6800/3795416779","cluster_addr":"10.20.193.44:6801/3795416779","heartbeat_back_addr":"10.20.193.44:6803/3795416779","heartbeat_front_addr":"10.20.193.44:6802/3795416779","state":["exists","up"]},{"osd":14,"uuid":"866643a2-5f54-425c-b5ec-70607e191f02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":351,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6809","nonce":2177297767}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6812","nonce":2177297767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6815","nonce":2177297767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.170:6814","nonce":2177297767}]},"public_addr":"10.20.193.170:6809/2177297767","cluster_addr":"10.20.193.170:6812/2177297767","heartbeat_back_addr":"10.20.193.170:6815/2177297767","heartbeat_front_addr":"10.20.193.170:6814/2177297767","state":["exists","up"]},{"osd":15,"uuid":"4726a8b0-bcef-4e7f-aa36-e80228e2aec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":351,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6809","nonce":3316970219}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6811","nonce":3316970219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6814","nonce":3316970219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.195:6813","nonce":3316970219}]},"public_addr":"10.20.193.195:6809/3316970219","cluster_addr":"10.20.193.195:6811/3316970219","heartbeat_back_addr":"10.20.193.195:6814/3316970219","heartbeat_front_addr":"10.20.193.195:6813/3316970219","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.649198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.571073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.859654+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.714982+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.749516+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.546522+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.704013+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.829729+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.543314+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.580646+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.932784+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.682415+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.742679+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.618137+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.759234+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:11.913664+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":11,"snaps":[{"begin":1,"length":4}]},{"pool":12,"snaps":[{"begin":2,"length":5}]},{"pool":30,"snaps":[{"begin":1,"length":1}]},{"pool":58,"snaps":[{"begin":1,"length":1}]},{"pool":86,"snaps":[{"begin":4,"length":1},{"begin":7,"length":2}]},{"pool":99,"snaps":[{"begin":1,"length":1}]},{"pool":114,"snaps":[{"begin":1,"length":2}]},{"pool":129,"snaps":[{"begin":3,"length":1}]},{"pool":133,"snaps":[{"begin":1,"length":4}]},{"pool":142,"snaps":[{"begin":2,"length":2}]},{"pool":154,"snaps":[{"begin":2,"length":3}]},{"pool":156,"snaps":[{"begin":2,"length":4}]},{"pool":160,"snaps":[{"begin":2,"length":1}]},{"pool":166,"snaps":[{"begin":2,"length":2}]},{"pool":169,"snaps":[{"begin":1,"length":4}]},{"pool":183,"snaps":[{"begin":4,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T19:23:47.034 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:47.031+0000 7f4931a16640 10 librados: watch_flush enter 2026-02-24T19:23:47.035 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:47.031+0000 7f4931a16640 10 librados: watch_flush exit 2026-02-24T19:23:47.035 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:47.031+0000 7f4931a16640 20 client.28685.objecter shutdown clearing up homeless session... 2026-02-24T19:23:47.035 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:47.031+0000 7f4931a16640 10 client.28685.objecter successfully canceled tick 2026-02-24T19:23:47.035 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:47.031+0000 7f4931a16640 1 -- 10.20.193.14:0/4082727654 >> v1:10.20.193.14:6800/4014096310 conn(0x7f48fc077e20 legacy=0x7f48fc0982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:47.035 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:47.031+0000 7f4931a16640 10 monclient: shutdown 2026-02-24T19:23:47.035 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:47.031+0000 7f4931a16640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:47.035 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:47.031+0000 7f4931a16640 1 -- 10.20.193.14:0/4082727654 >> v1:10.20.193.170:6789/0 conn(0x7f492c055bf0 legacy=0x7f492c160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:47.035 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:47.031+0000 7f4931a16640 1 -- 10.20.193.14:0/4082727654 shutdown_connections 2026-02-24T19:23:47.035 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:47.031+0000 7f4931a16640 1 -- 10.20.193.14:0/4082727654 >> 10.20.193.14:0/4082727654 conn(0x7f492c0b7bb0 msgr2=0x7f492c153ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:47.035 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:47.031+0000 7f4931a16640 1 -- 10.20.193.14:0/4082727654 shutdown_connections 2026-02-24T19:23:47.036 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:47.031+0000 7f4931a16640 1 -- 10.20.193.14:0/4082727654 wait complete. 2026-02-24T19:23:47.036 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:47.031+0000 7f4931a16640 1 librados: shutdown 2026-02-24T19:23:48.044 INFO:tasks.ceph:Scrubbing osd.0 2026-02-24T19:23:48.044 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:23:48.113 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.110+0000 7fb520816640 10 monclient: get_monmap_and_config 2026-02-24T19:23:48.113 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.110+0000 7fb520816640 10 monclient: build_initial_monmap 2026-02-24T19:23:48.113 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.110+0000 7fb520816640 10 monclient: monmap: 2026-02-24T19:23:48.113 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:48.113 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:48.114 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:23:48.112425+0000 2026-02-24T19:23:48.114 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:23:48.112425+0000 2026-02-24T19:23:48.114 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:48.114 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:48.114 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:48.114 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:48.114 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:48.114 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:48.117 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.111+0000 7fb520816640 1 Processor -- start 2026-02-24T19:23:48.117 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.111+0000 7fb520816640 1 -- start start 2026-02-24T19:23:48.117 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.111+0000 7fb520816640 10 monclient: init 2026-02-24T19:23:48.117 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.111+0000 7fb520816640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:48.117 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.111+0000 7fb520816640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:23:48.117 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.111+0000 7fb520816640 10 monclient(hunting): picked mon.noname-c con 0x7fb518159e10 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:48.117 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.111+0000 7fb520816640 10 monclient(hunting): picked mon.noname-a con 0x7fb51815a1e0 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:48.117 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.111+0000 7fb520816640 10 monclient(hunting): picked mon.noname-b con 0x7fb518161ac0 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:48.118 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.111+0000 7fb520816640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb518055ab0 con 0x7fb51815a1e0 2026-02-24T19:23:48.118 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.111+0000 7fb520816640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb518055d50 con 0x7fb518161ac0 2026-02-24T19:23:48.118 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.111+0000 7fb520816640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb518056030 con 0x7fb518159e10 2026-02-24T19:23:48.118 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.111+0000 7fb520816640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:48.118 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.111+0000 7fb520816640 10 monclient(hunting): authenticate will time out at 4002.793931s 2026-02-24T19:23:48.118 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.112+0000 7fb51dd8a640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7fb51815a1e0 0x7fb5181613b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:50618/0 (socket says 10.20.193.14:50618) 2026-02-24T19:23:48.118 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.112+0000 7fb51dd8a640 1 -- 10.20.193.14:0/3091901590 learned_addr learned my addr 10.20.193.14:0/3091901590 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:48.118 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.113+0000 7fb51d589640 1 -- 10.20.193.14:0/3091901590 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1202386493 0 0) 0x7fb518055d50 con 0x7fb518161ac0 2026-02-24T19:23:48.118 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.113+0000 7fb51d589640 10 monclient(hunting): _negotiate 2026-02-24T19:23:48.118 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.113+0000 7fb51d589640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:48.118 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.113+0000 7fb51d589640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:48.118 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.113+0000 7fb51d589640 10 monclient(hunting): my global_id is 29050 2026-02-24T19:23:48.119 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.113+0000 7fb51d589640 1 -- 10.20.193.14:0/3091901590 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb508003610 con 0x7fb518161ac0 2026-02-24T19:23:48.119 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.113+0000 7fb51d589640 1 -- 10.20.193.14:0/3091901590 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3632279841 0 0) 0x7fb518055ab0 con 0x7fb51815a1e0 2026-02-24T19:23:48.119 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.113+0000 7fb51d589640 10 monclient(hunting): _negotiate 2026-02-24T19:23:48.119 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.113+0000 7fb51d589640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:48.119 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.113+0000 7fb51d589640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:48.119 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.113+0000 7fb51d589640 10 monclient(hunting): my global_id is 30729 2026-02-24T19:23:48.119 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.113+0000 7fb51d589640 1 -- 10.20.193.14:0/3091901590 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb518055d50 con 0x7fb51815a1e0 2026-02-24T19:23:48.119 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.114+0000 7fb51d589640 1 -- 10.20.193.14:0/3091901590 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 450988370 0 0) 0x7fb518056030 con 0x7fb518159e10 2026-02-24T19:23:48.119 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.114+0000 7fb51d589640 10 monclient(hunting): _negotiate 2026-02-24T19:23:48.119 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.114+0000 7fb51d589640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:48.119 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.114+0000 7fb51d589640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:48.119 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.114+0000 7fb51d589640 10 monclient(hunting): my global_id is 28688 2026-02-24T19:23:48.119 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.114+0000 7fb51d589640 1 -- 10.20.193.14:0/3091901590 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb518055ab0 con 0x7fb518159e10 2026-02-24T19:23:48.125 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.115+0000 7fb51d589640 1 -- 10.20.193.14:0/3091901590 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1054794960 0 0) 0x7fb518055d50 con 0x7fb51815a1e0 2026-02-24T19:23:48.125 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.115+0000 7fb51d589640 1 -- 10.20.193.14:0/3091901590 >> v1:10.20.193.170:6789/0 conn(0x7fb518159e10 legacy=0x7fb518059c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:48.125 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.115+0000 7fb51d589640 1 -- 10.20.193.14:0/3091901590 >> v1:10.20.193.44:6789/0 conn(0x7fb518161ac0 legacy=0x7fb51815fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:48.125 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.115+0000 7fb51d589640 10 monclient: _finish_hunting 0 2026-02-24T19:23:48.126 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.115+0000 7fb51d589640 1 monclient: found mon.noname-a 2026-02-24T19:23:48.126 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.115+0000 7fb51d589640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:48.126 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.115+0000 7fb51d589640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:23:48.126 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.115+0000 7fb51d589640 1 -- 10.20.193.14:0/3091901590 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb518056310 con 0x7fb51815a1e0 2026-02-24T19:23:48.126 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.115+0000 7fb51d589640 10 monclient: _finish_auth 0 2026-02-24T19:23:48.126 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.115+0000 7fb51d589640 10 monclient: _check_auth_tickets 2026-02-24T19:23:48.126 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.115+0000 7fb51d589640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:48.126 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.115+0000 7fb51d589640 1 -- 10.20.193.14:0/3091901590 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fb504002df0 con 0x7fb51815a1e0 2026-02-24T19:23:48.126 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.115+0000 7fb520816640 5 monclient: authenticate success, global_id 30729 2026-02-24T19:23:48.126 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.115+0000 7fb520816640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:48.126 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.115+0000 7fb51d589640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:48.126 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.115+0000 7fb51d589640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:23:48.127 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.115+0000 7fb51d589640 10 monclient: dump: 2026-02-24T19:23:48.127 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:48.127 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:48.127 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.127 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.127 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:48.127 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:48.127 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:48.127 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:48.127 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:48.127 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:48.128 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.115+0000 7fb520816640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:48.128 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.116+0000 7fb51d589640 1 -- 10.20.193.14:0/3091901590 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb504002fc0 con 0x7fb51815a1e0 2026-02-24T19:23:48.128 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.116+0000 7fb51d589640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:48.128 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.116+0000 7fb51d589640 1 -- 10.20.193.14:0/3091901590 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fb504003400 con 0x7fb51815a1e0 2026-02-24T19:23:48.128 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.116+0000 7fb51d589640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:48.128 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.116+0000 7fb51d589640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:48.128 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.116+0000 7fb51d589640 10 monclient: dump: 2026-02-24T19:23:48.128 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:48.128 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:48.128 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.128 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.128 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:48.128 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:48.129 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:48.129 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:48.129 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:48.129 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:48.129 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.116+0000 7fb520816640 10 monclient: get_monmap_and_config success 2026-02-24T19:23:48.129 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.116+0000 7fb520816640 4 set_mon_vals no callback set 2026-02-24T19:23:48.129 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.116+0000 7fb520816640 10 monclient: shutdown 2026-02-24T19:23:48.129 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.116+0000 7fb520816640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:48.129 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.116+0000 7fb520816640 1 -- 10.20.193.14:0/3091901590 >> v1:10.20.193.14:6789/0 conn(0x7fb51815a1e0 legacy=0x7fb5181613b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:48.129 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.116+0000 7fb520816640 1 -- 10.20.193.14:0/3091901590 shutdown_connections 2026-02-24T19:23:48.129 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.116+0000 7fb520816640 1 -- 10.20.193.14:0/3091901590 >> 10.20.193.14:0/3091901590 conn(0x7fb5180b2f60 msgr2=0x7fb5180b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:48.129 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.116+0000 7fb520816640 1 -- 10.20.193.14:0/3091901590 shutdown_connections 2026-02-24T19:23:48.130 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.116+0000 7fb520816640 1 -- 10.20.193.14:0/3091901590 wait complete. 2026-02-24T19:23:48.130 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.117+0000 7fb520816640 10 monclient: build_initial_monmap 2026-02-24T19:23:48.130 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.117+0000 7fb520816640 10 monclient: monmap: 2026-02-24T19:23:48.130 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:48.130 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:23:48.130 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:23:48.130 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:23:48.130 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:48.130 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:23:48.130 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:48.130 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:48.130 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:48.131 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:48.131 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.117+0000 7fb520816640 1 librados: starting msgr at 2026-02-24T19:23:48.131 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.117+0000 7fb520816640 1 librados: starting objecter 2026-02-24T19:23:48.131 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.117+0000 7fb520816640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:23:48.131 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.117+0000 7fb520816640 1 Processor -- start 2026-02-24T19:23:48.131 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.117+0000 7fb520816640 1 -- start start 2026-02-24T19:23:48.131 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.117+0000 7fb520816640 1 librados: setting wanted keys 2026-02-24T19:23:48.131 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.117+0000 7fb520816640 1 librados: calling monclient init 2026-02-24T19:23:48.131 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.117+0000 7fb520816640 10 monclient: init 2026-02-24T19:23:48.131 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.117+0000 7fb520816640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:48.131 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.117+0000 7fb520816640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:23:48.131 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.117+0000 7fb520816640 10 monclient(hunting): picked mon.noname-a con 0x7fb518159e10 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:48.131 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.117+0000 7fb520816640 10 monclient(hunting): picked mon.noname-b con 0x7fb51815a1e0 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:48.132 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.117+0000 7fb520816640 10 monclient(hunting): picked mon.noname-c con 0x7fb518161ac0 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:48.132 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.117+0000 7fb520816640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5181628d0 con 0x7fb518159e10 2026-02-24T19:23:48.132 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.117+0000 7fb520816640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5180a8690 con 0x7fb51815a1e0 2026-02-24T19:23:48.132 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.117+0000 7fb520816640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb51815dec0 con 0x7fb518161ac0 2026-02-24T19:23:48.132 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.117+0000 7fb520816640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:48.132 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.117+0000 7fb520816640 10 monclient(hunting): authenticate will time out at 4002.799986s 2026-02-24T19:23:48.132 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.118+0000 7fb51e58b640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7fb518159e10 0x7fb5181621c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:50630/0 (socket says 10.20.193.14:50630) 2026-02-24T19:23:48.132 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.118+0000 7fb51e58b640 1 -- 10.20.193.14:0/3141950987 learned_addr learned my addr 10.20.193.14:0/3141950987 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:48.132 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.118+0000 7fb502ffd640 10 client.?.objecter ms_handle_connect 0x7fb518159e10 2026-02-24T19:23:48.132 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.118+0000 7fb502ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:48.132 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.118+0000 7fb502ffd640 10 client.?.objecter ms_handle_connect 0x7fb518161ac0 2026-02-24T19:23:48.132 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.118+0000 7fb502ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:48.132 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.118+0000 7fb502ffd640 10 client.?.objecter ms_handle_connect 0x7fb51815a1e0 2026-02-24T19:23:48.132 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.118+0000 7fb502ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:48.133 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.119+0000 7fb502ffd640 1 -- 10.20.193.14:0/3141950987 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3156002673 0 0) 0x7fb5181628d0 con 0x7fb518159e10 2026-02-24T19:23:48.133 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.119+0000 7fb502ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:23:48.133 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.119+0000 7fb502ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:48.133 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.119+0000 7fb502ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:48.133 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.119+0000 7fb502ffd640 10 monclient(hunting): my global_id is 30732 2026-02-24T19:23:48.133 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.119+0000 7fb502ffd640 1 -- 10.20.193.14:0/3141950987 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4e8003610 con 0x7fb518159e10 2026-02-24T19:23:48.133 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.119+0000 7fb502ffd640 1 -- 10.20.193.14:0/3141950987 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 722811486 0 0) 0x7fb51815dec0 con 0x7fb518161ac0 2026-02-24T19:23:48.133 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.119+0000 7fb502ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:23:48.133 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.119+0000 7fb502ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:48.133 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.119+0000 7fb502ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:48.133 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.119+0000 7fb502ffd640 10 monclient(hunting): my global_id is 28691 2026-02-24T19:23:48.133 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.119+0000 7fb502ffd640 1 -- 10.20.193.14:0/3141950987 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5181628d0 con 0x7fb518161ac0 2026-02-24T19:23:48.134 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.119+0000 7fb502ffd640 1 -- 10.20.193.14:0/3141950987 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2988759135 0 0) 0x7fb5180a8690 con 0x7fb51815a1e0 2026-02-24T19:23:48.134 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.119+0000 7fb502ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:23:48.134 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.119+0000 7fb502ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:48.134 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.119+0000 7fb502ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:48.134 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.119+0000 7fb502ffd640 10 monclient(hunting): my global_id is 29053 2026-02-24T19:23:48.134 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.119+0000 7fb502ffd640 1 -- 10.20.193.14:0/3141950987 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb51815dec0 con 0x7fb51815a1e0 2026-02-24T19:23:48.134 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.121+0000 7fb502ffd640 1 -- 10.20.193.14:0/3141950987 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2198967933 0 0) 0x7fb4e8003610 con 0x7fb518159e10 2026-02-24T19:23:48.134 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.121+0000 7fb502ffd640 1 -- 10.20.193.14:0/3141950987 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb5180a8690 con 0x7fb518159e10 2026-02-24T19:23:48.134 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.121+0000 7fb502ffd640 1 -- 10.20.193.14:0/3141950987 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fb510003190 con 0x7fb518159e10 2026-02-24T19:23:48.134 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.121+0000 7fb502ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:48.134 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.121+0000 7fb502ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:23:48.134 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.121+0000 7fb502ffd640 10 monclient(hunting): dump: 2026-02-24T19:23:48.134 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:48.135 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:48.135 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.135 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.135 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:48.135 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:48.135 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:48.135 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:48.135 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:48.135 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:48.135 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.121+0000 7fb502ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:23:48.135 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.122+0000 7fb502ffd640 1 -- 10.20.193.14:0/3141950987 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 781203270 0 0) 0x7fb5181628d0 con 0x7fb518161ac0 2026-02-24T19:23:48.135 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.122+0000 7fb502ffd640 1 -- 10.20.193.14:0/3141950987 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb4e8003610 con 0x7fb518161ac0 2026-02-24T19:23:48.136 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.122+0000 7fb502ffd640 1 -- 10.20.193.14:0/3141950987 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fb50c003250 con 0x7fb518161ac0 2026-02-24T19:23:48.136 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.122+0000 7fb502ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:48.136 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.122+0000 7fb502ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:48.136 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.122+0000 7fb502ffd640 10 monclient(hunting): dump: 2026-02-24T19:23:48.136 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:48.136 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:48.136 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.136 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.136 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:48.136 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:48.136 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:48.136 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:48.136 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:48.137 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:48.137 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.122+0000 7fb502ffd640 1 -- 10.20.193.14:0/3141950987 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3378921270 0 0) 0x7fb51815dec0 con 0x7fb51815a1e0 2026-02-24T19:23:48.137 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.122+0000 7fb502ffd640 1 -- 10.20.193.14:0/3141950987 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb5181628d0 con 0x7fb51815a1e0 2026-02-24T19:23:48.137 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.122+0000 7fb502ffd640 1 -- 10.20.193.14:0/3141950987 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fb504003310 con 0x7fb51815a1e0 2026-02-24T19:23:48.137 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.122+0000 7fb502ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:48.137 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.122+0000 7fb502ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:48.137 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.122+0000 7fb502ffd640 10 monclient(hunting): dump: 2026-02-24T19:23:48.137 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:48.137 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:48.137 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.137 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.137 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:48.138 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:48.138 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:48.138 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:48.138 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:48.138 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:48.141 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.123+0000 7fb502ffd640 1 -- 10.20.193.14:0/3141950987 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2848048128 0 0) 0x7fb5180a8690 con 0x7fb518159e10 2026-02-24T19:23:48.141 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.123+0000 7fb502ffd640 1 -- 10.20.193.14:0/3141950987 >> v1:10.20.193.170:6789/0 conn(0x7fb518161ac0 legacy=0x7fb5180a7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:48.141 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.123+0000 7fb502ffd640 1 -- 10.20.193.14:0/3141950987 >> v1:10.20.193.44:6789/0 conn(0x7fb51815a1e0 legacy=0x7fb518157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:48.141 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.123+0000 7fb502ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:23:48.141 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.123+0000 7fb502ffd640 1 monclient: found mon.a 2026-02-24T19:23:48.141 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.123+0000 7fb502ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:48.142 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.123+0000 7fb502ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:48.142 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.123+0000 7fb502ffd640 1 -- 10.20.193.14:0/3141950987 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb51815e1a0 con 0x7fb518159e10 2026-02-24T19:23:48.142 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.123+0000 7fb502ffd640 10 monclient: _finish_auth 0 2026-02-24T19:23:48.142 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.123+0000 7fb502ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:23:48.142 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.123+0000 7fb502ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:48.142 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.123+0000 7fb520816640 5 monclient: authenticate success, global_id 30732 2026-02-24T19:23:48.142 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.123+0000 7fb520816640 10 monclient: _renew_subs 2026-02-24T19:23:48.142 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.123+0000 7fb520816640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:48.142 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.123+0000 7fb520816640 1 -- 10.20.193.14:0/3141950987 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb51815e480 con 0x7fb518159e10 2026-02-24T19:23:48.142 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.123+0000 7fb520816640 10 client.30732.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:48.142 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.123+0000 7fb520816640 10 monclient: _renew_subs 2026-02-24T19:23:48.142 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.123+0000 7fb520816640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:48.142 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.123+0000 7fb520816640 1 -- 10.20.193.14:0/3141950987 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb51815ea40 con 0x7fb518159e10 2026-02-24T19:23:48.143 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.123+0000 7fb520816640 1 librados: init done 2026-02-24T19:23:48.143 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.123+0000 7fb520816640 10 client.30732.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:48.143 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.123+0000 7fb520816640 15 client.30732.objecter _session_command_op_assign -1 1 2026-02-24T19:23:48.143 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.123+0000 7fb520816640 20 client.30732.objecter _get_session osd=-1 returning homeless 2026-02-24T19:23:48.143 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.123+0000 7fb520816640 10 client.30732.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:48.143 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.123+0000 7fb520816640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:48.143 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.123+0000 7fb520816640 1 -- 10.20.193.14:0/3141950987 --> v1:10.20.193.14:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fb518162f20 con 0x7fb518159e10 2026-02-24T19:23:48.143 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.131+0000 7fb502ffd640 1 -- 10.20.193.14:0/3141950987 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb518162f20 con 0x7fb518159e10 2026-02-24T19:23:48.143 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.131+0000 7fb502ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:48.143 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.131+0000 7fb502ffd640 1 -- 10.20.193.14:0/3141950987 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fb5100039b0 con 0x7fb518159e10 2026-02-24T19:23:48.143 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.131+0000 7fb502ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:48.143 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.131+0000 7fb502ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:48.143 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.131+0000 7fb51cd88640 4 set_mon_vals no callback set 2026-02-24T19:23:48.144 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.131+0000 7fb502ffd640 10 monclient: dump: 2026-02-24T19:23:48.144 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:48.144 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:48.144 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.144 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.144 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:48.144 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:48.144 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:48.144 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:48.144 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:48.144 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:48.144 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.132+0000 7fb502ffd640 1 -- 10.20.193.14:0/3141950987 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7fb510003bc0 con 0x7fb518159e10 2026-02-24T19:23:48.144 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.132+0000 7fb51dd8a640 10 monclient: get_auth_request con 0x7fb4e8077e70 auth_method 0 2026-02-24T19:23:48.145 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.133+0000 7fb502ffd640 10 client.30732.objecter ms_handle_connect 0x7fb4e8077e70 2026-02-24T19:23:48.145 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.133+0000 7fb502ffd640 1 -- 10.20.193.14:0/3141950987 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7fb5100039b0 con 0x7fb518159e10 2026-02-24T19:23:48.145 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.133+0000 7fb502ffd640 10 client.30732.objecter ms_dispatch2 0x7fb518000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:23:48.145 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.133+0000 7fb502ffd640 3 client.30732.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:23:48.145 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.133+0000 7fb502ffd640 3 client.30732.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:23:48.145 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.134+0000 7fb502ffd640 10 client.30732.objecter checking command 1 2026-02-24T19:23:48.145 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.134+0000 7fb502ffd640 20 client.30732.objecter _get_session s=0x7fb4e80a2130 osd=0 3 2026-02-24T19:23:48.145 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.134+0000 7fb502ffd640 20 client.30732.objecter put_session s=0x7fb4e80a2130 osd=0 3 2026-02-24T19:23:48.145 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.134+0000 7fb502ffd640 15 client.30732.objecter _session_command_op_remove -1 1 2026-02-24T19:23:48.145 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.134+0000 7fb502ffd640 20 client.30732.objecter _get_session s=0x7fb4e80a2130 osd=0 3 2026-02-24T19:23:48.145 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.134+0000 7fb502ffd640 20 client.30732.objecter get_session s=0x7fb4e80a2130 osd=0 3 2026-02-24T19:23:48.145 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.134+0000 7fb502ffd640 15 client.30732.objecter _session_command_op_assign 0 1 2026-02-24T19:23:48.146 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.134+0000 7fb502ffd640 20 client.30732.objecter put_session s=0x7fb4e80a2130 osd=0 4 2026-02-24T19:23:48.146 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.134+0000 7fb502ffd640 10 client.30732.objecter _send_command 1 2026-02-24T19:23:48.146 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.134+0000 7fb502ffd640 1 -- 10.20.193.14:0/3141950987 --> v1:10.20.193.14:6806/3263337386 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb4e80c4440 con 0x7fb4e80a27e0 2026-02-24T19:23:48.146 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.134+0000 7fb502ffd640 20 client.30732.objecter dump_active .. 0 homeless 2026-02-24T19:23:48.146 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.134+0000 7fb502ffd640 1 -- 10.20.193.14:0/3141950987 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_get_version_reply(handle=1 version=354) ==== 24+0+0 (unknown 31317031 0 0) 0x7fb51005d1b0 con 0x7fb518159e10 2026-02-24T19:23:48.146 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.134+0000 7fb502ffd640 10 monclient: handle_get_version_reply finishing 1 version 354 2026-02-24T19:23:48.146 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.134+0000 7fb51ed8c640 10 monclient: get_auth_request con 0x7fb4e80a27e0 auth_method 0 2026-02-24T19:23:48.146 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.135+0000 7fb502ffd640 10 client.30732.objecter ms_handle_connect 0x7fb4e80a27e0 2026-02-24T19:23:48.147 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.144+0000 7fb502ffd640 1 -- 10.20.193.14:0/3141950987 <== osd.0 v1:10.20.193.14:6806/3263337386 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fb4e80c4440 con 0x7fb4e80a27e0 2026-02-24T19:23:48.147 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.144+0000 7fb502ffd640 10 client.30732.objecter ms_dispatch2 0x7fb518000b90 command_reply(tid 1: 0 ) 2026-02-24T19:23:48.147 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.144+0000 7fb502ffd640 10 client.30732.objecter _finish_command 1 = system:0 2026-02-24T19:23:48.147 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.144+0000 7fb502ffd640 20 client.30732.objecter put_session s=0x7fb4e80a2130 osd=0 4 2026-02-24T19:23:48.147 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.144+0000 7fb502ffd640 15 client.30732.objecter _session_command_op_remove 0 1 2026-02-24T19:23:48.154 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.152+0000 7fb520816640 10 client.30732.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:23:48.154 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.152+0000 7fb520816640 15 client.30732.objecter _session_command_op_assign -1 2 2026-02-24T19:23:48.154 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.152+0000 7fb520816640 20 client.30732.objecter _get_session s=0x7fb4e80a2130 osd=0 3 2026-02-24T19:23:48.155 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.152+0000 7fb520816640 20 client.30732.objecter put_session s=0x7fb4e80a2130 osd=0 3 2026-02-24T19:23:48.155 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.152+0000 7fb520816640 20 client.30732.objecter _get_session s=0x7fb4e80a2130 osd=0 3 2026-02-24T19:23:48.155 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.152+0000 7fb520816640 15 client.30732.objecter _session_command_op_remove -1 2 2026-02-24T19:23:48.155 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.152+0000 7fb520816640 20 client.30732.objecter get_session s=0x7fb4e80a2130 osd=0 3 2026-02-24T19:23:48.155 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.152+0000 7fb520816640 15 client.30732.objecter _session_command_op_assign 0 2 2026-02-24T19:23:48.155 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.152+0000 7fb520816640 20 client.30732.objecter put_session s=0x7fb4e80a2130 osd=0 4 2026-02-24T19:23:48.155 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.152+0000 7fb520816640 10 client.30732.objecter _send_command 2 2026-02-24T19:23:48.155 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.152+0000 7fb520816640 1 -- 10.20.193.14:0/3141950987 --> v1:10.20.193.14:6806/3263337386 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb5180ad2f0 con 0x7fb4e80a27e0 2026-02-24T19:23:48.162 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.159+0000 7fb502ffd640 1 -- 10.20.193.14:0/3141950987 <== osd.0 v1:10.20.193.14:6806/3263337386 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fb5180ad2f0 con 0x7fb4e80a27e0 2026-02-24T19:23:48.162 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.159+0000 7fb502ffd640 10 client.30732.objecter ms_dispatch2 0x7fb518000b90 command_reply(tid 2: 0 ) 2026-02-24T19:23:48.162 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.159+0000 7fb502ffd640 10 client.30732.objecter _finish_command 2 = system:0 2026-02-24T19:23:48.162 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.159+0000 7fb502ffd640 20 client.30732.objecter put_session s=0x7fb4e80a2130 osd=0 4 2026-02-24T19:23:48.162 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.159+0000 7fb502ffd640 15 client.30732.objecter _session_command_op_remove 0 2 2026-02-24T19:23:48.162 INFO:teuthology.orchestra.run.trial014.stdout:{ 2026-02-24T19:23:48.163 INFO:teuthology.orchestra.run.trial014.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:23:48.163 INFO:teuthology.orchestra.run.trial014.stdout:} 2026-02-24T19:23:48.164 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.159+0000 7fb520816640 10 librados: watch_flush enter 2026-02-24T19:23:48.164 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.159+0000 7fb520816640 10 librados: watch_flush exit 2026-02-24T19:23:48.164 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.159+0000 7fb520816640 10 client.30732.objecter close_session for osd.0 2026-02-24T19:23:48.164 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.159+0000 7fb520816640 1 -- 10.20.193.14:0/3141950987 >> v1:10.20.193.14:6806/3263337386 conn(0x7fb4e80a27e0 legacy=0x7fb4e80c2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:48.164 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.159+0000 7fb520816640 20 client.30732.objecter put_session s=0x7fb4e80a2130 osd=0 1 2026-02-24T19:23:48.164 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.159+0000 7fb520816640 20 client.30732.objecter shutdown clearing up homeless session... 2026-02-24T19:23:48.165 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.159+0000 7fb520816640 10 client.30732.objecter successfully canceled tick 2026-02-24T19:23:48.165 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.159+0000 7fb520816640 1 -- 10.20.193.14:0/3141950987 >> v1:10.20.193.14:6800/4014096310 conn(0x7fb4e8077e70 legacy=0x7fb4e8098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:48.165 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.159+0000 7fb520816640 10 monclient: shutdown 2026-02-24T19:23:48.165 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.159+0000 7fb520816640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:48.165 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.159+0000 7fb520816640 1 -- 10.20.193.14:0/3141950987 >> v1:10.20.193.14:6789/0 conn(0x7fb518159e10 legacy=0x7fb5181621c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:48.165 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.159+0000 7fb51ed8c640 1 -- 10.20.193.14:0/3141950987 reap_dead start 2026-02-24T19:23:48.165 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.159+0000 7fb520816640 1 -- 10.20.193.14:0/3141950987 shutdown_connections 2026-02-24T19:23:48.165 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.159+0000 7fb520816640 1 -- 10.20.193.14:0/3141950987 >> 10.20.193.14:0/3141950987 conn(0x7fb5180b2f60 msgr2=0x7fb518058c50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:48.165 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.159+0000 7fb520816640 1 -- 10.20.193.14:0/3141950987 shutdown_connections 2026-02-24T19:23:48.165 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.159+0000 7fb520816640 1 -- 10.20.193.14:0/3141950987 wait complete. 2026-02-24T19:23:48.165 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.159+0000 7fb520816640 1 librados: shutdown 2026-02-24T19:23:48.170 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-24T19:23:48.237 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.234+0000 7f8fd2f83640 10 monclient: get_monmap_and_config 2026-02-24T19:23:48.237 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.234+0000 7f8fd2f83640 10 monclient: build_initial_monmap 2026-02-24T19:23:48.237 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.234+0000 7f8fd2f83640 10 monclient: monmap: 2026-02-24T19:23:48.237 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:48.237 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:48.237 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:23:48.236012+0000 2026-02-24T19:23:48.237 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:23:48.236012+0000 2026-02-24T19:23:48.237 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:48.237 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:48.237 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:48.238 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:48.238 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:48.238 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:48.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.234+0000 7f8fd2f83640 1 Processor -- start 2026-02-24T19:23:48.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.234+0000 7f8fd2f83640 1 -- start start 2026-02-24T19:23:48.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.234+0000 7f8fd2f83640 10 monclient: init 2026-02-24T19:23:48.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.235+0000 7f8fd2f83640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:48.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.235+0000 7f8fd2f83640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:23:48.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.235+0000 7f8fd2f83640 10 monclient(hunting): picked mon.noname-b con 0x7f8fcc157780 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:48.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.235+0000 7f8fd2f83640 10 monclient(hunting): picked mon.noname-c con 0x7f8fcc157b50 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:48.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.235+0000 7f8fd2f83640 10 monclient(hunting): picked mon.noname-a con 0x7f8fcc164d00 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:48.241 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.235+0000 7f8fd2f83640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fcc05de70 con 0x7f8fcc164d00 2026-02-24T19:23:48.241 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.235+0000 7f8fd2f83640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fcc055b20 con 0x7f8fcc157780 2026-02-24T19:23:48.241 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.235+0000 7f8fd2f83640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fcc055e00 con 0x7f8fcc157b50 2026-02-24T19:23:48.241 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.235+0000 7f8fd2f83640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:48.241 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.235+0000 7f8fd2f83640 10 monclient(hunting): authenticate will time out at 4002.917403s 2026-02-24T19:23:48.241 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.235+0000 7f8fd14f9640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f8fcc164d00 0x7f8fcc1c5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:50644/0 (socket says 10.20.193.14:50644) 2026-02-24T19:23:48.241 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.235+0000 7f8fd14f9640 1 -- 10.20.193.14:0/3743880870 learned_addr learned my addr 10.20.193.14:0/3743880870 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:48.241 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.237+0000 7f8fc37fe640 1 -- 10.20.193.14:0/3743880870 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1987463923 0 0) 0x7f8fcc05de70 con 0x7f8fcc164d00 2026-02-24T19:23:48.241 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.237+0000 7f8fc37fe640 10 monclient(hunting): _negotiate 2026-02-24T19:23:48.241 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.237+0000 7f8fc37fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:48.241 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.237+0000 7f8fc37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:48.241 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.237+0000 7f8fc37fe640 10 monclient(hunting): my global_id is 30735 2026-02-24T19:23:48.242 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.237+0000 7f8fc37fe640 1 -- 10.20.193.14:0/3743880870 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8fb8003610 con 0x7f8fcc164d00 2026-02-24T19:23:48.242 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.237+0000 7f8fc37fe640 1 -- 10.20.193.14:0/3743880870 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2666850749 0 0) 0x7f8fcc055b20 con 0x7f8fcc157780 2026-02-24T19:23:48.242 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.237+0000 7f8fc37fe640 10 monclient(hunting): _negotiate 2026-02-24T19:23:48.242 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.237+0000 7f8fc37fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:48.242 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.237+0000 7f8fc37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:48.242 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.237+0000 7f8fc37fe640 10 monclient(hunting): my global_id is 29056 2026-02-24T19:23:48.242 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.237+0000 7f8fc37fe640 1 -- 10.20.193.14:0/3743880870 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8fcc05de70 con 0x7f8fcc157780 2026-02-24T19:23:48.242 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.237+0000 7f8fc37fe640 1 -- 10.20.193.14:0/3743880870 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4159386443 0 0) 0x7f8fcc055e00 con 0x7f8fcc157b50 2026-02-24T19:23:48.242 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.237+0000 7f8fc37fe640 10 monclient(hunting): _negotiate 2026-02-24T19:23:48.242 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.237+0000 7f8fc37fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:48.242 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.237+0000 7f8fc37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:48.242 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.237+0000 7f8fc37fe640 10 monclient(hunting): my global_id is 28694 2026-02-24T19:23:48.243 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.237+0000 7f8fc37fe640 1 -- 10.20.193.14:0/3743880870 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8fcc055b20 con 0x7f8fcc157b50 2026-02-24T19:23:48.247 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.238+0000 7f8fc37fe640 1 -- 10.20.193.14:0/3743880870 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 665241317 0 0) 0x7f8fcc05de70 con 0x7f8fcc157780 2026-02-24T19:23:48.247 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.238+0000 7f8fc37fe640 1 -- 10.20.193.14:0/3743880870 >> v1:10.20.193.170:6789/0 conn(0x7f8fcc157b50 legacy=0x7f8fcc1645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:48.247 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.238+0000 7f8fc37fe640 1 -- 10.20.193.14:0/3743880870 >> v1:10.20.193.14:6789/0 conn(0x7f8fcc164d00 legacy=0x7f8fcc1c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:48.247 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.238+0000 7f8fc37fe640 10 monclient: _finish_hunting 0 2026-02-24T19:23:48.247 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.238+0000 7f8fc37fe640 1 monclient: found mon.noname-b 2026-02-24T19:23:48.247 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.238+0000 7f8fc37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:48.247 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.238+0000 7f8fc37fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.44:6789/0 2026-02-24T19:23:48.247 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.238+0000 7f8fc37fe640 1 -- 10.20.193.14:0/3743880870 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fcc0560e0 con 0x7f8fcc157780 2026-02-24T19:23:48.248 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.238+0000 7f8fc37fe640 10 monclient: _finish_auth 0 2026-02-24T19:23:48.248 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.238+0000 7f8fc37fe640 10 monclient: _check_auth_tickets 2026-02-24T19:23:48.248 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.238+0000 7f8fc37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:48.248 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.238+0000 7f8fc37fe640 1 -- 10.20.193.14:0/3743880870 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f8fbc002df0 con 0x7f8fcc157780 2026-02-24T19:23:48.248 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.238+0000 7f8fc37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:48.248 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.238+0000 7f8fc37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:23:48.248 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.238+0000 7f8fc37fe640 10 monclient: dump: 2026-02-24T19:23:48.248 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:48.248 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:48.248 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.248 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.248 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:48.249 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:48.249 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:48.249 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:48.249 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:48.249 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:48.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.238+0000 7f8fd2f83640 5 monclient: authenticate success, global_id 29056 2026-02-24T19:23:48.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.238+0000 7f8fd2f83640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:48.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.239+0000 7f8fc37fe640 1 -- 10.20.193.14:0/3743880870 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8fbc002fc0 con 0x7f8fcc157780 2026-02-24T19:23:48.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.239+0000 7f8fc37fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:48.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.239+0000 7f8fc37fe640 1 -- 10.20.193.14:0/3743880870 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f8fbc003400 con 0x7f8fcc157780 2026-02-24T19:23:48.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.239+0000 7f8fc37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:48.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.239+0000 7f8fc37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:48.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.239+0000 7f8fc37fe640 10 monclient: dump: 2026-02-24T19:23:48.250 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:48.250 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:48.250 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.250 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.250 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:48.250 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:48.250 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:48.250 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:48.250 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:48.250 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:48.250 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.239+0000 7f8fd2f83640 10 monclient: get_monmap_and_config success 2026-02-24T19:23:48.250 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.239+0000 7f8fd2f83640 4 set_mon_vals no callback set 2026-02-24T19:23:48.250 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.239+0000 7f8fd2f83640 10 monclient: shutdown 2026-02-24T19:23:48.251 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.239+0000 7f8fd2f83640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:48.251 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.239+0000 7f8fd2f83640 1 -- 10.20.193.14:0/3743880870 >> v1:10.20.193.44:6789/0 conn(0x7f8fcc157780 legacy=0x7f8fcc056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:48.251 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.239+0000 7f8fd2f83640 1 -- 10.20.193.14:0/3743880870 shutdown_connections 2026-02-24T19:23:48.251 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.240+0000 7f8fd2f83640 1 -- 10.20.193.14:0/3743880870 >> 10.20.193.14:0/3743880870 conn(0x7f8fcc0b2ef0 msgr2=0x7f8fcc0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:48.251 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.240+0000 7f8fd2f83640 1 -- 10.20.193.14:0/3743880870 shutdown_connections 2026-02-24T19:23:48.251 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.240+0000 7f8fd2f83640 1 -- 10.20.193.14:0/3743880870 wait complete. 2026-02-24T19:23:48.251 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.240+0000 7f8fd2f83640 10 monclient: build_initial_monmap 2026-02-24T19:23:48.251 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.240+0000 7f8fd2f83640 10 monclient: monmap: 2026-02-24T19:23:48.251 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:48.251 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:23:48.251 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:23:48.251 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:23:48.252 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:48.252 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:23:48.252 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:48.252 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:48.252 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:48.252 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:48.252 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.240+0000 7f8fd2f83640 1 librados: starting msgr at 2026-02-24T19:23:48.252 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.240+0000 7f8fd2f83640 1 librados: starting objecter 2026-02-24T19:23:48.252 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.240+0000 7f8fd2f83640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:23:48.252 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.240+0000 7f8fd2f83640 1 Processor -- start 2026-02-24T19:23:48.252 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.240+0000 7f8fd2f83640 1 -- start start 2026-02-24T19:23:48.252 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.240+0000 7f8fd2f83640 1 librados: setting wanted keys 2026-02-24T19:23:48.252 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.240+0000 7f8fd2f83640 1 librados: calling monclient init 2026-02-24T19:23:48.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.240+0000 7f8fd2f83640 10 monclient: init 2026-02-24T19:23:48.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.241+0000 7f8fd2f83640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:48.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.241+0000 7f8fd2f83640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:23:48.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.241+0000 7f8fd2f83640 10 monclient(hunting): picked mon.noname-b con 0x7f8fcc157780 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:48.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.241+0000 7f8fd2f83640 10 monclient(hunting): picked mon.noname-c con 0x7f8fcc157b50 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:48.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.241+0000 7f8fd2f83640 10 monclient(hunting): picked mon.noname-a con 0x7f8fcc164d00 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:48.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.241+0000 7f8fd2f83640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fcc1392f0 con 0x7f8fcc164d00 2026-02-24T19:23:48.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.241+0000 7f8fd2f83640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fcc1395d0 con 0x7f8fcc157780 2026-02-24T19:23:48.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.241+0000 7f8fd2f83640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fcc1398b0 con 0x7f8fcc157b50 2026-02-24T19:23:48.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.241+0000 7f8fd2f83640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:48.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.241+0000 7f8fd2f83640 10 monclient(hunting): authenticate will time out at 4002.923106s 2026-02-24T19:23:48.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.241+0000 7f8fd14f9640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f8fcc164d00 0x7f8fcc137080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:50658/0 (socket says 10.20.193.14:50658) 2026-02-24T19:23:48.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.241+0000 7f8fd14f9640 1 -- 10.20.193.14:0/3130380049 learned_addr learned my addr 10.20.193.14:0/3130380049 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:48.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.241+0000 7f8fc17fa640 10 client.?.objecter ms_handle_connect 0x7f8fcc164d00 2026-02-24T19:23:48.254 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.241+0000 7f8fc17fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:48.254 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.241+0000 7f8fc17fa640 10 client.?.objecter ms_handle_connect 0x7f8fcc157780 2026-02-24T19:23:48.254 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.241+0000 7f8fc17fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:48.254 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.241+0000 7f8fc17fa640 10 client.?.objecter ms_handle_connect 0x7f8fcc157b50 2026-02-24T19:23:48.254 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.241+0000 7f8fc17fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:48.254 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.242+0000 7f8fc17fa640 1 -- 10.20.193.14:0/3130380049 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 844984976 0 0) 0x7f8fcc1395d0 con 0x7f8fcc157780 2026-02-24T19:23:48.254 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.242+0000 7f8fc17fa640 10 monclient(hunting): _negotiate 2026-02-24T19:23:48.254 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.242+0000 7f8fc17fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:48.254 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.242+0000 7f8fc17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:48.254 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.242+0000 7f8fc17fa640 10 monclient(hunting): my global_id is 29059 2026-02-24T19:23:48.254 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.242+0000 7f8fc17fa640 1 -- 10.20.193.14:0/3130380049 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f9c003610 con 0x7f8fcc157780 2026-02-24T19:23:48.254 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.242+0000 7f8fc17fa640 1 -- 10.20.193.14:0/3130380049 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1465799822 0 0) 0x7f8fcc1392f0 con 0x7f8fcc164d00 2026-02-24T19:23:48.254 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.242+0000 7f8fc17fa640 10 monclient(hunting): _negotiate 2026-02-24T19:23:48.255 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.242+0000 7f8fc17fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:48.255 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.242+0000 7f8fc17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:48.255 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.242+0000 7f8fc17fa640 10 monclient(hunting): my global_id is 30738 2026-02-24T19:23:48.255 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.242+0000 7f8fc17fa640 1 -- 10.20.193.14:0/3130380049 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8fcc1395d0 con 0x7f8fcc164d00 2026-02-24T19:23:48.255 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.243+0000 7f8fc17fa640 1 -- 10.20.193.14:0/3130380049 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2383046649 0 0) 0x7f8fcc1398b0 con 0x7f8fcc157b50 2026-02-24T19:23:48.255 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.243+0000 7f8fc17fa640 10 monclient(hunting): _negotiate 2026-02-24T19:23:48.255 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.243+0000 7f8fc17fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:48.255 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.243+0000 7f8fc17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:48.255 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.243+0000 7f8fc17fa640 10 monclient(hunting): my global_id is 28697 2026-02-24T19:23:48.255 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.243+0000 7f8fc17fa640 1 -- 10.20.193.14:0/3130380049 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8fcc1392f0 con 0x7f8fcc157b50 2026-02-24T19:23:48.259 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.245+0000 7f8fc17fa640 1 -- 10.20.193.14:0/3130380049 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2031241999 0 0) 0x7f8f9c003610 con 0x7f8fcc157780 2026-02-24T19:23:48.259 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.245+0000 7f8fc17fa640 1 -- 10.20.193.14:0/3130380049 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8fcc1398b0 con 0x7f8fcc157780 2026-02-24T19:23:48.259 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.245+0000 7f8fc17fa640 1 -- 10.20.193.14:0/3130380049 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f8fbc003310 con 0x7f8fcc157780 2026-02-24T19:23:48.259 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.245+0000 7f8fc17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:48.259 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.245+0000 7f8fc17fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:23:48.259 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.245+0000 7f8fc17fa640 10 monclient(hunting): dump: 2026-02-24T19:23:48.259 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:48.259 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:48.259 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.259 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.259 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:48.260 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:48.260 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:48.260 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:48.260 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:48.260 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:48.260 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.245+0000 7f8fc17fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:23:48.260 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.245+0000 7f8fc17fa640 1 -- 10.20.193.14:0/3130380049 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3206773785 0 0) 0x7f8fcc1395d0 con 0x7f8fcc164d00 2026-02-24T19:23:48.260 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.245+0000 7f8fc17fa640 1 -- 10.20.193.14:0/3130380049 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8f9c003610 con 0x7f8fcc164d00 2026-02-24T19:23:48.260 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.245+0000 7f8fc17fa640 1 -- 10.20.193.14:0/3130380049 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f8fc8003290 con 0x7f8fcc164d00 2026-02-24T19:23:48.260 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.245+0000 7f8fc17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:48.260 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.245+0000 7f8fc17fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:48.260 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.245+0000 7f8fc17fa640 10 monclient(hunting): dump: 2026-02-24T19:23:48.261 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:48.261 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:48.261 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.261 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.261 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:48.261 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:48.261 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:48.261 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:48.261 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:48.261 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:48.261 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.245+0000 7f8fc17fa640 1 -- 10.20.193.14:0/3130380049 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1713330345 0 0) 0x7f8fcc1392f0 con 0x7f8fcc157b50 2026-02-24T19:23:48.261 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.245+0000 7f8fc17fa640 1 -- 10.20.193.14:0/3130380049 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8fcc1395d0 con 0x7f8fcc157b50 2026-02-24T19:23:48.261 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.245+0000 7f8fc17fa640 1 -- 10.20.193.14:0/3130380049 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f8fb4003060 con 0x7f8fcc157b50 2026-02-24T19:23:48.262 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.245+0000 7f8fc17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:48.262 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.245+0000 7f8fc17fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:48.262 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.245+0000 7f8fc17fa640 10 monclient(hunting): dump: 2026-02-24T19:23:48.262 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:48.262 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:48.262 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.262 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.262 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:48.262 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:48.262 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:48.262 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:48.262 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:48.263 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:48.263 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.246+0000 7f8fc17fa640 1 -- 10.20.193.14:0/3130380049 <== mon.1 v1:10.20.193.44:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1742133381 0 0) 0x7f8fcc1398b0 con 0x7f8fcc157780 2026-02-24T19:23:48.263 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.246+0000 7f8fc17fa640 1 -- 10.20.193.14:0/3130380049 >> v1:10.20.193.170:6789/0 conn(0x7f8fcc157b50 legacy=0x7f8fcc0af530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:48.263 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.246+0000 7f8fc17fa640 1 -- 10.20.193.14:0/3130380049 >> v1:10.20.193.14:6789/0 conn(0x7f8fcc164d00 legacy=0x7f8fcc137080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:48.263 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.246+0000 7f8fc17fa640 10 monclient: _finish_hunting 0 2026-02-24T19:23:48.263 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.246+0000 7f8fc17fa640 1 monclient: found mon.b 2026-02-24T19:23:48.263 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.246+0000 7f8fc17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:48.263 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.246+0000 7f8fc17fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:23:48.263 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.246+0000 7f8fc17fa640 1 -- 10.20.193.14:0/3130380049 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fcc139b90 con 0x7f8fcc157780 2026-02-24T19:23:48.263 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.246+0000 7f8fc17fa640 10 monclient: _finish_auth 0 2026-02-24T19:23:48.263 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.246+0000 7f8fc17fa640 10 monclient: _check_auth_tickets 2026-02-24T19:23:48.263 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.246+0000 7f8fc17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:48.263 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.246+0000 7f8fd2f83640 5 monclient: authenticate success, global_id 29059 2026-02-24T19:23:48.264 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.246+0000 7f8fd2f83640 10 monclient: _renew_subs 2026-02-24T19:23:48.264 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.246+0000 7f8fd2f83640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:23:48.264 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.246+0000 7f8fd2f83640 1 -- 10.20.193.14:0/3130380049 --> v1:10.20.193.44:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8fcc15ff30 con 0x7f8fcc157780 2026-02-24T19:23:48.264 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.246+0000 7f8fd2f83640 10 client.29059.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:48.264 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.246+0000 7f8fd2f83640 10 monclient: _renew_subs 2026-02-24T19:23:48.264 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.246+0000 7f8fd2f83640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:23:48.264 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.246+0000 7f8fd2f83640 1 -- 10.20.193.14:0/3130380049 --> v1:10.20.193.44:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8fcc138e90 con 0x7f8fcc157780 2026-02-24T19:23:48.264 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.246+0000 7f8fd2f83640 1 librados: init done 2026-02-24T19:23:48.264 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.247+0000 7f8fd2f83640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:48.264 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.247+0000 7f8fd2f83640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:48.264 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.247+0000 7f8fd2f83640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:23:48.264 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.247+0000 7f8fd2f83640 1 -- 10.20.193.14:0/3130380049 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fcc0b43e0 con 0x7f8fcc157780 2026-02-24T19:23:48.264 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.254+0000 7f8fc17fa640 1 -- 10.20.193.14:0/3130380049 <== mon.1 v1:10.20.193.44:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8fbc002f70 con 0x7f8fcc157780 2026-02-24T19:23:48.264 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.254+0000 7f8fc17fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:48.265 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.254+0000 7f8fc17fa640 1 -- 10.20.193.14:0/3130380049 <== mon.1 v1:10.20.193.44:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f8fbc003b00 con 0x7f8fcc157780 2026-02-24T19:23:48.265 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.254+0000 7f8fc17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:48.265 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.254+0000 7f8fc17fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:48.265 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.254+0000 7f8fc2ffd640 4 set_mon_vals no callback set 2026-02-24T19:23:48.265 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.254+0000 7f8fc17fa640 10 monclient: dump: 2026-02-24T19:23:48.265 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:48.265 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:48.265 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.265 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.265 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:48.265 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:48.265 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:48.265 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:48.266 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:48.266 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:48.266 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.255+0000 7f8fc17fa640 1 -- 10.20.193.14:0/3130380049 <== mon.1 v1:10.20.193.44:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f8fbc003ce0 con 0x7f8fcc157780 2026-02-24T19:23:48.266 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.256+0000 7f8fc3fff640 10 monclient: get_auth_request con 0x7f8f9c077e20 auth_method 0 2026-02-24T19:23:48.266 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.256+0000 7f8fc17fa640 10 client.29059.objecter ms_handle_connect 0x7f8f9c077e20 2026-02-24T19:23:48.267 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.256+0000 7f8fc17fa640 1 -- 10.20.193.14:0/3130380049 <== mon.1 v1:10.20.193.44:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7f8fbc091f10 con 0x7f8fcc157780 2026-02-24T19:23:48.267 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.256+0000 7f8fc17fa640 10 client.29059.objecter ms_dispatch2 0x7f8fcc000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:23:48.267 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.256+0000 7f8fc17fa640 3 client.29059.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:23:48.267 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.256+0000 7f8fc17fa640 3 client.29059.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:23:48.267 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.257+0000 7f8fc17fa640 20 client.29059.objecter dump_active .. 0 homeless 2026-02-24T19:23:48.345 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.343+0000 7f8fc17fa640 1 -- 10.20.193.14:0/3130380049 <== mon.1 v1:10.20.193.44:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f8fbc003b00 con 0x7f8fcc157780 2026-02-24T19:23:48.345 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.343+0000 7f8fc17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:48.345 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.343+0000 7f8fc17fa640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:23:48.453 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.452+0000 7f8fd2f83640 1 -- 10.20.193.14:0/3130380049 --> v1:10.20.193.14:6800/4014096310 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f8fcc138750 con 0x7f8f9c077e20 2026-02-24T19:23:48.454 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.452+0000 7f8fc17fa640 1 -- 10.20.193.14:0/3130380049 <== mgr.4110 v1:10.20.193.14:6800/4014096310 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (unknown 2057319476 0 0) 0x7f8fcc138750 con 0x7f8f9c077e20 2026-02-24T19:23:48.454 INFO:teuthology.orchestra.run.trial014.stderr:instructed osd(s) 0 to deep-scrub 2026-02-24T19:23:48.456 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.454+0000 7f8fd2f83640 10 librados: watch_flush enter 2026-02-24T19:23:48.457 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.454+0000 7f8fd2f83640 10 librados: watch_flush exit 2026-02-24T19:23:48.457 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.454+0000 7f8fd2f83640 20 client.29059.objecter shutdown clearing up homeless session... 2026-02-24T19:23:48.457 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.454+0000 7f8fd2f83640 10 client.29059.objecter successfully canceled tick 2026-02-24T19:23:48.457 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.454+0000 7f8fd2f83640 1 -- 10.20.193.14:0/3130380049 >> v1:10.20.193.14:6800/4014096310 conn(0x7f8f9c077e20 legacy=0x7f8f9c0982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:48.457 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.454+0000 7f8fd2f83640 10 monclient: shutdown 2026-02-24T19:23:48.457 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.454+0000 7f8fd2f83640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:48.457 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.454+0000 7f8fd2f83640 1 -- 10.20.193.14:0/3130380049 >> v1:10.20.193.44:6789/0 conn(0x7f8fcc157780 legacy=0x7f8fcc160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:48.457 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.454+0000 7f8fd2f83640 1 -- 10.20.193.14:0/3130380049 shutdown_connections 2026-02-24T19:23:48.457 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.454+0000 7f8fd2f83640 1 -- 10.20.193.14:0/3130380049 >> 10.20.193.14:0/3130380049 conn(0x7f8fcc0b2ef0 msgr2=0x7f8fcc13b910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:48.457 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.454+0000 7f8fd2f83640 1 -- 10.20.193.14:0/3130380049 shutdown_connections 2026-02-24T19:23:48.457 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.454+0000 7f8fd2f83640 1 -- 10.20.193.14:0/3130380049 wait complete. 2026-02-24T19:23:48.458 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.454+0000 7f8fd2f83640 1 librados: shutdown 2026-02-24T19:23:48.464 INFO:tasks.ceph:Scrubbing osd.4 2026-02-24T19:23:48.465 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:23:48.534 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.531+0000 7f54d9344640 10 monclient: get_monmap_and_config 2026-02-24T19:23:48.534 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.531+0000 7f54d9344640 10 monclient: build_initial_monmap 2026-02-24T19:23:48.534 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.531+0000 7f54d9344640 10 monclient: monmap: 2026-02-24T19:23:48.534 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:48.535 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:48.535 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:23:48.533514+0000 2026-02-24T19:23:48.535 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:23:48.533514+0000 2026-02-24T19:23:48.535 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:48.535 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:48.535 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:48.535 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:48.535 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:48.535 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:48.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.532+0000 7f54d9344640 1 Processor -- start 2026-02-24T19:23:48.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.532+0000 7f54d9344640 1 -- start start 2026-02-24T19:23:48.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.532+0000 7f54d9344640 10 monclient: init 2026-02-24T19:23:48.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.532+0000 7f54d9344640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:48.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.532+0000 7f54d9344640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:23:48.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.532+0000 7f54d9344640 10 monclient(hunting): picked mon.noname-a con 0x7f54d415e2a0 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:48.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.532+0000 7f54d9344640 10 monclient(hunting): picked mon.noname-b con 0x7f54d4059e10 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:48.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.532+0000 7f54d9344640 10 monclient(hunting): picked mon.noname-c con 0x7f54d41a5660 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:48.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.532+0000 7f54d9344640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54d4162df0 con 0x7f54d415e2a0 2026-02-24T19:23:48.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.532+0000 7f54d9344640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54d41630d0 con 0x7f54d4059e10 2026-02-24T19:23:48.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.532+0000 7f54d9344640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54d41633b0 con 0x7f54d41a5660 2026-02-24T19:23:48.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.532+0000 7f54d9344640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:48.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.532+0000 7f54d9344640 10 monclient(hunting): authenticate will time out at 4003.214967s 2026-02-24T19:23:48.538 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.533+0000 7f54d2ffd640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f54d415e2a0 0x7f54d405da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:50668/0 (socket says 10.20.193.14:50668) 2026-02-24T19:23:48.538 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.533+0000 7f54d2ffd640 1 -- 10.20.193.14:0/2060716695 learned_addr learned my addr 10.20.193.14:0/2060716695 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:48.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.534+0000 7f54d1ffb640 1 -- 10.20.193.14:0/2060716695 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 754062979 0 0) 0x7f54d4162df0 con 0x7f54d415e2a0 2026-02-24T19:23:48.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.534+0000 7f54d1ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:23:48.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.534+0000 7f54d1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:48.542 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.534+0000 7f54d1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:48.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.534+0000 7f54d1ffb640 10 monclient(hunting): my global_id is 30741 2026-02-24T19:23:48.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.534+0000 7f54d1ffb640 1 -- 10.20.193.14:0/2060716695 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54c0003610 con 0x7f54d415e2a0 2026-02-24T19:23:48.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.534+0000 7f54d1ffb640 1 -- 10.20.193.14:0/2060716695 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3636385254 0 0) 0x7f54d41633b0 con 0x7f54d41a5660 2026-02-24T19:23:48.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.534+0000 7f54d1ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:23:48.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.534+0000 7f54d1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:48.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.534+0000 7f54d1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:48.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.534+0000 7f54d1ffb640 10 monclient(hunting): my global_id is 28700 2026-02-24T19:23:48.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.534+0000 7f54d1ffb640 1 -- 10.20.193.14:0/2060716695 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54d4162df0 con 0x7f54d41a5660 2026-02-24T19:23:48.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.535+0000 7f54d1ffb640 1 -- 10.20.193.14:0/2060716695 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3715599794 0 0) 0x7f54d41630d0 con 0x7f54d4059e10 2026-02-24T19:23:48.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.535+0000 7f54d1ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:23:48.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.535+0000 7f54d1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:48.543 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.535+0000 7f54d1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:48.544 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.535+0000 7f54d1ffb640 10 monclient(hunting): my global_id is 29062 2026-02-24T19:23:48.544 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.535+0000 7f54d1ffb640 1 -- 10.20.193.14:0/2060716695 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54d41633b0 con 0x7f54d4059e10 2026-02-24T19:23:48.544 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.536+0000 7f54d1ffb640 1 -- 10.20.193.14:0/2060716695 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 507943572 0 0) 0x7f54c0003610 con 0x7f54d415e2a0 2026-02-24T19:23:48.544 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.536+0000 7f54d1ffb640 1 -- 10.20.193.14:0/2060716695 >> v1:10.20.193.170:6789/0 conn(0x7f54d41a5660 legacy=0x7f54d41c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:48.544 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.536+0000 7f54d1ffb640 1 -- 10.20.193.14:0/2060716695 >> v1:10.20.193.44:6789/0 conn(0x7f54d4059e10 legacy=0x7f54d415ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:48.544 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.536+0000 7f54d1ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:23:48.544 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.536+0000 7f54d1ffb640 1 monclient: found mon.noname-a 2026-02-24T19:23:48.544 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.536+0000 7f54d1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:48.544 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.536+0000 7f54d1ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:23:48.544 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.536+0000 7f54d1ffb640 1 -- 10.20.193.14:0/2060716695 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d4163690 con 0x7f54d415e2a0 2026-02-24T19:23:48.544 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.536+0000 7f54d1ffb640 10 monclient: _finish_auth 0 2026-02-24T19:23:48.544 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.536+0000 7f54d1ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:23:48.544 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.536+0000 7f54d1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:48.545 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.536+0000 7f54d1ffb640 1 -- 10.20.193.14:0/2060716695 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f54c8002df0 con 0x7f54d415e2a0 2026-02-24T19:23:48.545 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.536+0000 7f54d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:48.545 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.536+0000 7f54d1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:23:48.545 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.536+0000 7f54d1ffb640 10 monclient: dump: 2026-02-24T19:23:48.545 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:48.545 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:48.545 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.545 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.545 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:48.545 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:48.545 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:48.545 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:48.545 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:48.546 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:48.546 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.536+0000 7f54d9344640 5 monclient: authenticate success, global_id 30741 2026-02-24T19:23:48.546 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.536+0000 7f54d9344640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:48.546 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.537+0000 7f54d1ffb640 1 -- 10.20.193.14:0/2060716695 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f54c8003040 con 0x7f54d415e2a0 2026-02-24T19:23:48.546 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.537+0000 7f54d1ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:48.546 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.537+0000 7f54d1ffb640 1 -- 10.20.193.14:0/2060716695 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f54c8003480 con 0x7f54d415e2a0 2026-02-24T19:23:48.546 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.537+0000 7f54d9344640 10 monclient: get_monmap_and_config success 2026-02-24T19:23:48.546 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.537+0000 7f54d9344640 4 set_mon_vals no callback set 2026-02-24T19:23:48.546 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.537+0000 7f54d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:48.546 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.537+0000 7f54d1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:48.546 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.537+0000 7f54d1ffb640 10 monclient: dump: 2026-02-24T19:23:48.546 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:48.547 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:48.547 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.547 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.547 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:48.547 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:48.547 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:48.547 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:48.547 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:48.547 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:48.547 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.537+0000 7f54d9344640 10 monclient: shutdown 2026-02-24T19:23:48.547 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.537+0000 7f54d9344640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:48.547 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.537+0000 7f54d9344640 1 -- 10.20.193.14:0/2060716695 >> v1:10.20.193.14:6789/0 conn(0x7f54d415e2a0 legacy=0x7f54d405da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:48.547 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.537+0000 7f54d9344640 1 -- 10.20.193.14:0/2060716695 shutdown_connections 2026-02-24T19:23:48.548 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.537+0000 7f54d9344640 1 -- 10.20.193.14:0/2060716695 >> 10.20.193.14:0/2060716695 conn(0x7f54d40b2f60 msgr2=0x7f54d40b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:48.548 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.537+0000 7f54d9344640 1 -- 10.20.193.14:0/2060716695 shutdown_connections 2026-02-24T19:23:48.548 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.537+0000 7f54d9344640 1 -- 10.20.193.14:0/2060716695 wait complete. 2026-02-24T19:23:48.548 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.538+0000 7f54d9344640 10 monclient: build_initial_monmap 2026-02-24T19:23:48.548 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.538+0000 7f54d9344640 10 monclient: monmap: 2026-02-24T19:23:48.548 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:48.548 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:23:48.548 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:23:48.548 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:23:48.548 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:48.548 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:23:48.548 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:48.548 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:48.549 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:48.549 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:48.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.538+0000 7f54d9344640 1 librados: starting msgr at 2026-02-24T19:23:48.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.538+0000 7f54d9344640 1 librados: starting objecter 2026-02-24T19:23:48.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.538+0000 7f54d9344640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:23:48.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.538+0000 7f54d9344640 1 Processor -- start 2026-02-24T19:23:48.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.538+0000 7f54d9344640 1 -- start start 2026-02-24T19:23:48.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.538+0000 7f54d9344640 1 librados: setting wanted keys 2026-02-24T19:23:48.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.538+0000 7f54d9344640 1 librados: calling monclient init 2026-02-24T19:23:48.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.538+0000 7f54d9344640 10 monclient: init 2026-02-24T19:23:48.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.539+0000 7f54d9344640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:48.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.539+0000 7f54d9344640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:23:48.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.539+0000 7f54d9344640 10 monclient(hunting): picked mon.noname-c con 0x7f54d4059e10 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:48.550 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.539+0000 7f54d9344640 10 monclient(hunting): picked mon.noname-a con 0x7f54d415e2a0 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:48.550 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.539+0000 7f54d9344640 10 monclient(hunting): picked mon.noname-b con 0x7f54d41a5660 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:48.550 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.539+0000 7f54d9344640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54d412a4a0 con 0x7f54d415e2a0 2026-02-24T19:23:48.550 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.539+0000 7f54d9344640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54d412a760 con 0x7f54d41a5660 2026-02-24T19:23:48.550 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.539+0000 7f54d9344640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54d412aa40 con 0x7f54d4059e10 2026-02-24T19:23:48.550 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.539+0000 7f54d9344640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:48.550 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.539+0000 7f54d9344640 10 monclient(hunting): authenticate will time out at 4003.221141s 2026-02-24T19:23:48.550 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.539+0000 7f54d27fc640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f54d415e2a0 0x7f54d4129d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:50676/0 (socket says 10.20.193.14:50676) 2026-02-24T19:23:48.550 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.539+0000 7f54d27fc640 1 -- 10.20.193.14:0/4271176975 learned_addr learned my addr 10.20.193.14:0/4271176975 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:48.550 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.539+0000 7f54b37fe640 10 client.?.objecter ms_handle_connect 0x7f54d415e2a0 2026-02-24T19:23:48.550 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.539+0000 7f54b37fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:48.550 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.539+0000 7f54b37fe640 10 client.?.objecter ms_handle_connect 0x7f54d4059e10 2026-02-24T19:23:48.551 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.539+0000 7f54b37fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:48.551 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.539+0000 7f54b37fe640 10 client.?.objecter ms_handle_connect 0x7f54d41a5660 2026-02-24T19:23:48.551 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.539+0000 7f54b37fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:48.554 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.540+0000 7f54b37fe640 1 -- 10.20.193.14:0/4271176975 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4084747409 0 0) 0x7f54d412a4a0 con 0x7f54d415e2a0 2026-02-24T19:23:48.554 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.540+0000 7f54b37fe640 10 monclient(hunting): _negotiate 2026-02-24T19:23:48.554 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.540+0000 7f54b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:48.554 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.540+0000 7f54b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:48.555 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.540+0000 7f54b37fe640 10 monclient(hunting): my global_id is 30744 2026-02-24T19:23:48.555 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.540+0000 7f54b37fe640 1 -- 10.20.193.14:0/4271176975 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54a0003610 con 0x7f54d415e2a0 2026-02-24T19:23:48.555 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.540+0000 7f54b37fe640 1 -- 10.20.193.14:0/4271176975 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1963591115 0 0) 0x7f54d412aa40 con 0x7f54d4059e10 2026-02-24T19:23:48.555 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.540+0000 7f54b37fe640 10 monclient(hunting): _negotiate 2026-02-24T19:23:48.555 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.540+0000 7f54b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:48.555 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.540+0000 7f54b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:48.555 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.540+0000 7f54b37fe640 10 monclient(hunting): my global_id is 28703 2026-02-24T19:23:48.555 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.540+0000 7f54b37fe640 1 -- 10.20.193.14:0/4271176975 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54d412a4a0 con 0x7f54d4059e10 2026-02-24T19:23:48.555 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.540+0000 7f54b37fe640 1 -- 10.20.193.14:0/4271176975 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2141194649 0 0) 0x7f54d412a760 con 0x7f54d41a5660 2026-02-24T19:23:48.555 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.540+0000 7f54b37fe640 10 monclient(hunting): _negotiate 2026-02-24T19:23:48.555 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.540+0000 7f54b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:48.555 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.540+0000 7f54b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:48.556 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.540+0000 7f54b37fe640 10 monclient(hunting): my global_id is 29065 2026-02-24T19:23:48.556 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.540+0000 7f54b37fe640 1 -- 10.20.193.14:0/4271176975 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54d412aa40 con 0x7f54d41a5660 2026-02-24T19:23:48.556 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.543+0000 7f54b37fe640 1 -- 10.20.193.14:0/4271176975 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3425087623 0 0) 0x7f54a0003610 con 0x7f54d415e2a0 2026-02-24T19:23:48.556 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.543+0000 7f54b37fe640 1 -- 10.20.193.14:0/4271176975 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f54d412a760 con 0x7f54d415e2a0 2026-02-24T19:23:48.556 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.543+0000 7f54b37fe640 1 -- 10.20.193.14:0/4271176975 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f54bc0030c0 con 0x7f54d415e2a0 2026-02-24T19:23:48.556 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.543+0000 7f54b37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:48.556 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.543+0000 7f54b37fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:23:48.556 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.543+0000 7f54b37fe640 10 monclient(hunting): dump: 2026-02-24T19:23:48.556 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:48.556 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:48.556 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.556 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.556 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:48.557 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:48.557 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:48.557 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:48.557 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:48.557 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:48.557 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.543+0000 7f54b37fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:23:48.557 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.543+0000 7f54b37fe640 1 -- 10.20.193.14:0/4271176975 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1572095515 0 0) 0x7f54d412aa40 con 0x7f54d41a5660 2026-02-24T19:23:48.557 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.543+0000 7f54b37fe640 1 -- 10.20.193.14:0/4271176975 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f54a0003610 con 0x7f54d41a5660 2026-02-24T19:23:48.557 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.543+0000 7f54b37fe640 1 -- 10.20.193.14:0/4271176975 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f54c4003430 con 0x7f54d41a5660 2026-02-24T19:23:48.557 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.543+0000 7f54b37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:48.557 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.543+0000 7f54b37fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:48.557 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.543+0000 7f54b37fe640 10 monclient(hunting): dump: 2026-02-24T19:23:48.558 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:48.558 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:48.558 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.558 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.558 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:48.558 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:48.558 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:48.558 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:48.558 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:48.558 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:48.558 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.543+0000 7f54b37fe640 1 -- 10.20.193.14:0/4271176975 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2603623963 0 0) 0x7f54d412a4a0 con 0x7f54d4059e10 2026-02-24T19:23:48.558 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.543+0000 7f54b37fe640 1 -- 10.20.193.14:0/4271176975 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f54d412aa40 con 0x7f54d4059e10 2026-02-24T19:23:48.558 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.543+0000 7f54b37fe640 1 -- 10.20.193.14:0/4271176975 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f54c80031f0 con 0x7f54d4059e10 2026-02-24T19:23:48.559 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.543+0000 7f54b37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:48.559 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.543+0000 7f54b37fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:48.559 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.543+0000 7f54b37fe640 10 monclient(hunting): dump: 2026-02-24T19:23:48.559 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:48.559 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:48.559 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.559 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.559 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:48.559 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:48.559 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:48.559 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:48.559 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:48.560 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:48.560 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.544+0000 7f54b37fe640 1 -- 10.20.193.14:0/4271176975 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 38994361 0 0) 0x7f54d412a760 con 0x7f54d415e2a0 2026-02-24T19:23:48.560 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.544+0000 7f54b37fe640 1 -- 10.20.193.14:0/4271176975 >> v1:10.20.193.170:6789/0 conn(0x7f54d4059e10 legacy=0x7f54d412b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:48.560 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.544+0000 7f54b37fe640 1 -- 10.20.193.14:0/4271176975 >> v1:10.20.193.44:6789/0 conn(0x7f54d41a5660 legacy=0x7f54d40b2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:48.560 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.544+0000 7f54b37fe640 10 monclient: _finish_hunting 0 2026-02-24T19:23:48.560 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.544+0000 7f54b37fe640 1 monclient: found mon.a 2026-02-24T19:23:48.560 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.544+0000 7f54b37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:48.560 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.544+0000 7f54b37fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:48.560 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.544+0000 7f54b37fe640 1 -- 10.20.193.14:0/4271176975 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d40a79e0 con 0x7f54d415e2a0 2026-02-24T19:23:48.560 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.544+0000 7f54b37fe640 10 monclient: _finish_auth 0 2026-02-24T19:23:48.560 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.544+0000 7f54b37fe640 10 monclient: _check_auth_tickets 2026-02-24T19:23:48.560 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.544+0000 7f54b37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:48.560 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.544+0000 7f54d9344640 5 monclient: authenticate success, global_id 30744 2026-02-24T19:23:48.561 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.544+0000 7f54d9344640 10 monclient: _renew_subs 2026-02-24T19:23:48.561 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.544+0000 7f54d9344640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:48.561 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.544+0000 7f54d9344640 1 -- 10.20.193.14:0/4271176975 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f54d40a7cc0 con 0x7f54d415e2a0 2026-02-24T19:23:48.561 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.544+0000 7f54d9344640 10 client.30744.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:48.561 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.544+0000 7f54d9344640 10 monclient: _renew_subs 2026-02-24T19:23:48.561 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.544+0000 7f54d9344640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:48.561 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.544+0000 7f54d9344640 1 -- 10.20.193.14:0/4271176975 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f54d40a86a0 con 0x7f54d415e2a0 2026-02-24T19:23:48.561 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.544+0000 7f54d9344640 1 librados: init done 2026-02-24T19:23:48.561 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.545+0000 7f54d9344640 10 client.30744.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:48.561 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.545+0000 7f54d9344640 15 client.30744.objecter _session_command_op_assign -1 1 2026-02-24T19:23:48.561 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.545+0000 7f54d9344640 20 client.30744.objecter _get_session osd=-1 returning homeless 2026-02-24T19:23:48.561 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.545+0000 7f54d9344640 10 client.30744.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:48.561 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.545+0000 7f54d9344640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:48.562 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.545+0000 7f54d9344640 1 -- 10.20.193.14:0/4271176975 --> v1:10.20.193.14:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f54d40a9350 con 0x7f54d415e2a0 2026-02-24T19:23:48.563 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.553+0000 7f54b37fe640 1 -- 10.20.193.14:0/4271176975 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f54d40a9350 con 0x7f54d415e2a0 2026-02-24T19:23:48.564 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.553+0000 7f54b37fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:48.564 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.553+0000 7f54b37fe640 1 -- 10.20.193.14:0/4271176975 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f54bc0038a0 con 0x7f54d415e2a0 2026-02-24T19:23:48.564 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.553+0000 7f54b37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:48.564 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.553+0000 7f54b37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:48.564 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.553+0000 7f54d17fa640 4 set_mon_vals no callback set 2026-02-24T19:23:48.564 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.553+0000 7f54b37fe640 10 monclient: dump: 2026-02-24T19:23:48.564 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:48.564 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:48.564 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.564 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.564 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:48.564 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:48.565 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:48.565 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:48.565 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:48.565 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:48.565 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.553+0000 7f54b37fe640 1 -- 10.20.193.14:0/4271176975 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f54bc003ab0 con 0x7f54d415e2a0 2026-02-24T19:23:48.565 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.554+0000 7f54d2ffd640 10 monclient: get_auth_request con 0x7f54a0077e70 auth_method 0 2026-02-24T19:23:48.565 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.554+0000 7f54b37fe640 10 client.30744.objecter ms_handle_connect 0x7f54a0077e70 2026-02-24T19:23:48.565 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.555+0000 7f54b37fe640 1 -- 10.20.193.14:0/4271176975 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7f54bc0038a0 con 0x7f54d415e2a0 2026-02-24T19:23:48.565 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.555+0000 7f54b37fe640 10 client.30744.objecter ms_dispatch2 0x7f54d4000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:23:48.565 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.555+0000 7f54b37fe640 3 client.30744.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:23:48.565 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.555+0000 7f54b37fe640 3 client.30744.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:23:48.565 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.555+0000 7f54b37fe640 10 client.30744.objecter checking command 1 2026-02-24T19:23:48.565 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.555+0000 7f54b37fe640 20 client.30744.objecter _get_session s=0x7f54a00a2130 osd=4 3 2026-02-24T19:23:48.566 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.555+0000 7f54b37fe640 20 client.30744.objecter put_session s=0x7f54a00a2130 osd=4 3 2026-02-24T19:23:48.566 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.555+0000 7f54b37fe640 15 client.30744.objecter _session_command_op_remove -1 1 2026-02-24T19:23:48.566 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.555+0000 7f54b37fe640 20 client.30744.objecter _get_session s=0x7f54a00a2130 osd=4 3 2026-02-24T19:23:48.566 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.555+0000 7f54b37fe640 20 client.30744.objecter get_session s=0x7f54a00a2130 osd=4 3 2026-02-24T19:23:48.566 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.555+0000 7f54b37fe640 15 client.30744.objecter _session_command_op_assign 4 1 2026-02-24T19:23:48.566 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.555+0000 7f54b37fe640 20 client.30744.objecter put_session s=0x7f54a00a2130 osd=4 4 2026-02-24T19:23:48.566 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.555+0000 7f54b37fe640 10 client.30744.objecter _send_command 1 2026-02-24T19:23:48.566 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.555+0000 7f54b37fe640 1 -- 10.20.193.14:0/4271176975 --> v1:10.20.193.14:6805/4020872388 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f54a00c4440 con 0x7f54a00a27e0 2026-02-24T19:23:48.566 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.555+0000 7f54b37fe640 20 client.30744.objecter dump_active .. 0 homeless 2026-02-24T19:23:48.566 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.555+0000 7f54b37fe640 1 -- 10.20.193.14:0/4271176975 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_get_version_reply(handle=1 version=354) ==== 24+0+0 (unknown 31317031 0 0) 0x7f54bc05d0e0 con 0x7f54d415e2a0 2026-02-24T19:23:48.566 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.555+0000 7f54b37fe640 10 monclient: handle_get_version_reply finishing 1 version 354 2026-02-24T19:23:48.566 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.555+0000 7f54d37fe640 10 monclient: get_auth_request con 0x7f54a00a27e0 auth_method 0 2026-02-24T19:23:48.566 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.556+0000 7f54b37fe640 10 client.30744.objecter ms_handle_connect 0x7f54a00a27e0 2026-02-24T19:23:48.569 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.566+0000 7f54b37fe640 1 -- 10.20.193.14:0/4271176975 <== osd.4 v1:10.20.193.14:6805/4020872388 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f54a00c4440 con 0x7f54a00a27e0 2026-02-24T19:23:48.569 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.566+0000 7f54b37fe640 10 client.30744.objecter ms_dispatch2 0x7f54d4000b90 command_reply(tid 1: 0 ) 2026-02-24T19:23:48.569 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.566+0000 7f54b37fe640 10 client.30744.objecter _finish_command 1 = system:0 2026-02-24T19:23:48.569 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.566+0000 7f54b37fe640 20 client.30744.objecter put_session s=0x7f54a00a2130 osd=4 4 2026-02-24T19:23:48.569 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.566+0000 7f54b37fe640 15 client.30744.objecter _session_command_op_remove 4 1 2026-02-24T19:23:48.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.574+0000 7f54d9344640 10 client.30744.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:23:48.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.574+0000 7f54d9344640 15 client.30744.objecter _session_command_op_assign -1 2 2026-02-24T19:23:48.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.574+0000 7f54d9344640 20 client.30744.objecter _get_session s=0x7f54a00a2130 osd=4 3 2026-02-24T19:23:48.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.574+0000 7f54d9344640 20 client.30744.objecter put_session s=0x7f54a00a2130 osd=4 3 2026-02-24T19:23:48.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.574+0000 7f54d9344640 20 client.30744.objecter _get_session s=0x7f54a00a2130 osd=4 3 2026-02-24T19:23:48.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.574+0000 7f54d9344640 15 client.30744.objecter _session_command_op_remove -1 2 2026-02-24T19:23:48.576 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.574+0000 7f54d9344640 20 client.30744.objecter get_session s=0x7f54a00a2130 osd=4 3 2026-02-24T19:23:48.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.574+0000 7f54d9344640 15 client.30744.objecter _session_command_op_assign 4 2 2026-02-24T19:23:48.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.574+0000 7f54d9344640 20 client.30744.objecter put_session s=0x7f54a00a2130 osd=4 4 2026-02-24T19:23:48.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.574+0000 7f54d9344640 10 client.30744.objecter _send_command 2 2026-02-24T19:23:48.577 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.574+0000 7f54d9344640 1 -- 10.20.193.14:0/4271176975 --> v1:10.20.193.14:6805/4020872388 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f54d41645a0 con 0x7f54a00a27e0 2026-02-24T19:23:48.584 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.581+0000 7f54b37fe640 1 -- 10.20.193.14:0/4271176975 <== osd.4 v1:10.20.193.14:6805/4020872388 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f54d41645a0 con 0x7f54a00a27e0 2026-02-24T19:23:48.584 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.581+0000 7f54b37fe640 10 client.30744.objecter ms_dispatch2 0x7f54d4000b90 command_reply(tid 2: 0 ) 2026-02-24T19:23:48.585 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.581+0000 7f54b37fe640 10 client.30744.objecter _finish_command 2 = system:0 2026-02-24T19:23:48.585 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.581+0000 7f54b37fe640 20 client.30744.objecter put_session s=0x7f54a00a2130 osd=4 4 2026-02-24T19:23:48.585 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.581+0000 7f54b37fe640 15 client.30744.objecter _session_command_op_remove 4 2 2026-02-24T19:23:48.585 INFO:teuthology.orchestra.run.trial014.stdout:{ 2026-02-24T19:23:48.585 INFO:teuthology.orchestra.run.trial014.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:23:48.585 INFO:teuthology.orchestra.run.trial014.stdout:} 2026-02-24T19:23:48.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.581+0000 7f54d9344640 10 librados: watch_flush enter 2026-02-24T19:23:48.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.581+0000 7f54d9344640 10 librados: watch_flush exit 2026-02-24T19:23:48.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.581+0000 7f54d9344640 10 client.30744.objecter close_session for osd.4 2026-02-24T19:23:48.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.581+0000 7f54d9344640 1 -- 10.20.193.14:0/4271176975 >> v1:10.20.193.14:6805/4020872388 conn(0x7f54a00a27e0 legacy=0x7f54a00c2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:48.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.581+0000 7f54d9344640 20 client.30744.objecter put_session s=0x7f54a00a2130 osd=4 1 2026-02-24T19:23:48.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.581+0000 7f54d9344640 20 client.30744.objecter shutdown clearing up homeless session... 2026-02-24T19:23:48.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.581+0000 7f54d9344640 10 client.30744.objecter successfully canceled tick 2026-02-24T19:23:48.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.582+0000 7f54d9344640 1 -- 10.20.193.14:0/4271176975 >> v1:10.20.193.14:6800/4014096310 conn(0x7f54a0077e70 legacy=0x7f54a0098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:48.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.582+0000 7f54d9344640 10 monclient: shutdown 2026-02-24T19:23:48.587 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.582+0000 7f54d9344640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:48.588 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.582+0000 7f54d9344640 1 -- 10.20.193.14:0/4271176975 >> v1:10.20.193.14:6789/0 conn(0x7f54d415e2a0 legacy=0x7f54d4129d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:48.588 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.582+0000 7f54d37fe640 1 -- 10.20.193.14:0/4271176975 reap_dead start 2026-02-24T19:23:48.588 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.582+0000 7f54d9344640 1 -- 10.20.193.14:0/4271176975 shutdown_connections 2026-02-24T19:23:48.588 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.582+0000 7f54d9344640 1 -- 10.20.193.14:0/4271176975 >> 10.20.193.14:0/4271176975 conn(0x7f54d40b2f60 msgr2=0x7f54d4195db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:48.588 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.582+0000 7f54d9344640 1 -- 10.20.193.14:0/4271176975 shutdown_connections 2026-02-24T19:23:48.588 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.582+0000 7f54d9344640 1 -- 10.20.193.14:0/4271176975 wait complete. 2026-02-24T19:23:48.588 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.582+0000 7f54d9344640 1 librados: shutdown 2026-02-24T19:23:48.593 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2026-02-24T19:23:48.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.660+0000 7fa00db45640 10 monclient: get_monmap_and_config 2026-02-24T19:23:48.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.660+0000 7fa00db45640 10 monclient: build_initial_monmap 2026-02-24T19:23:48.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.660+0000 7fa00db45640 10 monclient: monmap: 2026-02-24T19:23:48.662 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:48.662 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:48.662 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:23:48.661220+0000 2026-02-24T19:23:48.662 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:23:48.661220+0000 2026-02-24T19:23:48.662 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:48.663 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:48.663 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:48.663 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:48.663 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:48.663 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:48.664 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.661+0000 7fa00db45640 1 Processor -- start 2026-02-24T19:23:48.665 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.661+0000 7fa00db45640 1 -- start start 2026-02-24T19:23:48.665 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.661+0000 7fa00db45640 10 monclient: init 2026-02-24T19:23:48.665 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.661+0000 7fa00db45640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:48.665 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.661+0000 7fa00db45640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:23:48.665 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.661+0000 7fa00db45640 10 monclient(hunting): picked mon.noname-a con 0x7fa008157780 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:48.665 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.661+0000 7fa00db45640 10 monclient(hunting): picked mon.noname-c con 0x7fa008157b50 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:48.665 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.661+0000 7fa00db45640 10 monclient(hunting): picked mon.noname-b con 0x7fa008164d00 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:48.665 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.661+0000 7fa00db45640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa00805de70 con 0x7fa008157780 2026-02-24T19:23:48.665 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.661+0000 7fa00db45640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa008055b20 con 0x7fa008164d00 2026-02-24T19:23:48.665 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.662+0000 7fa00db45640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa008055e00 con 0x7fa008157b50 2026-02-24T19:23:48.665 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.662+0000 7fa00db45640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:48.666 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.662+0000 7fa00db45640 10 monclient(hunting): authenticate will time out at 4003.343023s 2026-02-24T19:23:48.666 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.662+0000 7fa0077fe640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7fa008157780 0x7fa008056ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:50690/0 (socket says 10.20.193.14:50690) 2026-02-24T19:23:48.666 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.662+0000 7fa0077fe640 1 -- 10.20.193.14:0/19608917 learned_addr learned my addr 10.20.193.14:0/19608917 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:48.670 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.662+0000 7fa0067fc640 1 -- 10.20.193.14:0/19608917 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2385034451 0 0) 0x7fa00805de70 con 0x7fa008157780 2026-02-24T19:23:48.670 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.662+0000 7fa0067fc640 10 monclient(hunting): _negotiate 2026-02-24T19:23:48.670 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.662+0000 7fa0067fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:48.670 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.662+0000 7fa0067fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:48.670 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.662+0000 7fa0067fc640 10 monclient(hunting): my global_id is 30747 2026-02-24T19:23:48.670 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.662+0000 7fa0067fc640 1 -- 10.20.193.14:0/19608917 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9fec003610 con 0x7fa008157780 2026-02-24T19:23:48.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.662+0000 7fa0067fc640 1 -- 10.20.193.14:0/19608917 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3112010572 0 0) 0x7fa008055b20 con 0x7fa008164d00 2026-02-24T19:23:48.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.662+0000 7fa0067fc640 10 monclient(hunting): _negotiate 2026-02-24T19:23:48.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.662+0000 7fa0067fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:48.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.662+0000 7fa0067fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:48.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.662+0000 7fa0067fc640 10 monclient(hunting): my global_id is 29068 2026-02-24T19:23:48.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.662+0000 7fa0067fc640 1 -- 10.20.193.14:0/19608917 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa00805de70 con 0x7fa008164d00 2026-02-24T19:23:48.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.663+0000 7fa0067fc640 1 -- 10.20.193.14:0/19608917 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2034141527 0 0) 0x7fa008055e00 con 0x7fa008157b50 2026-02-24T19:23:48.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.663+0000 7fa0067fc640 10 monclient(hunting): _negotiate 2026-02-24T19:23:48.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.663+0000 7fa0067fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:48.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.663+0000 7fa0067fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:48.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.663+0000 7fa0067fc640 10 monclient(hunting): my global_id is 28706 2026-02-24T19:23:48.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.663+0000 7fa0067fc640 1 -- 10.20.193.14:0/19608917 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa008055b20 con 0x7fa008157b50 2026-02-24T19:23:48.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.665+0000 7fa0067fc640 1 -- 10.20.193.14:0/19608917 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 567905763 0 0) 0x7fa00805de70 con 0x7fa008164d00 2026-02-24T19:23:48.672 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.665+0000 7fa0067fc640 1 -- 10.20.193.14:0/19608917 >> v1:10.20.193.170:6789/0 conn(0x7fa008157b50 legacy=0x7fa0081645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:48.672 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.665+0000 7fa0067fc640 1 -- 10.20.193.14:0/19608917 >> v1:10.20.193.14:6789/0 conn(0x7fa008157780 legacy=0x7fa008056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:48.672 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.665+0000 7fa0067fc640 10 monclient: _finish_hunting 0 2026-02-24T19:23:48.672 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.665+0000 7fa0067fc640 1 monclient: found mon.noname-b 2026-02-24T19:23:48.672 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.665+0000 7fa0067fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:48.672 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.665+0000 7fa0067fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.44:6789/0 2026-02-24T19:23:48.672 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.665+0000 7fa0067fc640 1 -- 10.20.193.14:0/19608917 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0080560e0 con 0x7fa008164d00 2026-02-24T19:23:48.672 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.665+0000 7fa0067fc640 10 monclient: _finish_auth 0 2026-02-24T19:23:48.672 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.665+0000 7fa0067fc640 10 monclient: _check_auth_tickets 2026-02-24T19:23:48.672 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.665+0000 7fa0067fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:48.672 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.665+0000 7fa0067fc640 1 -- 10.20.193.14:0/19608917 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f9ffc003170 con 0x7fa008164d00 2026-02-24T19:23:48.672 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.665+0000 7fa0067fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:48.672 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.665+0000 7fa0067fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:23:48.673 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.665+0000 7fa0067fc640 10 monclient: dump: 2026-02-24T19:23:48.673 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:48.673 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:48.673 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.673 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.673 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:48.673 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:48.673 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:48.673 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:48.673 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:48.673 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:48.673 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.665+0000 7fa00db45640 5 monclient: authenticate success, global_id 29068 2026-02-24T19:23:48.674 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.665+0000 7fa00db45640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:48.674 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.666+0000 7fa0067fc640 1 -- 10.20.193.14:0/19608917 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9ffc003340 con 0x7fa008164d00 2026-02-24T19:23:48.674 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.666+0000 7fa0067fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:48.674 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.666+0000 7fa0067fc640 1 -- 10.20.193.14:0/19608917 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f9ffc003780 con 0x7fa008164d00 2026-02-24T19:23:48.674 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.666+0000 7fa0067fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:48.674 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.666+0000 7fa0067fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:48.674 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.666+0000 7fa0067fc640 10 monclient: dump: 2026-02-24T19:23:48.674 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:48.674 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:48.674 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.674 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.674 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:48.674 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:48.675 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:48.675 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:48.675 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:48.675 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:48.675 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.666+0000 7fa00db45640 10 monclient: get_monmap_and_config success 2026-02-24T19:23:48.675 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.666+0000 7fa00db45640 4 set_mon_vals no callback set 2026-02-24T19:23:48.675 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.666+0000 7fa00db45640 10 monclient: shutdown 2026-02-24T19:23:48.675 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.666+0000 7fa00db45640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:48.675 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.666+0000 7fa00db45640 1 -- 10.20.193.14:0/19608917 >> v1:10.20.193.44:6789/0 conn(0x7fa008164d00 legacy=0x7fa0081c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:48.675 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.666+0000 7fa00db45640 1 -- 10.20.193.14:0/19608917 shutdown_connections 2026-02-24T19:23:48.675 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.666+0000 7fa00db45640 1 -- 10.20.193.14:0/19608917 >> 10.20.193.14:0/19608917 conn(0x7fa0080b2ef0 msgr2=0x7fa0080b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:48.675 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.666+0000 7fa00db45640 1 -- 10.20.193.14:0/19608917 shutdown_connections 2026-02-24T19:23:48.675 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.666+0000 7fa00db45640 1 -- 10.20.193.14:0/19608917 wait complete. 2026-02-24T19:23:48.676 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.667+0000 7fa00db45640 10 monclient: build_initial_monmap 2026-02-24T19:23:48.676 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.667+0000 7fa00db45640 10 monclient: monmap: 2026-02-24T19:23:48.676 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:48.676 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:23:48.676 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:23:48.676 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:23:48.676 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:48.676 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:23:48.676 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:48.676 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:48.676 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:48.676 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:48.676 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.667+0000 7fa00db45640 1 librados: starting msgr at 2026-02-24T19:23:48.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.667+0000 7fa00db45640 1 librados: starting objecter 2026-02-24T19:23:48.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.667+0000 7fa00db45640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:23:48.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.667+0000 7fa00db45640 1 Processor -- start 2026-02-24T19:23:48.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.667+0000 7fa00db45640 1 -- start start 2026-02-24T19:23:48.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.667+0000 7fa00db45640 1 librados: setting wanted keys 2026-02-24T19:23:48.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.667+0000 7fa00db45640 1 librados: calling monclient init 2026-02-24T19:23:48.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.667+0000 7fa00db45640 10 monclient: init 2026-02-24T19:23:48.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.667+0000 7fa00db45640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:48.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.667+0000 7fa00db45640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:23:48.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.667+0000 7fa00db45640 10 monclient(hunting): picked mon.noname-b con 0x7fa008157780 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:48.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.667+0000 7fa00db45640 10 monclient(hunting): picked mon.noname-c con 0x7fa008157b50 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:48.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.667+0000 7fa00db45640 10 monclient(hunting): picked mon.noname-a con 0x7fa008164d00 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:48.677 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.667+0000 7fa00db45640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa008131050 con 0x7fa008164d00 2026-02-24T19:23:48.678 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.667+0000 7fa00db45640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa008131330 con 0x7fa008157780 2026-02-24T19:23:48.678 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.667+0000 7fa00db45640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa008131610 con 0x7fa008157b50 2026-02-24T19:23:48.678 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.667+0000 7fa00db45640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:48.678 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.667+0000 7fa00db45640 10 monclient(hunting): authenticate will time out at 4003.348835s 2026-02-24T19:23:48.678 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.668+0000 7fa007fff640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7fa008164d00 0x7fa0080a6c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:50700/0 (socket says 10.20.193.14:50700) 2026-02-24T19:23:48.678 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.668+0000 7fa007fff640 1 -- 10.20.193.14:0/482778974 learned_addr learned my addr 10.20.193.14:0/482778974 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:48.678 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.668+0000 7f9fe3fff640 10 client.?.objecter ms_handle_connect 0x7fa008164d00 2026-02-24T19:23:48.678 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.668+0000 7f9fe3fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:48.678 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.668+0000 7f9fe3fff640 10 client.?.objecter ms_handle_connect 0x7fa008157780 2026-02-24T19:23:48.678 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.668+0000 7f9fe3fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:48.678 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.668+0000 7f9fe3fff640 10 client.?.objecter ms_handle_connect 0x7fa008157b50 2026-02-24T19:23:48.678 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.668+0000 7f9fe3fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:48.684 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.669+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2510596874 0 0) 0x7fa008131050 con 0x7fa008164d00 2026-02-24T19:23:48.684 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.669+0000 7f9fe3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:23:48.685 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.669+0000 7f9fe3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:48.685 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.669+0000 7f9fe3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:48.685 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.669+0000 7f9fe3fff640 10 monclient(hunting): my global_id is 30750 2026-02-24T19:23:48.685 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.669+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9fd8003610 con 0x7fa008164d00 2026-02-24T19:23:48.685 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.669+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1702960269 0 0) 0x7fa008131330 con 0x7fa008157780 2026-02-24T19:23:48.685 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.669+0000 7f9fe3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:23:48.685 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.669+0000 7f9fe3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:48.685 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.669+0000 7f9fe3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:48.685 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.669+0000 7f9fe3fff640 10 monclient(hunting): my global_id is 29071 2026-02-24T19:23:48.685 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.669+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa008131050 con 0x7fa008157780 2026-02-24T19:23:48.685 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.669+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3162963209 0 0) 0x7fa008131610 con 0x7fa008157b50 2026-02-24T19:23:48.686 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.669+0000 7f9fe3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:23:48.686 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.669+0000 7f9fe3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:48.686 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.669+0000 7f9fe3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:48.686 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.669+0000 7f9fe3fff640 10 monclient(hunting): my global_id is 28709 2026-02-24T19:23:48.686 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.669+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa008131330 con 0x7fa008157b50 2026-02-24T19:23:48.686 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.672+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2603565657 0 0) 0x7fa008131330 con 0x7fa008157b50 2026-02-24T19:23:48.686 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.672+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa008131610 con 0x7fa008157b50 2026-02-24T19:23:48.686 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.672+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f9ff8003060 con 0x7fa008157b50 2026-02-24T19:23:48.686 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.672+0000 7f9fe3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:48.686 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.672+0000 7f9fe3fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:23:48.686 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.672+0000 7f9fe3fff640 10 monclient(hunting): dump: 2026-02-24T19:23:48.686 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:48.686 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:48.687 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.687 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.687 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:48.687 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:48.687 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:48.687 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:48.687 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:48.687 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:48.687 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.672+0000 7f9fe3fff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:23:48.687 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.672+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4232895318 0 0) 0x7f9fd8003610 con 0x7fa008164d00 2026-02-24T19:23:48.687 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.672+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa008131330 con 0x7fa008164d00 2026-02-24T19:23:48.687 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.672+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f9ffc003690 con 0x7fa008164d00 2026-02-24T19:23:48.687 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.672+0000 7f9fe3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:48.688 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.672+0000 7f9fe3fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:48.688 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.672+0000 7f9fe3fff640 10 monclient(hunting): dump: 2026-02-24T19:23:48.688 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:48.688 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:48.688 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.688 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.688 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:48.688 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:48.688 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:48.688 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:48.688 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:48.688 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:48.688 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.672+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 864359492 0 0) 0x7fa008131050 con 0x7fa008157780 2026-02-24T19:23:48.689 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.672+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9fd8003610 con 0x7fa008157780 2026-02-24T19:23:48.689 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.672+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f9ff40030b0 con 0x7fa008157780 2026-02-24T19:23:48.689 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.672+0000 7f9fe3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:48.689 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.672+0000 7f9fe3fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:48.689 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.672+0000 7f9fe3fff640 10 monclient(hunting): dump: 2026-02-24T19:23:48.689 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:48.689 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:48.689 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.689 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.689 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:48.689 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:48.689 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:48.690 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:48.690 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:48.690 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:48.690 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.673+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3767855760 0 0) 0x7fa008131610 con 0x7fa008157b50 2026-02-24T19:23:48.690 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.673+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 >> v1:10.20.193.44:6789/0 conn(0x7fa008157780 legacy=0x7fa0080ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:48.690 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.673+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 >> v1:10.20.193.14:6789/0 conn(0x7fa008164d00 legacy=0x7fa0080a6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:48.690 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.673+0000 7f9fe3fff640 10 monclient: _finish_hunting 0 2026-02-24T19:23:48.690 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.673+0000 7f9fe3fff640 1 monclient: found mon.c 2026-02-24T19:23:48.690 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.673+0000 7f9fe3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:48.690 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.673+0000 7f9fe3fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:48.690 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.673+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0081318f0 con 0x7fa008157b50 2026-02-24T19:23:48.690 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.673+0000 7f9fe3fff640 10 monclient: _finish_auth 0 2026-02-24T19:23:48.690 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.673+0000 7f9fe3fff640 10 monclient: _check_auth_tickets 2026-02-24T19:23:48.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.673+0000 7f9fe3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:48.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.673+0000 7fa00db45640 5 monclient: authenticate success, global_id 28709 2026-02-24T19:23:48.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.673+0000 7fa00db45640 10 monclient: _renew_subs 2026-02-24T19:23:48.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.673+0000 7fa00db45640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:48.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.673+0000 7fa00db45640 1 -- 10.20.193.14:0/482778974 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa008131bd0 con 0x7fa008157b50 2026-02-24T19:23:48.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.673+0000 7fa00db45640 10 client.28709.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:48.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.673+0000 7fa00db45640 10 monclient: _renew_subs 2026-02-24T19:23:48.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.673+0000 7fa00db45640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:48.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.673+0000 7fa00db45640 1 -- 10.20.193.14:0/482778974 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa008144e10 con 0x7fa008157b50 2026-02-24T19:23:48.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.673+0000 7fa00db45640 1 librados: init done 2026-02-24T19:23:48.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.673+0000 7fa006ffd640 1 -- 10.20.193.14:0/482778974 >> v1:10.20.193.170:6789/0 conn(0x7fa008157b50 legacy=0x7fa0080a8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-24T19:23:48.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.673+0000 7fa006ffd640 1 -- 10.20.193.14:0/482778974 >> v1:10.20.193.170:6789/0 conn(0x7fa008157b50 legacy=0x7fa0080a8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-24T19:23:48.691 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.673+0000 7fa006ffd640 1 --1- 10.20.193.14:0/482778974 >> v1:10.20.193.170:6789/0 conn(0x7fa008157b50 0x7fa0080a8eb0 :-1 s=OPENED pgs=9156 cs=1 l=1).handle_message read tag failed 2026-02-24T19:23:48.692 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.673+0000 7fa006ffd640 1 --1- 10.20.193.14:0/482778974 >> v1:10.20.193.170:6789/0 conn(0x7fa008157b50 0x7fa0080a8eb0 :-1 s=OPENED pgs=9156 cs=1 l=1).fault on lossy channel, failing 2026-02-24T19:23:48.692 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.673+0000 7f9fe3fff640 10 monclient: ms_handle_reset current mon v1:10.20.193.170:6789/0 2026-02-24T19:23:48.692 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.673+0000 7f9fe3fff640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:48.692 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.673+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 >> v1:10.20.193.170:6789/0 conn(0x7fa008157b50 legacy=0x7fa0080a8eb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-24T19:23:48.692 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.674+0000 7f9fe3fff640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:23:48.692 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.674+0000 7f9fe3fff640 10 monclient(hunting): picked mon.a con 0x7fa008164d00 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:48.692 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.674+0000 7f9fe3fff640 10 monclient(hunting): picked mon.c con 0x7f9fd8026b20 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:48.692 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.674+0000 7f9fe3fff640 10 monclient(hunting): picked mon.b con 0x7fa008157780 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:48.692 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.674+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa008131610 con 0x7fa008164d00 2026-02-24T19:23:48.692 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.674+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa008131050 con 0x7fa008157780 2026-02-24T19:23:48.692 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.674+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9fd806c6e0 con 0x7f9fd8026b20 2026-02-24T19:23:48.692 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.674+0000 7f9fe3fff640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:48.692 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.674+0000 7fa00db45640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:48.692 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.674+0000 7fa00db45640 10 monclient(hunting): _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:48.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.674+0000 7f9fe3fff640 10 client.28709.objecter ms_handle_connect 0x7fa008157780 2026-02-24T19:23:48.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.674+0000 7f9fe3fff640 10 client.28709.objecter resend_mon_ops 2026-02-24T19:23:48.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.674+0000 7f9fe3fff640 10 client.28709.objecter ms_handle_connect 0x7fa008164d00 2026-02-24T19:23:48.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.674+0000 7f9fe3fff640 10 client.28709.objecter resend_mon_ops 2026-02-24T19:23:48.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.675+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 78331470 0 0) 0x7fa008131050 con 0x7fa008157780 2026-02-24T19:23:48.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.675+0000 7f9fe3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:23:48.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.675+0000 7f9fe3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:48.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.675+0000 7f9fe3fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-24T19:23:48.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.675+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 --> v1:10.20.193.44:6789/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f9fd806a5e0 con 0x7fa008157780 2026-02-24T19:23:48.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.675+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 100122331 0 0) 0x7fa008131610 con 0x7fa008164d00 2026-02-24T19:23:48.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.675+0000 7f9fe3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:23:48.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.675+0000 7f9fe3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:48.694 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.675+0000 7f9fe3fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-24T19:23:48.694 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.675+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 --> v1:10.20.193.14:6789/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7fa008131050 con 0x7fa008164d00 2026-02-24T19:23:48.694 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.677+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (unknown 1293677904 0 0) 0x7f9fd806a5e0 con 0x7fa008157780 2026-02-24T19:23:48.694 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.677+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 >> v1:10.20.193.170:6789/0 conn(0x7f9fd8026b20 legacy=0x7f9fd8046f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:48.694 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.677+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 >> v1:10.20.193.14:6789/0 conn(0x7fa008164d00 legacy=0x7f9fd8004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:48.694 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.677+0000 7f9fe3fff640 10 monclient: _finish_hunting 0 2026-02-24T19:23:48.694 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.677+0000 7f9fe3fff640 1 monclient: found mon.b 2026-02-24T19:23:48.694 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.677+0000 7f9fe3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:48.694 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.677+0000 7f9fe3fff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:23:48.694 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.677+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+,osdmap=0}) -- 0x7f9fd806db00 con 0x7fa008157780 2026-02-24T19:23:48.694 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.677+0000 7f9fe3fff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:23:48.694 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.677+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0080ad220 con 0x7fa008157780 2026-02-24T19:23:48.694 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.677+0000 7f9fe3fff640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:48.694 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.677+0000 7f9fe3fff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:23:48.694 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.677+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fd806c6e0 con 0x7fa008157780 2026-02-24T19:23:48.695 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.677+0000 7f9fe3fff640 10 monclient: _finish_auth 0 2026-02-24T19:23:48.695 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.677+0000 7f9fe3fff640 10 monclient: _check_auth_tickets 2026-02-24T19:23:48.695 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.677+0000 7f9fe3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:48.695 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.677+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f9ffc003b30 con 0x7fa008157780 2026-02-24T19:23:48.695 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.677+0000 7f9fe3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:48.695 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.677+0000 7f9fe3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:48.695 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.677+0000 7f9fe3fff640 10 monclient: dump: 2026-02-24T19:23:48.695 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:48.695 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:48.695 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.695 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:48.695 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:48.695 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:48.695 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:48.696 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:48.696 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:48.696 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:48.850 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.848+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9ffc003b30 con 0x7fa008157780 2026-02-24T19:23:48.850 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.848+0000 7f9fe3fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:48.850 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.848+0000 7fa005ffb640 4 set_mon_vals no callback set 2026-02-24T19:23:48.851 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.849+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f9ffc003d20 con 0x7fa008157780 2026-02-24T19:23:48.852 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.850+0000 7fa0077fe640 10 monclient: get_auth_request con 0x7fa008157b50 auth_method 0 2026-02-24T19:23:48.852 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.850+0000 7f9fe3fff640 10 client.28709.objecter ms_handle_connect 0x7fa008157b50 2026-02-24T19:23:48.852 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.851+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 <== mon.1 v1:10.20.193.44:6789/0 6 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7f9ffc0595c0 con 0x7fa008157780 2026-02-24T19:23:48.852 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.851+0000 7f9fe3fff640 10 client.28709.objecter ms_dispatch2 0x7fa008000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:23:48.853 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.851+0000 7f9fe3fff640 3 client.28709.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:23:48.853 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.851+0000 7f9fe3fff640 3 client.28709.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:23:48.853 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.851+0000 7f9fe3fff640 20 client.28709.objecter dump_active .. 0 homeless 2026-02-24T19:23:48.853 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.852+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 <== mon.1 v1:10.20.193.44:6789/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f9ffc05dd30 con 0x7fa008157780 2026-02-24T19:23:48.854 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.852+0000 7f9fe3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:48.854 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.852+0000 7f9fe3fff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:23:48.855 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.853+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 <== mon.1 v1:10.20.193.44:6789/0 8 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f9ffc05d630 con 0x7fa008157780 2026-02-24T19:23:48.855 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.853+0000 7f9fe3fff640 10 monclient: handle_mon_command_ack 1 not found 2026-02-24T19:23:48.961 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.959+0000 7fa00db45640 1 -- 10.20.193.14:0/482778974 --> v1:10.20.193.14:6800/4014096310 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fa008130e00 con 0x7fa008157b50 2026-02-24T19:23:48.961 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.959+0000 7f9fe3fff640 1 -- 10.20.193.14:0/482778974 <== mgr.4110 v1:10.20.193.14:6800/4014096310 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (unknown 3782719169 0 0) 0x7fa008130e00 con 0x7fa008157b50 2026-02-24T19:23:48.961 INFO:teuthology.orchestra.run.trial014.stderr:instructed osd(s) 4 to deep-scrub 2026-02-24T19:23:48.962 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.960+0000 7fa00db45640 10 librados: watch_flush enter 2026-02-24T19:23:48.963 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.960+0000 7fa00db45640 10 librados: watch_flush exit 2026-02-24T19:23:48.963 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.960+0000 7fa00db45640 20 client.28709.objecter shutdown clearing up homeless session... 2026-02-24T19:23:48.963 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.960+0000 7fa00db45640 10 client.28709.objecter successfully canceled tick 2026-02-24T19:23:48.963 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.960+0000 7fa00db45640 1 -- 10.20.193.14:0/482778974 >> v1:10.20.193.14:6800/4014096310 conn(0x7fa008157b50 legacy=0x7f9fd80fda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:48.963 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.960+0000 7fa00db45640 10 monclient: shutdown 2026-02-24T19:23:48.963 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.960+0000 7fa00db45640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:48.963 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.960+0000 7fa00db45640 1 -- 10.20.193.14:0/482778974 >> v1:10.20.193.44:6789/0 conn(0x7fa008157780 legacy=0x7f9fd8068a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:48.963 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.960+0000 7fa00db45640 1 -- 10.20.193.14:0/482778974 shutdown_connections 2026-02-24T19:23:48.963 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.960+0000 7fa00db45640 1 -- 10.20.193.14:0/482778974 >> 10.20.193.14:0/482778974 conn(0x7fa0080b2ef0 msgr2=0x7fa00813ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:48.963 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.960+0000 7fa00db45640 1 -- 10.20.193.14:0/482778974 shutdown_connections 2026-02-24T19:23:48.963 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.960+0000 7fa00db45640 1 -- 10.20.193.14:0/482778974 wait complete. 2026-02-24T19:23:48.964 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:48.960+0000 7fa00db45640 1 librados: shutdown 2026-02-24T19:23:48.971 INFO:tasks.ceph:Scrubbing osd.8 2026-02-24T19:23:48.971 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:23:49.040 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.039+0000 7fd448bd9640 10 monclient: get_monmap_and_config 2026-02-24T19:23:49.040 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.039+0000 7fd448bd9640 10 monclient: build_initial_monmap 2026-02-24T19:23:49.040 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.039+0000 7fd448bd9640 10 monclient: monmap: 2026-02-24T19:23:49.041 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:49.041 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:49.041 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:23:49.039682+0000 2026-02-24T19:23:49.041 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:23:49.039682+0000 2026-02-24T19:23:49.041 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:49.041 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:49.041 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:49.041 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:49.041 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:49.041 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.043 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.039+0000 7fd448bd9640 1 Processor -- start 2026-02-24T19:23:49.043 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.039+0000 7fd448bd9640 1 -- start start 2026-02-24T19:23:49.044 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.039+0000 7fd448bd9640 10 monclient: init 2026-02-24T19:23:49.044 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.040+0000 7fd448bd9640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:49.044 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.040+0000 7fd448bd9640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:23:49.044 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.040+0000 7fd448bd9640 10 monclient(hunting): picked mon.noname-a con 0x7fd444159e10 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:49.044 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.040+0000 7fd448bd9640 10 monclient(hunting): picked mon.noname-b con 0x7fd44415a1e0 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:49.044 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.040+0000 7fd448bd9640 10 monclient(hunting): picked mon.noname-c con 0x7fd444161ac0 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:49.044 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.040+0000 7fd448bd9640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd444055ab0 con 0x7fd444159e10 2026-02-24T19:23:49.044 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.040+0000 7fd448bd9640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd444055d50 con 0x7fd44415a1e0 2026-02-24T19:23:49.044 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.040+0000 7fd448bd9640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd444056030 con 0x7fd444161ac0 2026-02-24T19:23:49.044 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.040+0000 7fd448bd9640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:49.044 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.040+0000 7fd448bd9640 10 monclient(hunting): authenticate will time out at 4003.721110s 2026-02-24T19:23:49.044 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.040+0000 7fd442575640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7fd444159e10 0x7fd444059c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:50714/0 (socket says 10.20.193.14:50714) 2026-02-24T19:23:49.045 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.040+0000 7fd442575640 1 -- 10.20.193.14:0/3351519665 learned_addr learned my addr 10.20.193.14:0/3351519665 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:49.045 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.042+0000 7fd441573640 1 -- 10.20.193.14:0/3351519665 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2762437480 0 0) 0x7fd444055ab0 con 0x7fd444159e10 2026-02-24T19:23:49.045 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.042+0000 7fd441573640 10 monclient(hunting): _negotiate 2026-02-24T19:23:49.045 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.042+0000 7fd441573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:49.045 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.042+0000 7fd441573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:49.045 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.042+0000 7fd441573640 10 monclient(hunting): my global_id is 30753 2026-02-24T19:23:49.045 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.042+0000 7fd441573640 1 -- 10.20.193.14:0/3351519665 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd430003610 con 0x7fd444159e10 2026-02-24T19:23:49.050 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.042+0000 7fd441573640 1 -- 10.20.193.14:0/3351519665 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3912501000 0 0) 0x7fd444056030 con 0x7fd444161ac0 2026-02-24T19:23:49.050 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.042+0000 7fd441573640 10 monclient(hunting): _negotiate 2026-02-24T19:23:49.050 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.042+0000 7fd441573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:49.050 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.042+0000 7fd441573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:49.050 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.042+0000 7fd441573640 10 monclient(hunting): my global_id is 28712 2026-02-24T19:23:49.050 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.042+0000 7fd441573640 1 -- 10.20.193.14:0/3351519665 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd444055ab0 con 0x7fd444161ac0 2026-02-24T19:23:49.051 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.043+0000 7fd441573640 1 -- 10.20.193.14:0/3351519665 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1961608071 0 0) 0x7fd430003610 con 0x7fd444159e10 2026-02-24T19:23:49.051 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.043+0000 7fd441573640 1 -- 10.20.193.14:0/3351519665 >> v1:10.20.193.170:6789/0 conn(0x7fd444161ac0 legacy=0x7fd44415fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:49.051 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.043+0000 7fd441573640 1 -- 10.20.193.14:0/3351519665 >> v1:10.20.193.44:6789/0 conn(0x7fd44415a1e0 legacy=0x7fd4441613b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:49.051 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.043+0000 7fd441573640 10 monclient: _finish_hunting 0 2026-02-24T19:23:49.051 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.043+0000 7fd441573640 1 monclient: found mon.noname-a 2026-02-24T19:23:49.051 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.043+0000 7fd441573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:49.051 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.043+0000 7fd441573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:23:49.051 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.043+0000 7fd441573640 1 -- 10.20.193.14:0/3351519665 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd444056310 con 0x7fd444159e10 2026-02-24T19:23:49.051 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.043+0000 7fd441573640 10 monclient: _finish_auth 0 2026-02-24T19:23:49.051 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.043+0000 7fd441573640 10 monclient: _check_auth_tickets 2026-02-24T19:23:49.051 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.043+0000 7fd441573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:49.051 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.043+0000 7fd448bd9640 5 monclient: authenticate success, global_id 30753 2026-02-24T19:23:49.051 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.043+0000 7fd448bd9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:49.052 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.043+0000 7fd441573640 1 -- 10.20.193.14:0/3351519665 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fd438002df0 con 0x7fd444159e10 2026-02-24T19:23:49.052 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.043+0000 7fd441573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:49.052 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.043+0000 7fd441573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:23:49.052 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.043+0000 7fd441573640 10 monclient: dump: 2026-02-24T19:23:49.052 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:49.052 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:49.052 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.052 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.052 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:49.052 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:49.052 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:49.052 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:49.052 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:49.053 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.053 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.044+0000 7fd448bd9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:49.053 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.044+0000 7fd441573640 1 -- 10.20.193.14:0/3351519665 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd438003040 con 0x7fd444159e10 2026-02-24T19:23:49.053 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.044+0000 7fd441573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:49.053 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.044+0000 7fd441573640 1 -- 10.20.193.14:0/3351519665 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fd438003480 con 0x7fd444159e10 2026-02-24T19:23:49.053 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.044+0000 7fd441573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:49.053 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.044+0000 7fd441573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:49.053 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.044+0000 7fd441573640 10 monclient: dump: 2026-02-24T19:23:49.053 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:49.053 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:49.053 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.053 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.054 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:49.054 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:49.054 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:49.054 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:49.054 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:49.054 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.054 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.044+0000 7fd448bd9640 10 monclient: get_monmap_and_config success 2026-02-24T19:23:49.054 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.044+0000 7fd448bd9640 4 set_mon_vals no callback set 2026-02-24T19:23:49.054 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.045+0000 7fd448bd9640 10 monclient: shutdown 2026-02-24T19:23:49.054 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.045+0000 7fd448bd9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:49.054 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.045+0000 7fd448bd9640 1 -- 10.20.193.14:0/3351519665 >> v1:10.20.193.14:6789/0 conn(0x7fd444159e10 legacy=0x7fd444059c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:49.054 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.045+0000 7fd448bd9640 1 -- 10.20.193.14:0/3351519665 shutdown_connections 2026-02-24T19:23:49.054 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.045+0000 7fd448bd9640 1 -- 10.20.193.14:0/3351519665 >> 10.20.193.14:0/3351519665 conn(0x7fd4440b2f60 msgr2=0x7fd4440b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:49.055 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.045+0000 7fd448bd9640 1 -- 10.20.193.14:0/3351519665 shutdown_connections 2026-02-24T19:23:49.055 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.045+0000 7fd448bd9640 1 -- 10.20.193.14:0/3351519665 wait complete. 2026-02-24T19:23:49.055 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.045+0000 7fd448bd9640 10 monclient: build_initial_monmap 2026-02-24T19:23:49.055 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.045+0000 7fd448bd9640 10 monclient: monmap: 2026-02-24T19:23:49.055 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:49.055 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:23:49.055 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:23:49.055 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:23:49.055 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:49.055 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:23:49.055 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:49.055 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:49.055 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:49.056 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.045+0000 7fd448bd9640 1 librados: starting msgr at 2026-02-24T19:23:49.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.045+0000 7fd448bd9640 1 librados: starting objecter 2026-02-24T19:23:49.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.045+0000 7fd448bd9640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:23:49.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.045+0000 7fd448bd9640 1 Processor -- start 2026-02-24T19:23:49.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.045+0000 7fd448bd9640 1 -- start start 2026-02-24T19:23:49.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.045+0000 7fd448bd9640 1 librados: setting wanted keys 2026-02-24T19:23:49.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.045+0000 7fd448bd9640 1 librados: calling monclient init 2026-02-24T19:23:49.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.045+0000 7fd448bd9640 10 monclient: init 2026-02-24T19:23:49.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.046+0000 7fd448bd9640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:49.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.046+0000 7fd448bd9640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:23:49.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.046+0000 7fd448bd9640 10 monclient(hunting): picked mon.noname-b con 0x7fd444159e10 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:49.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.046+0000 7fd448bd9640 10 monclient(hunting): picked mon.noname-a con 0x7fd44415a1e0 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:49.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.046+0000 7fd448bd9640 10 monclient(hunting): picked mon.noname-c con 0x7fd444161ac0 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:49.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.046+0000 7fd448bd9640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd444159520 con 0x7fd44415a1e0 2026-02-24T19:23:49.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.046+0000 7fd448bd9640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd44405d1a0 con 0x7fd444159e10 2026-02-24T19:23:49.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.046+0000 7fd448bd9640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd44405d480 con 0x7fd444161ac0 2026-02-24T19:23:49.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.046+0000 7fd448bd9640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:49.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.046+0000 7fd448bd9640 10 monclient(hunting): authenticate will time out at 4003.727356s 2026-02-24T19:23:49.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.046+0000 7fd441d74640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7fd44415a1e0 0x7fd44413e730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:50728/0 (socket says 10.20.193.14:50728) 2026-02-24T19:23:49.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.046+0000 7fd441d74640 1 -- 10.20.193.14:0/104150509 learned_addr learned my addr 10.20.193.14:0/104150509 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:49.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.046+0000 7fd42affd640 10 client.?.objecter ms_handle_connect 0x7fd44415a1e0 2026-02-24T19:23:49.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.046+0000 7fd42affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:49.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.046+0000 7fd42affd640 10 client.?.objecter ms_handle_connect 0x7fd444161ac0 2026-02-24T19:23:49.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.046+0000 7fd42affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:49.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.047+0000 7fd42affd640 10 client.?.objecter ms_handle_connect 0x7fd444159e10 2026-02-24T19:23:49.058 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.047+0000 7fd42affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:49.058 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.047+0000 7fd42affd640 1 -- 10.20.193.14:0/104150509 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2222149654 0 0) 0x7fd444159520 con 0x7fd44415a1e0 2026-02-24T19:23:49.058 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.047+0000 7fd42affd640 10 monclient(hunting): _negotiate 2026-02-24T19:23:49.058 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.047+0000 7fd42affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:49.058 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.047+0000 7fd42affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:49.058 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.047+0000 7fd42affd640 10 monclient(hunting): my global_id is 30756 2026-02-24T19:23:49.058 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.047+0000 7fd42affd640 1 -- 10.20.193.14:0/104150509 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd410003610 con 0x7fd44415a1e0 2026-02-24T19:23:49.058 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.047+0000 7fd42affd640 1 -- 10.20.193.14:0/104150509 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 227686214 0 0) 0x7fd44405d480 con 0x7fd444161ac0 2026-02-24T19:23:49.058 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.047+0000 7fd42affd640 10 monclient(hunting): _negotiate 2026-02-24T19:23:49.058 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.047+0000 7fd42affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:49.058 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.047+0000 7fd42affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:49.058 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.047+0000 7fd42affd640 10 monclient(hunting): my global_id is 28715 2026-02-24T19:23:49.059 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.047+0000 7fd42affd640 1 -- 10.20.193.14:0/104150509 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd444159520 con 0x7fd444161ac0 2026-02-24T19:23:49.059 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.048+0000 7fd42affd640 1 -- 10.20.193.14:0/104150509 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3381639415 0 0) 0x7fd44405d1a0 con 0x7fd444159e10 2026-02-24T19:23:49.059 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.048+0000 7fd42affd640 10 monclient(hunting): _negotiate 2026-02-24T19:23:49.059 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.048+0000 7fd42affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:49.059 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.048+0000 7fd42affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:49.059 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.048+0000 7fd42affd640 10 monclient(hunting): my global_id is 29077 2026-02-24T19:23:49.059 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.048+0000 7fd42affd640 1 -- 10.20.193.14:0/104150509 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd44405d480 con 0x7fd444159e10 2026-02-24T19:23:49.062 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.050+0000 7fd42affd640 1 -- 10.20.193.14:0/104150509 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 136128745 0 0) 0x7fd444159520 con 0x7fd444161ac0 2026-02-24T19:23:49.062 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.050+0000 7fd42affd640 1 -- 10.20.193.14:0/104150509 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd44405d1a0 con 0x7fd444161ac0 2026-02-24T19:23:49.062 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.050+0000 7fd42affd640 1 -- 10.20.193.14:0/104150509 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2638429943 0 0) 0x7fd410003610 con 0x7fd44415a1e0 2026-02-24T19:23:49.062 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.050+0000 7fd42affd640 1 -- 10.20.193.14:0/104150509 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd444159520 con 0x7fd44415a1e0 2026-02-24T19:23:49.062 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.050+0000 7fd42affd640 1 -- 10.20.193.14:0/104150509 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fd42c003160 con 0x7fd44415a1e0 2026-02-24T19:23:49.062 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.050+0000 7fd42affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:49.062 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.050+0000 7fd42affd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:23:49.063 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.050+0000 7fd42affd640 10 monclient(hunting): dump: 2026-02-24T19:23:49.063 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:49.063 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:49.063 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.063 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.063 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:49.063 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:49.063 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:49.063 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:49.063 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:49.063 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.063 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.050+0000 7fd42affd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:23:49.063 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.050+0000 7fd42affd640 1 -- 10.20.193.14:0/104150509 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fd4340033d0 con 0x7fd444161ac0 2026-02-24T19:23:49.064 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.050+0000 7fd42affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:49.064 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.050+0000 7fd42affd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:49.064 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.050+0000 7fd42affd640 10 monclient(hunting): dump: 2026-02-24T19:23:49.064 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:49.064 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:49.064 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.064 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.064 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:49.064 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:49.064 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:49.064 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:49.064 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:49.064 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.065 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.050+0000 7fd42affd640 1 -- 10.20.193.14:0/104150509 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1348753010 0 0) 0x7fd44405d480 con 0x7fd444159e10 2026-02-24T19:23:49.065 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.050+0000 7fd42affd640 1 -- 10.20.193.14:0/104150509 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd410003610 con 0x7fd444159e10 2026-02-24T19:23:49.065 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.050+0000 7fd42affd640 1 -- 10.20.193.14:0/104150509 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fd4380031f0 con 0x7fd444159e10 2026-02-24T19:23:49.065 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.050+0000 7fd42affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:49.065 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.050+0000 7fd42affd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:49.065 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.050+0000 7fd42affd640 10 monclient(hunting): dump: 2026-02-24T19:23:49.065 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:49.065 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:49.065 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.065 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.065 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:49.065 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:49.066 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:49.066 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:49.066 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:49.066 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.066 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.052+0000 7fd42affd640 1 -- 10.20.193.14:0/104150509 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 71267329 0 0) 0x7fd44405d1a0 con 0x7fd444161ac0 2026-02-24T19:23:49.066 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.052+0000 7fd42affd640 1 -- 10.20.193.14:0/104150509 >> v1:10.20.193.44:6789/0 conn(0x7fd444159e10 legacy=0x7fd444158e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:49.066 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.052+0000 7fd42affd640 1 -- 10.20.193.14:0/104150509 >> v1:10.20.193.14:6789/0 conn(0x7fd44415a1e0 legacy=0x7fd44413e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:49.066 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.052+0000 7fd42affd640 10 monclient: _finish_hunting 0 2026-02-24T19:23:49.066 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.052+0000 7fd42affd640 1 monclient: found mon.c 2026-02-24T19:23:49.066 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.052+0000 7fd42affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:49.066 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.052+0000 7fd42affd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:49.066 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.052+0000 7fd42affd640 1 -- 10.20.193.14:0/104150509 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd44405d760 con 0x7fd444161ac0 2026-02-24T19:23:49.066 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.052+0000 7fd42affd640 10 monclient: _finish_auth 0 2026-02-24T19:23:49.067 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.052+0000 7fd42affd640 10 monclient: _check_auth_tickets 2026-02-24T19:23:49.067 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.052+0000 7fd42affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:49.067 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.052+0000 7fd448bd9640 5 monclient: authenticate success, global_id 28715 2026-02-24T19:23:49.067 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.052+0000 7fd448bd9640 10 monclient: _renew_subs 2026-02-24T19:23:49.067 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.052+0000 7fd448bd9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:49.067 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.052+0000 7fd448bd9640 1 -- 10.20.193.14:0/104150509 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd44413dc50 con 0x7fd444161ac0 2026-02-24T19:23:49.067 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.052+0000 7fd448bd9640 10 client.28715.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:49.067 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.052+0000 7fd448bd9640 10 monclient: _renew_subs 2026-02-24T19:23:49.067 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.052+0000 7fd448bd9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:49.067 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.052+0000 7fd448bd9640 1 -- 10.20.193.14:0/104150509 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd44413e210 con 0x7fd444161ac0 2026-02-24T19:23:49.067 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.052+0000 7fd448bd9640 1 librados: init done 2026-02-24T19:23:49.067 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.052+0000 7fd448bd9640 10 client.28715.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:49.067 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.052+0000 7fd448bd9640 15 client.28715.objecter _session_command_op_assign -1 1 2026-02-24T19:23:49.068 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.052+0000 7fd448bd9640 20 client.28715.objecter _get_session osd=-1 returning homeless 2026-02-24T19:23:49.068 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.052+0000 7fd448bd9640 10 client.28715.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:49.068 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.052+0000 7fd448bd9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:49.068 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.052+0000 7fd448bd9640 1 -- 10.20.193.14:0/104150509 --> v1:10.20.193.170:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fd444056c80 con 0x7fd444161ac0 2026-02-24T19:23:49.068 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.060+0000 7fd42affd640 1 -- 10.20.193.14:0/104150509 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd444056c80 con 0x7fd444161ac0 2026-02-24T19:23:49.068 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.060+0000 7fd42affd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:49.068 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.060+0000 7fd42affd640 1 -- 10.20.193.14:0/104150509 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fd434003890 con 0x7fd444161ac0 2026-02-24T19:23:49.068 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.060+0000 7fd42affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:49.068 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.060+0000 7fd42affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:49.068 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.060+0000 7fd42affd640 10 monclient: dump: 2026-02-24T19:23:49.068 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:49.068 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:49.068 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.068 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.069 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:49.069 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:49.069 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:49.069 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:49.069 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:49.069 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.069 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.060+0000 7fd440d72640 4 set_mon_vals no callback set 2026-02-24T19:23:49.071 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.061+0000 7fd42affd640 1 -- 10.20.193.14:0/104150509 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7fd434003aa0 con 0x7fd444161ac0 2026-02-24T19:23:49.071 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.061+0000 7fd442575640 10 monclient: get_auth_request con 0x7fd410077df0 auth_method 0 2026-02-24T19:23:49.071 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.061+0000 7fd42affd640 10 client.28715.objecter ms_handle_connect 0x7fd410077df0 2026-02-24T19:23:49.071 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.062+0000 7fd42affd640 1 -- 10.20.193.14:0/104150509 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7fd434003890 con 0x7fd444161ac0 2026-02-24T19:23:49.071 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.062+0000 7fd42affd640 10 client.28715.objecter ms_dispatch2 0x7fd444000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:23:49.071 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.062+0000 7fd42affd640 3 client.28715.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:23:49.071 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.062+0000 7fd42affd640 3 client.28715.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:23:49.071 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.062+0000 7fd42affd640 10 client.28715.objecter checking command 1 2026-02-24T19:23:49.071 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.062+0000 7fd42affd640 20 client.28715.objecter _get_session s=0x7fd4100a2110 osd=8 3 2026-02-24T19:23:49.071 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.062+0000 7fd42affd640 20 client.28715.objecter put_session s=0x7fd4100a2110 osd=8 3 2026-02-24T19:23:49.071 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.062+0000 7fd42affd640 15 client.28715.objecter _session_command_op_remove -1 1 2026-02-24T19:23:49.072 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.062+0000 7fd42affd640 20 client.28715.objecter _get_session s=0x7fd4100a2110 osd=8 3 2026-02-24T19:23:49.072 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.062+0000 7fd42affd640 20 client.28715.objecter get_session s=0x7fd4100a2110 osd=8 3 2026-02-24T19:23:49.072 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.062+0000 7fd42affd640 15 client.28715.objecter _session_command_op_assign 8 1 2026-02-24T19:23:49.072 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.062+0000 7fd42affd640 20 client.28715.objecter put_session s=0x7fd4100a2110 osd=8 4 2026-02-24T19:23:49.072 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.062+0000 7fd42affd640 10 client.28715.objecter _send_command 1 2026-02-24T19:23:49.072 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.062+0000 7fd42affd640 1 -- 10.20.193.14:0/104150509 --> v1:10.20.193.14:6809/1223168292 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd4100c4420 con 0x7fd4100a27c0 2026-02-24T19:23:49.072 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.062+0000 7fd42affd640 20 client.28715.objecter dump_active .. 0 homeless 2026-02-24T19:23:49.072 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.063+0000 7fd42affd640 1 -- 10.20.193.14:0/104150509 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_get_version_reply(handle=1 version=354) ==== 24+0+0 (unknown 31317031 0 0) 0x7fd43405bff0 con 0x7fd444161ac0 2026-02-24T19:23:49.072 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.063+0000 7fd42affd640 10 monclient: handle_get_version_reply finishing 1 version 354 2026-02-24T19:23:49.072 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.069+0000 7fd441d74640 10 monclient: get_auth_request con 0x7fd4100a27c0 auth_method 0 2026-02-24T19:23:49.074 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.072+0000 7fd42affd640 10 client.28715.objecter ms_handle_connect 0x7fd4100a27c0 2026-02-24T19:23:49.088 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.086+0000 7fd42affd640 1 -- 10.20.193.14:0/104150509 <== osd.8 v1:10.20.193.14:6809/1223168292 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fd4100c4420 con 0x7fd4100a27c0 2026-02-24T19:23:49.088 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.086+0000 7fd42affd640 10 client.28715.objecter ms_dispatch2 0x7fd444000b90 command_reply(tid 1: 0 ) 2026-02-24T19:23:49.088 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.086+0000 7fd42affd640 10 client.28715.objecter _finish_command 1 = system:0 2026-02-24T19:23:49.088 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.086+0000 7fd42affd640 20 client.28715.objecter put_session s=0x7fd4100a2110 osd=8 4 2026-02-24T19:23:49.088 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.086+0000 7fd42affd640 15 client.28715.objecter _session_command_op_remove 8 1 2026-02-24T19:23:49.095 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.093+0000 7fd448bd9640 10 client.28715.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:23:49.095 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.093+0000 7fd448bd9640 15 client.28715.objecter _session_command_op_assign -1 2 2026-02-24T19:23:49.095 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.093+0000 7fd448bd9640 20 client.28715.objecter _get_session s=0x7fd4100a2110 osd=8 3 2026-02-24T19:23:49.095 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.093+0000 7fd448bd9640 20 client.28715.objecter put_session s=0x7fd4100a2110 osd=8 3 2026-02-24T19:23:49.095 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.093+0000 7fd448bd9640 20 client.28715.objecter _get_session s=0x7fd4100a2110 osd=8 3 2026-02-24T19:23:49.095 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.093+0000 7fd448bd9640 15 client.28715.objecter _session_command_op_remove -1 2 2026-02-24T19:23:49.095 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.093+0000 7fd448bd9640 20 client.28715.objecter get_session s=0x7fd4100a2110 osd=8 3 2026-02-24T19:23:49.095 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.093+0000 7fd448bd9640 15 client.28715.objecter _session_command_op_assign 8 2 2026-02-24T19:23:49.095 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.093+0000 7fd448bd9640 20 client.28715.objecter put_session s=0x7fd4100a2110 osd=8 4 2026-02-24T19:23:49.095 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.093+0000 7fd448bd9640 10 client.28715.objecter _send_command 2 2026-02-24T19:23:49.096 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.093+0000 7fd448bd9640 1 -- 10.20.193.14:0/104150509 --> v1:10.20.193.14:6809/1223168292 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd44413ba70 con 0x7fd4100a27c0 2026-02-24T19:23:49.102 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.100+0000 7fd42affd640 1 -- 10.20.193.14:0/104150509 <== osd.8 v1:10.20.193.14:6809/1223168292 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fd44413ba70 con 0x7fd4100a27c0 2026-02-24T19:23:49.102 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.100+0000 7fd42affd640 10 client.28715.objecter ms_dispatch2 0x7fd444000b90 command_reply(tid 2: 0 ) 2026-02-24T19:23:49.102 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.100+0000 7fd42affd640 10 client.28715.objecter _finish_command 2 = system:0 2026-02-24T19:23:49.102 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.100+0000 7fd42affd640 20 client.28715.objecter put_session s=0x7fd4100a2110 osd=8 4 2026-02-24T19:23:49.102 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.100+0000 7fd42affd640 15 client.28715.objecter _session_command_op_remove 8 2 2026-02-24T19:23:49.103 INFO:teuthology.orchestra.run.trial014.stdout:{ 2026-02-24T19:23:49.103 INFO:teuthology.orchestra.run.trial014.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:23:49.103 INFO:teuthology.orchestra.run.trial014.stdout:} 2026-02-24T19:23:49.104 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.100+0000 7fd448bd9640 10 librados: watch_flush enter 2026-02-24T19:23:49.104 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.100+0000 7fd448bd9640 10 librados: watch_flush exit 2026-02-24T19:23:49.104 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.100+0000 7fd448bd9640 10 client.28715.objecter close_session for osd.8 2026-02-24T19:23:49.104 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.100+0000 7fd448bd9640 1 -- 10.20.193.14:0/104150509 >> v1:10.20.193.14:6809/1223168292 conn(0x7fd4100a27c0 legacy=0x7fd4100c2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:49.104 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.100+0000 7fd448bd9640 20 client.28715.objecter put_session s=0x7fd4100a2110 osd=8 1 2026-02-24T19:23:49.105 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.100+0000 7fd448bd9640 20 client.28715.objecter shutdown clearing up homeless session... 2026-02-24T19:23:49.105 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.100+0000 7fd448bd9640 10 client.28715.objecter successfully canceled tick 2026-02-24T19:23:49.105 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.100+0000 7fd448bd9640 1 -- 10.20.193.14:0/104150509 >> v1:10.20.193.14:6800/4014096310 conn(0x7fd410077df0 legacy=0x7fd4100982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:49.105 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.100+0000 7fd448bd9640 10 monclient: shutdown 2026-02-24T19:23:49.105 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.100+0000 7fd448bd9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:49.105 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.100+0000 7fd448bd9640 1 -- 10.20.193.14:0/104150509 >> v1:10.20.193.170:6789/0 conn(0x7fd444161ac0 legacy=0x7fd444163200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:49.105 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.100+0000 7fd442d76640 1 -- 10.20.193.14:0/104150509 reap_dead start 2026-02-24T19:23:49.105 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.100+0000 7fd448bd9640 1 -- 10.20.193.14:0/104150509 shutdown_connections 2026-02-24T19:23:49.105 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.100+0000 7fd448bd9640 1 -- 10.20.193.14:0/104150509 >> 10.20.193.14:0/104150509 conn(0x7fd4440b2f60 msgr2=0x7fd444058000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:49.105 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.101+0000 7fd448bd9640 1 -- 10.20.193.14:0/104150509 shutdown_connections 2026-02-24T19:23:49.105 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.101+0000 7fd448bd9640 1 -- 10.20.193.14:0/104150509 wait complete. 2026-02-24T19:23:49.105 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.101+0000 7fd448bd9640 1 librados: shutdown 2026-02-24T19:23:49.110 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 8 2026-02-24T19:23:49.178 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.176+0000 7f82f654c640 10 monclient: get_monmap_and_config 2026-02-24T19:23:49.178 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.176+0000 7f82f654c640 10 monclient: build_initial_monmap 2026-02-24T19:23:49.178 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.176+0000 7f82f654c640 10 monclient: monmap: 2026-02-24T19:23:49.178 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:49.178 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:49.178 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:23:49.177213+0000 2026-02-24T19:23:49.178 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:23:49.177213+0000 2026-02-24T19:23:49.179 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:49.179 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:49.179 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:49.179 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:49.179 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:49.179 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.181 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.177+0000 7f82f654c640 1 Processor -- start 2026-02-24T19:23:49.181 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.177+0000 7f82f654c640 1 -- start start 2026-02-24T19:23:49.181 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.177+0000 7f82f654c640 10 monclient: init 2026-02-24T19:23:49.181 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.177+0000 7f82f654c640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:49.181 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.177+0000 7f82f654c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:23:49.182 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.177+0000 7f82f654c640 10 monclient(hunting): picked mon.noname-a con 0x7f82f0157780 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:49.182 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.177+0000 7f82f654c640 10 monclient(hunting): picked mon.noname-c con 0x7f82f0157b50 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:49.182 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.177+0000 7f82f654c640 10 monclient(hunting): picked mon.noname-b con 0x7f82f0164d00 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:49.182 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.177+0000 7f82f654c640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82f005de70 con 0x7f82f0157780 2026-02-24T19:23:49.182 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.177+0000 7f82f654c640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82f0055b20 con 0x7f82f0164d00 2026-02-24T19:23:49.182 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.177+0000 7f82f654c640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82f0055e00 con 0x7f82f0157b50 2026-02-24T19:23:49.182 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.177+0000 7f82f654c640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:49.182 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.177+0000 7f82f654c640 10 monclient(hunting): authenticate will time out at 4003.858619s 2026-02-24T19:23:49.182 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.177+0000 7f82effff640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f82f0157780 0x7f82f0056ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:50738/0 (socket says 10.20.193.14:50738) 2026-02-24T19:23:49.182 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.177+0000 7f82effff640 1 -- 10.20.193.14:0/2617438244 learned_addr learned my addr 10.20.193.14:0/2617438244 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:49.182 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.179+0000 7f82eeffd640 1 -- 10.20.193.14:0/2617438244 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4217876345 0 0) 0x7f82f0055e00 con 0x7f82f0157b50 2026-02-24T19:23:49.182 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.179+0000 7f82eeffd640 10 monclient(hunting): _negotiate 2026-02-24T19:23:49.183 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.179+0000 7f82eeffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:49.183 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.179+0000 7f82eeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:49.183 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.179+0000 7f82eeffd640 10 monclient(hunting): my global_id is 28718 2026-02-24T19:23:49.183 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.179+0000 7f82eeffd640 1 -- 10.20.193.14:0/2617438244 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82d4003610 con 0x7f82f0157b50 2026-02-24T19:23:49.183 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.179+0000 7f82eeffd640 1 -- 10.20.193.14:0/2617438244 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1479381893 0 0) 0x7f82f005de70 con 0x7f82f0157780 2026-02-24T19:23:49.183 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.179+0000 7f82eeffd640 10 monclient(hunting): _negotiate 2026-02-24T19:23:49.183 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.179+0000 7f82eeffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:49.183 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.179+0000 7f82eeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:49.183 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.179+0000 7f82eeffd640 10 monclient(hunting): my global_id is 30759 2026-02-24T19:23:49.183 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.179+0000 7f82eeffd640 1 -- 10.20.193.14:0/2617438244 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82f0055e00 con 0x7f82f0157780 2026-02-24T19:23:49.183 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.179+0000 7f82eeffd640 1 -- 10.20.193.14:0/2617438244 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3038445196 0 0) 0x7f82f0055b20 con 0x7f82f0164d00 2026-02-24T19:23:49.183 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.179+0000 7f82eeffd640 10 monclient(hunting): _negotiate 2026-02-24T19:23:49.183 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.179+0000 7f82eeffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:49.184 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.179+0000 7f82eeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:49.184 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.179+0000 7f82eeffd640 10 monclient(hunting): my global_id is 29080 2026-02-24T19:23:49.184 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.179+0000 7f82eeffd640 1 -- 10.20.193.14:0/2617438244 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82f005de70 con 0x7f82f0164d00 2026-02-24T19:23:49.188 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.181+0000 7f82eeffd640 1 -- 10.20.193.14:0/2617438244 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2352791496 0 0) 0x7f82d4003610 con 0x7f82f0157b50 2026-02-24T19:23:49.188 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.181+0000 7f82eeffd640 1 -- 10.20.193.14:0/2617438244 >> v1:10.20.193.44:6789/0 conn(0x7f82f0164d00 legacy=0x7f82f01c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:49.188 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.181+0000 7f82eeffd640 1 -- 10.20.193.14:0/2617438244 >> v1:10.20.193.14:6789/0 conn(0x7f82f0157780 legacy=0x7f82f0056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:49.188 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.181+0000 7f82eeffd640 10 monclient: _finish_hunting 0 2026-02-24T19:23:49.188 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.181+0000 7f82eeffd640 1 monclient: found mon.noname-c 2026-02-24T19:23:49.189 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.181+0000 7f82eeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:49.189 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.181+0000 7f82eeffd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.170:6789/0 2026-02-24T19:23:49.189 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.181+0000 7f82eeffd640 1 -- 10.20.193.14:0/2617438244 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f00560e0 con 0x7f82f0157b50 2026-02-24T19:23:49.189 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.181+0000 7f82eeffd640 10 monclient: _finish_auth 0 2026-02-24T19:23:49.189 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.181+0000 7f82eeffd640 10 monclient: _check_auth_tickets 2026-02-24T19:23:49.189 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.181+0000 7f82eeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:49.189 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.181+0000 7f82eeffd640 1 -- 10.20.193.14:0/2617438244 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f82e0002df0 con 0x7f82f0157b50 2026-02-24T19:23:49.189 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.181+0000 7f82f654c640 5 monclient: authenticate success, global_id 28718 2026-02-24T19:23:49.189 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.181+0000 7f82f654c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:49.189 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.181+0000 7f82eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:49.189 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.181+0000 7f82eeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:23:49.189 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.181+0000 7f82eeffd640 10 monclient: dump: 2026-02-24T19:23:49.189 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:49.190 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:49.190 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.190 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.190 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:49.190 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:49.190 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:49.190 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:49.190 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:49.190 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.190 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.181+0000 7f82f654c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:49.190 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.181+0000 7f82eeffd640 1 -- 10.20.193.14:0/2617438244 <== mon.2 v1:10.20.193.170:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f82e0002fc0 con 0x7f82f0157b50 2026-02-24T19:23:49.190 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.181+0000 7f82eeffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:49.191 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.181+0000 7f82eeffd640 1 -- 10.20.193.14:0/2617438244 <== mon.2 v1:10.20.193.170:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f82e0003400 con 0x7f82f0157b50 2026-02-24T19:23:49.191 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.181+0000 7f82eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:49.191 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.181+0000 7f82eeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:49.191 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.181+0000 7f82eeffd640 10 monclient: dump: 2026-02-24T19:23:49.191 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:49.191 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:49.191 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.191 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.191 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:49.191 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:49.191 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:49.191 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:49.191 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:49.192 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.192 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.181+0000 7f82f654c640 10 monclient: get_monmap_and_config success 2026-02-24T19:23:49.192 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.181+0000 7f82f654c640 4 set_mon_vals no callback set 2026-02-24T19:23:49.192 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.182+0000 7f82f654c640 10 monclient: shutdown 2026-02-24T19:23:49.192 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.182+0000 7f82f654c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:49.192 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.182+0000 7f82f654c640 1 -- 10.20.193.14:0/2617438244 >> v1:10.20.193.170:6789/0 conn(0x7f82f0157b50 legacy=0x7f82f01645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:49.192 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.182+0000 7f82f654c640 1 -- 10.20.193.14:0/2617438244 shutdown_connections 2026-02-24T19:23:49.192 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.182+0000 7f82f654c640 1 -- 10.20.193.14:0/2617438244 >> 10.20.193.14:0/2617438244 conn(0x7f82f00b2ef0 msgr2=0x7f82f00b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:49.192 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.182+0000 7f82f654c640 1 -- 10.20.193.14:0/2617438244 shutdown_connections 2026-02-24T19:23:49.192 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.182+0000 7f82f654c640 1 -- 10.20.193.14:0/2617438244 wait complete. 2026-02-24T19:23:49.192 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.182+0000 7f82f654c640 10 monclient: build_initial_monmap 2026-02-24T19:23:49.192 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.182+0000 7f82f654c640 10 monclient: monmap: 2026-02-24T19:23:49.193 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:49.193 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:23:49.193 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:23:49.193 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:23:49.193 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:49.193 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:23:49.193 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:49.193 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:49.193 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:49.193 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.193 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.182+0000 7f82f654c640 1 librados: starting msgr at 2026-02-24T19:23:49.193 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.182+0000 7f82f654c640 1 librados: starting objecter 2026-02-24T19:23:49.193 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.182+0000 7f82f654c640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:23:49.193 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.183+0000 7f82f654c640 1 Processor -- start 2026-02-24T19:23:49.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.183+0000 7f82f654c640 1 -- start start 2026-02-24T19:23:49.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.183+0000 7f82f654c640 1 librados: setting wanted keys 2026-02-24T19:23:49.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.183+0000 7f82f654c640 1 librados: calling monclient init 2026-02-24T19:23:49.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.183+0000 7f82f654c640 10 monclient: init 2026-02-24T19:23:49.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.183+0000 7f82f654c640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:49.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.183+0000 7f82f654c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:23:49.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.183+0000 7f82f654c640 10 monclient(hunting): picked mon.noname-a con 0x7f82f0157780 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:49.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.183+0000 7f82f654c640 10 monclient(hunting): picked mon.noname-b con 0x7f82f0157b50 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:49.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.183+0000 7f82f654c640 10 monclient(hunting): picked mon.noname-c con 0x7f82f0164d00 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:49.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.183+0000 7f82f654c640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82f005c290 con 0x7f82f0157780 2026-02-24T19:23:49.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.183+0000 7f82f654c640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82f005c570 con 0x7f82f0157b50 2026-02-24T19:23:49.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.183+0000 7f82f654c640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82f005c850 con 0x7f82f0164d00 2026-02-24T19:23:49.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.183+0000 7f82f654c640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:49.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.183+0000 7f82f654c640 10 monclient(hunting): authenticate will time out at 4003.864445s 2026-02-24T19:23:49.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.183+0000 7f82f4ac2640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7f82f0164d00 0x7f82f0146980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:48094/0 (socket says 10.20.193.14:48094) 2026-02-24T19:23:49.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.183+0000 7f82f4ac2640 1 -- 10.20.193.14:0/2420576512 learned_addr learned my addr 10.20.193.14:0/2420576512 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:49.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.184+0000 7f82ecff9640 10 client.?.objecter ms_handle_connect 0x7f82f0157780 2026-02-24T19:23:49.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.184+0000 7f82ecff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:49.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.184+0000 7f82ecff9640 10 client.?.objecter ms_handle_connect 0x7f82f0164d00 2026-02-24T19:23:49.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.184+0000 7f82ecff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:49.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.184+0000 7f82ecff9640 10 client.?.objecter ms_handle_connect 0x7f82f0157b50 2026-02-24T19:23:49.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.184+0000 7f82ecff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:49.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.184+0000 7f82ecff9640 1 -- 10.20.193.14:0/2420576512 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2009412805 0 0) 0x7f82f005c290 con 0x7f82f0157780 2026-02-24T19:23:49.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.184+0000 7f82ecff9640 10 monclient(hunting): _negotiate 2026-02-24T19:23:49.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.184+0000 7f82ecff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:49.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.184+0000 7f82ecff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:49.196 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.185+0000 7f82ecff9640 10 monclient(hunting): my global_id is 30762 2026-02-24T19:23:49.196 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.185+0000 7f82ecff9640 1 -- 10.20.193.14:0/2420576512 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82c0003610 con 0x7f82f0157780 2026-02-24T19:23:49.196 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.185+0000 7f82ecff9640 1 -- 10.20.193.14:0/2420576512 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3075315784 0 0) 0x7f82f005c850 con 0x7f82f0164d00 2026-02-24T19:23:49.196 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.185+0000 7f82ecff9640 10 monclient(hunting): _negotiate 2026-02-24T19:23:49.196 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.185+0000 7f82ecff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:49.196 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.185+0000 7f82ecff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:49.196 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.185+0000 7f82ecff9640 10 monclient(hunting): my global_id is 28721 2026-02-24T19:23:49.196 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.185+0000 7f82ecff9640 1 -- 10.20.193.14:0/2420576512 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82f005c290 con 0x7f82f0164d00 2026-02-24T19:23:49.196 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.185+0000 7f82ecff9640 1 -- 10.20.193.14:0/2420576512 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3853986130 0 0) 0x7f82f005c570 con 0x7f82f0157b50 2026-02-24T19:23:49.196 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.185+0000 7f82ecff9640 10 monclient(hunting): _negotiate 2026-02-24T19:23:49.196 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.185+0000 7f82ecff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:49.196 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.185+0000 7f82ecff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:49.197 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.185+0000 7f82ecff9640 10 monclient(hunting): my global_id is 29083 2026-02-24T19:23:49.197 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.185+0000 7f82ecff9640 1 -- 10.20.193.14:0/2420576512 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82f005c850 con 0x7f82f0157b50 2026-02-24T19:23:49.199 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.187+0000 7f82ecff9640 1 -- 10.20.193.14:0/2420576512 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2822291395 0 0) 0x7f82c0003610 con 0x7f82f0157780 2026-02-24T19:23:49.199 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.187+0000 7f82ecff9640 1 -- 10.20.193.14:0/2420576512 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f82f005c570 con 0x7f82f0157780 2026-02-24T19:23:49.199 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.187+0000 7f82ecff9640 1 -- 10.20.193.14:0/2420576512 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f82dc0030b0 con 0x7f82f0157780 2026-02-24T19:23:49.199 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.187+0000 7f82ecff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:49.199 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.187+0000 7f82ecff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:23:49.199 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.187+0000 7f82ecff9640 10 monclient(hunting): dump: 2026-02-24T19:23:49.199 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:49.199 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:49.200 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.200 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.200 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:49.200 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:49.200 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:49.200 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:49.200 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:49.200 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.200 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.187+0000 7f82ecff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:23:49.200 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.187+0000 7f82ecff9640 1 -- 10.20.193.14:0/2420576512 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 730151746 0 0) 0x7f82f005c290 con 0x7f82f0164d00 2026-02-24T19:23:49.200 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.187+0000 7f82ecff9640 1 -- 10.20.193.14:0/2420576512 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f82c0003610 con 0x7f82f0164d00 2026-02-24T19:23:49.200 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.187+0000 7f82ecff9640 1 -- 10.20.193.14:0/2420576512 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f82e40033c0 con 0x7f82f0164d00 2026-02-24T19:23:49.201 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.187+0000 7f82ecff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:49.201 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.187+0000 7f82ecff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:49.201 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.187+0000 7f82ecff9640 10 monclient(hunting): dump: 2026-02-24T19:23:49.201 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:49.201 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:49.201 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.201 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.201 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:49.201 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:49.201 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:49.201 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:49.201 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:49.202 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.202 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.187+0000 7f82ecff9640 1 -- 10.20.193.14:0/2420576512 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1131455723 0 0) 0x7f82f005c850 con 0x7f82f0157b50 2026-02-24T19:23:49.202 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.187+0000 7f82ecff9640 1 -- 10.20.193.14:0/2420576512 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f82f005c290 con 0x7f82f0157b50 2026-02-24T19:23:49.202 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.187+0000 7f82ecff9640 1 -- 10.20.193.14:0/2420576512 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f82e0003310 con 0x7f82f0157b50 2026-02-24T19:23:49.202 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.187+0000 7f82ecff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:49.202 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.187+0000 7f82ecff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:49.202 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.187+0000 7f82ecff9640 10 monclient(hunting): dump: 2026-02-24T19:23:49.202 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:49.202 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:49.202 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.202 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.202 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:49.202 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:49.203 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:49.203 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:49.203 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:49.203 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.189+0000 7f82ecff9640 1 -- 10.20.193.14:0/2420576512 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4194706849 0 0) 0x7f82f005c570 con 0x7f82f0157780 2026-02-24T19:23:49.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.189+0000 7f82ecff9640 1 -- 10.20.193.14:0/2420576512 >> v1:10.20.193.170:6789/0 conn(0x7f82f0164d00 legacy=0x7f82f0146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:49.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.189+0000 7f82ecff9640 1 -- 10.20.193.14:0/2420576512 >> v1:10.20.193.44:6789/0 conn(0x7f82f0157b50 legacy=0x7f82f013a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:49.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.189+0000 7f82ecff9640 10 monclient: _finish_hunting 0 2026-02-24T19:23:49.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.189+0000 7f82ecff9640 1 monclient: found mon.a 2026-02-24T19:23:49.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.189+0000 7f82ecff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:49.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.189+0000 7f82ecff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:49.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.189+0000 7f82ecff9640 1 -- 10.20.193.14:0/2420576512 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f005cb30 con 0x7f82f0157780 2026-02-24T19:23:49.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.189+0000 7f82ecff9640 10 monclient: _finish_auth 0 2026-02-24T19:23:49.204 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.189+0000 7f82ecff9640 10 monclient: _check_auth_tickets 2026-02-24T19:23:49.204 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.189+0000 7f82ecff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:49.204 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.189+0000 7f82f654c640 5 monclient: authenticate success, global_id 30762 2026-02-24T19:23:49.204 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.189+0000 7f82f654c640 10 monclient: _renew_subs 2026-02-24T19:23:49.204 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.189+0000 7f82f654c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:49.204 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.189+0000 7f82f654c640 1 -- 10.20.193.14:0/2420576512 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f82f005ce10 con 0x7f82f0157780 2026-02-24T19:23:49.204 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.189+0000 7f82f654c640 10 client.30762.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:49.204 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.189+0000 7f82f654c640 10 monclient: _renew_subs 2026-02-24T19:23:49.204 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.189+0000 7f82f654c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:49.204 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.189+0000 7f82f654c640 1 -- 10.20.193.14:0/2420576512 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f82f005d610 con 0x7f82f0157780 2026-02-24T19:23:49.204 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.189+0000 7f82f654c640 1 librados: init done 2026-02-24T19:23:49.204 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.189+0000 7f82f654c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:49.204 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.189+0000 7f82f654c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:49.205 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.189+0000 7f82f654c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:49.205 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.189+0000 7f82f654c640 1 -- 10.20.193.14:0/2420576512 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82f0055b20 con 0x7f82f0157780 2026-02-24T19:23:49.283 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.281+0000 7f82ecff9640 1 -- 10.20.193.14:0/2420576512 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f82dc003250 con 0x7f82f0157780 2026-02-24T19:23:49.283 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.281+0000 7f82ecff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:49.283 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.281+0000 7f82ecff9640 1 -- 10.20.193.14:0/2420576512 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f82dc004a70 con 0x7f82f0157780 2026-02-24T19:23:49.283 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.281+0000 7f82ecff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:49.283 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.281+0000 7f82ecff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:49.283 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.281+0000 7f82ecff9640 10 monclient: dump: 2026-02-24T19:23:49.284 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:49.284 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:49.284 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.284 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.284 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:49.284 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:49.284 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:49.284 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:49.284 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:49.284 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.284 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.281+0000 7f82ee7fc640 4 set_mon_vals no callback set 2026-02-24T19:23:49.285 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.282+0000 7f82ecff9640 1 -- 10.20.193.14:0/2420576512 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f82dc01d920 con 0x7f82f0157780 2026-02-24T19:23:49.285 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.282+0000 7f82ef7fe640 10 monclient: get_auth_request con 0x7f82c0077e70 auth_method 0 2026-02-24T19:23:49.285 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.282+0000 7f82ecff9640 10 client.30762.objecter ms_handle_connect 0x7f82c0077e70 2026-02-24T19:23:49.286 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.285+0000 7f82ecff9640 1 -- 10.20.193.14:0/2420576512 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7f82dc0931a0 con 0x7f82f0157780 2026-02-24T19:23:49.287 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.285+0000 7f82ecff9640 10 client.30762.objecter ms_dispatch2 0x7f82f0000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:23:49.287 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.285+0000 7f82ecff9640 3 client.30762.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:23:49.287 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.285+0000 7f82ecff9640 3 client.30762.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:23:49.287 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.285+0000 7f82ecff9640 20 client.30762.objecter dump_active .. 0 homeless 2026-02-24T19:23:49.287 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.285+0000 7f82ecff9640 1 -- 10.20.193.14:0/2420576512 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f82f0055b20 con 0x7f82f0157780 2026-02-24T19:23:49.287 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.285+0000 7f82ecff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:49.287 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.285+0000 7f82ecff9640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:23:49.392 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.391+0000 7f82f654c640 1 -- 10.20.193.14:0/2420576512 --> v1:10.20.193.14:6800/4014096310 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "8", "target": ["mon-mgr", ""]}) -- 0x7f82f005db90 con 0x7f82c0077e70 2026-02-24T19:23:49.393 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.391+0000 7f82ecff9640 1 -- 10.20.193.14:0/2420576512 <== mgr.4110 v1:10.20.193.14:6800/4014096310 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 8 to deep-scrub) ==== 41+0+0 (unknown 1222854447 0 0) 0x7f82f005db90 con 0x7f82c0077e70 2026-02-24T19:23:49.393 INFO:teuthology.orchestra.run.trial014.stderr:instructed osd(s) 8 to deep-scrub 2026-02-24T19:23:49.395 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.392+0000 7f82f654c640 10 librados: watch_flush enter 2026-02-24T19:23:49.395 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.392+0000 7f82f654c640 10 librados: watch_flush exit 2026-02-24T19:23:49.395 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.392+0000 7f82f654c640 20 client.30762.objecter shutdown clearing up homeless session... 2026-02-24T19:23:49.395 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.392+0000 7f82f654c640 10 client.30762.objecter successfully canceled tick 2026-02-24T19:23:49.395 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.392+0000 7f82f654c640 1 -- 10.20.193.14:0/2420576512 >> v1:10.20.193.14:6800/4014096310 conn(0x7f82c0077e70 legacy=0x7f82c0098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:49.395 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.392+0000 7f82f654c640 10 monclient: shutdown 2026-02-24T19:23:49.395 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.392+0000 7f82f654c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:49.395 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.392+0000 7f82f654c640 1 -- 10.20.193.14:0/2420576512 >> v1:10.20.193.14:6789/0 conn(0x7f82f0157780 legacy=0x7f82f0147bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:49.395 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.392+0000 7f82f654c640 1 -- 10.20.193.14:0/2420576512 shutdown_connections 2026-02-24T19:23:49.395 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.392+0000 7f82f654c640 1 -- 10.20.193.14:0/2420576512 >> 10.20.193.14:0/2420576512 conn(0x7f82f00b2ef0 msgr2=0x7f82f013bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:49.396 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.392+0000 7f82f654c640 1 -- 10.20.193.14:0/2420576512 shutdown_connections 2026-02-24T19:23:49.396 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.392+0000 7f82f654c640 1 -- 10.20.193.14:0/2420576512 wait complete. 2026-02-24T19:23:49.396 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.393+0000 7f82f654c640 1 librados: shutdown 2026-02-24T19:23:49.403 INFO:tasks.ceph:Scrubbing osd.12 2026-02-24T19:23:49.403 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:23:49.474 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.473+0000 7f2bb3567640 10 monclient: get_monmap_and_config 2026-02-24T19:23:49.475 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.473+0000 7f2bb3567640 10 monclient: build_initial_monmap 2026-02-24T19:23:49.475 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.473+0000 7f2bb3567640 10 monclient: monmap: 2026-02-24T19:23:49.475 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:49.475 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:49.475 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:23:49.473793+0000 2026-02-24T19:23:49.475 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:23:49.473793+0000 2026-02-24T19:23:49.475 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:49.475 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:49.475 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:49.475 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:49.475 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:49.476 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.477 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.473+0000 7f2bb3567640 1 Processor -- start 2026-02-24T19:23:49.477 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.473+0000 7f2bb3567640 1 -- start start 2026-02-24T19:23:49.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.473+0000 7f2bb3567640 10 monclient: init 2026-02-24T19:23:49.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.474+0000 7f2bb3567640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:49.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.474+0000 7f2bb3567640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:23:49.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.474+0000 7f2bb3567640 10 monclient(hunting): picked mon.noname-c con 0x7f2bac15e2a0 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:49.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.474+0000 7f2bb3567640 10 monclient(hunting): picked mon.noname-b con 0x7f2bac059e10 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:49.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.474+0000 7f2bb3567640 10 monclient(hunting): picked mon.noname-a con 0x7f2bac1a5660 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:49.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.474+0000 7f2bb3567640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bac162df0 con 0x7f2bac1a5660 2026-02-24T19:23:49.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.474+0000 7f2bb3567640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bac1630d0 con 0x7f2bac059e10 2026-02-24T19:23:49.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.474+0000 7f2bb3567640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bac1633b0 con 0x7f2bac15e2a0 2026-02-24T19:23:49.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.474+0000 7f2bb3567640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:49.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.474+0000 7f2bb3567640 10 monclient(hunting): authenticate will time out at 4004.155194s 2026-02-24T19:23:49.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.474+0000 7f2bb12dc640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7f2bac15e2a0 0x7f2bac05da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:48106/0 (socket says 10.20.193.14:48106) 2026-02-24T19:23:49.479 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.474+0000 7f2bb12dc640 1 -- 10.20.193.14:0/998301832 learned_addr learned my addr 10.20.193.14:0/998301832 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:49.479 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.475+0000 7f2b9bfff640 1 -- 10.20.193.14:0/998301832 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1435549424 0 0) 0x7f2bac1633b0 con 0x7f2bac15e2a0 2026-02-24T19:23:49.479 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.475+0000 7f2b9bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:23:49.479 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.475+0000 7f2b9bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:49.479 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.475+0000 7f2b9bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:49.479 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.475+0000 7f2b9bfff640 10 monclient(hunting): my global_id is 28724 2026-02-24T19:23:49.479 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.475+0000 7f2b9bfff640 1 -- 10.20.193.14:0/998301832 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b94003610 con 0x7f2bac15e2a0 2026-02-24T19:23:49.479 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.476+0000 7f2b9bfff640 1 -- 10.20.193.14:0/998301832 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2670287125 0 0) 0x7f2bac1630d0 con 0x7f2bac059e10 2026-02-24T19:23:49.479 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.476+0000 7f2b9bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:23:49.479 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.476+0000 7f2b9bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:49.479 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.476+0000 7f2b9bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:49.479 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.476+0000 7f2b9bfff640 10 monclient(hunting): my global_id is 29086 2026-02-24T19:23:49.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.476+0000 7f2b9bfff640 1 -- 10.20.193.14:0/998301832 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bac1633b0 con 0x7f2bac059e10 2026-02-24T19:23:49.484 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.477+0000 7f2b9bfff640 1 -- 10.20.193.14:0/998301832 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 737964971 0 0) 0x7f2b94003610 con 0x7f2bac15e2a0 2026-02-24T19:23:49.484 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.477+0000 7f2b9bfff640 1 -- 10.20.193.14:0/998301832 >> v1:10.20.193.44:6789/0 conn(0x7f2bac059e10 legacy=0x7f2bac15ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:49.484 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.477+0000 7f2b9bfff640 1 -- 10.20.193.14:0/998301832 >> v1:10.20.193.14:6789/0 conn(0x7f2bac1a5660 legacy=0x7f2bac1c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:23:49.484 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.477+0000 7f2b9bfff640 10 monclient: _finish_hunting 0 2026-02-24T19:23:49.484 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.477+0000 7f2b9bfff640 1 monclient: found mon.noname-c 2026-02-24T19:23:49.484 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.477+0000 7f2b9bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:49.484 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.477+0000 7f2b9bfff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.170:6789/0 2026-02-24T19:23:49.484 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.477+0000 7f2b9bfff640 1 -- 10.20.193.14:0/998301832 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bac163690 con 0x7f2bac15e2a0 2026-02-24T19:23:49.484 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.477+0000 7f2b9bfff640 10 monclient: _finish_auth 0 2026-02-24T19:23:49.484 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.477+0000 7f2b9bfff640 10 monclient: _check_auth_tickets 2026-02-24T19:23:49.485 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.477+0000 7f2b9bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:49.485 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.477+0000 7f2b9bfff640 1 -- 10.20.193.14:0/998301832 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f2b9c002df0 con 0x7f2bac15e2a0 2026-02-24T19:23:49.485 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.477+0000 7f2b9bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:49.485 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.477+0000 7f2b9bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:23:49.485 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.477+0000 7f2b9bfff640 10 monclient: dump: 2026-02-24T19:23:49.485 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:49.485 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:49.485 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.485 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.485 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:49.485 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:49.485 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:49.486 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:49.486 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:49.486 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.477+0000 7f2bb3567640 5 monclient: authenticate success, global_id 28724 2026-02-24T19:23:49.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.477+0000 7f2bb3567640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:49.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.478+0000 7f2b9bfff640 1 -- 10.20.193.14:0/998301832 <== mon.2 v1:10.20.193.170:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2b9c003000 con 0x7f2bac15e2a0 2026-02-24T19:23:49.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.478+0000 7f2b9bfff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:49.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.478+0000 7f2b9bfff640 1 -- 10.20.193.14:0/998301832 <== mon.2 v1:10.20.193.170:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f2b9c003440 con 0x7f2bac15e2a0 2026-02-24T19:23:49.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.478+0000 7f2bb3567640 10 monclient: get_monmap_and_config success 2026-02-24T19:23:49.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.478+0000 7f2bb3567640 4 set_mon_vals no callback set 2026-02-24T19:23:49.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.478+0000 7f2b9bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:49.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.478+0000 7f2b9bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:49.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.478+0000 7f2b9bfff640 10 monclient: dump: 2026-02-24T19:23:49.487 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:49.487 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:49.487 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.487 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.487 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:49.487 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:49.487 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:49.487 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:49.487 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:49.487 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.487 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.478+0000 7f2bb3567640 10 monclient: shutdown 2026-02-24T19:23:49.487 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.478+0000 7f2bb3567640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:49.488 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.478+0000 7f2bb3567640 1 -- 10.20.193.14:0/998301832 >> v1:10.20.193.170:6789/0 conn(0x7f2bac15e2a0 legacy=0x7f2bac05da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:49.488 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.478+0000 7f2bb3567640 1 -- 10.20.193.14:0/998301832 shutdown_connections 2026-02-24T19:23:49.488 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.478+0000 7f2bb3567640 1 -- 10.20.193.14:0/998301832 >> 10.20.193.14:0/998301832 conn(0x7f2bac0b2f60 msgr2=0x7f2bac0b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:49.488 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.478+0000 7f2bb3567640 1 -- 10.20.193.14:0/998301832 shutdown_connections 2026-02-24T19:23:49.488 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.479+0000 7f2bb3567640 1 -- 10.20.193.14:0/998301832 wait complete. 2026-02-24T19:23:49.488 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.479+0000 7f2bb3567640 10 monclient: build_initial_monmap 2026-02-24T19:23:49.488 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.479+0000 7f2bb3567640 10 monclient: monmap: 2026-02-24T19:23:49.488 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:49.488 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:23:49.488 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:23:49.488 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:23:49.488 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:49.488 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:23:49.489 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:49.489 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:49.489 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:49.489 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.489 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.479+0000 7f2bb3567640 1 librados: starting msgr at 2026-02-24T19:23:49.489 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.479+0000 7f2bb3567640 1 librados: starting objecter 2026-02-24T19:23:49.489 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.479+0000 7f2bb3567640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:23:49.489 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.479+0000 7f2bb3567640 1 Processor -- start 2026-02-24T19:23:49.489 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.479+0000 7f2bb3567640 1 -- start start 2026-02-24T19:23:49.489 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.479+0000 7f2bb3567640 1 librados: setting wanted keys 2026-02-24T19:23:49.489 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.479+0000 7f2bb3567640 1 librados: calling monclient init 2026-02-24T19:23:49.489 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.479+0000 7f2bb3567640 10 monclient: init 2026-02-24T19:23:49.489 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.480+0000 7f2bb3567640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:49.490 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.480+0000 7f2bb3567640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:23:49.490 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.480+0000 7f2bb3567640 10 monclient(hunting): picked mon.noname-b con 0x7f2bac059e10 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:49.490 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.480+0000 7f2bb3567640 10 monclient(hunting): picked mon.noname-c con 0x7f2bac15e2a0 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:49.490 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.480+0000 7f2bb3567640 10 monclient(hunting): picked mon.noname-a con 0x7f2bac1a5660 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:49.490 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.480+0000 7f2bb3567640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bac0b0c10 con 0x7f2bac1a5660 2026-02-24T19:23:49.490 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.480+0000 7f2bb3567640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bac0b0ef0 con 0x7f2bac059e10 2026-02-24T19:23:49.490 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.480+0000 7f2bb3567640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bac0b11d0 con 0x7f2bac15e2a0 2026-02-24T19:23:49.490 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.480+0000 7f2bb3567640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:49.490 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.480+0000 7f2bb3567640 10 monclient(hunting): authenticate will time out at 4004.161305s 2026-02-24T19:23:49.490 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.480+0000 7f2bb0adb640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7f2bac15e2a0 0x7f2bac190dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:48112/0 (socket says 10.20.193.14:48112) 2026-02-24T19:23:49.490 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.480+0000 7f2bb0adb640 1 -- 10.20.193.14:0/272761942 learned_addr learned my addr 10.20.193.14:0/272761942 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:49.490 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.480+0000 7f2b99ffb640 10 client.?.objecter ms_handle_connect 0x7f2bac15e2a0 2026-02-24T19:23:49.490 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.480+0000 7f2b99ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:49.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.481+0000 7f2b99ffb640 10 client.?.objecter ms_handle_connect 0x7f2bac1a5660 2026-02-24T19:23:49.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.481+0000 7f2b99ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:49.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.481+0000 7f2b99ffb640 10 client.?.objecter ms_handle_connect 0x7f2bac059e10 2026-02-24T19:23:49.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.481+0000 7f2b99ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:49.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.481+0000 7f2b99ffb640 1 -- 10.20.193.14:0/272761942 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3098168169 0 0) 0x7f2bac0b11d0 con 0x7f2bac15e2a0 2026-02-24T19:23:49.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.481+0000 7f2b99ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:23:49.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.481+0000 7f2b99ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:49.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.481+0000 7f2b99ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:49.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.481+0000 7f2b99ffb640 10 monclient(hunting): my global_id is 28727 2026-02-24T19:23:49.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.481+0000 7f2b99ffb640 1 -- 10.20.193.14:0/272761942 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b7c003610 con 0x7f2bac15e2a0 2026-02-24T19:23:49.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.482+0000 7f2b99ffb640 1 -- 10.20.193.14:0/272761942 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 385979417 0 0) 0x7f2bac0b0c10 con 0x7f2bac1a5660 2026-02-24T19:23:49.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.482+0000 7f2b99ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:23:49.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.482+0000 7f2b99ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:49.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.482+0000 7f2b99ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:49.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.482+0000 7f2b99ffb640 10 monclient(hunting): my global_id is 30765 2026-02-24T19:23:49.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.482+0000 7f2b99ffb640 1 -- 10.20.193.14:0/272761942 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bac0b11d0 con 0x7f2bac1a5660 2026-02-24T19:23:49.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.482+0000 7f2b99ffb640 1 -- 10.20.193.14:0/272761942 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2519658161 0 0) 0x7f2bac0b0ef0 con 0x7f2bac059e10 2026-02-24T19:23:49.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.482+0000 7f2b99ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:23:49.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.482+0000 7f2b99ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:49.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.482+0000 7f2b99ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:49.495 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.482+0000 7f2b99ffb640 10 monclient(hunting): my global_id is 29089 2026-02-24T19:23:49.495 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.482+0000 7f2b99ffb640 1 -- 10.20.193.14:0/272761942 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bac0b0c10 con 0x7f2bac059e10 2026-02-24T19:23:49.495 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.484+0000 7f2b99ffb640 1 -- 10.20.193.14:0/272761942 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3864224236 0 0) 0x7f2b7c003610 con 0x7f2bac15e2a0 2026-02-24T19:23:49.495 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.484+0000 7f2b99ffb640 1 -- 10.20.193.14:0/272761942 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2bac0b0ef0 con 0x7f2bac15e2a0 2026-02-24T19:23:49.495 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.484+0000 7f2b99ffb640 1 -- 10.20.193.14:0/272761942 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f2ba0003170 con 0x7f2bac15e2a0 2026-02-24T19:23:49.495 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.484+0000 7f2b99ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:49.495 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.484+0000 7f2b99ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:23:49.495 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.484+0000 7f2b99ffb640 10 monclient(hunting): dump: 2026-02-24T19:23:49.495 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:49.495 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:49.495 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.495 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.496 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:49.496 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:49.496 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:49.496 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:49.496 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:49.496 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.496 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.484+0000 7f2b99ffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:23:49.496 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.484+0000 7f2b99ffb640 1 -- 10.20.193.14:0/272761942 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1375495190 0 0) 0x7f2bac0b11d0 con 0x7f2bac1a5660 2026-02-24T19:23:49.496 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.484+0000 7f2b99ffb640 1 -- 10.20.193.14:0/272761942 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2b7c003610 con 0x7f2bac1a5660 2026-02-24T19:23:49.496 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.484+0000 7f2b99ffb640 1 -- 10.20.193.14:0/272761942 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f2ba8003270 con 0x7f2bac1a5660 2026-02-24T19:23:49.496 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.484+0000 7f2b99ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:49.496 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.484+0000 7f2b99ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:49.497 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.484+0000 7f2b99ffb640 10 monclient(hunting): dump: 2026-02-24T19:23:49.497 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:49.497 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:49.497 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.497 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.497 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:49.497 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:49.497 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:49.497 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:49.497 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:49.497 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.497 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.485+0000 7f2b99ffb640 1 -- 10.20.193.14:0/272761942 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3597041013 0 0) 0x7f2bac0b0c10 con 0x7f2bac059e10 2026-02-24T19:23:49.497 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.485+0000 7f2b99ffb640 1 -- 10.20.193.14:0/272761942 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2bac0b11d0 con 0x7f2bac059e10 2026-02-24T19:23:49.498 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.485+0000 7f2b99ffb640 1 -- 10.20.193.14:0/272761942 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f2b9c002d00 con 0x7f2bac059e10 2026-02-24T19:23:49.498 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.485+0000 7f2b99ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:49.498 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.485+0000 7f2b99ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:49.498 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.485+0000 7f2b99ffb640 10 monclient(hunting): dump: 2026-02-24T19:23:49.498 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:49.498 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:49.498 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.498 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.498 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:49.498 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:49.498 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:49.498 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:49.498 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:49.499 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.499 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.486+0000 7f2b99ffb640 1 -- 10.20.193.14:0/272761942 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4161526791 0 0) 0x7f2bac0b0ef0 con 0x7f2bac15e2a0 2026-02-24T19:23:49.499 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.486+0000 7f2b99ffb640 1 -- 10.20.193.14:0/272761942 >> v1:10.20.193.44:6789/0 conn(0x7f2bac059e10 legacy=0x7f2bac11ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:49.499 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.486+0000 7f2b99ffb640 1 -- 10.20.193.14:0/272761942 >> v1:10.20.193.14:6789/0 conn(0x7f2bac1a5660 legacy=0x7f2bac0564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:49.499 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.486+0000 7f2b99ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:23:49.499 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.486+0000 7f2b99ffb640 1 monclient: found mon.c 2026-02-24T19:23:49.499 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.486+0000 7f2b99ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:49.499 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.486+0000 7f2b99ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:49.499 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.486+0000 7f2b99ffb640 1 -- 10.20.193.14:0/272761942 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bac0b14b0 con 0x7f2bac15e2a0 2026-02-24T19:23:49.499 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.486+0000 7f2b99ffb640 10 monclient: _finish_auth 0 2026-02-24T19:23:49.499 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.486+0000 7f2b99ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:23:49.499 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.486+0000 7f2b99ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:49.500 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.486+0000 7f2bb3567640 5 monclient: authenticate success, global_id 28727 2026-02-24T19:23:49.500 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.486+0000 7f2bb3567640 10 monclient: _renew_subs 2026-02-24T19:23:49.500 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.486+0000 7f2bb3567640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:49.500 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.486+0000 7f2bb3567640 1 -- 10.20.193.14:0/272761942 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2bac0b1790 con 0x7f2bac15e2a0 2026-02-24T19:23:49.500 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.486+0000 7f2bb3567640 10 client.28727.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:49.500 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.486+0000 7f2bb3567640 10 monclient: _renew_subs 2026-02-24T19:23:49.500 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.486+0000 7f2bb3567640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:49.500 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.486+0000 7f2bb3567640 1 -- 10.20.193.14:0/272761942 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2bac1914e0 con 0x7f2bac15e2a0 2026-02-24T19:23:49.500 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.486+0000 7f2bb3567640 1 librados: init done 2026-02-24T19:23:49.500 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.486+0000 7f2bb3567640 10 client.28727.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:49.500 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.486+0000 7f2bb3567640 15 client.28727.objecter _session_command_op_assign -1 1 2026-02-24T19:23:49.500 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.486+0000 7f2bb3567640 20 client.28727.objecter _get_session osd=-1 returning homeless 2026-02-24T19:23:49.500 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.486+0000 7f2bb3567640 10 client.28727.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:49.500 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.486+0000 7f2bb3567640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:49.501 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.486+0000 7f2bb3567640 1 -- 10.20.193.14:0/272761942 --> v1:10.20.193.170:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f2bac1917c0 con 0x7f2bac15e2a0 2026-02-24T19:23:49.502 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.494+0000 7f2b99ffb640 1 -- 10.20.193.14:0/272761942 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2ba0003310 con 0x7f2bac15e2a0 2026-02-24T19:23:49.502 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.494+0000 7f2b99ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:49.502 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.494+0000 7f2b99ffb640 1 -- 10.20.193.14:0/272761942 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f2ba0003b50 con 0x7f2bac15e2a0 2026-02-24T19:23:49.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.494+0000 7f2b99ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:49.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.494+0000 7f2b99ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:49.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.494+0000 7f2b9b7fe640 4 set_mon_vals no callback set 2026-02-24T19:23:49.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.494+0000 7f2b99ffb640 10 monclient: dump: 2026-02-24T19:23:49.503 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:49.503 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:49.503 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.503 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.503 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:49.503 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:49.503 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:49.503 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:49.504 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:49.504 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.495+0000 7f2b99ffb640 1 -- 10.20.193.14:0/272761942 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f2ba0003d60 con 0x7f2bac15e2a0 2026-02-24T19:23:49.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.495+0000 7f2bb12dc640 10 monclient: get_auth_request con 0x7f2b7c077ed0 auth_method 0 2026-02-24T19:23:49.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.496+0000 7f2b99ffb640 10 client.28727.objecter ms_handle_connect 0x7f2b7c077ed0 2026-02-24T19:23:49.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.496+0000 7f2b99ffb640 1 -- 10.20.193.14:0/272761942 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7f2ba0003b50 con 0x7f2bac15e2a0 2026-02-24T19:23:49.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.496+0000 7f2b99ffb640 10 client.28727.objecter ms_dispatch2 0x7f2bac000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:23:49.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.496+0000 7f2b99ffb640 3 client.28727.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:23:49.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.496+0000 7f2b99ffb640 3 client.28727.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:23:49.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.496+0000 7f2b99ffb640 10 client.28727.objecter checking command 1 2026-02-24T19:23:49.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.496+0000 7f2b99ffb640 20 client.28727.objecter _get_session s=0x7f2b7c0a21f0 osd=12 3 2026-02-24T19:23:49.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.496+0000 7f2b99ffb640 20 client.28727.objecter put_session s=0x7f2b7c0a21f0 osd=12 3 2026-02-24T19:23:49.505 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.496+0000 7f2b99ffb640 15 client.28727.objecter _session_command_op_remove -1 1 2026-02-24T19:23:49.505 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.496+0000 7f2b99ffb640 20 client.28727.objecter _get_session s=0x7f2b7c0a21f0 osd=12 3 2026-02-24T19:23:49.505 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.496+0000 7f2b99ffb640 20 client.28727.objecter get_session s=0x7f2b7c0a21f0 osd=12 3 2026-02-24T19:23:49.505 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.496+0000 7f2b99ffb640 15 client.28727.objecter _session_command_op_assign 12 1 2026-02-24T19:23:49.505 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.496+0000 7f2b99ffb640 20 client.28727.objecter put_session s=0x7f2b7c0a21f0 osd=12 4 2026-02-24T19:23:49.505 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.496+0000 7f2b99ffb640 10 client.28727.objecter _send_command 1 2026-02-24T19:23:49.505 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.496+0000 7f2b99ffb640 1 -- 10.20.193.14:0/272761942 --> v1:10.20.193.14:6801/1483397197 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2b7c0c4500 con 0x7f2b7c0a28a0 2026-02-24T19:23:49.505 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.496+0000 7f2b99ffb640 20 client.28727.objecter dump_active .. 0 homeless 2026-02-24T19:23:49.505 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.496+0000 7f2b99ffb640 1 -- 10.20.193.14:0/272761942 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_get_version_reply(handle=1 version=354) ==== 24+0+0 (unknown 31317031 0 0) 0x7f2ba00598f0 con 0x7f2bac15e2a0 2026-02-24T19:23:49.505 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.496+0000 7f2b99ffb640 10 monclient: handle_get_version_reply finishing 1 version 354 2026-02-24T19:23:49.505 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.497+0000 7f2bb1add640 10 monclient: get_auth_request con 0x7f2b7c0a28a0 auth_method 0 2026-02-24T19:23:49.505 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.498+0000 7f2b99ffb640 10 client.28727.objecter ms_handle_connect 0x7f2b7c0a28a0 2026-02-24T19:23:49.509 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.507+0000 7f2b99ffb640 1 -- 10.20.193.14:0/272761942 <== osd.12 v1:10.20.193.14:6801/1483397197 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f2b7c0c4500 con 0x7f2b7c0a28a0 2026-02-24T19:23:49.509 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.507+0000 7f2b99ffb640 10 client.28727.objecter ms_dispatch2 0x7f2bac000b90 command_reply(tid 1: 0 ) 2026-02-24T19:23:49.509 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.507+0000 7f2b99ffb640 10 client.28727.objecter _finish_command 1 = system:0 2026-02-24T19:23:49.509 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.507+0000 7f2b99ffb640 20 client.28727.objecter put_session s=0x7f2b7c0a21f0 osd=12 4 2026-02-24T19:23:49.509 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.507+0000 7f2b99ffb640 15 client.28727.objecter _session_command_op_remove 12 1 2026-02-24T19:23:49.518 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.517+0000 7f2bb3567640 10 client.28727.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:23:49.519 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.517+0000 7f2bb3567640 15 client.28727.objecter _session_command_op_assign -1 2 2026-02-24T19:23:49.519 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.517+0000 7f2bb3567640 20 client.28727.objecter _get_session s=0x7f2b7c0a21f0 osd=12 3 2026-02-24T19:23:49.519 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.517+0000 7f2bb3567640 20 client.28727.objecter put_session s=0x7f2b7c0a21f0 osd=12 3 2026-02-24T19:23:49.519 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.517+0000 7f2bb3567640 20 client.28727.objecter _get_session s=0x7f2b7c0a21f0 osd=12 3 2026-02-24T19:23:49.519 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.517+0000 7f2bb3567640 15 client.28727.objecter _session_command_op_remove -1 2 2026-02-24T19:23:49.519 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.517+0000 7f2bb3567640 20 client.28727.objecter get_session s=0x7f2b7c0a21f0 osd=12 3 2026-02-24T19:23:49.519 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.517+0000 7f2bb3567640 15 client.28727.objecter _session_command_op_assign 12 2 2026-02-24T19:23:49.519 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.517+0000 7f2bb3567640 20 client.28727.objecter put_session s=0x7f2b7c0a21f0 osd=12 4 2026-02-24T19:23:49.519 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.517+0000 7f2bb3567640 10 client.28727.objecter _send_command 2 2026-02-24T19:23:49.519 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.517+0000 7f2bb3567640 1 -- 10.20.193.14:0/272761942 --> v1:10.20.193.14:6801/1483397197 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2bac0531e0 con 0x7f2b7c0a28a0 2026-02-24T19:23:49.533 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.531+0000 7f2b99ffb640 1 -- 10.20.193.14:0/272761942 <== osd.12 v1:10.20.193.14:6801/1483397197 2 ==== command_reply(tid 2: 0 ) ==== 8+0+712 (unknown 0 0 714369635) 0x7f2bac0531e0 con 0x7f2b7c0a28a0 2026-02-24T19:23:49.533 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.531+0000 7f2b99ffb640 10 client.28727.objecter ms_dispatch2 0x7f2bac000b90 command_reply(tid 2: 0 ) 2026-02-24T19:23:49.533 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.531+0000 7f2b99ffb640 10 client.28727.objecter _finish_command 2 = system:0 2026-02-24T19:23:49.533 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.531+0000 7f2b99ffb640 20 client.28727.objecter put_session s=0x7f2b7c0a21f0 osd=12 4 2026-02-24T19:23:49.534 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.531+0000 7f2b99ffb640 15 client.28727.objecter _session_command_op_remove 12 2 2026-02-24T19:23:49.534 INFO:teuthology.orchestra.run.trial014.stdout:{ 2026-02-24T19:23:49.534 INFO:teuthology.orchestra.run.trial014.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-24T19:23:49.534 INFO:teuthology.orchestra.run.trial014.stdout:} 2026-02-24T19:23:49.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.532+0000 7f2bb3567640 10 librados: watch_flush enter 2026-02-24T19:23:49.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.532+0000 7f2bb3567640 10 librados: watch_flush exit 2026-02-24T19:23:49.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.532+0000 7f2bb3567640 10 client.28727.objecter close_session for osd.12 2026-02-24T19:23:49.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.532+0000 7f2bb3567640 1 -- 10.20.193.14:0/272761942 >> v1:10.20.193.14:6801/1483397197 conn(0x7f2b7c0a28a0 legacy=0x7f2b7c0c2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:49.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.532+0000 7f2bb3567640 20 client.28727.objecter put_session s=0x7f2b7c0a21f0 osd=12 1 2026-02-24T19:23:49.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.532+0000 7f2bb3567640 20 client.28727.objecter shutdown clearing up homeless session... 2026-02-24T19:23:49.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.532+0000 7f2bb3567640 10 client.28727.objecter successfully canceled tick 2026-02-24T19:23:49.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.532+0000 7f2bb3567640 1 -- 10.20.193.14:0/272761942 >> v1:10.20.193.14:6800/4014096310 conn(0x7f2b7c077ed0 legacy=0x7f2b7c098380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:49.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.532+0000 7f2bb3567640 10 monclient: shutdown 2026-02-24T19:23:49.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.532+0000 7f2bb3567640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:49.536 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.532+0000 7f2bb3567640 1 -- 10.20.193.14:0/272761942 >> v1:10.20.193.170:6789/0 conn(0x7f2bac15e2a0 legacy=0x7f2bac190dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:49.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.532+0000 7f2bb1add640 1 -- 10.20.193.14:0/272761942 reap_dead start 2026-02-24T19:23:49.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.532+0000 7f2bb3567640 1 -- 10.20.193.14:0/272761942 shutdown_connections 2026-02-24T19:23:49.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.532+0000 7f2bb3567640 1 -- 10.20.193.14:0/272761942 >> 10.20.193.14:0/272761942 conn(0x7f2bac0b2f60 msgr2=0x7f2bac15ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:49.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.532+0000 7f2bb3567640 1 -- 10.20.193.14:0/272761942 shutdown_connections 2026-02-24T19:23:49.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.532+0000 7f2bb3567640 1 -- 10.20.193.14:0/272761942 wait complete. 2026-02-24T19:23:49.537 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.532+0000 7f2bb3567640 1 librados: shutdown 2026-02-24T19:23:49.541 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 12 2026-02-24T19:23:49.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.607+0000 7f1ff0326640 10 monclient: get_monmap_and_config 2026-02-24T19:23:49.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.607+0000 7f1ff0326640 10 monclient: build_initial_monmap 2026-02-24T19:23:49.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.607+0000 7f1ff0326640 10 monclient: monmap: 2026-02-24T19:23:49.609 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:49.609 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:49.609 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:23:49.607691+0000 2026-02-24T19:23:49.609 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:23:49.607691+0000 2026-02-24T19:23:49.609 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:49.609 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:49.609 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:49.609 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:49.609 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:49.609 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.610 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.607+0000 7f1ff0326640 1 Processor -- start 2026-02-24T19:23:49.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.607+0000 7f1ff0326640 1 -- start start 2026-02-24T19:23:49.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.607+0000 7f1ff0326640 10 monclient: init 2026-02-24T19:23:49.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.607+0000 7f1ff0326640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:49.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.608+0000 7f1ff0326640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:23:49.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.608+0000 7f1ff0326640 10 monclient(hunting): picked mon.noname-a con 0x7f1fe8157780 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:49.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.608+0000 7f1ff0326640 10 monclient(hunting): picked mon.noname-b con 0x7f1fe8157b50 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:49.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.608+0000 7f1ff0326640 10 monclient(hunting): picked mon.noname-c con 0x7f1fe8164d00 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:49.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.608+0000 7f1ff0326640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fe805de70 con 0x7f1fe8157780 2026-02-24T19:23:49.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.608+0000 7f1ff0326640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fe8055b20 con 0x7f1fe8157b50 2026-02-24T19:23:49.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.608+0000 7f1ff0326640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fe8055e00 con 0x7f1fe8164d00 2026-02-24T19:23:49.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.608+0000 7f1ff0326640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:49.612 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.608+0000 7f1ff0326640 10 monclient(hunting): authenticate will time out at 4004.289063s 2026-02-24T19:23:49.612 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.608+0000 7f1fee09b640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f1fe8157780 0x7f1fe8056ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:50772/0 (socket says 10.20.193.14:50772) 2026-02-24T19:23:49.612 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.608+0000 7f1fee09b640 1 -- 10.20.193.14:0/640914769 learned_addr learned my addr 10.20.193.14:0/640914769 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:49.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.609+0000 7f1fed099640 1 -- 10.20.193.14:0/640914769 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4205248520 0 0) 0x7f1fe805de70 con 0x7f1fe8157780 2026-02-24T19:23:49.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.609+0000 7f1fed099640 10 monclient(hunting): _negotiate 2026-02-24T19:23:49.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.609+0000 7f1fed099640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:49.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.609+0000 7f1fed099640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:49.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.609+0000 7f1fed099640 10 monclient(hunting): my global_id is 30768 2026-02-24T19:23:49.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.609+0000 7f1fed099640 1 -- 10.20.193.14:0/640914769 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fd0003610 con 0x7f1fe8157780 2026-02-24T19:23:49.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.609+0000 7f1fed099640 1 -- 10.20.193.14:0/640914769 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3635199125 0 0) 0x7f1fe8055e00 con 0x7f1fe8164d00 2026-02-24T19:23:49.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.609+0000 7f1fed099640 10 monclient(hunting): _negotiate 2026-02-24T19:23:49.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.609+0000 7f1fed099640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:49.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.609+0000 7f1fed099640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:49.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.609+0000 7f1fed099640 10 monclient(hunting): my global_id is 28730 2026-02-24T19:23:49.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.609+0000 7f1fed099640 1 -- 10.20.193.14:0/640914769 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fe805de70 con 0x7f1fe8164d00 2026-02-24T19:23:49.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.610+0000 7f1fed099640 1 -- 10.20.193.14:0/640914769 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1592768521 0 0) 0x7f1fe8055b20 con 0x7f1fe8157b50 2026-02-24T19:23:49.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.610+0000 7f1fed099640 10 monclient(hunting): _negotiate 2026-02-24T19:23:49.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.610+0000 7f1fed099640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:49.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.610+0000 7f1fed099640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:49.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.610+0000 7f1fed099640 10 monclient(hunting): my global_id is 29092 2026-02-24T19:23:49.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.610+0000 7f1fed099640 1 -- 10.20.193.14:0/640914769 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fe8055e00 con 0x7f1fe8157b50 2026-02-24T19:23:49.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.611+0000 7f1fed099640 1 -- 10.20.193.14:0/640914769 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 10111626 0 0) 0x7f1fe805de70 con 0x7f1fe8164d00 2026-02-24T19:23:49.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.611+0000 7f1fed099640 1 -- 10.20.193.14:0/640914769 >> v1:10.20.193.44:6789/0 conn(0x7f1fe8157b50 legacy=0x7f1fe81645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:49.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.611+0000 7f1fed099640 1 -- 10.20.193.14:0/640914769 >> v1:10.20.193.14:6789/0 conn(0x7f1fe8157780 legacy=0x7f1fe8056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:49.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.611+0000 7f1fed099640 10 monclient: _finish_hunting 0 2026-02-24T19:23:49.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.611+0000 7f1fed099640 1 monclient: found mon.noname-c 2026-02-24T19:23:49.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.611+0000 7f1fed099640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:49.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.611+0000 7f1fed099640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.170:6789/0 2026-02-24T19:23:49.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.611+0000 7f1fed099640 1 -- 10.20.193.14:0/640914769 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fe80560e0 con 0x7f1fe8164d00 2026-02-24T19:23:49.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.611+0000 7f1fed099640 10 monclient: _finish_auth 0 2026-02-24T19:23:49.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.611+0000 7f1fed099640 10 monclient: _check_auth_tickets 2026-02-24T19:23:49.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.611+0000 7f1fed099640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:49.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.611+0000 7f1fed099640 1 -- 10.20.193.14:0/640914769 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f1fe4003170 con 0x7f1fe8164d00 2026-02-24T19:23:49.620 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.611+0000 7f1fed099640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:49.620 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.611+0000 7f1fed099640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:23:49.620 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.611+0000 7f1fed099640 10 monclient: dump: 2026-02-24T19:23:49.620 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:49.620 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:49.620 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.620 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.620 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:49.620 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:49.620 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:49.620 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:49.620 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:49.620 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.611+0000 7f1ff0326640 5 monclient: authenticate success, global_id 28730 2026-02-24T19:23:49.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.611+0000 7f1ff0326640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:49.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.612+0000 7f1fed099640 1 -- 10.20.193.14:0/640914769 <== mon.2 v1:10.20.193.170:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1fe4003340 con 0x7f1fe8164d00 2026-02-24T19:23:49.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.612+0000 7f1fed099640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:49.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.612+0000 7f1fed099640 1 -- 10.20.193.14:0/640914769 <== mon.2 v1:10.20.193.170:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f1fe4003780 con 0x7f1fe8164d00 2026-02-24T19:23:49.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.612+0000 7f1fed099640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:49.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.612+0000 7f1fed099640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:49.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.612+0000 7f1fed099640 10 monclient: dump: 2026-02-24T19:23:49.621 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:49.621 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:49.621 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.621 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.621 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:49.622 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:49.622 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:49.622 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:49.622 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:49.622 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.612+0000 7f1ff0326640 10 monclient: get_monmap_and_config success 2026-02-24T19:23:49.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.612+0000 7f1ff0326640 4 set_mon_vals no callback set 2026-02-24T19:23:49.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.612+0000 7f1ff0326640 10 monclient: shutdown 2026-02-24T19:23:49.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.612+0000 7f1ff0326640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:49.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.612+0000 7f1ff0326640 1 -- 10.20.193.14:0/640914769 >> v1:10.20.193.170:6789/0 conn(0x7f1fe8164d00 legacy=0x7f1fe81c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:49.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.612+0000 7f1ff0326640 1 -- 10.20.193.14:0/640914769 shutdown_connections 2026-02-24T19:23:49.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.612+0000 7f1ff0326640 1 -- 10.20.193.14:0/640914769 >> 10.20.193.14:0/640914769 conn(0x7f1fe80b2ef0 msgr2=0x7f1fe80b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:49.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.612+0000 7f1ff0326640 1 -- 10.20.193.14:0/640914769 shutdown_connections 2026-02-24T19:23:49.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.612+0000 7f1ff0326640 1 -- 10.20.193.14:0/640914769 wait complete. 2026-02-24T19:23:49.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.613+0000 7f1ff0326640 10 monclient: build_initial_monmap 2026-02-24T19:23:49.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.613+0000 7f1ff0326640 10 monclient: monmap: 2026-02-24T19:23:49.623 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:49.623 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:23:49.623 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:23:49.623 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:23:49.623 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:49.623 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:23:49.623 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:49.623 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:49.623 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:49.623 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.613+0000 7f1ff0326640 1 librados: starting msgr at 2026-02-24T19:23:49.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.613+0000 7f1ff0326640 1 librados: starting objecter 2026-02-24T19:23:49.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.613+0000 7f1ff0326640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:23:49.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.613+0000 7f1ff0326640 1 Processor -- start 2026-02-24T19:23:49.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.613+0000 7f1ff0326640 1 -- start start 2026-02-24T19:23:49.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.613+0000 7f1ff0326640 1 librados: setting wanted keys 2026-02-24T19:23:49.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.613+0000 7f1ff0326640 1 librados: calling monclient init 2026-02-24T19:23:49.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.613+0000 7f1ff0326640 10 monclient: init 2026-02-24T19:23:49.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.613+0000 7f1ff0326640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:49.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.613+0000 7f1ff0326640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:23:49.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.613+0000 7f1ff0326640 10 monclient(hunting): picked mon.noname-a con 0x7f1fe8157780 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:49.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.613+0000 7f1ff0326640 10 monclient(hunting): picked mon.noname-b con 0x7f1fe8157b50 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:49.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.613+0000 7f1ff0326640 10 monclient(hunting): picked mon.noname-c con 0x7f1fe8164d00 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:49.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.613+0000 7f1ff0326640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fe8146a70 con 0x7f1fe8157780 2026-02-24T19:23:49.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.613+0000 7f1ff0326640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fe8135980 con 0x7f1fe8157b50 2026-02-24T19:23:49.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.613+0000 7f1ff0326640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fe8135c60 con 0x7f1fe8164d00 2026-02-24T19:23:49.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.613+0000 7f1ff0326640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:49.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.613+0000 7f1ff0326640 10 monclient(hunting): authenticate will time out at 4004.294719s 2026-02-24T19:23:49.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.613+0000 7f1fee09b640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f1fe8157780 0x7f1fe8058bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:50782/0 (socket says 10.20.193.14:50782) 2026-02-24T19:23:49.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.613+0000 7f1fee09b640 1 -- 10.20.193.14:0/2187404618 learned_addr learned my addr 10.20.193.14:0/2187404618 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:49.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.614+0000 7f1fceffd640 10 client.?.objecter ms_handle_connect 0x7f1fe8157780 2026-02-24T19:23:49.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.614+0000 7f1fceffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:49.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.614+0000 7f1fceffd640 10 client.?.objecter ms_handle_connect 0x7f1fe8164d00 2026-02-24T19:23:49.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.614+0000 7f1fceffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:49.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.614+0000 7f1fceffd640 10 client.?.objecter ms_handle_connect 0x7f1fe8157b50 2026-02-24T19:23:49.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.614+0000 7f1fceffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:49.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.615+0000 7f1fceffd640 1 -- 10.20.193.14:0/2187404618 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4188616863 0 0) 0x7f1fe8135c60 con 0x7f1fe8164d00 2026-02-24T19:23:49.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.615+0000 7f1fceffd640 10 monclient(hunting): _negotiate 2026-02-24T19:23:49.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.615+0000 7f1fceffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:49.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.615+0000 7f1fceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:49.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.615+0000 7f1fceffd640 10 monclient(hunting): my global_id is 28733 2026-02-24T19:23:49.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.615+0000 7f1fceffd640 1 -- 10.20.193.14:0/2187404618 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fb8003610 con 0x7f1fe8164d00 2026-02-24T19:23:49.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.615+0000 7f1fceffd640 1 -- 10.20.193.14:0/2187404618 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2353243867 0 0) 0x7f1fe8146a70 con 0x7f1fe8157780 2026-02-24T19:23:49.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.615+0000 7f1fceffd640 10 monclient(hunting): _negotiate 2026-02-24T19:23:49.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.615+0000 7f1fceffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:49.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.615+0000 7f1fceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:49.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.615+0000 7f1fceffd640 10 monclient(hunting): my global_id is 30771 2026-02-24T19:23:49.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.615+0000 7f1fceffd640 1 -- 10.20.193.14:0/2187404618 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fe8135c60 con 0x7f1fe8157780 2026-02-24T19:23:49.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.615+0000 7f1fceffd640 1 -- 10.20.193.14:0/2187404618 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 687765139 0 0) 0x7f1fe8135980 con 0x7f1fe8157b50 2026-02-24T19:23:49.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.615+0000 7f1fceffd640 10 monclient(hunting): _negotiate 2026-02-24T19:23:49.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.615+0000 7f1fceffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:49.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.615+0000 7f1fceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:49.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.615+0000 7f1fceffd640 10 monclient(hunting): my global_id is 29095 2026-02-24T19:23:49.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.615+0000 7f1fceffd640 1 -- 10.20.193.14:0/2187404618 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fe8146a70 con 0x7f1fe8157b50 2026-02-24T19:23:49.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.617+0000 7f1fceffd640 1 -- 10.20.193.14:0/2187404618 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2570765057 0 0) 0x7f1fb8003610 con 0x7f1fe8164d00 2026-02-24T19:23:49.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.617+0000 7f1fceffd640 1 -- 10.20.193.14:0/2187404618 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1fe8135980 con 0x7f1fe8164d00 2026-02-24T19:23:49.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.617+0000 7f1fceffd640 1 -- 10.20.193.14:0/2187404618 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f1fe4003690 con 0x7f1fe8164d00 2026-02-24T19:23:49.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.617+0000 7f1fceffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:49.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.617+0000 7f1fceffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:23:49.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.617+0000 7f1fceffd640 10 monclient(hunting): dump: 2026-02-24T19:23:49.630 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:49.630 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:49.630 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.630 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.631 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:49.631 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:49.631 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:49.631 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:49.631 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:49.631 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.617+0000 7f1fceffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:23:49.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.617+0000 7f1fceffd640 1 -- 10.20.193.14:0/2187404618 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3177815730 0 0) 0x7f1fe8135c60 con 0x7f1fe8157780 2026-02-24T19:23:49.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.617+0000 7f1fceffd640 1 -- 10.20.193.14:0/2187404618 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1fb8003610 con 0x7f1fe8157780 2026-02-24T19:23:49.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.617+0000 7f1fceffd640 1 -- 10.20.193.14:0/2187404618 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f1fd80030b0 con 0x7f1fe8157780 2026-02-24T19:23:49.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.617+0000 7f1fceffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:49.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.617+0000 7f1fceffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:49.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.617+0000 7f1fceffd640 10 monclient(hunting): dump: 2026-02-24T19:23:49.632 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:49.632 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:49.632 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.632 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.632 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:49.632 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:49.632 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:49.632 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:49.632 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:49.632 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.618+0000 7f1fceffd640 1 -- 10.20.193.14:0/2187404618 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3383470850 0 0) 0x7f1fe8146a70 con 0x7f1fe8157b50 2026-02-24T19:23:49.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.618+0000 7f1fceffd640 1 -- 10.20.193.14:0/2187404618 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1fe8135c60 con 0x7f1fe8157b50 2026-02-24T19:23:49.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.618+0000 7f1fceffd640 1 -- 10.20.193.14:0/2187404618 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f1fdc003060 con 0x7f1fe8157b50 2026-02-24T19:23:49.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.618+0000 7f1fceffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:49.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.618+0000 7f1fceffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:49.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.618+0000 7f1fceffd640 10 monclient(hunting): dump: 2026-02-24T19:23:49.633 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:49.633 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:49.633 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.633 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.633 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:49.633 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:49.633 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:49.633 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:49.633 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:49.634 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.619+0000 7f1fceffd640 1 -- 10.20.193.14:0/2187404618 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1164688811 0 0) 0x7f1fe8135980 con 0x7f1fe8164d00 2026-02-24T19:23:49.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.619+0000 7f1fceffd640 1 -- 10.20.193.14:0/2187404618 >> v1:10.20.193.44:6789/0 conn(0x7f1fe8157b50 legacy=0x7f1fe809ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:49.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.619+0000 7f1fceffd640 1 -- 10.20.193.14:0/2187404618 >> v1:10.20.193.14:6789/0 conn(0x7f1fe8157780 legacy=0x7f1fe8058bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:49.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.619+0000 7f1fceffd640 10 monclient: _finish_hunting 0 2026-02-24T19:23:49.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.619+0000 7f1fceffd640 1 monclient: found mon.c 2026-02-24T19:23:49.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.619+0000 7f1fceffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:49.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.619+0000 7f1fceffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:49.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.619+0000 7f1fceffd640 1 -- 10.20.193.14:0/2187404618 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fe8135f40 con 0x7f1fe8164d00 2026-02-24T19:23:49.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.619+0000 7f1fceffd640 10 monclient: _finish_auth 0 2026-02-24T19:23:49.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.619+0000 7f1fceffd640 10 monclient: _check_auth_tickets 2026-02-24T19:23:49.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.619+0000 7f1fceffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:49.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.619+0000 7f1ff0326640 5 monclient: authenticate success, global_id 28733 2026-02-24T19:23:49.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.619+0000 7f1ff0326640 10 monclient: _renew_subs 2026-02-24T19:23:49.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.619+0000 7f1ff0326640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:49.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.619+0000 7f1ff0326640 1 -- 10.20.193.14:0/2187404618 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1fe8136220 con 0x7f1fe8164d00 2026-02-24T19:23:49.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.619+0000 7f1ff0326640 10 client.28733.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:49.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.619+0000 7f1ff0326640 10 monclient: _renew_subs 2026-02-24T19:23:49.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.619+0000 7f1ff0326640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:49.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.619+0000 7f1ff0326640 1 -- 10.20.193.14:0/2187404618 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1fe809f730 con 0x7f1fe8164d00 2026-02-24T19:23:49.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.619+0000 7f1ff0326640 1 librados: init done 2026-02-24T19:23:49.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.619+0000 7f1ff0326640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:49.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.619+0000 7f1ff0326640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:49.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.619+0000 7f1ff0326640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:49.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.619+0000 7f1ff0326640 1 -- 10.20.193.14:0/2187404618 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fe8161ea0 con 0x7f1fe8164d00 2026-02-24T19:23:49.712 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.710+0000 7f1fceffd640 1 -- 10.20.193.14:0/2187404618 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1fe40032f0 con 0x7f1fe8164d00 2026-02-24T19:23:49.712 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.710+0000 7f1fceffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:49.712 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.710+0000 7f1fceffd640 1 -- 10.20.193.14:0/2187404618 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f1fe4003c80 con 0x7f1fe8164d00 2026-02-24T19:23:49.712 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.710+0000 7f1fceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:49.712 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.710+0000 7f1fceffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:49.712 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.710+0000 7f1fceffd640 10 monclient: dump: 2026-02-24T19:23:49.712 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:49.713 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:49.713 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.713 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.713 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:49.713 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:49.713 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:49.713 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:49.713 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:49.713 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.713 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.710+0000 7f1fec898640 4 set_mon_vals no callback set 2026-02-24T19:23:49.714 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.711+0000 7f1fceffd640 1 -- 10.20.193.14:0/2187404618 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f1fe4003e60 con 0x7f1fe8164d00 2026-02-24T19:23:49.714 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.712+0000 7f1fee09b640 10 monclient: get_auth_request con 0x7f1fb8077e60 auth_method 0 2026-02-24T19:23:49.714 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.712+0000 7f1fceffd640 10 client.28733.objecter ms_handle_connect 0x7f1fb8077e60 2026-02-24T19:23:49.715 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.712+0000 7f1fceffd640 1 -- 10.20.193.14:0/2187404618 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7f1fe40921a0 con 0x7f1fe8164d00 2026-02-24T19:23:49.715 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.712+0000 7f1fceffd640 10 client.28733.objecter ms_dispatch2 0x7f1fe8000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:23:49.715 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.712+0000 7f1fceffd640 3 client.28733.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:23:49.715 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.712+0000 7f1fceffd640 3 client.28733.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:23:49.715 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.713+0000 7f1fceffd640 20 client.28733.objecter dump_active .. 0 homeless 2026-02-24T19:23:49.715 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.714+0000 7f1fceffd640 1 -- 10.20.193.14:0/2187404618 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f1fe4003c80 con 0x7f1fe8164d00 2026-02-24T19:23:49.715 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.714+0000 7f1fceffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:49.715 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.714+0000 7f1fceffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:23:49.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.821+0000 7f1ff0326640 1 -- 10.20.193.14:0/2187404618 --> v1:10.20.193.14:6800/4014096310 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "12", "target": ["mon-mgr", ""]}) -- 0x7f1fe80b4d80 con 0x7f1fb8077e60 2026-02-24T19:23:49.823 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.821+0000 7f1fceffd640 1 -- 10.20.193.14:0/2187404618 <== mgr.4110 v1:10.20.193.14:6800/4014096310 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 12 to deep-scrub) ==== 42+0+0 (unknown 660425183 0 0) 0x7f1fe80b4d80 con 0x7f1fb8077e60 2026-02-24T19:23:49.823 INFO:teuthology.orchestra.run.trial014.stderr:instructed osd(s) 12 to deep-scrub 2026-02-24T19:23:49.824 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.822+0000 7f1ff0326640 10 librados: watch_flush enter 2026-02-24T19:23:49.825 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.822+0000 7f1ff0326640 10 librados: watch_flush exit 2026-02-24T19:23:49.825 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.822+0000 7f1ff0326640 20 client.28733.objecter shutdown clearing up homeless session... 2026-02-24T19:23:49.825 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.822+0000 7f1ff0326640 10 client.28733.objecter successfully canceled tick 2026-02-24T19:23:49.825 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.822+0000 7f1ff0326640 1 -- 10.20.193.14:0/2187404618 >> v1:10.20.193.14:6800/4014096310 conn(0x7f1fb8077e60 legacy=0x7f1fb8098310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:49.825 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.822+0000 7f1ff0326640 10 monclient: shutdown 2026-02-24T19:23:49.825 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.822+0000 7f1ff0326640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:49.825 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.822+0000 7f1ff0326640 1 -- 10.20.193.14:0/2187404618 >> v1:10.20.193.170:6789/0 conn(0x7f1fe8164d00 legacy=0x7f1fe8156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:49.825 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.822+0000 7f1ff0326640 1 -- 10.20.193.14:0/2187404618 shutdown_connections 2026-02-24T19:23:49.825 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.822+0000 7f1ff0326640 1 -- 10.20.193.14:0/2187404618 >> 10.20.193.14:0/2187404618 conn(0x7f1fe80b2ef0 msgr2=0x7f1fe80b5580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:49.825 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.822+0000 7f1ff0326640 1 -- 10.20.193.14:0/2187404618 shutdown_connections 2026-02-24T19:23:49.825 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.822+0000 7f1ff0326640 1 -- 10.20.193.14:0/2187404618 wait complete. 2026-02-24T19:23:49.826 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.822+0000 7f1ff0326640 1 librados: shutdown 2026-02-24T19:23:49.832 INFO:tasks.ceph:Scrubbing osd.1 2026-02-24T19:23:49.832 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:23:49.902 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.901+0000 7fc50b44e640 10 monclient: get_monmap_and_config 2026-02-24T19:23:49.903 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.901+0000 7fc50b44e640 10 monclient: build_initial_monmap 2026-02-24T19:23:49.903 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.901+0000 7fc50b44e640 10 monclient: monmap: 2026-02-24T19:23:49.903 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:49.903 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:49.903 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:23:49.901756+0000 2026-02-24T19:23:49.903 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:23:49.901756+0000 2026-02-24T19:23:49.903 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:49.903 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:49.903 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:49.903 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:49.903 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:49.904 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.905 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.901+0000 7fc50b44e640 1 Processor -- start 2026-02-24T19:23:49.905 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.901+0000 7fc50b44e640 1 -- start start 2026-02-24T19:23:49.905 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.901+0000 7fc50b44e640 10 monclient: init 2026-02-24T19:23:49.905 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.902+0000 7fc50b44e640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:49.905 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.902+0000 7fc50b44e640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:23:49.905 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.902+0000 7fc50b44e640 10 monclient(hunting): picked mon.noname-b con 0x7fc50415e2a0 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:49.905 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.902+0000 7fc50b44e640 10 monclient(hunting): picked mon.noname-c con 0x7fc504059e10 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:49.905 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.902+0000 7fc50b44e640 10 monclient(hunting): picked mon.noname-a con 0x7fc5041a5660 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:49.905 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.902+0000 7fc50b44e640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc504162df0 con 0x7fc5041a5660 2026-02-24T19:23:49.905 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.902+0000 7fc50b44e640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5041630d0 con 0x7fc50415e2a0 2026-02-24T19:23:49.905 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.902+0000 7fc50b44e640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5041633b0 con 0x7fc504059e10 2026-02-24T19:23:49.906 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.902+0000 7fc50b44e640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:49.906 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.902+0000 7fc50b44e640 10 monclient(hunting): authenticate will time out at 4004.583157s 2026-02-24T19:23:49.906 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.902+0000 7fc5099c4640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7fc5041a5660 0x7fc5041c5a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:50786/0 (socket says 10.20.193.14:50786) 2026-02-24T19:23:49.906 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.902+0000 7fc5099c4640 1 -- 10.20.193.14:0/1610966022 learned_addr learned my addr 10.20.193.14:0/1610966022 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:49.910 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.903+0000 7fc4f3fff640 1 -- 10.20.193.14:0/1610966022 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1392979558 0 0) 0x7fc5041633b0 con 0x7fc504059e10 2026-02-24T19:23:49.910 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.903+0000 7fc4f3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:23:49.910 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.903+0000 7fc4f3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:49.910 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.903+0000 7fc4f3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:49.910 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.903+0000 7fc4f3fff640 10 monclient(hunting): my global_id is 28736 2026-02-24T19:23:49.910 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.903+0000 7fc4f3fff640 1 -- 10.20.193.14:0/1610966022 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4ec003610 con 0x7fc504059e10 2026-02-24T19:23:49.910 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.903+0000 7fc4f3fff640 1 -- 10.20.193.14:0/1610966022 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1200913447 0 0) 0x7fc5041630d0 con 0x7fc50415e2a0 2026-02-24T19:23:49.910 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.903+0000 7fc4f3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:23:49.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.903+0000 7fc4f3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:49.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.903+0000 7fc4f3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:49.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.903+0000 7fc4f3fff640 10 monclient(hunting): my global_id is 29098 2026-02-24T19:23:49.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.903+0000 7fc4f3fff640 1 -- 10.20.193.14:0/1610966022 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5041633b0 con 0x7fc50415e2a0 2026-02-24T19:23:49.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.904+0000 7fc4f3fff640 1 -- 10.20.193.14:0/1610966022 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2229191345 0 0) 0x7fc504162df0 con 0x7fc5041a5660 2026-02-24T19:23:49.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.904+0000 7fc4f3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:23:49.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.904+0000 7fc4f3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:49.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.904+0000 7fc4f3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:49.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.904+0000 7fc4f3fff640 10 monclient(hunting): my global_id is 30774 2026-02-24T19:23:49.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.904+0000 7fc4f3fff640 1 -- 10.20.193.14:0/1610966022 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5041630d0 con 0x7fc5041a5660 2026-02-24T19:23:49.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.905+0000 7fc4f3fff640 1 -- 10.20.193.14:0/1610966022 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1905669791 0 0) 0x7fc5041633b0 con 0x7fc50415e2a0 2026-02-24T19:23:49.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.905+0000 7fc4f3fff640 1 -- 10.20.193.14:0/1610966022 >> v1:10.20.193.170:6789/0 conn(0x7fc504059e10 legacy=0x7fc50415ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:49.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.905+0000 7fc4f3fff640 1 -- 10.20.193.14:0/1610966022 >> v1:10.20.193.14:6789/0 conn(0x7fc5041a5660 legacy=0x7fc5041c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:49.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.905+0000 7fc4f3fff640 10 monclient: _finish_hunting 0 2026-02-24T19:23:49.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.905+0000 7fc4f3fff640 1 monclient: found mon.noname-b 2026-02-24T19:23:49.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.905+0000 7fc4f3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:49.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.905+0000 7fc4f3fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.44:6789/0 2026-02-24T19:23:49.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.905+0000 7fc4f3fff640 1 -- 10.20.193.14:0/1610966022 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc504163690 con 0x7fc50415e2a0 2026-02-24T19:23:49.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.905+0000 7fc4f3fff640 10 monclient: _finish_auth 0 2026-02-24T19:23:49.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.905+0000 7fc4f3fff640 10 monclient: _check_auth_tickets 2026-02-24T19:23:49.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.905+0000 7fc4f3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:49.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.905+0000 7fc4f3fff640 1 -- 10.20.193.14:0/1610966022 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc4f4002df0 con 0x7fc50415e2a0 2026-02-24T19:23:49.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.905+0000 7fc4f3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:49.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.905+0000 7fc4f3fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:23:49.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.905+0000 7fc4f3fff640 10 monclient: dump: 2026-02-24T19:23:49.912 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:49.913 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:49.913 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.913 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.913 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:49.913 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:49.913 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:49.913 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:49.913 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:49.913 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.905+0000 7fc50b44e640 5 monclient: authenticate success, global_id 29098 2026-02-24T19:23:49.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.905+0000 7fc50b44e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:49.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.906+0000 7fc4f3fff640 1 -- 10.20.193.14:0/1610966022 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc4f4002f90 con 0x7fc50415e2a0 2026-02-24T19:23:49.914 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.906+0000 7fc4f3fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:49.914 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.906+0000 7fc4f3fff640 1 -- 10.20.193.14:0/1610966022 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc4f40033d0 con 0x7fc50415e2a0 2026-02-24T19:23:49.914 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.906+0000 7fc4f3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:49.914 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.906+0000 7fc4f3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:49.914 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.906+0000 7fc4f3fff640 10 monclient: dump: 2026-02-24T19:23:49.914 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:49.914 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:49.914 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.914 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.914 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:49.914 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:49.914 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:49.914 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:49.915 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:49.915 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.915 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.906+0000 7fc50b44e640 10 monclient: get_monmap_and_config success 2026-02-24T19:23:49.915 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.906+0000 7fc50b44e640 4 set_mon_vals no callback set 2026-02-24T19:23:49.915 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.906+0000 7fc50b44e640 10 monclient: shutdown 2026-02-24T19:23:49.915 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.906+0000 7fc50b44e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:49.915 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.906+0000 7fc50b44e640 1 -- 10.20.193.14:0/1610966022 >> v1:10.20.193.44:6789/0 conn(0x7fc50415e2a0 legacy=0x7fc50405da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:49.915 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.906+0000 7fc50b44e640 1 -- 10.20.193.14:0/1610966022 shutdown_connections 2026-02-24T19:23:49.915 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.906+0000 7fc50b44e640 1 -- 10.20.193.14:0/1610966022 >> 10.20.193.14:0/1610966022 conn(0x7fc5040b2f60 msgr2=0x7fc5040b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:49.915 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.906+0000 7fc50b44e640 1 -- 10.20.193.14:0/1610966022 shutdown_connections 2026-02-24T19:23:49.915 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.907+0000 7fc50b44e640 1 -- 10.20.193.14:0/1610966022 wait complete. 2026-02-24T19:23:49.915 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.907+0000 7fc50b44e640 10 monclient: build_initial_monmap 2026-02-24T19:23:49.915 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.907+0000 7fc50b44e640 10 monclient: monmap: 2026-02-24T19:23:49.916 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:49.916 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:23:49.916 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:23:49.916 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:23:49.916 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:49.916 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:23:49.916 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:49.916 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:49.916 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:49.916 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.916 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.907+0000 7fc50b44e640 1 librados: starting msgr at 2026-02-24T19:23:49.916 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.907+0000 7fc50b44e640 1 librados: starting objecter 2026-02-24T19:23:49.916 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.907+0000 7fc50b44e640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:23:49.917 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.907+0000 7fc50b44e640 1 Processor -- start 2026-02-24T19:23:49.917 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.907+0000 7fc50b44e640 1 -- start start 2026-02-24T19:23:49.917 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.907+0000 7fc50b44e640 1 librados: setting wanted keys 2026-02-24T19:23:49.917 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.907+0000 7fc50b44e640 1 librados: calling monclient init 2026-02-24T19:23:49.917 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.907+0000 7fc50b44e640 10 monclient: init 2026-02-24T19:23:49.917 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.908+0000 7fc50b44e640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:49.917 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.908+0000 7fc50b44e640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:23:49.917 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.908+0000 7fc50b44e640 10 monclient(hunting): picked mon.noname-c con 0x7fc504059e10 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:49.917 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.908+0000 7fc50b44e640 10 monclient(hunting): picked mon.noname-b con 0x7fc50415e2a0 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:49.917 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.908+0000 7fc50b44e640 10 monclient(hunting): picked mon.noname-a con 0x7fc5041a5660 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:49.917 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.908+0000 7fc50b44e640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc50412c090 con 0x7fc5041a5660 2026-02-24T19:23:49.917 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.908+0000 7fc50b44e640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc50412c370 con 0x7fc50415e2a0 2026-02-24T19:23:49.917 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.908+0000 7fc50b44e640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc504128010 con 0x7fc504059e10 2026-02-24T19:23:49.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.908+0000 7fc50b44e640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:49.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.908+0000 7fc50b44e640 10 monclient(hunting): authenticate will time out at 4004.589160s 2026-02-24T19:23:49.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.908+0000 7fc5099c4640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7fc5041a5660 0x7fc50412b4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:50790/0 (socket says 10.20.193.14:50790) 2026-02-24T19:23:49.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.908+0000 7fc5099c4640 1 -- 10.20.193.14:0/1261325268 learned_addr learned my addr 10.20.193.14:0/1261325268 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:49.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.908+0000 7fc4f1ffb640 10 client.?.objecter ms_handle_connect 0x7fc5041a5660 2026-02-24T19:23:49.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.908+0000 7fc4f1ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:49.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.908+0000 7fc4f1ffb640 10 client.?.objecter ms_handle_connect 0x7fc50415e2a0 2026-02-24T19:23:49.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.908+0000 7fc4f1ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:49.922 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.909+0000 7fc4f1ffb640 1 -- 10.20.193.14:0/1261325268 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4208241703 0 0) 0x7fc50412c090 con 0x7fc5041a5660 2026-02-24T19:23:49.922 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.909+0000 7fc4f1ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:23:49.922 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.909+0000 7fc4f1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:49.922 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.909+0000 7fc4f1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:49.922 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.909+0000 7fc4f1ffb640 10 monclient(hunting): my global_id is 30777 2026-02-24T19:23:49.922 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.909+0000 7fc4f1ffb640 1 -- 10.20.193.14:0/1261325268 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4d4003610 con 0x7fc5041a5660 2026-02-24T19:23:49.922 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.909+0000 7fc4f1ffb640 1 -- 10.20.193.14:0/1261325268 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 564116141 0 0) 0x7fc50412c370 con 0x7fc50415e2a0 2026-02-24T19:23:49.922 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.909+0000 7fc4f1ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:23:49.922 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.909+0000 7fc4f1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:49.922 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.909+0000 7fc4f1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:49.922 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.909+0000 7fc4f1ffb640 10 monclient(hunting): my global_id is 29101 2026-02-24T19:23:49.923 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.909+0000 7fc4f1ffb640 1 -- 10.20.193.14:0/1261325268 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc50412c090 con 0x7fc50415e2a0 2026-02-24T19:23:49.923 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.909+0000 7fc4f1ffb640 10 client.?.objecter ms_handle_connect 0x7fc504059e10 2026-02-24T19:23:49.923 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.909+0000 7fc4f1ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:49.923 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.910+0000 7fc4f1ffb640 1 -- 10.20.193.14:0/1261325268 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 230213024 0 0) 0x7fc504128010 con 0x7fc504059e10 2026-02-24T19:23:49.923 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.910+0000 7fc4f1ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:23:49.923 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.910+0000 7fc4f1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:49.923 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.910+0000 7fc4f1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:49.923 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.910+0000 7fc4f1ffb640 10 monclient(hunting): my global_id is 28739 2026-02-24T19:23:49.923 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.910+0000 7fc4f1ffb640 1 -- 10.20.193.14:0/1261325268 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc50412c370 con 0x7fc504059e10 2026-02-24T19:23:49.923 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.912+0000 7fc4f1ffb640 1 -- 10.20.193.14:0/1261325268 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4191470851 0 0) 0x7fc4d4003610 con 0x7fc5041a5660 2026-02-24T19:23:49.923 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.912+0000 7fc4f1ffb640 1 -- 10.20.193.14:0/1261325268 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc504128010 con 0x7fc5041a5660 2026-02-24T19:23:49.923 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.912+0000 7fc4f1ffb640 1 -- 10.20.193.14:0/1261325268 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc500003390 con 0x7fc5041a5660 2026-02-24T19:23:49.923 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.912+0000 7fc4f1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:49.924 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.912+0000 7fc4f1ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:23:49.924 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.912+0000 7fc4f1ffb640 10 monclient(hunting): dump: 2026-02-24T19:23:49.924 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:49.924 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:49.924 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.924 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.924 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:49.924 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:49.924 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:49.924 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:49.924 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:49.924 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.924 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.912+0000 7fc4f1ffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:23:49.925 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.912+0000 7fc4f1ffb640 1 -- 10.20.193.14:0/1261325268 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2804597642 0 0) 0x7fc50412c090 con 0x7fc50415e2a0 2026-02-24T19:23:49.925 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.912+0000 7fc4f1ffb640 1 -- 10.20.193.14:0/1261325268 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc4d4003610 con 0x7fc50415e2a0 2026-02-24T19:23:49.925 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.912+0000 7fc4f1ffb640 1 -- 10.20.193.14:0/1261325268 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc4f8002ff0 con 0x7fc50415e2a0 2026-02-24T19:23:49.925 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.912+0000 7fc4f1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:49.925 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.912+0000 7fc4f1ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:49.925 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.912+0000 7fc4f1ffb640 10 monclient(hunting): dump: 2026-02-24T19:23:49.925 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:49.925 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:49.925 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.925 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.925 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:49.925 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:49.926 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:49.926 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:49.926 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:49.926 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.926 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.913+0000 7fc4f1ffb640 1 -- 10.20.193.14:0/1261325268 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3003987170 0 0) 0x7fc50412c370 con 0x7fc504059e10 2026-02-24T19:23:49.926 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.913+0000 7fc4f1ffb640 1 -- 10.20.193.14:0/1261325268 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc50412c090 con 0x7fc504059e10 2026-02-24T19:23:49.926 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.913+0000 7fc4f1ffb640 1 -- 10.20.193.14:0/1261325268 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc4f40032e0 con 0x7fc504059e10 2026-02-24T19:23:49.926 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.913+0000 7fc4f1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:49.926 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.913+0000 7fc4f1ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:49.926 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.913+0000 7fc4f1ffb640 10 monclient(hunting): dump: 2026-02-24T19:23:49.926 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:49.926 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:49.926 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.927 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.927 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:49.927 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:49.927 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:49.927 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:49.927 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:49.927 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.927 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.914+0000 7fc4f1ffb640 1 -- 10.20.193.14:0/1261325268 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 23214436 0 0) 0x7fc504128010 con 0x7fc5041a5660 2026-02-24T19:23:49.927 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.914+0000 7fc4f1ffb640 1 -- 10.20.193.14:0/1261325268 >> v1:10.20.193.170:6789/0 conn(0x7fc504059e10 legacy=0x7fc5041914c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:49.927 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.914+0000 7fc4f1ffb640 1 -- 10.20.193.14:0/1261325268 >> v1:10.20.193.44:6789/0 conn(0x7fc50415e2a0 legacy=0x7fc504056a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:49.927 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.914+0000 7fc4f1ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:23:49.927 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.914+0000 7fc4f1ffb640 1 monclient: found mon.a 2026-02-24T19:23:49.927 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.914+0000 7fc4f1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:49.928 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.914+0000 7fc4f1ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:49.928 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.914+0000 7fc4f1ffb640 1 -- 10.20.193.14:0/1261325268 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5041282f0 con 0x7fc5041a5660 2026-02-24T19:23:49.928 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.914+0000 7fc4f1ffb640 10 monclient: _finish_auth 0 2026-02-24T19:23:49.928 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.914+0000 7fc4f1ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:23:49.928 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.914+0000 7fc4f1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:49.928 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.914+0000 7fc50b44e640 5 monclient: authenticate success, global_id 30777 2026-02-24T19:23:49.928 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.914+0000 7fc50b44e640 10 monclient: _renew_subs 2026-02-24T19:23:49.928 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.914+0000 7fc50b44e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:49.928 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.914+0000 7fc50b44e640 1 -- 10.20.193.14:0/1261325268 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc5041285d0 con 0x7fc5041a5660 2026-02-24T19:23:49.928 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.914+0000 7fc50b44e640 10 client.30777.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:49.928 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.914+0000 7fc50b44e640 10 monclient: _renew_subs 2026-02-24T19:23:49.928 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.914+0000 7fc50b44e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:49.928 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.914+0000 7fc50b44e640 1 -- 10.20.193.14:0/1261325268 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc504057150 con 0x7fc5041a5660 2026-02-24T19:23:49.929 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.914+0000 7fc50b44e640 1 librados: init done 2026-02-24T19:23:49.929 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.914+0000 7fc50b44e640 10 client.30777.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:49.929 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.914+0000 7fc50b44e640 15 client.30777.objecter _session_command_op_assign -1 1 2026-02-24T19:23:49.929 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.914+0000 7fc50b44e640 20 client.30777.objecter _get_session osd=-1 returning homeless 2026-02-24T19:23:49.929 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.914+0000 7fc50b44e640 10 client.30777.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:49.929 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.914+0000 7fc50b44e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:49.929 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.914+0000 7fc50b44e640 1 -- 10.20.193.14:0/1261325268 --> v1:10.20.193.14:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fc5041951b0 con 0x7fc5041a5660 2026-02-24T19:23:49.931 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.923+0000 7fc4f1ffb640 1 -- 10.20.193.14:0/1261325268 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc5041951b0 con 0x7fc5041a5660 2026-02-24T19:23:49.931 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.923+0000 7fc4f1ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:49.931 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.923+0000 7fc4f1ffb640 1 -- 10.20.193.14:0/1261325268 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc500004df0 con 0x7fc5041a5660 2026-02-24T19:23:49.931 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.923+0000 7fc4f1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:49.931 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.923+0000 7fc4f1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:49.931 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.923+0000 7fc4f1ffb640 10 monclient: dump: 2026-02-24T19:23:49.932 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:49.932 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:49.932 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.932 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:49.932 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:49.932 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:49.932 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:49.932 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:49.932 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:49.932 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:49.932 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.923+0000 7fc4f37fe640 4 set_mon_vals no callback set 2026-02-24T19:23:49.932 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.923+0000 7fc4f1ffb640 1 -- 10.20.193.14:0/1261325268 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7fc500004fd0 con 0x7fc5041a5660 2026-02-24T19:23:49.933 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.924+0000 7fc5091c3640 10 monclient: get_auth_request con 0x7fc4d4077dd0 auth_method 0 2026-02-24T19:23:49.933 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.924+0000 7fc4f1ffb640 10 client.30777.objecter ms_handle_connect 0x7fc4d4077dd0 2026-02-24T19:23:49.933 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.925+0000 7fc4f1ffb640 1 -- 10.20.193.14:0/1261325268 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7fc5000932c0 con 0x7fc5041a5660 2026-02-24T19:23:49.933 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.925+0000 7fc4f1ffb640 10 client.30777.objecter ms_dispatch2 0x7fc504000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:23:49.933 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.925+0000 7fc4f1ffb640 3 client.30777.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:23:49.933 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.925+0000 7fc4f1ffb640 3 client.30777.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:23:49.933 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.925+0000 7fc4f1ffb640 10 client.30777.objecter checking command 1 2026-02-24T19:23:49.933 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.925+0000 7fc4f1ffb640 20 client.30777.objecter _get_session s=0x7fc4d40a20f0 osd=1 3 2026-02-24T19:23:49.933 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.925+0000 7fc4f1ffb640 20 client.30777.objecter put_session s=0x7fc4d40a20f0 osd=1 3 2026-02-24T19:23:49.933 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.925+0000 7fc4f1ffb640 15 client.30777.objecter _session_command_op_remove -1 1 2026-02-24T19:23:49.933 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.925+0000 7fc4f1ffb640 20 client.30777.objecter _get_session s=0x7fc4d40a20f0 osd=1 3 2026-02-24T19:23:49.933 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.925+0000 7fc4f1ffb640 20 client.30777.objecter get_session s=0x7fc4d40a20f0 osd=1 3 2026-02-24T19:23:49.933 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.925+0000 7fc4f1ffb640 15 client.30777.objecter _session_command_op_assign 1 1 2026-02-24T19:23:49.934 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.925+0000 7fc4f1ffb640 20 client.30777.objecter put_session s=0x7fc4d40a20f0 osd=1 4 2026-02-24T19:23:49.934 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.925+0000 7fc4f1ffb640 10 client.30777.objecter _send_command 1 2026-02-24T19:23:49.934 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.925+0000 7fc4f1ffb640 1 -- 10.20.193.14:0/1261325268 --> v1:10.20.193.44:6804/1955152616 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc4d40c44a0 con 0x7fc4d40a27a0 2026-02-24T19:23:49.934 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.925+0000 7fc4f1ffb640 20 client.30777.objecter dump_active .. 0 homeless 2026-02-24T19:23:49.934 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.925+0000 7fc4f1ffb640 1 -- 10.20.193.14:0/1261325268 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_get_version_reply(handle=1 version=354) ==== 24+0+0 (unknown 31317031 0 0) 0x7fc500059960 con 0x7fc5041a5660 2026-02-24T19:23:49.934 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.925+0000 7fc4f1ffb640 10 monclient: handle_get_version_reply finishing 1 version 354 2026-02-24T19:23:49.934 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.925+0000 7fc5089c2640 10 monclient: get_auth_request con 0x7fc4d40a27a0 auth_method 0 2026-02-24T19:23:49.934 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.926+0000 7fc4f1ffb640 10 client.30777.objecter ms_handle_connect 0x7fc4d40a27a0 2026-02-24T19:23:49.937 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.935+0000 7fc4f1ffb640 1 -- 10.20.193.14:0/1261325268 <== osd.1 v1:10.20.193.44:6804/1955152616 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fc4d40c44a0 con 0x7fc4d40a27a0 2026-02-24T19:23:49.937 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.935+0000 7fc4f1ffb640 10 client.30777.objecter ms_dispatch2 0x7fc504000b90 command_reply(tid 1: 0 ) 2026-02-24T19:23:49.937 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.935+0000 7fc4f1ffb640 10 client.30777.objecter _finish_command 1 = system:0 2026-02-24T19:23:49.937 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.935+0000 7fc4f1ffb640 20 client.30777.objecter put_session s=0x7fc4d40a20f0 osd=1 4 2026-02-24T19:23:49.937 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.935+0000 7fc4f1ffb640 15 client.30777.objecter _session_command_op_remove 1 1 2026-02-24T19:23:49.944 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.942+0000 7fc50b44e640 10 client.30777.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:23:49.945 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.942+0000 7fc50b44e640 15 client.30777.objecter _session_command_op_assign -1 2 2026-02-24T19:23:49.945 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.942+0000 7fc50b44e640 20 client.30777.objecter _get_session s=0x7fc4d40a20f0 osd=1 3 2026-02-24T19:23:49.945 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.942+0000 7fc50b44e640 20 client.30777.objecter put_session s=0x7fc4d40a20f0 osd=1 3 2026-02-24T19:23:49.945 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.942+0000 7fc50b44e640 20 client.30777.objecter _get_session s=0x7fc4d40a20f0 osd=1 3 2026-02-24T19:23:49.945 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.942+0000 7fc50b44e640 15 client.30777.objecter _session_command_op_remove -1 2 2026-02-24T19:23:49.945 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.942+0000 7fc50b44e640 20 client.30777.objecter get_session s=0x7fc4d40a20f0 osd=1 3 2026-02-24T19:23:49.945 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.942+0000 7fc50b44e640 15 client.30777.objecter _session_command_op_assign 1 2 2026-02-24T19:23:49.945 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.942+0000 7fc50b44e640 20 client.30777.objecter put_session s=0x7fc4d40a20f0 osd=1 4 2026-02-24T19:23:49.945 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.942+0000 7fc50b44e640 10 client.30777.objecter _send_command 2 2026-02-24T19:23:49.945 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.942+0000 7fc50b44e640 1 -- 10.20.193.14:0/1261325268 --> v1:10.20.193.44:6804/1955152616 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc504192690 con 0x7fc4d40a27a0 2026-02-24T19:23:49.951 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.950+0000 7fc4f1ffb640 1 -- 10.20.193.14:0/1261325268 <== osd.1 v1:10.20.193.44:6804/1955152616 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fc504192690 con 0x7fc4d40a27a0 2026-02-24T19:23:49.951 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.950+0000 7fc4f1ffb640 10 client.30777.objecter ms_dispatch2 0x7fc504000b90 command_reply(tid 2: 0 ) 2026-02-24T19:23:49.952 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.950+0000 7fc4f1ffb640 10 client.30777.objecter _finish_command 2 = system:0 2026-02-24T19:23:49.952 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.950+0000 7fc4f1ffb640 20 client.30777.objecter put_session s=0x7fc4d40a20f0 osd=1 4 2026-02-24T19:23:49.952 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.950+0000 7fc4f1ffb640 15 client.30777.objecter _session_command_op_remove 1 2 2026-02-24T19:23:49.952 INFO:teuthology.orchestra.run.trial014.stdout:{ 2026-02-24T19:23:49.952 INFO:teuthology.orchestra.run.trial014.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:23:49.952 INFO:teuthology.orchestra.run.trial014.stdout:} 2026-02-24T19:23:49.954 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.950+0000 7fc50b44e640 10 librados: watch_flush enter 2026-02-24T19:23:49.954 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.950+0000 7fc50b44e640 10 librados: watch_flush exit 2026-02-24T19:23:49.954 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.950+0000 7fc50b44e640 10 client.30777.objecter close_session for osd.1 2026-02-24T19:23:49.954 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.950+0000 7fc50b44e640 1 -- 10.20.193.14:0/1261325268 >> v1:10.20.193.44:6804/1955152616 conn(0x7fc4d40a27a0 legacy=0x7fc4d40c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:49.954 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.950+0000 7fc50b44e640 20 client.30777.objecter put_session s=0x7fc4d40a20f0 osd=1 1 2026-02-24T19:23:49.954 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.950+0000 7fc50b44e640 20 client.30777.objecter shutdown clearing up homeless session... 2026-02-24T19:23:49.954 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.950+0000 7fc50b44e640 10 client.30777.objecter successfully canceled tick 2026-02-24T19:23:49.954 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.950+0000 7fc50b44e640 1 -- 10.20.193.14:0/1261325268 >> v1:10.20.193.14:6800/4014096310 conn(0x7fc4d4077dd0 legacy=0x7fc4d4098280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:49.954 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.950+0000 7fc50b44e640 10 monclient: shutdown 2026-02-24T19:23:49.955 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.950+0000 7fc50b44e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:49.955 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.950+0000 7fc50b44e640 1 -- 10.20.193.14:0/1261325268 >> v1:10.20.193.14:6789/0 conn(0x7fc5041a5660 legacy=0x7fc50412b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:49.955 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.950+0000 7fc5099c4640 1 -- 10.20.193.14:0/1261325268 reap_dead start 2026-02-24T19:23:49.955 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.950+0000 7fc50b44e640 1 -- 10.20.193.14:0/1261325268 shutdown_connections 2026-02-24T19:23:49.955 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.950+0000 7fc50b44e640 1 -- 10.20.193.14:0/1261325268 >> 10.20.193.14:0/1261325268 conn(0x7fc5040b2f60 msgr2=0x7fc5041953d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:49.955 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.950+0000 7fc50b44e640 1 -- 10.20.193.14:0/1261325268 shutdown_connections 2026-02-24T19:23:49.955 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.950+0000 7fc50b44e640 1 -- 10.20.193.14:0/1261325268 wait complete. 2026-02-24T19:23:49.955 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:49.950+0000 7fc50b44e640 1 librados: shutdown 2026-02-24T19:23:49.959 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-24T19:23:50.025 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.024+0000 7f2cffc2b640 10 monclient: get_monmap_and_config 2026-02-24T19:23:50.026 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.024+0000 7f2cffc2b640 10 monclient: build_initial_monmap 2026-02-24T19:23:50.026 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.024+0000 7f2cffc2b640 10 monclient: monmap: 2026-02-24T19:23:50.026 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:50.026 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:50.026 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:23:50.024684+0000 2026-02-24T19:23:50.026 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:23:50.024684+0000 2026-02-24T19:23:50.026 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:50.026 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:50.026 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:50.026 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:50.026 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:50.027 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:50.030 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.024+0000 7f2cffc2b640 1 Processor -- start 2026-02-24T19:23:50.031 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.024+0000 7f2cffc2b640 1 -- start start 2026-02-24T19:23:50.031 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.024+0000 7f2cffc2b640 10 monclient: init 2026-02-24T19:23:50.031 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.025+0000 7f2cffc2b640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:50.031 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.025+0000 7f2cffc2b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:23:50.031 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.025+0000 7f2cffc2b640 10 monclient(hunting): picked mon.noname-b con 0x7f2cf815d3b0 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:50.031 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.025+0000 7f2cffc2b640 10 monclient(hunting): picked mon.noname-a con 0x7f2cf80b4c30 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:50.031 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.025+0000 7f2cffc2b640 10 monclient(hunting): picked mon.noname-c con 0x7f2cf81a7ac0 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:50.032 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.025+0000 7f2cffc2b640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cf8164640 con 0x7f2cf80b4c30 2026-02-24T19:23:50.032 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.025+0000 7f2cffc2b640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cf80b1530 con 0x7f2cf815d3b0 2026-02-24T19:23:50.032 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.025+0000 7f2cffc2b640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cf80b1810 con 0x7f2cf81a7ac0 2026-02-24T19:23:50.032 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.025+0000 7f2cffc2b640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:50.032 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.025+0000 7f2cffc2b640 10 monclient(hunting): authenticate will time out at 4004.706457s 2026-02-24T19:23:50.032 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.025+0000 7f2cfd19f640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f2cf80b4c30 0x7f2cf80af6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:50798/0 (socket says 10.20.193.14:50798) 2026-02-24T19:23:50.032 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.025+0000 7f2cfd19f640 1 -- 10.20.193.14:0/2261412837 learned_addr learned my addr 10.20.193.14:0/2261412837 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:50.032 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.027+0000 7f2cfc99e640 1 -- 10.20.193.14:0/2261412837 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3495663611 0 0) 0x7f2cf80b1810 con 0x7f2cf81a7ac0 2026-02-24T19:23:50.032 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.027+0000 7f2cfc99e640 10 monclient(hunting): _negotiate 2026-02-24T19:23:50.032 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.027+0000 7f2cfc99e640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:50.032 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.027+0000 7f2cfc99e640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:50.032 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.027+0000 7f2cfc99e640 10 monclient(hunting): my global_id is 28742 2026-02-24T19:23:50.032 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.027+0000 7f2cfc99e640 1 -- 10.20.193.14:0/2261412837 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ce0003610 con 0x7f2cf81a7ac0 2026-02-24T19:23:50.033 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.027+0000 7f2cfc99e640 1 -- 10.20.193.14:0/2261412837 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3640297302 0 0) 0x7f2cec002910 con 0x7f2cf80b4c30 2026-02-24T19:23:50.033 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.027+0000 7f2cfc99e640 10 monclient(hunting): _negotiate 2026-02-24T19:23:50.033 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.027+0000 7f2cfc99e640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:50.033 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.027+0000 7f2cfc99e640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:50.033 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.027+0000 7f2cfc99e640 10 monclient(hunting): my global_id is 30780 2026-02-24T19:23:50.033 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.027+0000 7f2cfc99e640 1 -- 10.20.193.14:0/2261412837 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cf80b1810 con 0x7f2cf80b4c30 2026-02-24T19:23:50.033 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.027+0000 7f2cfc99e640 1 -- 10.20.193.14:0/2261412837 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 84128336 0 0) 0x7f2cf80b1530 con 0x7f2cf815d3b0 2026-02-24T19:23:50.033 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.027+0000 7f2cfc99e640 10 monclient(hunting): _negotiate 2026-02-24T19:23:50.033 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.027+0000 7f2cfc99e640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:50.033 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.027+0000 7f2cfc99e640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:50.033 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.027+0000 7f2cfc99e640 10 monclient(hunting): my global_id is 29104 2026-02-24T19:23:50.033 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.027+0000 7f2cfc99e640 1 -- 10.20.193.14:0/2261412837 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cec002910 con 0x7f2cf815d3b0 2026-02-24T19:23:50.033 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.028+0000 7f2cfc99e640 1 -- 10.20.193.14:0/2261412837 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 106258592 0 0) 0x7f2ce0003610 con 0x7f2cf81a7ac0 2026-02-24T19:23:50.034 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.028+0000 7f2cfc99e640 1 -- 10.20.193.14:0/2261412837 >> v1:10.20.193.44:6789/0 conn(0x7f2cf815d3b0 legacy=0x7f2cf8163bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:50.034 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.028+0000 7f2cfc99e640 1 -- 10.20.193.14:0/2261412837 >> v1:10.20.193.14:6789/0 conn(0x7f2cf80b4c30 legacy=0x7f2cf80af6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:50.034 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.028+0000 7f2cfc99e640 10 monclient: _finish_hunting 0 2026-02-24T19:23:50.034 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.028+0000 7f2cfc99e640 1 monclient: found mon.noname-c 2026-02-24T19:23:50.034 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.028+0000 7f2cfc99e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:50.034 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.028+0000 7f2cfc99e640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.170:6789/0 2026-02-24T19:23:50.034 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.028+0000 7f2cfc99e640 1 -- 10.20.193.14:0/2261412837 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cf80aebd0 con 0x7f2cf81a7ac0 2026-02-24T19:23:50.034 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.028+0000 7f2cfc99e640 10 monclient: _finish_auth 0 2026-02-24T19:23:50.034 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.028+0000 7f2cfc99e640 10 monclient: _check_auth_tickets 2026-02-24T19:23:50.034 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.028+0000 7f2cfc99e640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:50.034 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.028+0000 7f2cfc99e640 1 -- 10.20.193.14:0/2261412837 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f2cf4003170 con 0x7f2cf81a7ac0 2026-02-24T19:23:50.034 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.028+0000 7f2cfc99e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:50.035 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.028+0000 7f2cfc99e640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:23:50.035 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.028+0000 7f2cfc99e640 10 monclient: dump: 2026-02-24T19:23:50.035 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:50.035 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:50.035 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.035 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.035 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:50.035 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:50.035 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:50.035 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:50.035 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:50.035 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:50.035 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.028+0000 7f2cffc2b640 5 monclient: authenticate success, global_id 28742 2026-02-24T19:23:50.035 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.028+0000 7f2cffc2b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:50.041 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.029+0000 7f2cfc99e640 1 -- 10.20.193.14:0/2261412837 <== mon.2 v1:10.20.193.170:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2cf4003340 con 0x7f2cf81a7ac0 2026-02-24T19:23:50.041 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.029+0000 7f2cfc99e640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:50.041 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.029+0000 7f2cfc99e640 1 -- 10.20.193.14:0/2261412837 <== mon.2 v1:10.20.193.170:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f2cf4003780 con 0x7f2cf81a7ac0 2026-02-24T19:23:50.041 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.029+0000 7f2cfc99e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:50.042 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.029+0000 7f2cfc99e640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:50.042 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.029+0000 7f2cfc99e640 10 monclient: dump: 2026-02-24T19:23:50.042 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:50.042 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:50.042 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.042 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.042 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:50.042 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:50.042 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:50.042 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:50.042 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:50.042 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:50.043 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.029+0000 7f2cffc2b640 10 monclient: get_monmap_and_config success 2026-02-24T19:23:50.043 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.029+0000 7f2cffc2b640 4 set_mon_vals no callback set 2026-02-24T19:23:50.043 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.029+0000 7f2cffc2b640 10 monclient: shutdown 2026-02-24T19:23:50.043 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.029+0000 7f2cffc2b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:50.043 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.029+0000 7f2cffc2b640 1 -- 10.20.193.14:0/2261412837 >> v1:10.20.193.170:6789/0 conn(0x7f2cf81a7ac0 legacy=0x7f2cf81c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:50.043 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.030+0000 7f2cffc2b640 1 -- 10.20.193.14:0/2261412837 shutdown_connections 2026-02-24T19:23:50.043 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.030+0000 7f2cffc2b640 1 -- 10.20.193.14:0/2261412837 >> 10.20.193.14:0/2261412837 conn(0x7f2cf80b4120 msgr2=0x7f2cf80b4520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:50.043 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.030+0000 7f2cffc2b640 1 -- 10.20.193.14:0/2261412837 shutdown_connections 2026-02-24T19:23:50.043 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.030+0000 7f2cffc2b640 1 -- 10.20.193.14:0/2261412837 wait complete. 2026-02-24T19:23:50.043 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.030+0000 7f2cffc2b640 10 monclient: build_initial_monmap 2026-02-24T19:23:50.043 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.030+0000 7f2cffc2b640 10 monclient: monmap: 2026-02-24T19:23:50.043 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:50.043 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:23:50.044 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:23:50.044 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:23:50.044 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:50.044 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:23:50.044 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:50.044 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:50.044 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:50.044 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:50.044 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.030+0000 7f2cffc2b640 1 librados: starting msgr at 2026-02-24T19:23:50.044 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.030+0000 7f2cffc2b640 1 librados: starting objecter 2026-02-24T19:23:50.044 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.030+0000 7f2cffc2b640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:23:50.044 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.030+0000 7f2cffc2b640 1 Processor -- start 2026-02-24T19:23:50.045 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.030+0000 7f2cffc2b640 1 -- start start 2026-02-24T19:23:50.045 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.030+0000 7f2cffc2b640 1 librados: setting wanted keys 2026-02-24T19:23:50.045 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.030+0000 7f2cffc2b640 1 librados: calling monclient init 2026-02-24T19:23:50.045 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.030+0000 7f2cffc2b640 10 monclient: init 2026-02-24T19:23:50.045 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.031+0000 7f2cffc2b640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:50.045 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.031+0000 7f2cffc2b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:23:50.045 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.031+0000 7f2cffc2b640 10 monclient(hunting): picked mon.noname-b con 0x7f2cf80b4c30 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:50.045 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.031+0000 7f2cffc2b640 10 monclient(hunting): picked mon.noname-c con 0x7f2cf815d3b0 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:50.045 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.031+0000 7f2cffc2b640 10 monclient(hunting): picked mon.noname-a con 0x7f2cf81a7ac0 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:50.045 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.031+0000 7f2cffc2b640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cf81a78d0 con 0x7f2cf81a7ac0 2026-02-24T19:23:50.045 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.031+0000 7f2cffc2b640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cf815f710 con 0x7f2cf80b4c30 2026-02-24T19:23:50.045 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.031+0000 7f2cffc2b640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cf815f9f0 con 0x7f2cf815d3b0 2026-02-24T19:23:50.045 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.031+0000 7f2cffc2b640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:50.046 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.031+0000 7f2cffc2b640 10 monclient(hunting): authenticate will time out at 4004.712407s 2026-02-24T19:23:50.046 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.031+0000 7f2cfe1a1640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f2cf81a7ac0 0x7f2cf8127240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:50808/0 (socket says 10.20.193.14:50808) 2026-02-24T19:23:50.046 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.031+0000 7f2cfe1a1640 1 -- 10.20.193.14:0/12263450 learned_addr learned my addr 10.20.193.14:0/12263450 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:50.046 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.031+0000 7f2ce67fc640 10 client.?.objecter ms_handle_connect 0x7f2cf81a7ac0 2026-02-24T19:23:50.046 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.031+0000 7f2ce67fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:50.046 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.031+0000 7f2ce67fc640 10 client.?.objecter ms_handle_connect 0x7f2cf815d3b0 2026-02-24T19:23:50.046 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.031+0000 7f2ce67fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:50.046 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.031+0000 7f2ce67fc640 10 client.?.objecter ms_handle_connect 0x7f2cf80b4c30 2026-02-24T19:23:50.046 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.031+0000 7f2ce67fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:50.046 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.032+0000 7f2ce67fc640 1 -- 10.20.193.14:0/12263450 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4189408959 0 0) 0x7f2cf815f9f0 con 0x7f2cf815d3b0 2026-02-24T19:23:50.046 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.032+0000 7f2ce67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:23:50.046 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.032+0000 7f2ce67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:50.046 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.032+0000 7f2ce67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:50.046 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.032+0000 7f2ce67fc640 10 monclient(hunting): my global_id is 28745 2026-02-24T19:23:50.047 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.032+0000 7f2ce67fc640 1 -- 10.20.193.14:0/12263450 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cc8003610 con 0x7f2cf815d3b0 2026-02-24T19:23:50.047 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.032+0000 7f2ce67fc640 1 -- 10.20.193.14:0/12263450 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2939329699 0 0) 0x7f2cf81a78d0 con 0x7f2cf81a7ac0 2026-02-24T19:23:50.047 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.032+0000 7f2ce67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:23:50.047 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.032+0000 7f2ce67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:50.047 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.032+0000 7f2ce67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:50.047 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.032+0000 7f2ce67fc640 10 monclient(hunting): my global_id is 30783 2026-02-24T19:23:50.047 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.032+0000 7f2ce67fc640 1 -- 10.20.193.14:0/12263450 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cf815f9f0 con 0x7f2cf81a7ac0 2026-02-24T19:23:50.047 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.032+0000 7f2ce67fc640 1 -- 10.20.193.14:0/12263450 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2255352707 0 0) 0x7f2cf815f710 con 0x7f2cf80b4c30 2026-02-24T19:23:50.047 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.032+0000 7f2ce67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:23:50.047 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.032+0000 7f2ce67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:50.047 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.032+0000 7f2ce67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:50.047 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.032+0000 7f2ce67fc640 10 monclient(hunting): my global_id is 29107 2026-02-24T19:23:50.047 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.032+0000 7f2ce67fc640 1 -- 10.20.193.14:0/12263450 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cf81a78d0 con 0x7f2cf80b4c30 2026-02-24T19:23:50.048 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.035+0000 7f2ce67fc640 1 -- 10.20.193.14:0/12263450 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 970700024 0 0) 0x7f2cc8003610 con 0x7f2cf815d3b0 2026-02-24T19:23:50.048 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.035+0000 7f2ce67fc640 1 -- 10.20.193.14:0/12263450 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2cf815f710 con 0x7f2cf815d3b0 2026-02-24T19:23:50.048 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.035+0000 7f2ce67fc640 1 -- 10.20.193.14:0/12263450 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f2cec003250 con 0x7f2cf815d3b0 2026-02-24T19:23:50.048 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.035+0000 7f2ce67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:50.048 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.035+0000 7f2ce67fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:23:50.048 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.035+0000 7f2ce67fc640 10 monclient(hunting): dump: 2026-02-24T19:23:50.048 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:50.048 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:50.048 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.048 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.048 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:50.048 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:50.049 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:50.049 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:50.049 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:50.049 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:50.049 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.035+0000 7f2ce67fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:23:50.049 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.035+0000 7f2ce67fc640 1 -- 10.20.193.14:0/12263450 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 811232028 0 0) 0x7f2cf81a78d0 con 0x7f2cf80b4c30 2026-02-24T19:23:50.049 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.035+0000 7f2ce67fc640 1 -- 10.20.193.14:0/12263450 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2cc8003610 con 0x7f2cf80b4c30 2026-02-24T19:23:50.049 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.035+0000 7f2ce67fc640 1 -- 10.20.193.14:0/12263450 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f2ce8003060 con 0x7f2cf80b4c30 2026-02-24T19:23:50.049 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.035+0000 7f2ce67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:50.049 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.035+0000 7f2ce67fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:50.049 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.035+0000 7f2ce67fc640 10 monclient(hunting): dump: 2026-02-24T19:23:50.049 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:50.049 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:50.050 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.050 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.050 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:50.050 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:50.050 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:50.050 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:50.050 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:50.050 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:50.050 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.035+0000 7f2ce67fc640 1 -- 10.20.193.14:0/12263450 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 866840361 0 0) 0x7f2cf815f9f0 con 0x7f2cf81a7ac0 2026-02-24T19:23:50.050 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.035+0000 7f2ce67fc640 1 -- 10.20.193.14:0/12263450 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2cf81a78d0 con 0x7f2cf81a7ac0 2026-02-24T19:23:50.050 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.035+0000 7f2ce67fc640 1 -- 10.20.193.14:0/12263450 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f2cf4003690 con 0x7f2cf81a7ac0 2026-02-24T19:23:50.050 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.035+0000 7f2ce67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:50.050 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.035+0000 7f2ce67fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:50.051 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.035+0000 7f2ce67fc640 10 monclient(hunting): dump: 2026-02-24T19:23:50.051 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:50.051 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:50.051 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.051 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.051 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:50.051 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:50.051 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:50.051 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:50.051 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:50.051 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:50.051 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.036+0000 7f2ce67fc640 1 -- 10.20.193.14:0/12263450 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 746138496 0 0) 0x7f2cf815f710 con 0x7f2cf815d3b0 2026-02-24T19:23:50.051 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.036+0000 7f2ce67fc640 1 -- 10.20.193.14:0/12263450 >> v1:10.20.193.44:6789/0 conn(0x7f2cf80b4c30 legacy=0x7f2cf81a71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:50.052 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.036+0000 7f2ce67fc640 1 -- 10.20.193.14:0/12263450 >> v1:10.20.193.14:6789/0 conn(0x7f2cf81a7ac0 legacy=0x7f2cf8127240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:50.052 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.036+0000 7f2ce67fc640 10 monclient: _finish_hunting 0 2026-02-24T19:23:50.052 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.036+0000 7f2ce67fc640 1 monclient: found mon.c 2026-02-24T19:23:50.052 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.036+0000 7f2ce67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:50.052 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.036+0000 7f2ce67fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:50.052 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.036+0000 7f2ce67fc640 1 -- 10.20.193.14:0/12263450 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cf815fcd0 con 0x7f2cf815d3b0 2026-02-24T19:23:50.052 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.036+0000 7f2ce67fc640 10 monclient: _finish_auth 0 2026-02-24T19:23:50.052 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.036+0000 7f2ce67fc640 10 monclient: _check_auth_tickets 2026-02-24T19:23:50.052 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.036+0000 7f2ce67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:50.052 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.036+0000 7f2cffc2b640 5 monclient: authenticate success, global_id 28745 2026-02-24T19:23:50.052 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.036+0000 7f2cffc2b640 10 monclient: _renew_subs 2026-02-24T19:23:50.052 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.036+0000 7f2cffc2b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:50.052 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.036+0000 7f2cffc2b640 1 -- 10.20.193.14:0/12263450 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2cf815ffb0 con 0x7f2cf815d3b0 2026-02-24T19:23:50.053 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.036+0000 7f2cffc2b640 10 client.28745.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:50.053 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.036+0000 7f2cffc2b640 10 monclient: _renew_subs 2026-02-24T19:23:50.053 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.036+0000 7f2cffc2b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:50.053 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.036+0000 7f2cffc2b640 1 -- 10.20.193.14:0/12263450 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2cf8160570 con 0x7f2cf815d3b0 2026-02-24T19:23:50.053 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.036+0000 7f2cffc2b640 1 librados: init done 2026-02-24T19:23:50.053 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.037+0000 7f2cffc2b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:50.053 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.037+0000 7f2cffc2b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:50.053 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.037+0000 7f2cffc2b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:50.053 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.037+0000 7f2cffc2b640 1 -- 10.20.193.14:0/12263450 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cf80531e0 con 0x7f2cf815d3b0 2026-02-24T19:23:50.054 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.042+0000 7f2ce67fc640 1 -- 10.20.193.14:0/12263450 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2cec0034f0 con 0x7f2cf815d3b0 2026-02-24T19:23:50.055 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.042+0000 7f2ce67fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:50.055 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.042+0000 7f2ce67fc640 1 -- 10.20.193.14:0/12263450 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f2cec004d20 con 0x7f2cf815d3b0 2026-02-24T19:23:50.055 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.042+0000 7f2ce67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:50.055 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.042+0000 7f2ce67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:50.055 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.042+0000 7f2ce7fff640 4 set_mon_vals no callback set 2026-02-24T19:23:50.055 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.042+0000 7f2ce67fc640 10 monclient: dump: 2026-02-24T19:23:50.055 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:50.055 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:50.055 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.055 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.055 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:50.055 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:50.056 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:50.056 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:50.056 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:50.056 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:50.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.045+0000 7f2ce67fc640 1 -- 10.20.193.14:0/12263450 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f2cec01d9f0 con 0x7f2cf815d3b0 2026-02-24T19:23:50.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.046+0000 7f2cfd9a0640 10 monclient: get_auth_request con 0x7f2cc8077dd0 auth_method 0 2026-02-24T19:23:50.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.046+0000 7f2ce67fc640 10 client.28745.objecter ms_handle_connect 0x7f2cc8077dd0 2026-02-24T19:23:50.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.046+0000 7f2ce67fc640 1 -- 10.20.193.14:0/12263450 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7f2cec093330 con 0x7f2cf815d3b0 2026-02-24T19:23:50.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.046+0000 7f2ce67fc640 10 client.28745.objecter ms_dispatch2 0x7f2cf8000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:23:50.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.046+0000 7f2ce67fc640 3 client.28745.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:23:50.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.046+0000 7f2ce67fc640 3 client.28745.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:23:50.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.046+0000 7f2ce67fc640 20 client.28745.objecter dump_active .. 0 homeless 2026-02-24T19:23:50.135 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.134+0000 7f2ce67fc640 1 -- 10.20.193.14:0/12263450 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f2cf8164640 con 0x7f2cf815d3b0 2026-02-24T19:23:50.135 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.134+0000 7f2ce67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:50.135 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.134+0000 7f2ce67fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:23:50.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.238+0000 7f2cffc2b640 1 -- 10.20.193.14:0/12263450 --> v1:10.20.193.14:6800/4014096310 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f2cf80b2fe0 con 0x7f2cc8077dd0 2026-02-24T19:23:50.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.239+0000 7f2ce67fc640 1 -- 10.20.193.14:0/12263450 <== mgr.4110 v1:10.20.193.14:6800/4014096310 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (unknown 489605429 0 0) 0x7f2cf80b2fe0 con 0x7f2cc8077dd0 2026-02-24T19:23:50.240 INFO:teuthology.orchestra.run.trial014.stderr:instructed osd(s) 1 to deep-scrub 2026-02-24T19:23:50.242 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.239+0000 7f2cffc2b640 10 librados: watch_flush enter 2026-02-24T19:23:50.242 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.239+0000 7f2cffc2b640 10 librados: watch_flush exit 2026-02-24T19:23:50.242 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.239+0000 7f2cffc2b640 20 client.28745.objecter shutdown clearing up homeless session... 2026-02-24T19:23:50.242 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.239+0000 7f2cffc2b640 10 client.28745.objecter successfully canceled tick 2026-02-24T19:23:50.242 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.239+0000 7f2cffc2b640 1 -- 10.20.193.14:0/12263450 >> v1:10.20.193.14:6800/4014096310 conn(0x7f2cc8077dd0 legacy=0x7f2cc8098280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:50.242 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.239+0000 7f2cffc2b640 10 monclient: shutdown 2026-02-24T19:23:50.242 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.239+0000 7f2cffc2b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:50.242 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.239+0000 7f2cffc2b640 1 -- 10.20.193.14:0/12263450 >> v1:10.20.193.170:6789/0 conn(0x7f2cf815d3b0 legacy=0x7f2cf8162c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:50.242 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.239+0000 7f2cffc2b640 1 -- 10.20.193.14:0/12263450 shutdown_connections 2026-02-24T19:23:50.242 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.239+0000 7f2cffc2b640 1 -- 10.20.193.14:0/12263450 >> 10.20.193.14:0/12263450 conn(0x7f2cf80b4120 msgr2=0x7f2cf80b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:50.242 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.239+0000 7f2cffc2b640 1 -- 10.20.193.14:0/12263450 shutdown_connections 2026-02-24T19:23:50.243 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.239+0000 7f2cffc2b640 1 -- 10.20.193.14:0/12263450 wait complete. 2026-02-24T19:23:50.243 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.239+0000 7f2cffc2b640 1 librados: shutdown 2026-02-24T19:23:50.249 INFO:tasks.ceph:Scrubbing osd.5 2026-02-24T19:23:50.250 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:23:50.321 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.319+0000 7fe92ccae640 10 monclient: get_monmap_and_config 2026-02-24T19:23:50.321 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.319+0000 7fe92ccae640 10 monclient: build_initial_monmap 2026-02-24T19:23:50.321 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.319+0000 7fe92ccae640 10 monclient: monmap: 2026-02-24T19:23:50.321 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:50.321 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:50.321 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:23:50.320009+0000 2026-02-24T19:23:50.321 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:23:50.320009+0000 2026-02-24T19:23:50.321 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:50.321 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:50.321 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:50.322 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:50.322 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:50.322 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:50.324 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.319+0000 7fe92ccae640 1 Processor -- start 2026-02-24T19:23:50.324 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.319+0000 7fe92ccae640 1 -- start start 2026-02-24T19:23:50.324 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.319+0000 7fe92ccae640 10 monclient: init 2026-02-24T19:23:50.324 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.320+0000 7fe92ccae640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:50.324 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.320+0000 7fe92ccae640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:23:50.325 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.320+0000 7fe92ccae640 10 monclient(hunting): picked mon.noname-c con 0x7fe92815e2a0 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:50.325 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.320+0000 7fe92ccae640 10 monclient(hunting): picked mon.noname-b con 0x7fe928059e10 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:50.325 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.320+0000 7fe92ccae640 10 monclient(hunting): picked mon.noname-a con 0x7fe9281a5660 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:50.325 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.320+0000 7fe92ccae640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe928162df0 con 0x7fe9281a5660 2026-02-24T19:23:50.325 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.320+0000 7fe92ccae640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9281630d0 con 0x7fe928059e10 2026-02-24T19:23:50.325 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.320+0000 7fe92ccae640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9281633b0 con 0x7fe92815e2a0 2026-02-24T19:23:50.325 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.320+0000 7fe92ccae640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:50.325 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.320+0000 7fe92ccae640 10 monclient(hunting): authenticate will time out at 4005.001502s 2026-02-24T19:23:50.325 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.320+0000 7fe926d76640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7fe9281a5660 0x7fe9281c5a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:50814/0 (socket says 10.20.193.14:50814) 2026-02-24T19:23:50.325 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.320+0000 7fe926d76640 1 -- 10.20.193.14:0/1973842906 learned_addr learned my addr 10.20.193.14:0/1973842906 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:50.325 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.322+0000 7fe925573640 1 -- 10.20.193.14:0/1973842906 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 102806539 0 0) 0x7fe928162df0 con 0x7fe9281a5660 2026-02-24T19:23:50.326 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.322+0000 7fe925573640 10 monclient(hunting): _negotiate 2026-02-24T19:23:50.326 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.322+0000 7fe925573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:50.326 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.322+0000 7fe925573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:50.326 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.322+0000 7fe925573640 10 monclient(hunting): my global_id is 30786 2026-02-24T19:23:50.326 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.322+0000 7fe925573640 1 -- 10.20.193.14:0/1973842906 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe914003610 con 0x7fe9281a5660 2026-02-24T19:23:50.326 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.322+0000 7fe925573640 1 -- 10.20.193.14:0/1973842906 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2479505376 0 0) 0x7fe9281630d0 con 0x7fe928059e10 2026-02-24T19:23:50.326 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.322+0000 7fe925573640 10 monclient(hunting): _negotiate 2026-02-24T19:23:50.326 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.322+0000 7fe925573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:50.326 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.322+0000 7fe925573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:50.326 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.322+0000 7fe925573640 10 monclient(hunting): my global_id is 29110 2026-02-24T19:23:50.326 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.322+0000 7fe925573640 1 -- 10.20.193.14:0/1973842906 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe928162df0 con 0x7fe928059e10 2026-02-24T19:23:50.326 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.322+0000 7fe925573640 1 -- 10.20.193.14:0/1973842906 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3180885754 0 0) 0x7fe9281633b0 con 0x7fe92815e2a0 2026-02-24T19:23:50.327 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.322+0000 7fe925573640 10 monclient(hunting): _negotiate 2026-02-24T19:23:50.327 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.322+0000 7fe925573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:50.327 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.322+0000 7fe925573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:50.327 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.322+0000 7fe925573640 10 monclient(hunting): my global_id is 28748 2026-02-24T19:23:50.327 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.322+0000 7fe925573640 1 -- 10.20.193.14:0/1973842906 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9281630d0 con 0x7fe92815e2a0 2026-02-24T19:23:50.331 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.323+0000 7fe925573640 1 -- 10.20.193.14:0/1973842906 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2668315212 0 0) 0x7fe914003610 con 0x7fe9281a5660 2026-02-24T19:23:50.331 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.323+0000 7fe925573640 1 -- 10.20.193.14:0/1973842906 >> v1:10.20.193.170:6789/0 conn(0x7fe92815e2a0 legacy=0x7fe92805da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:50.331 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.323+0000 7fe925573640 1 -- 10.20.193.14:0/1973842906 >> v1:10.20.193.44:6789/0 conn(0x7fe928059e10 legacy=0x7fe92815ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:50.331 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.323+0000 7fe925573640 10 monclient: _finish_hunting 0 2026-02-24T19:23:50.331 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.323+0000 7fe925573640 1 monclient: found mon.noname-a 2026-02-24T19:23:50.331 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.323+0000 7fe925573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:50.332 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.323+0000 7fe925573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:23:50.332 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.323+0000 7fe925573640 1 -- 10.20.193.14:0/1973842906 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe928163690 con 0x7fe9281a5660 2026-02-24T19:23:50.332 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.323+0000 7fe925573640 10 monclient: _finish_auth 0 2026-02-24T19:23:50.332 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.323+0000 7fe925573640 10 monclient: _check_auth_tickets 2026-02-24T19:23:50.332 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.323+0000 7fe925573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:50.332 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.323+0000 7fe925573640 1 -- 10.20.193.14:0/1973842906 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fe918003170 con 0x7fe9281a5660 2026-02-24T19:23:50.332 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.323+0000 7fe925573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:50.332 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.324+0000 7fe925573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:23:50.332 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.324+0000 7fe925573640 10 monclient: dump: 2026-02-24T19:23:50.332 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:50.332 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:50.332 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.333 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.333 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:50.333 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:50.333 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:50.333 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:50.333 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:50.333 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:50.333 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.324+0000 7fe92ccae640 5 monclient: authenticate success, global_id 30786 2026-02-24T19:23:50.333 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.324+0000 7fe92ccae640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:50.333 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.325+0000 7fe925573640 1 -- 10.20.193.14:0/1973842906 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe918003340 con 0x7fe9281a5660 2026-02-24T19:23:50.333 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.325+0000 7fe925573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:50.333 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.325+0000 7fe925573640 1 -- 10.20.193.14:0/1973842906 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fe918003780 con 0x7fe9281a5660 2026-02-24T19:23:50.333 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.325+0000 7fe925573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:50.334 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.325+0000 7fe925573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:50.334 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.325+0000 7fe925573640 10 monclient: dump: 2026-02-24T19:23:50.334 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:50.334 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:50.334 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.334 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.334 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:50.334 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:50.334 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:50.334 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:50.334 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:50.334 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:50.335 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.325+0000 7fe92ccae640 10 monclient: get_monmap_and_config success 2026-02-24T19:23:50.335 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.325+0000 7fe92ccae640 4 set_mon_vals no callback set 2026-02-24T19:23:50.335 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.325+0000 7fe92ccae640 10 monclient: shutdown 2026-02-24T19:23:50.335 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.325+0000 7fe92ccae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:50.335 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.325+0000 7fe92ccae640 1 -- 10.20.193.14:0/1973842906 >> v1:10.20.193.14:6789/0 conn(0x7fe9281a5660 legacy=0x7fe9281c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:50.335 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.325+0000 7fe92ccae640 1 -- 10.20.193.14:0/1973842906 shutdown_connections 2026-02-24T19:23:50.335 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.325+0000 7fe92ccae640 1 -- 10.20.193.14:0/1973842906 >> 10.20.193.14:0/1973842906 conn(0x7fe9280b2f60 msgr2=0x7fe9280b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:50.335 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.325+0000 7fe92ccae640 1 -- 10.20.193.14:0/1973842906 shutdown_connections 2026-02-24T19:23:50.335 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.325+0000 7fe92ccae640 1 -- 10.20.193.14:0/1973842906 wait complete. 2026-02-24T19:23:50.335 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.325+0000 7fe92ccae640 10 monclient: build_initial_monmap 2026-02-24T19:23:50.335 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.325+0000 7fe92ccae640 10 monclient: monmap: 2026-02-24T19:23:50.335 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:50.335 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:23:50.336 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:23:50.336 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:23:50.336 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:50.336 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:23:50.336 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:50.336 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:50.336 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:50.336 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:50.336 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.326+0000 7fe92ccae640 1 librados: starting msgr at 2026-02-24T19:23:50.336 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.326+0000 7fe92ccae640 1 librados: starting objecter 2026-02-24T19:23:50.336 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.326+0000 7fe92ccae640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:23:50.336 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.326+0000 7fe92ccae640 1 Processor -- start 2026-02-24T19:23:50.336 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.326+0000 7fe92ccae640 1 -- start start 2026-02-24T19:23:50.337 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.326+0000 7fe92ccae640 1 librados: setting wanted keys 2026-02-24T19:23:50.337 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.326+0000 7fe92ccae640 1 librados: calling monclient init 2026-02-24T19:23:50.337 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.326+0000 7fe92ccae640 10 monclient: init 2026-02-24T19:23:50.337 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.326+0000 7fe92ccae640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:50.337 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.326+0000 7fe92ccae640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:23:50.337 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.326+0000 7fe92ccae640 10 monclient(hunting): picked mon.noname-a con 0x7fe928059e10 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:50.337 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.326+0000 7fe92ccae640 10 monclient(hunting): picked mon.noname-b con 0x7fe92815e2a0 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:50.337 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.326+0000 7fe92ccae640 10 monclient(hunting): picked mon.noname-c con 0x7fe9281a5660 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:50.337 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.326+0000 7fe92ccae640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9280a91e0 con 0x7fe928059e10 2026-02-24T19:23:50.337 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.326+0000 7fe92ccae640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9280a8940 con 0x7fe92815e2a0 2026-02-24T19:23:50.337 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.326+0000 7fe92ccae640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9280a8c20 con 0x7fe9281a5660 2026-02-24T19:23:50.337 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.326+0000 7fe92ccae640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:50.337 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.326+0000 7fe92ccae640 10 monclient(hunting): authenticate will time out at 4005.007630s 2026-02-24T19:23:50.338 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.326+0000 7fe926575640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7fe928059e10 0x7fe9281a4eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:50816/0 (socket says 10.20.193.14:50816) 2026-02-24T19:23:50.338 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.326+0000 7fe926575640 1 -- 10.20.193.14:0/1250825004 learned_addr learned my addr 10.20.193.14:0/1250825004 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:50.338 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.327+0000 7fe90effd640 10 client.?.objecter ms_handle_connect 0x7fe928059e10 2026-02-24T19:23:50.338 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.327+0000 7fe90effd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:50.338 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.327+0000 7fe90effd640 10 client.?.objecter ms_handle_connect 0x7fe92815e2a0 2026-02-24T19:23:50.338 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.327+0000 7fe90effd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:50.338 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.327+0000 7fe90effd640 10 client.?.objecter ms_handle_connect 0x7fe9281a5660 2026-02-24T19:23:50.338 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.327+0000 7fe90effd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:50.338 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.328+0000 7fe90effd640 1 -- 10.20.193.14:0/1250825004 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 665866483 0 0) 0x7fe9280a8940 con 0x7fe92815e2a0 2026-02-24T19:23:50.338 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.328+0000 7fe90effd640 10 monclient(hunting): _negotiate 2026-02-24T19:23:50.338 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.328+0000 7fe90effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:50.338 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.328+0000 7fe90effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:50.338 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.328+0000 7fe90effd640 10 monclient(hunting): my global_id is 29113 2026-02-24T19:23:50.339 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.328+0000 7fe90effd640 1 -- 10.20.193.14:0/1250825004 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8f4003610 con 0x7fe92815e2a0 2026-02-24T19:23:50.339 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.328+0000 7fe90effd640 1 -- 10.20.193.14:0/1250825004 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 690716349 0 0) 0x7fe9280a91e0 con 0x7fe928059e10 2026-02-24T19:23:50.339 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.328+0000 7fe90effd640 10 monclient(hunting): _negotiate 2026-02-24T19:23:50.339 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.328+0000 7fe90effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:50.339 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.328+0000 7fe90effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:50.339 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.328+0000 7fe90effd640 10 monclient(hunting): my global_id is 30789 2026-02-24T19:23:50.339 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.328+0000 7fe90effd640 1 -- 10.20.193.14:0/1250825004 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9280a8940 con 0x7fe928059e10 2026-02-24T19:23:50.339 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.328+0000 7fe90effd640 1 -- 10.20.193.14:0/1250825004 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3507386601 0 0) 0x7fe9280a8c20 con 0x7fe9281a5660 2026-02-24T19:23:50.339 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.328+0000 7fe90effd640 10 monclient(hunting): _negotiate 2026-02-24T19:23:50.339 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.328+0000 7fe90effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:50.339 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.328+0000 7fe90effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:50.339 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.328+0000 7fe90effd640 10 monclient(hunting): my global_id is 28751 2026-02-24T19:23:50.339 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.328+0000 7fe90effd640 1 -- 10.20.193.14:0/1250825004 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9280a91e0 con 0x7fe9281a5660 2026-02-24T19:23:50.342 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.330+0000 7fe90effd640 1 -- 10.20.193.14:0/1250825004 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1369859179 0 0) 0x7fe8f4003610 con 0x7fe92815e2a0 2026-02-24T19:23:50.342 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.330+0000 7fe90effd640 1 -- 10.20.193.14:0/1250825004 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe9280a8c20 con 0x7fe92815e2a0 2026-02-24T19:23:50.342 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.330+0000 7fe90effd640 1 -- 10.20.193.14:0/1250825004 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fe910002ff0 con 0x7fe92815e2a0 2026-02-24T19:23:50.342 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.330+0000 7fe90effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:50.343 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.330+0000 7fe90effd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:23:50.343 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.330+0000 7fe90effd640 10 monclient(hunting): dump: 2026-02-24T19:23:50.343 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:50.343 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:50.343 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.343 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.343 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:50.343 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:50.343 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:50.343 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:50.343 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:50.343 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:50.344 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.330+0000 7fe90effd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:23:50.344 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.330+0000 7fe90effd640 1 -- 10.20.193.14:0/1250825004 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 150074234 0 0) 0x7fe9280a91e0 con 0x7fe9281a5660 2026-02-24T19:23:50.344 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.330+0000 7fe90effd640 1 -- 10.20.193.14:0/1250825004 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe8f4003610 con 0x7fe9281a5660 2026-02-24T19:23:50.344 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.330+0000 7fe90effd640 1 -- 10.20.193.14:0/1250825004 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fe9180034f0 con 0x7fe9281a5660 2026-02-24T19:23:50.344 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.330+0000 7fe90effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:50.344 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.330+0000 7fe90effd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:50.344 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.330+0000 7fe90effd640 10 monclient(hunting): dump: 2026-02-24T19:23:50.344 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:50.344 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:50.344 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.344 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.344 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:50.345 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:50.345 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:50.345 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:50.345 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:50.345 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:50.345 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.330+0000 7fe90effd640 1 -- 10.20.193.14:0/1250825004 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2828035045 0 0) 0x7fe9280a8940 con 0x7fe928059e10 2026-02-24T19:23:50.345 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.330+0000 7fe90effd640 1 -- 10.20.193.14:0/1250825004 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe9280a91e0 con 0x7fe928059e10 2026-02-24T19:23:50.345 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.330+0000 7fe90effd640 1 -- 10.20.193.14:0/1250825004 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fe91c003170 con 0x7fe928059e10 2026-02-24T19:23:50.345 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.330+0000 7fe90effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:50.345 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.330+0000 7fe90effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:50.345 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.330+0000 7fe90effd640 10 monclient(hunting): dump: 2026-02-24T19:23:50.345 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:50.345 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:50.346 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.346 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.346 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:50.346 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:50.346 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:50.346 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:50.346 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:50.346 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:50.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.332+0000 7fe90effd640 1 -- 10.20.193.14:0/1250825004 <== mon.1 v1:10.20.193.44:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1283899618 0 0) 0x7fe9280a8c20 con 0x7fe92815e2a0 2026-02-24T19:23:50.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.332+0000 7fe90effd640 1 -- 10.20.193.14:0/1250825004 >> v1:10.20.193.170:6789/0 conn(0x7fe9281a5660 legacy=0x7fe928056720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:50.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.332+0000 7fe90effd640 1 -- 10.20.193.14:0/1250825004 >> v1:10.20.193.14:6789/0 conn(0x7fe928059e10 legacy=0x7fe9281a4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:50.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.332+0000 7fe90effd640 10 monclient: _finish_hunting 0 2026-02-24T19:23:50.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.332+0000 7fe90effd640 1 monclient: found mon.b 2026-02-24T19:23:50.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.332+0000 7fe90effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:50.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.332+0000 7fe90effd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:23:50.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.332+0000 7fe90effd640 1 -- 10.20.193.14:0/1250825004 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9280a8f00 con 0x7fe92815e2a0 2026-02-24T19:23:50.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.332+0000 7fe90effd640 10 monclient: _finish_auth 0 2026-02-24T19:23:50.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.332+0000 7fe90effd640 10 monclient: _check_auth_tickets 2026-02-24T19:23:50.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.332+0000 7fe90effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:50.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.332+0000 7fe92ccae640 5 monclient: authenticate success, global_id 29113 2026-02-24T19:23:50.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.332+0000 7fe92ccae640 10 monclient: _renew_subs 2026-02-24T19:23:50.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.332+0000 7fe92ccae640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:23:50.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.332+0000 7fe92ccae640 1 -- 10.20.193.14:0/1250825004 --> v1:10.20.193.44:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe92805bc60 con 0x7fe92815e2a0 2026-02-24T19:23:50.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.332+0000 7fe92ccae640 10 client.29113.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:50.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.332+0000 7fe92ccae640 10 monclient: _renew_subs 2026-02-24T19:23:50.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.332+0000 7fe92ccae640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:23:50.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.332+0000 7fe92ccae640 1 -- 10.20.193.14:0/1250825004 --> v1:10.20.193.44:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe92812dc40 con 0x7fe92815e2a0 2026-02-24T19:23:50.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.332+0000 7fe92ccae640 1 librados: init done 2026-02-24T19:23:50.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.332+0000 7fe92ccae640 10 client.29113.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:50.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.332+0000 7fe92ccae640 15 client.29113.objecter _session_command_op_assign -1 1 2026-02-24T19:23:50.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.332+0000 7fe92ccae640 20 client.29113.objecter _get_session osd=-1 returning homeless 2026-02-24T19:23:50.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.332+0000 7fe92ccae640 10 client.29113.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:50.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.332+0000 7fe92ccae640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:23:50.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.332+0000 7fe92ccae640 1 -- 10.20.193.14:0/1250825004 --> v1:10.20.193.44:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fe928162880 con 0x7fe92815e2a0 2026-02-24T19:23:50.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.340+0000 7fe90effd640 1 -- 10.20.193.14:0/1250825004 <== mon.1 v1:10.20.193.44:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe928162880 con 0x7fe92815e2a0 2026-02-24T19:23:50.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.340+0000 7fe90effd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:50.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.340+0000 7fe90effd640 1 -- 10.20.193.14:0/1250825004 <== mon.1 v1:10.20.193.44:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fe910003670 con 0x7fe92815e2a0 2026-02-24T19:23:50.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.340+0000 7fe90effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:50.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.340+0000 7fe90effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:50.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.340+0000 7fe90effd640 10 monclient: dump: 2026-02-24T19:23:50.349 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:50.349 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:50.349 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.349 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.349 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:50.349 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:50.349 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:50.349 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:50.349 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:50.349 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:50.349 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.340+0000 7fe924d72640 4 set_mon_vals no callback set 2026-02-24T19:23:50.351 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.341+0000 7fe90effd640 1 -- 10.20.193.14:0/1250825004 <== mon.1 v1:10.20.193.44:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7fe91001c550 con 0x7fe92815e2a0 2026-02-24T19:23:50.351 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.342+0000 7fe926575640 10 monclient: get_auth_request con 0x7fe8f4077e70 auth_method 0 2026-02-24T19:23:50.351 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.342+0000 7fe90effd640 10 client.29113.objecter ms_handle_connect 0x7fe8f4077e70 2026-02-24T19:23:50.351 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.342+0000 7fe90effd640 1 -- 10.20.193.14:0/1250825004 <== mon.1 v1:10.20.193.44:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7fe910091d40 con 0x7fe92815e2a0 2026-02-24T19:23:50.351 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.342+0000 7fe90effd640 10 client.29113.objecter ms_dispatch2 0x7fe928000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:23:50.351 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.342+0000 7fe90effd640 3 client.29113.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:23:50.351 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.342+0000 7fe90effd640 3 client.29113.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:23:50.352 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.342+0000 7fe90effd640 10 client.29113.objecter checking command 1 2026-02-24T19:23:50.352 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.342+0000 7fe90effd640 20 client.29113.objecter _get_session s=0x7fe8f40a2130 osd=5 3 2026-02-24T19:23:50.352 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.342+0000 7fe90effd640 20 client.29113.objecter put_session s=0x7fe8f40a2130 osd=5 3 2026-02-24T19:23:50.352 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.342+0000 7fe90effd640 15 client.29113.objecter _session_command_op_remove -1 1 2026-02-24T19:23:50.352 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.342+0000 7fe90effd640 20 client.29113.objecter _get_session s=0x7fe8f40a2130 osd=5 3 2026-02-24T19:23:50.352 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.342+0000 7fe90effd640 20 client.29113.objecter get_session s=0x7fe8f40a2130 osd=5 3 2026-02-24T19:23:50.352 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.342+0000 7fe90effd640 15 client.29113.objecter _session_command_op_assign 5 1 2026-02-24T19:23:50.352 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.342+0000 7fe90effd640 20 client.29113.objecter put_session s=0x7fe8f40a2130 osd=5 4 2026-02-24T19:23:50.352 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.342+0000 7fe90effd640 10 client.29113.objecter _send_command 1 2026-02-24T19:23:50.352 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.342+0000 7fe90effd640 1 -- 10.20.193.14:0/1250825004 --> v1:10.20.193.44:6811/2261252351 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe8f40c4440 con 0x7fe8f40a27e0 2026-02-24T19:23:50.352 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.342+0000 7fe90effd640 20 client.29113.objecter dump_active .. 0 homeless 2026-02-24T19:23:50.352 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.342+0000 7fe90effd640 1 -- 10.20.193.14:0/1250825004 <== mon.1 v1:10.20.193.44:6789/0 9 ==== mon_get_version_reply(handle=1 version=354) ==== 24+0+0 (unknown 31317031 0 0) 0x7fe91005be40 con 0x7fe92815e2a0 2026-02-24T19:23:50.352 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.342+0000 7fe90effd640 10 monclient: handle_get_version_reply finishing 1 version 354 2026-02-24T19:23:50.353 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.343+0000 7fe926d76640 10 monclient: get_auth_request con 0x7fe8f40a27e0 auth_method 0 2026-02-24T19:23:50.353 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.344+0000 7fe90effd640 10 client.29113.objecter ms_handle_connect 0x7fe8f40a27e0 2026-02-24T19:23:50.355 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.354+0000 7fe90effd640 1 -- 10.20.193.14:0/1250825004 <== osd.5 v1:10.20.193.44:6811/2261252351 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fe8f40c4440 con 0x7fe8f40a27e0 2026-02-24T19:23:50.356 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.354+0000 7fe90effd640 10 client.29113.objecter ms_dispatch2 0x7fe928000b90 command_reply(tid 1: 0 ) 2026-02-24T19:23:50.356 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.354+0000 7fe90effd640 10 client.29113.objecter _finish_command 1 = system:0 2026-02-24T19:23:50.356 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.354+0000 7fe90effd640 20 client.29113.objecter put_session s=0x7fe8f40a2130 osd=5 4 2026-02-24T19:23:50.356 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.354+0000 7fe90effd640 15 client.29113.objecter _session_command_op_remove 5 1 2026-02-24T19:23:50.363 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.361+0000 7fe92ccae640 10 client.29113.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:23:50.363 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.361+0000 7fe92ccae640 15 client.29113.objecter _session_command_op_assign -1 2 2026-02-24T19:23:50.363 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.361+0000 7fe92ccae640 20 client.29113.objecter _get_session s=0x7fe8f40a2130 osd=5 3 2026-02-24T19:23:50.363 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.361+0000 7fe92ccae640 20 client.29113.objecter put_session s=0x7fe8f40a2130 osd=5 3 2026-02-24T19:23:50.363 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.361+0000 7fe92ccae640 20 client.29113.objecter _get_session s=0x7fe8f40a2130 osd=5 3 2026-02-24T19:23:50.363 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.361+0000 7fe92ccae640 15 client.29113.objecter _session_command_op_remove -1 2 2026-02-24T19:23:50.363 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.361+0000 7fe92ccae640 20 client.29113.objecter get_session s=0x7fe8f40a2130 osd=5 3 2026-02-24T19:23:50.364 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.361+0000 7fe92ccae640 15 client.29113.objecter _session_command_op_assign 5 2 2026-02-24T19:23:50.364 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.361+0000 7fe92ccae640 20 client.29113.objecter put_session s=0x7fe8f40a2130 osd=5 4 2026-02-24T19:23:50.364 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.361+0000 7fe92ccae640 10 client.29113.objecter _send_command 2 2026-02-24T19:23:50.364 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.361+0000 7fe92ccae640 1 -- 10.20.193.14:0/1250825004 --> v1:10.20.193.44:6811/2261252351 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe92805db60 con 0x7fe8f40a27e0 2026-02-24T19:23:50.370 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.369+0000 7fe90effd640 1 -- 10.20.193.14:0/1250825004 <== osd.5 v1:10.20.193.44:6811/2261252351 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fe92805db60 con 0x7fe8f40a27e0 2026-02-24T19:23:50.370 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.369+0000 7fe90effd640 10 client.29113.objecter ms_dispatch2 0x7fe928000b90 command_reply(tid 2: 0 ) 2026-02-24T19:23:50.370 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.369+0000 7fe90effd640 10 client.29113.objecter _finish_command 2 = system:0 2026-02-24T19:23:50.371 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.369+0000 7fe90effd640 20 client.29113.objecter put_session s=0x7fe8f40a2130 osd=5 4 2026-02-24T19:23:50.371 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.369+0000 7fe90effd640 15 client.29113.objecter _session_command_op_remove 5 2 2026-02-24T19:23:50.371 INFO:teuthology.orchestra.run.trial014.stdout:{ 2026-02-24T19:23:50.371 INFO:teuthology.orchestra.run.trial014.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:23:50.371 INFO:teuthology.orchestra.run.trial014.stdout:} 2026-02-24T19:23:50.373 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.369+0000 7fe92ccae640 10 librados: watch_flush enter 2026-02-24T19:23:50.373 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.369+0000 7fe92ccae640 10 librados: watch_flush exit 2026-02-24T19:23:50.373 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.369+0000 7fe92ccae640 10 client.29113.objecter close_session for osd.5 2026-02-24T19:23:50.373 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.369+0000 7fe92ccae640 1 -- 10.20.193.14:0/1250825004 >> v1:10.20.193.44:6811/2261252351 conn(0x7fe8f40a27e0 legacy=0x7fe8f40c2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:50.373 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.369+0000 7fe92ccae640 20 client.29113.objecter put_session s=0x7fe8f40a2130 osd=5 1 2026-02-24T19:23:50.373 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.369+0000 7fe92ccae640 20 client.29113.objecter shutdown clearing up homeless session... 2026-02-24T19:23:50.373 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.369+0000 7fe92ccae640 10 client.29113.objecter successfully canceled tick 2026-02-24T19:23:50.373 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.369+0000 7fe92ccae640 1 -- 10.20.193.14:0/1250825004 >> v1:10.20.193.14:6800/4014096310 conn(0x7fe8f4077e70 legacy=0x7fe8f4098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:50.373 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.369+0000 7fe92ccae640 10 monclient: shutdown 2026-02-24T19:23:50.373 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.369+0000 7fe92ccae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:50.373 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.369+0000 7fe92ccae640 1 -- 10.20.193.14:0/1250825004 >> v1:10.20.193.44:6789/0 conn(0x7fe92815e2a0 legacy=0x7fe92805c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:50.374 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.369+0000 7fe926d76640 1 -- 10.20.193.14:0/1250825004 reap_dead start 2026-02-24T19:23:50.374 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.369+0000 7fe92ccae640 1 -- 10.20.193.14:0/1250825004 shutdown_connections 2026-02-24T19:23:50.374 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.369+0000 7fe92ccae640 1 -- 10.20.193.14:0/1250825004 >> 10.20.193.14:0/1250825004 conn(0x7fe9280b2f60 msgr2=0x7fe928164070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:50.374 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.369+0000 7fe92ccae640 1 -- 10.20.193.14:0/1250825004 shutdown_connections 2026-02-24T19:23:50.374 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.369+0000 7fe92ccae640 1 -- 10.20.193.14:0/1250825004 wait complete. 2026-02-24T19:23:50.374 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.369+0000 7fe92ccae640 1 librados: shutdown 2026-02-24T19:23:50.378 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2026-02-24T19:23:50.447 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.445+0000 7f44a474c640 10 monclient: get_monmap_and_config 2026-02-24T19:23:50.447 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.445+0000 7f44a474c640 10 monclient: build_initial_monmap 2026-02-24T19:23:50.447 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.445+0000 7f44a474c640 10 monclient: monmap: 2026-02-24T19:23:50.447 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:50.447 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:50.447 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:23:50.446301+0000 2026-02-24T19:23:50.448 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:23:50.446301+0000 2026-02-24T19:23:50.448 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:50.448 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:50.448 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:50.448 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:50.448 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:50.448 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:50.449 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.446+0000 7f44a474c640 1 Processor -- start 2026-02-24T19:23:50.449 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.446+0000 7f44a474c640 1 -- start start 2026-02-24T19:23:50.450 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.446+0000 7f44a474c640 10 monclient: init 2026-02-24T19:23:50.450 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.446+0000 7f44a474c640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:50.450 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.446+0000 7f44a474c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:23:50.450 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.446+0000 7f44a474c640 10 monclient(hunting): picked mon.noname-b con 0x7f449c157780 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:50.450 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.446+0000 7f44a474c640 10 monclient(hunting): picked mon.noname-a con 0x7f449c157b50 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:50.450 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.446+0000 7f44a474c640 10 monclient(hunting): picked mon.noname-c con 0x7f449c164d00 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:50.450 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.446+0000 7f44a474c640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f449c05de70 con 0x7f449c157b50 2026-02-24T19:23:50.450 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.446+0000 7f44a474c640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f449c055b20 con 0x7f449c157780 2026-02-24T19:23:50.450 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.446+0000 7f44a474c640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f449c055e00 con 0x7f449c164d00 2026-02-24T19:23:50.450 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.446+0000 7f44a474c640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:50.450 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.446+0000 7f44a474c640 10 monclient(hunting): authenticate will time out at 4005.127766s 2026-02-24T19:23:50.450 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.447+0000 7f44a2cc2640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7f449c164d00 0x7f449c1c5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:48170/0 (socket says 10.20.193.14:48170) 2026-02-24T19:23:50.451 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.447+0000 7f44a2cc2640 1 -- 10.20.193.14:0/3921332470 learned_addr learned my addr 10.20.193.14:0/3921332470 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:50.462 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.461+0000 7f44a14bf640 1 -- 10.20.193.14:0/3921332470 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1136514593 0 0) 0x7f449c055b20 con 0x7f449c157780 2026-02-24T19:23:50.462 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.461+0000 7f44a14bf640 10 monclient(hunting): _negotiate 2026-02-24T19:23:50.463 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.461+0000 7f44a14bf640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:50.463 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.461+0000 7f44a14bf640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:50.463 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.461+0000 7f44a14bf640 10 monclient(hunting): my global_id is 29116 2026-02-24T19:23:50.463 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.461+0000 7f44a14bf640 1 -- 10.20.193.14:0/3921332470 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4484003610 con 0x7f449c157780 2026-02-24T19:23:50.463 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.461+0000 7f44a14bf640 1 -- 10.20.193.14:0/3921332470 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1020941823 0 0) 0x7f449c05de70 con 0x7f449c157b50 2026-02-24T19:23:50.464 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.461+0000 7f44a14bf640 10 monclient(hunting): _negotiate 2026-02-24T19:23:50.464 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.461+0000 7f44a14bf640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:50.464 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.461+0000 7f44a14bf640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:50.464 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.461+0000 7f44a14bf640 10 monclient(hunting): my global_id is 30792 2026-02-24T19:23:50.464 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.461+0000 7f44a14bf640 1 -- 10.20.193.14:0/3921332470 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f449c055b20 con 0x7f449c157b50 2026-02-24T19:23:50.466 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.464+0000 7f44a14bf640 1 -- 10.20.193.14:0/3921332470 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2115667262 0 0) 0x7f449c055b20 con 0x7f449c157b50 2026-02-24T19:23:50.466 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.464+0000 7f44a14bf640 1 -- 10.20.193.14:0/3921332470 >> v1:10.20.193.170:6789/0 conn(0x7f449c164d00 legacy=0x7f449c1c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:50.466 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.464+0000 7f44a14bf640 1 -- 10.20.193.14:0/3921332470 >> v1:10.20.193.44:6789/0 conn(0x7f449c157780 legacy=0x7f449c056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:50.466 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.464+0000 7f44a14bf640 10 monclient: _finish_hunting 0 2026-02-24T19:23:50.466 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.464+0000 7f44a14bf640 1 monclient: found mon.noname-a 2026-02-24T19:23:50.466 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.464+0000 7f44a14bf640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:50.466 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.464+0000 7f44a14bf640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:23:50.466 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.464+0000 7f44a14bf640 1 -- 10.20.193.14:0/3921332470 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f449c0560e0 con 0x7f449c157b50 2026-02-24T19:23:50.467 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.464+0000 7f44a14bf640 10 monclient: _finish_auth 0 2026-02-24T19:23:50.467 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.464+0000 7f44a14bf640 10 monclient: _check_auth_tickets 2026-02-24T19:23:50.467 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.464+0000 7f44a14bf640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:50.467 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.464+0000 7f44a14bf640 1 -- 10.20.193.14:0/3921332470 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4490002df0 con 0x7f449c157b50 2026-02-24T19:23:50.467 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.464+0000 7f44a474c640 5 monclient: authenticate success, global_id 30792 2026-02-24T19:23:50.467 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.464+0000 7f44a474c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:50.467 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.464+0000 7f44a14bf640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:50.467 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.464+0000 7f44a14bf640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:23:50.467 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.464+0000 7f44a14bf640 10 monclient: dump: 2026-02-24T19:23:50.467 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:50.467 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:50.467 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.468 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.468 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:50.468 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:50.468 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:50.468 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:50.468 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:50.468 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:50.468 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.464+0000 7f44a474c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:50.471 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.465+0000 7f44a14bf640 1 -- 10.20.193.14:0/3921332470 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4490003000 con 0x7f449c157b50 2026-02-24T19:23:50.471 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.465+0000 7f44a14bf640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:50.471 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.465+0000 7f44a14bf640 1 -- 10.20.193.14:0/3921332470 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4490003440 con 0x7f449c157b50 2026-02-24T19:23:50.471 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.465+0000 7f44a14bf640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:50.471 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.465+0000 7f44a14bf640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:50.471 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.465+0000 7f44a14bf640 10 monclient: dump: 2026-02-24T19:23:50.471 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:50.472 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:50.472 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.472 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.472 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:50.472 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:50.472 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:50.472 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:50.472 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:50.472 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:50.472 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.465+0000 7f44a474c640 10 monclient: get_monmap_and_config success 2026-02-24T19:23:50.472 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.465+0000 7f44a474c640 4 set_mon_vals no callback set 2026-02-24T19:23:50.472 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.465+0000 7f44a474c640 10 monclient: shutdown 2026-02-24T19:23:50.472 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.465+0000 7f44a474c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:50.473 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.465+0000 7f44a474c640 1 -- 10.20.193.14:0/3921332470 >> v1:10.20.193.14:6789/0 conn(0x7f449c157b50 legacy=0x7f449c1645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:50.473 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.465+0000 7f44a474c640 1 -- 10.20.193.14:0/3921332470 shutdown_connections 2026-02-24T19:23:50.473 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.465+0000 7f44a474c640 1 -- 10.20.193.14:0/3921332470 >> 10.20.193.14:0/3921332470 conn(0x7f449c0b2ef0 msgr2=0x7f449c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:50.473 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.465+0000 7f44a474c640 1 -- 10.20.193.14:0/3921332470 shutdown_connections 2026-02-24T19:23:50.473 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.465+0000 7f44a474c640 1 -- 10.20.193.14:0/3921332470 wait complete. 2026-02-24T19:23:50.473 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.466+0000 7f44a474c640 10 monclient: build_initial_monmap 2026-02-24T19:23:50.473 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.466+0000 7f44a474c640 10 monclient: monmap: 2026-02-24T19:23:50.473 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:50.473 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:23:50.473 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:23:50.473 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:23:50.473 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:50.473 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:23:50.474 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:50.474 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:50.474 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:50.474 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:50.474 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.466+0000 7f44a474c640 1 librados: starting msgr at 2026-02-24T19:23:50.474 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.466+0000 7f44a474c640 1 librados: starting objecter 2026-02-24T19:23:50.474 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.466+0000 7f44a474c640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:23:50.474 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.466+0000 7f44a474c640 1 Processor -- start 2026-02-24T19:23:50.474 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.466+0000 7f44a474c640 1 -- start start 2026-02-24T19:23:50.474 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.466+0000 7f44a474c640 1 librados: setting wanted keys 2026-02-24T19:23:50.474 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.466+0000 7f44a474c640 1 librados: calling monclient init 2026-02-24T19:23:50.474 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.466+0000 7f44a474c640 10 monclient: init 2026-02-24T19:23:50.475 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.466+0000 7f44a474c640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:50.475 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.466+0000 7f44a474c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:23:50.475 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.467+0000 7f44a474c640 10 monclient(hunting): picked mon.noname-c con 0x7f449c157780 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:50.475 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.467+0000 7f44a474c640 10 monclient(hunting): picked mon.noname-b con 0x7f449c157b50 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:50.475 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.467+0000 7f44a474c640 10 monclient(hunting): picked mon.noname-a con 0x7f449c164d00 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:50.475 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.467+0000 7f44a474c640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f449c0abe20 con 0x7f449c164d00 2026-02-24T19:23:50.475 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.467+0000 7f44a474c640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f449c0aa390 con 0x7f449c157b50 2026-02-24T19:23:50.475 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.467+0000 7f44a474c640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f449c0aa670 con 0x7f449c157780 2026-02-24T19:23:50.475 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.467+0000 7f44a474c640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:50.475 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.467+0000 7f44a474c640 10 monclient(hunting): authenticate will time out at 4005.148034s 2026-02-24T19:23:50.475 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.467+0000 7f44a2cc2640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f449c164d00 0x7f449c1475c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:50840/0 (socket says 10.20.193.14:50840) 2026-02-24T19:23:50.475 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.467+0000 7f44a2cc2640 1 -- 10.20.193.14:0/3045639105 learned_addr learned my addr 10.20.193.14:0/3045639105 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:50.475 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.467+0000 7f4482ffd640 10 client.?.objecter ms_handle_connect 0x7f449c164d00 2026-02-24T19:23:50.475 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.467+0000 7f4482ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:50.476 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.468+0000 7f4482ffd640 10 client.?.objecter ms_handle_connect 0x7f449c157b50 2026-02-24T19:23:50.476 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.468+0000 7f4482ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:50.476 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.469+0000 7f4482ffd640 1 -- 10.20.193.14:0/3045639105 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2020812162 0 0) 0x7f449c0abe20 con 0x7f449c164d00 2026-02-24T19:23:50.476 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.469+0000 7f4482ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:23:50.476 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.469+0000 7f4482ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:50.476 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.469+0000 7f4482ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:50.476 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.469+0000 7f4482ffd640 10 monclient(hunting): my global_id is 30795 2026-02-24T19:23:50.476 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.469+0000 7f4482ffd640 1 -- 10.20.193.14:0/3045639105 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f446c003610 con 0x7f449c164d00 2026-02-24T19:23:50.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.471+0000 7f4482ffd640 1 -- 10.20.193.14:0/3045639105 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1621523954 0 0) 0x7f446c003610 con 0x7f449c164d00 2026-02-24T19:23:50.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.471+0000 7f4482ffd640 1 -- 10.20.193.14:0/3045639105 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f449c0abe20 con 0x7f449c164d00 2026-02-24T19:23:50.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.471+0000 7f4482ffd640 1 -- 10.20.193.14:0/3045639105 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4498003270 con 0x7f449c164d00 2026-02-24T19:23:50.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.471+0000 7f4482ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:50.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.471+0000 7f4482ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:23:50.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.471+0000 7f4482ffd640 10 monclient(hunting): dump: 2026-02-24T19:23:50.479 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:50.479 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:50.479 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.479 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.479 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:50.479 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:50.479 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:50.479 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:50.479 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:50.479 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:50.479 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.471+0000 7f4482ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:23:50.479 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.473+0000 7f4482ffd640 1 -- 10.20.193.14:0/3045639105 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 603805045 0 0) 0x7f449c0abe20 con 0x7f449c164d00 2026-02-24T19:23:50.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.473+0000 7f4482ffd640 1 -- 10.20.193.14:0/3045639105 >> v1:10.20.193.170:6789/0 conn(0x7f449c157780 legacy=0x7f449c0ab710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:50.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.473+0000 7f4482ffd640 1 -- 10.20.193.14:0/3045639105 >> v1:10.20.193.44:6789/0 conn(0x7f449c157b50 legacy=0x7f449c12c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:50.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.473+0000 7f4482ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:23:50.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.473+0000 7f4482ffd640 1 monclient: found mon.a 2026-02-24T19:23:50.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.473+0000 7f4482ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:50.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.473+0000 7f4482ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:50.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.473+0000 7f4482ffd640 1 -- 10.20.193.14:0/3045639105 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f449c0aa950 con 0x7f449c164d00 2026-02-24T19:23:50.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.473+0000 7f4482ffd640 10 monclient: _finish_auth 0 2026-02-24T19:23:50.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.473+0000 7f4482ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:23:50.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.473+0000 7f4482ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:50.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.473+0000 7f44a474c640 5 monclient: authenticate success, global_id 30795 2026-02-24T19:23:50.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.473+0000 7f44a474c640 10 monclient: _renew_subs 2026-02-24T19:23:50.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.473+0000 7f44a474c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:50.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.473+0000 7f44a474c640 1 -- 10.20.193.14:0/3045639105 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f449c0aac30 con 0x7f449c164d00 2026-02-24T19:23:50.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.473+0000 7f44a474c640 10 client.30795.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:50.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.473+0000 7f44a474c640 10 monclient: _renew_subs 2026-02-24T19:23:50.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.473+0000 7f44a474c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:50.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.473+0000 7f44a474c640 1 -- 10.20.193.14:0/3045639105 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f449c0ab1f0 con 0x7f449c164d00 2026-02-24T19:23:50.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.473+0000 7f44a474c640 1 librados: init done 2026-02-24T19:23:50.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.473+0000 7f44a474c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:50.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.474+0000 7f44a474c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:50.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.474+0000 7f44a474c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:50.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.474+0000 7f44a474c640 1 -- 10.20.193.14:0/3045639105 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f449c15ea20 con 0x7f449c164d00 2026-02-24T19:23:50.482 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.481+0000 7f4482ffd640 1 -- 10.20.193.14:0/3045639105 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4498004c50 con 0x7f449c164d00 2026-02-24T19:23:50.482 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.481+0000 7f4482ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:50.483 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.481+0000 7f4482ffd640 1 -- 10.20.193.14:0/3045639105 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4498004ec0 con 0x7f449c164d00 2026-02-24T19:23:50.483 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.481+0000 7f4482ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:50.483 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.481+0000 7f4482ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:50.483 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.481+0000 7f44a0cbe640 4 set_mon_vals no callback set 2026-02-24T19:23:50.483 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.481+0000 7f4482ffd640 10 monclient: dump: 2026-02-24T19:23:50.483 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:50.483 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:50.483 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.483 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.483 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:50.483 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:50.483 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:50.484 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:50.484 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:50.484 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:50.485 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.481+0000 7f4482ffd640 1 -- 10.20.193.14:0/3045639105 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f44980050a0 con 0x7f449c164d00 2026-02-24T19:23:50.485 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.482+0000 7f44a24c1640 10 monclient: get_auth_request con 0x7f446c077cd0 auth_method 0 2026-02-24T19:23:50.485 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.482+0000 7f4482ffd640 10 client.30795.objecter ms_handle_connect 0x7f446c077cd0 2026-02-24T19:23:50.485 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.483+0000 7f4482ffd640 1 -- 10.20.193.14:0/3045639105 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7f4498093620 con 0x7f449c164d00 2026-02-24T19:23:50.485 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.483+0000 7f4482ffd640 10 client.30795.objecter ms_dispatch2 0x7f449c000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:23:50.485 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.483+0000 7f4482ffd640 3 client.30795.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:23:50.485 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.483+0000 7f4482ffd640 3 client.30795.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:23:50.485 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.483+0000 7f4482ffd640 20 client.30795.objecter dump_active .. 0 homeless 2026-02-24T19:23:50.568 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.567+0000 7f4482ffd640 1 -- 10.20.193.14:0/3045639105 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f449805e050 con 0x7f449c164d00 2026-02-24T19:23:50.568 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.567+0000 7f4482ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:50.569 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.567+0000 7f4482ffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:23:50.678 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.677+0000 7f44a474c640 1 -- 10.20.193.14:0/3045639105 --> v1:10.20.193.14:6800/4014096310 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f449c15e6e0 con 0x7f446c077cd0 2026-02-24T19:23:50.679 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.677+0000 7f4482ffd640 1 -- 10.20.193.14:0/3045639105 <== mgr.4110 v1:10.20.193.14:6800/4014096310 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (unknown 2264484800 0 0) 0x7f449c15e6e0 con 0x7f446c077cd0 2026-02-24T19:23:50.679 INFO:teuthology.orchestra.run.trial014.stderr:instructed osd(s) 5 to deep-scrub 2026-02-24T19:23:50.680 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.678+0000 7f44a474c640 10 librados: watch_flush enter 2026-02-24T19:23:50.680 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.678+0000 7f44a474c640 10 librados: watch_flush exit 2026-02-24T19:23:50.680 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.678+0000 7f44a474c640 20 client.30795.objecter shutdown clearing up homeless session... 2026-02-24T19:23:50.680 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.678+0000 7f44a474c640 10 client.30795.objecter successfully canceled tick 2026-02-24T19:23:50.680 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.678+0000 7f44a474c640 1 -- 10.20.193.14:0/3045639105 >> v1:10.20.193.14:6800/4014096310 conn(0x7f446c077cd0 legacy=0x7f446c098180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:50.680 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.678+0000 7f44a474c640 10 monclient: shutdown 2026-02-24T19:23:50.681 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.678+0000 7f44a474c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:50.681 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.678+0000 7f44a474c640 1 -- 10.20.193.14:0/3045639105 >> v1:10.20.193.14:6789/0 conn(0x7f449c164d00 legacy=0x7f449c1475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:50.681 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.678+0000 7f44a474c640 1 -- 10.20.193.14:0/3045639105 shutdown_connections 2026-02-24T19:23:50.681 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.678+0000 7f44a474c640 1 -- 10.20.193.14:0/3045639105 >> 10.20.193.14:0/3045639105 conn(0x7f449c0b2ef0 msgr2=0x7f449c0b26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:50.681 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.678+0000 7f44a474c640 1 -- 10.20.193.14:0/3045639105 shutdown_connections 2026-02-24T19:23:50.681 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.678+0000 7f44a474c640 1 -- 10.20.193.14:0/3045639105 wait complete. 2026-02-24T19:23:50.681 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.678+0000 7f44a474c640 1 librados: shutdown 2026-02-24T19:23:50.688 INFO:tasks.ceph:Scrubbing osd.9 2026-02-24T19:23:50.688 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:23:50.759 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.758+0000 7f4ec1d45640 10 monclient: get_monmap_and_config 2026-02-24T19:23:50.760 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.758+0000 7f4ec1d45640 10 monclient: build_initial_monmap 2026-02-24T19:23:50.760 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.758+0000 7f4ec1d45640 10 monclient: monmap: 2026-02-24T19:23:50.760 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:50.760 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:50.760 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:23:50.758832+0000 2026-02-24T19:23:50.760 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:23:50.758832+0000 2026-02-24T19:23:50.760 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:50.760 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:50.760 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:50.760 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:50.760 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:50.761 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:50.762 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.758+0000 7f4ec1d45640 1 Processor -- start 2026-02-24T19:23:50.762 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.758+0000 7f4ec1d45640 1 -- start start 2026-02-24T19:23:50.762 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.758+0000 7f4ec1d45640 10 monclient: init 2026-02-24T19:23:50.762 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.759+0000 7f4ec1d45640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:50.762 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.759+0000 7f4ec1d45640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:23:50.763 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.759+0000 7f4ec1d45640 10 monclient(hunting): picked mon.noname-c con 0x7f4ebc15e2a0 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:50.763 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.759+0000 7f4ec1d45640 10 monclient(hunting): picked mon.noname-a con 0x7f4ebc059e10 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:50.763 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.759+0000 7f4ec1d45640 10 monclient(hunting): picked mon.noname-b con 0x7f4ebc1a5660 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:50.763 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.759+0000 7f4ec1d45640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ebc162df0 con 0x7f4ebc059e10 2026-02-24T19:23:50.763 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.759+0000 7f4ec1d45640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ebc1630d0 con 0x7f4ebc1a5660 2026-02-24T19:23:50.763 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.759+0000 7f4ec1d45640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ebc1633b0 con 0x7f4ebc15e2a0 2026-02-24T19:23:50.763 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.759+0000 7f4ec1d45640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:50.763 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.759+0000 7f4ec1d45640 10 monclient(hunting): authenticate will time out at 4005.440447s 2026-02-24T19:23:50.763 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.759+0000 7f4ebaffd640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f4ebc059e10 0x7f4ebc15ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:50852/0 (socket says 10.20.193.14:50852) 2026-02-24T19:23:50.763 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.759+0000 7f4ebaffd640 1 -- 10.20.193.14:0/2498561431 learned_addr learned my addr 10.20.193.14:0/2498561431 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:50.768 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.761+0000 7f4eba7fc640 1 -- 10.20.193.14:0/2498561431 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4289462976 0 0) 0x7f4ebc1633b0 con 0x7f4ebc15e2a0 2026-02-24T19:23:50.768 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.761+0000 7f4eba7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:23:50.768 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.761+0000 7f4eba7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:50.768 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.761+0000 7f4eba7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:50.768 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.761+0000 7f4eba7fc640 10 monclient(hunting): my global_id is 28757 2026-02-24T19:23:50.768 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.761+0000 7f4eba7fc640 1 -- 10.20.193.14:0/2498561431 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ea0003610 con 0x7f4ebc15e2a0 2026-02-24T19:23:50.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.761+0000 7f4eba7fc640 1 -- 10.20.193.14:0/2498561431 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 17594194 0 0) 0x7f4ebc162df0 con 0x7f4ebc059e10 2026-02-24T19:23:50.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.761+0000 7f4eba7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:23:50.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.761+0000 7f4eba7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:50.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.761+0000 7f4eba7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:50.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.761+0000 7f4eba7fc640 10 monclient(hunting): my global_id is 30798 2026-02-24T19:23:50.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.761+0000 7f4eba7fc640 1 -- 10.20.193.14:0/2498561431 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ebc1633b0 con 0x7f4ebc059e10 2026-02-24T19:23:50.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.761+0000 7f4eba7fc640 1 -- 10.20.193.14:0/2498561431 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1327327214 0 0) 0x7f4ebc1630d0 con 0x7f4ebc1a5660 2026-02-24T19:23:50.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.761+0000 7f4eba7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:23:50.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.761+0000 7f4eba7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:50.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.761+0000 7f4eba7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:50.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.761+0000 7f4eba7fc640 10 monclient(hunting): my global_id is 29119 2026-02-24T19:23:50.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.761+0000 7f4eba7fc640 1 -- 10.20.193.14:0/2498561431 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ebc162df0 con 0x7f4ebc1a5660 2026-02-24T19:23:50.770 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.762+0000 7f4eba7fc640 1 -- 10.20.193.14:0/2498561431 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3299127475 0 0) 0x7f4ea0003610 con 0x7f4ebc15e2a0 2026-02-24T19:23:50.770 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.762+0000 7f4eba7fc640 1 -- 10.20.193.14:0/2498561431 >> v1:10.20.193.44:6789/0 conn(0x7f4ebc1a5660 legacy=0x7f4ebc1c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:50.770 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.762+0000 7f4eba7fc640 1 -- 10.20.193.14:0/2498561431 >> v1:10.20.193.14:6789/0 conn(0x7f4ebc059e10 legacy=0x7f4ebc15ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:50.770 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.762+0000 7f4eba7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:23:50.770 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.762+0000 7f4eba7fc640 1 monclient: found mon.noname-c 2026-02-24T19:23:50.770 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.762+0000 7f4eba7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:50.770 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.762+0000 7f4eba7fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.170:6789/0 2026-02-24T19:23:50.770 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.762+0000 7f4eba7fc640 1 -- 10.20.193.14:0/2498561431 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ebc163690 con 0x7f4ebc15e2a0 2026-02-24T19:23:50.770 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.762+0000 7f4eba7fc640 10 monclient: _finish_auth 0 2026-02-24T19:23:50.770 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.762+0000 7f4eba7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:23:50.770 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.762+0000 7f4eba7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:50.770 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.762+0000 7f4ec1d45640 5 monclient: authenticate success, global_id 28757 2026-02-24T19:23:50.770 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.762+0000 7f4eba7fc640 1 -- 10.20.193.14:0/2498561431 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4ea8002df0 con 0x7f4ebc15e2a0 2026-02-24T19:23:50.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.762+0000 7f4ec1d45640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:50.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.762+0000 7f4eba7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:50.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.763+0000 7f4eba7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:23:50.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.763+0000 7f4eba7fc640 10 monclient: dump: 2026-02-24T19:23:50.771 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:50.771 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:50.771 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.771 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.771 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:50.771 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:50.771 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:50.771 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:50.771 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:50.772 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:50.772 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.763+0000 7f4ec1d45640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:50.772 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.763+0000 7f4eba7fc640 1 -- 10.20.193.14:0/2498561431 <== mon.2 v1:10.20.193.170:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4ea8002fc0 con 0x7f4ebc15e2a0 2026-02-24T19:23:50.772 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.763+0000 7f4eba7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:50.772 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.763+0000 7f4eba7fc640 1 -- 10.20.193.14:0/2498561431 <== mon.2 v1:10.20.193.170:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4ea8003400 con 0x7f4ebc15e2a0 2026-02-24T19:23:50.772 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.763+0000 7f4eba7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:50.772 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.763+0000 7f4eba7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:50.772 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.763+0000 7f4eba7fc640 10 monclient: dump: 2026-02-24T19:23:50.772 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:50.772 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:50.772 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.772 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.773 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:50.773 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:50.773 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:50.773 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:50.773 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:50.773 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:50.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.763+0000 7f4ec1d45640 10 monclient: get_monmap_and_config success 2026-02-24T19:23:50.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.763+0000 7f4ec1d45640 4 set_mon_vals no callback set 2026-02-24T19:23:50.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.764+0000 7f4ec1d45640 10 monclient: shutdown 2026-02-24T19:23:50.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.764+0000 7f4ec1d45640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:50.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.764+0000 7f4ec1d45640 1 -- 10.20.193.14:0/2498561431 >> v1:10.20.193.170:6789/0 conn(0x7f4ebc15e2a0 legacy=0x7f4ebc05da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:50.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.764+0000 7f4ec1d45640 1 -- 10.20.193.14:0/2498561431 shutdown_connections 2026-02-24T19:23:50.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.764+0000 7f4ec1d45640 1 -- 10.20.193.14:0/2498561431 >> 10.20.193.14:0/2498561431 conn(0x7f4ebc0b2f60 msgr2=0x7f4ebc0b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:50.774 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.764+0000 7f4ec1d45640 1 -- 10.20.193.14:0/2498561431 shutdown_connections 2026-02-24T19:23:50.774 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.764+0000 7f4ec1d45640 1 -- 10.20.193.14:0/2498561431 wait complete. 2026-02-24T19:23:50.774 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.764+0000 7f4ec1d45640 10 monclient: build_initial_monmap 2026-02-24T19:23:50.774 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.764+0000 7f4ec1d45640 10 monclient: monmap: 2026-02-24T19:23:50.774 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:50.774 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:23:50.774 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:23:50.774 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:23:50.774 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:50.774 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:23:50.774 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:50.774 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:50.774 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:50.775 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:50.775 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.765+0000 7f4ec1d45640 1 librados: starting msgr at 2026-02-24T19:23:50.775 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.765+0000 7f4ec1d45640 1 librados: starting objecter 2026-02-24T19:23:50.775 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.765+0000 7f4ec1d45640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:23:50.775 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.765+0000 7f4ec1d45640 1 Processor -- start 2026-02-24T19:23:50.775 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.765+0000 7f4ec1d45640 1 -- start start 2026-02-24T19:23:50.775 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.765+0000 7f4ec1d45640 1 librados: setting wanted keys 2026-02-24T19:23:50.775 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.765+0000 7f4ec1d45640 1 librados: calling monclient init 2026-02-24T19:23:50.775 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.765+0000 7f4ec1d45640 10 monclient: init 2026-02-24T19:23:50.775 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.765+0000 7f4ec1d45640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:50.775 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.765+0000 7f4ec1d45640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:23:50.775 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.765+0000 7f4ec1d45640 10 monclient(hunting): picked mon.noname-b con 0x7f4ebc059e10 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:50.775 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.765+0000 7f4ec1d45640 10 monclient(hunting): picked mon.noname-c con 0x7f4ebc15e2a0 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:50.776 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.765+0000 7f4ec1d45640 10 monclient(hunting): picked mon.noname-a con 0x7f4ebc1a5660 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:50.776 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.765+0000 7f4ec1d45640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ebc0a8240 con 0x7f4ebc1a5660 2026-02-24T19:23:50.776 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.765+0000 7f4ec1d45640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ebc0a8520 con 0x7f4ebc059e10 2026-02-24T19:23:50.776 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.765+0000 7f4ec1d45640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ebc0b1320 con 0x7f4ebc15e2a0 2026-02-24T19:23:50.776 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.765+0000 7f4ec1d45640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:50.776 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.765+0000 7f4ec1d45640 10 monclient(hunting): authenticate will time out at 4005.446662s 2026-02-24T19:23:50.776 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.765+0000 7f4ebbfff640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f4ebc1a5660 0x7f4ebc0b1e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:50866/0 (socket says 10.20.193.14:50866) 2026-02-24T19:23:50.776 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.765+0000 7f4ebbfff640 1 -- 10.20.193.14:0/4084219351 learned_addr learned my addr 10.20.193.14:0/4084219351 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:50.776 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.766+0000 7f4e97fff640 10 client.?.objecter ms_handle_connect 0x7f4ebc1a5660 2026-02-24T19:23:50.776 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.766+0000 7f4e97fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:50.776 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.766+0000 7f4e97fff640 10 client.?.objecter ms_handle_connect 0x7f4ebc15e2a0 2026-02-24T19:23:50.776 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.766+0000 7f4e97fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:50.777 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.766+0000 7f4e97fff640 10 client.?.objecter ms_handle_connect 0x7f4ebc059e10 2026-02-24T19:23:50.777 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.766+0000 7f4e97fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:50.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.767+0000 7f4e97fff640 1 -- 10.20.193.14:0/4084219351 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2832025529 0 0) 0x7f4ebc0a8240 con 0x7f4ebc1a5660 2026-02-24T19:23:50.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.767+0000 7f4e97fff640 10 monclient(hunting): _negotiate 2026-02-24T19:23:50.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.767+0000 7f4e97fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:50.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.767+0000 7f4e97fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:50.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.767+0000 7f4e97fff640 10 monclient(hunting): my global_id is 30801 2026-02-24T19:23:50.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.767+0000 7f4e97fff640 1 -- 10.20.193.14:0/4084219351 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e8c003610 con 0x7f4ebc1a5660 2026-02-24T19:23:50.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.767+0000 7f4e97fff640 1 -- 10.20.193.14:0/4084219351 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4232102673 0 0) 0x7f4ebc0b1320 con 0x7f4ebc15e2a0 2026-02-24T19:23:50.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.767+0000 7f4e97fff640 10 monclient(hunting): _negotiate 2026-02-24T19:23:50.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.767+0000 7f4e97fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:50.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.767+0000 7f4e97fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:50.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.767+0000 7f4e97fff640 10 monclient(hunting): my global_id is 28760 2026-02-24T19:23:50.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.767+0000 7f4e97fff640 1 -- 10.20.193.14:0/4084219351 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ebc0a8240 con 0x7f4ebc15e2a0 2026-02-24T19:23:50.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.767+0000 7f4e97fff640 1 -- 10.20.193.14:0/4084219351 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2651098613 0 0) 0x7f4ebc0a8520 con 0x7f4ebc059e10 2026-02-24T19:23:50.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.767+0000 7f4e97fff640 10 monclient(hunting): _negotiate 2026-02-24T19:23:50.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.767+0000 7f4e97fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:50.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.767+0000 7f4e97fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:50.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.767+0000 7f4e97fff640 10 monclient(hunting): my global_id is 29122 2026-02-24T19:23:50.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.767+0000 7f4e97fff640 1 -- 10.20.193.14:0/4084219351 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ebc0b1320 con 0x7f4ebc059e10 2026-02-24T19:23:50.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.769+0000 7f4e97fff640 1 -- 10.20.193.14:0/4084219351 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 47648192 0 0) 0x7f4ebc0a8240 con 0x7f4ebc15e2a0 2026-02-24T19:23:50.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.769+0000 7f4e97fff640 1 -- 10.20.193.14:0/4084219351 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4ebc0a8520 con 0x7f4ebc15e2a0 2026-02-24T19:23:50.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.769+0000 7f4e97fff640 1 -- 10.20.193.14:0/4084219351 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4eac002ff0 con 0x7f4ebc15e2a0 2026-02-24T19:23:50.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.769+0000 7f4e97fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:50.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.769+0000 7f4e97fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:23:50.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.769+0000 7f4e97fff640 10 monclient(hunting): dump: 2026-02-24T19:23:50.782 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:50.782 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:50.782 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.782 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.782 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:50.782 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:50.782 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:50.782 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:50.782 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:50.782 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:50.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.769+0000 7f4e97fff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:23:50.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.769+0000 7f4e97fff640 1 -- 10.20.193.14:0/4084219351 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4164638954 0 0) 0x7f4e8c003610 con 0x7f4ebc1a5660 2026-02-24T19:23:50.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.769+0000 7f4e97fff640 1 -- 10.20.193.14:0/4084219351 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4ebc0a8240 con 0x7f4ebc1a5660 2026-02-24T19:23:50.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.769+0000 7f4e97fff640 1 -- 10.20.193.14:0/4084219351 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4eb0003470 con 0x7f4ebc1a5660 2026-02-24T19:23:50.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.769+0000 7f4e97fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:50.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.769+0000 7f4e97fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:50.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.769+0000 7f4e97fff640 10 monclient(hunting): dump: 2026-02-24T19:23:50.783 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:50.783 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:50.783 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.783 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.783 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:50.783 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:50.783 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:50.783 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:50.783 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:50.784 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:50.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.771+0000 7f4e97fff640 1 -- 10.20.193.14:0/4084219351 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 143150138 0 0) 0x7f4ebc0a8520 con 0x7f4ebc15e2a0 2026-02-24T19:23:50.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.771+0000 7f4e97fff640 1 -- 10.20.193.14:0/4084219351 >> v1:10.20.193.44:6789/0 conn(0x7f4ebc059e10 legacy=0x7f4ebc05d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:50.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.771+0000 7f4e97fff640 1 -- 10.20.193.14:0/4084219351 >> v1:10.20.193.14:6789/0 conn(0x7f4ebc1a5660 legacy=0x7f4ebc0b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:50.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.771+0000 7f4e97fff640 10 monclient: _finish_hunting 0 2026-02-24T19:23:50.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.771+0000 7f4e97fff640 1 monclient: found mon.c 2026-02-24T19:23:50.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.771+0000 7f4e97fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:50.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.771+0000 7f4e97fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:50.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.771+0000 7f4e97fff640 1 -- 10.20.193.14:0/4084219351 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ebc0b1600 con 0x7f4ebc15e2a0 2026-02-24T19:23:50.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.771+0000 7f4e97fff640 10 monclient: _finish_auth 0 2026-02-24T19:23:50.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.771+0000 7f4e97fff640 10 monclient: _check_auth_tickets 2026-02-24T19:23:50.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.771+0000 7f4e97fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:50.785 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.771+0000 7f4ec1d45640 5 monclient: authenticate success, global_id 28760 2026-02-24T19:23:50.785 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.771+0000 7f4ec1d45640 10 monclient: _renew_subs 2026-02-24T19:23:50.785 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.771+0000 7f4ec1d45640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:50.785 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.771+0000 7f4ec1d45640 1 -- 10.20.193.14:0/4084219351 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4ebc0b18e0 con 0x7f4ebc15e2a0 2026-02-24T19:23:50.785 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.771+0000 7f4ec1d45640 10 client.28760.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:50.785 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.771+0000 7f4ec1d45640 10 monclient: _renew_subs 2026-02-24T19:23:50.785 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.771+0000 7f4ec1d45640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:50.785 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.771+0000 7f4ec1d45640 1 -- 10.20.193.14:0/4084219351 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4ebc0a7f50 con 0x7f4ebc15e2a0 2026-02-24T19:23:50.785 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.771+0000 7f4ec1d45640 1 librados: init done 2026-02-24T19:23:50.785 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.771+0000 7f4ec1d45640 10 client.28760.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:50.785 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.771+0000 7f4ec1d45640 15 client.28760.objecter _session_command_op_assign -1 1 2026-02-24T19:23:50.785 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.771+0000 7f4ec1d45640 20 client.28760.objecter _get_session osd=-1 returning homeless 2026-02-24T19:23:50.785 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.771+0000 7f4ec1d45640 10 client.28760.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:50.785 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.771+0000 7f4ec1d45640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:50.786 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.771+0000 7f4ec1d45640 1 -- 10.20.193.14:0/4084219351 --> v1:10.20.193.170:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f4ebc1609c0 con 0x7f4ebc15e2a0 2026-02-24T19:23:50.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.779+0000 7f4e97fff640 1 -- 10.20.193.14:0/4084219351 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4ebc1609c0 con 0x7f4ebc15e2a0 2026-02-24T19:23:50.788 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.779+0000 7f4e97fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:50.788 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.779+0000 7f4e97fff640 1 -- 10.20.193.14:0/4084219351 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4eac0048d0 con 0x7f4ebc15e2a0 2026-02-24T19:23:50.788 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.779+0000 7f4e97fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:50.788 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.779+0000 7f4e97fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:50.788 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.779+0000 7f4eb9ffb640 4 set_mon_vals no callback set 2026-02-24T19:23:50.788 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.779+0000 7f4e97fff640 10 monclient: dump: 2026-02-24T19:23:50.788 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:50.788 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:50.788 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.788 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.788 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:50.788 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:50.789 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:50.789 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:50.789 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:50.789 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:50.789 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.780+0000 7f4e97fff640 1 -- 10.20.193.14:0/4084219351 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f4eac01d780 con 0x7f4ebc15e2a0 2026-02-24T19:23:50.789 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.780+0000 7f4ebb7fe640 10 monclient: get_auth_request con 0x7f4e8c077d30 auth_method 0 2026-02-24T19:23:50.789 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.781+0000 7f4e97fff640 10 client.28760.objecter ms_handle_connect 0x7f4e8c077d30 2026-02-24T19:23:50.789 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.781+0000 7f4e97fff640 1 -- 10.20.193.14:0/4084219351 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7f4eac0930c0 con 0x7f4ebc15e2a0 2026-02-24T19:23:50.789 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.781+0000 7f4e97fff640 10 client.28760.objecter ms_dispatch2 0x7f4ebc000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:23:50.789 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.781+0000 7f4e97fff640 3 client.28760.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:23:50.789 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.781+0000 7f4e97fff640 3 client.28760.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:23:50.789 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.781+0000 7f4e97fff640 10 client.28760.objecter checking command 1 2026-02-24T19:23:50.790 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.781+0000 7f4e97fff640 20 client.28760.objecter _get_session s=0x7f4e8c0a1ff0 osd=9 3 2026-02-24T19:23:50.790 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.781+0000 7f4e97fff640 20 client.28760.objecter put_session s=0x7f4e8c0a1ff0 osd=9 3 2026-02-24T19:23:50.790 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.781+0000 7f4e97fff640 15 client.28760.objecter _session_command_op_remove -1 1 2026-02-24T19:23:50.790 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.781+0000 7f4e97fff640 20 client.28760.objecter _get_session s=0x7f4e8c0a1ff0 osd=9 3 2026-02-24T19:23:50.790 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.781+0000 7f4e97fff640 20 client.28760.objecter get_session s=0x7f4e8c0a1ff0 osd=9 3 2026-02-24T19:23:50.790 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.781+0000 7f4e97fff640 15 client.28760.objecter _session_command_op_assign 9 1 2026-02-24T19:23:50.790 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.781+0000 7f4e97fff640 20 client.28760.objecter put_session s=0x7f4e8c0a1ff0 osd=9 4 2026-02-24T19:23:50.790 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.781+0000 7f4e97fff640 10 client.28760.objecter _send_command 1 2026-02-24T19:23:50.790 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.781+0000 7f4e97fff640 1 -- 10.20.193.14:0/4084219351 --> v1:10.20.193.44:6808/4259724385 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4e8c0c4300 con 0x7f4e8c0a26a0 2026-02-24T19:23:50.790 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.781+0000 7f4e97fff640 20 client.28760.objecter dump_active .. 0 homeless 2026-02-24T19:23:50.790 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.781+0000 7f4e97fff640 1 -- 10.20.193.14:0/4084219351 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_get_version_reply(handle=1 version=354) ==== 24+0+0 (unknown 31317031 0 0) 0x7f4eac05d1c0 con 0x7f4ebc15e2a0 2026-02-24T19:23:50.790 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.781+0000 7f4e97fff640 10 monclient: handle_get_version_reply finishing 1 version 354 2026-02-24T19:23:50.790 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.783+0000 7f4ebbfff640 10 monclient: get_auth_request con 0x7f4e8c0a26a0 auth_method 0 2026-02-24T19:23:50.791 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.784+0000 7f4e97fff640 10 client.28760.objecter ms_handle_connect 0x7f4e8c0a26a0 2026-02-24T19:23:50.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.794+0000 7f4e97fff640 1 -- 10.20.193.14:0/4084219351 <== osd.9 v1:10.20.193.44:6808/4259724385 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f4e8c0c4300 con 0x7f4e8c0a26a0 2026-02-24T19:23:50.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.794+0000 7f4e97fff640 10 client.28760.objecter ms_dispatch2 0x7f4ebc000b90 command_reply(tid 1: 0 ) 2026-02-24T19:23:50.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.794+0000 7f4e97fff640 10 client.28760.objecter _finish_command 1 = system:0 2026-02-24T19:23:50.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.794+0000 7f4e97fff640 20 client.28760.objecter put_session s=0x7f4e8c0a1ff0 osd=9 4 2026-02-24T19:23:50.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.794+0000 7f4e97fff640 15 client.28760.objecter _session_command_op_remove 9 1 2026-02-24T19:23:50.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.801+0000 7f4ec1d45640 10 client.28760.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:23:50.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.801+0000 7f4ec1d45640 15 client.28760.objecter _session_command_op_assign -1 2 2026-02-24T19:23:50.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.801+0000 7f4ec1d45640 20 client.28760.objecter _get_session s=0x7f4e8c0a1ff0 osd=9 3 2026-02-24T19:23:50.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.801+0000 7f4ec1d45640 20 client.28760.objecter put_session s=0x7f4e8c0a1ff0 osd=9 3 2026-02-24T19:23:50.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.801+0000 7f4ec1d45640 20 client.28760.objecter _get_session s=0x7f4e8c0a1ff0 osd=9 3 2026-02-24T19:23:50.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.801+0000 7f4ec1d45640 15 client.28760.objecter _session_command_op_remove -1 2 2026-02-24T19:23:50.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.801+0000 7f4ec1d45640 20 client.28760.objecter get_session s=0x7f4e8c0a1ff0 osd=9 3 2026-02-24T19:23:50.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.801+0000 7f4ec1d45640 15 client.28760.objecter _session_command_op_assign 9 2 2026-02-24T19:23:50.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.801+0000 7f4ec1d45640 20 client.28760.objecter put_session s=0x7f4e8c0a1ff0 osd=9 4 2026-02-24T19:23:50.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.801+0000 7f4ec1d45640 10 client.28760.objecter _send_command 2 2026-02-24T19:23:50.804 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.801+0000 7f4ec1d45640 1 -- 10.20.193.14:0/4084219351 --> v1:10.20.193.44:6808/4259724385 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4ebc1a4f80 con 0x7f4e8c0a26a0 2026-02-24T19:23:50.818 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.816+0000 7f4e97fff640 1 -- 10.20.193.14:0/4084219351 <== osd.9 v1:10.20.193.44:6808/4259724385 2 ==== command_reply(tid 2: 0 ) ==== 8+0+712 (unknown 0 0 714369635) 0x7f4ebc1a4f80 con 0x7f4e8c0a26a0 2026-02-24T19:23:50.818 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.816+0000 7f4e97fff640 10 client.28760.objecter ms_dispatch2 0x7f4ebc000b90 command_reply(tid 2: 0 ) 2026-02-24T19:23:50.818 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.816+0000 7f4e97fff640 10 client.28760.objecter _finish_command 2 = system:0 2026-02-24T19:23:50.818 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.816+0000 7f4e97fff640 20 client.28760.objecter put_session s=0x7f4e8c0a1ff0 osd=9 4 2026-02-24T19:23:50.818 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.816+0000 7f4e97fff640 15 client.28760.objecter _session_command_op_remove 9 2 2026-02-24T19:23:50.818 INFO:teuthology.orchestra.run.trial014.stdout:{ 2026-02-24T19:23:50.818 INFO:teuthology.orchestra.run.trial014.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-24T19:23:50.819 INFO:teuthology.orchestra.run.trial014.stdout:} 2026-02-24T19:23:50.820 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.816+0000 7f4ec1d45640 10 librados: watch_flush enter 2026-02-24T19:23:50.820 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.816+0000 7f4ec1d45640 10 librados: watch_flush exit 2026-02-24T19:23:50.820 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.816+0000 7f4ec1d45640 10 client.28760.objecter close_session for osd.9 2026-02-24T19:23:50.820 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.816+0000 7f4ec1d45640 1 -- 10.20.193.14:0/4084219351 >> v1:10.20.193.44:6808/4259724385 conn(0x7f4e8c0a26a0 legacy=0x7f4e8c0c2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:50.820 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.816+0000 7f4ec1d45640 20 client.28760.objecter put_session s=0x7f4e8c0a1ff0 osd=9 1 2026-02-24T19:23:50.820 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.816+0000 7f4ec1d45640 20 client.28760.objecter shutdown clearing up homeless session... 2026-02-24T19:23:50.820 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.816+0000 7f4ec1d45640 10 client.28760.objecter successfully canceled tick 2026-02-24T19:23:50.820 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.816+0000 7f4ec1d45640 1 -- 10.20.193.14:0/4084219351 >> v1:10.20.193.14:6800/4014096310 conn(0x7f4e8c077d30 legacy=0x7f4e8c0981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:50.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.816+0000 7f4ec1d45640 10 monclient: shutdown 2026-02-24T19:23:50.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.816+0000 7f4ec1d45640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:50.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.816+0000 7f4ec1d45640 1 -- 10.20.193.14:0/4084219351 >> v1:10.20.193.170:6789/0 conn(0x7f4ebc15e2a0 legacy=0x7f4ebc0a7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:50.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.816+0000 7f4ebbfff640 1 -- 10.20.193.14:0/4084219351 reap_dead start 2026-02-24T19:23:50.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.816+0000 7f4ec1d45640 1 -- 10.20.193.14:0/4084219351 shutdown_connections 2026-02-24T19:23:50.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.816+0000 7f4ec1d45640 1 -- 10.20.193.14:0/4084219351 >> 10.20.193.14:0/4084219351 conn(0x7f4ebc0b2f60 msgr2=0x7f4ebc0b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:50.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.816+0000 7f4ec1d45640 1 -- 10.20.193.14:0/4084219351 shutdown_connections 2026-02-24T19:23:50.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.816+0000 7f4ec1d45640 1 -- 10.20.193.14:0/4084219351 wait complete. 2026-02-24T19:23:50.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.816+0000 7f4ec1d45640 1 librados: shutdown 2026-02-24T19:23:50.826 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 9 2026-02-24T19:23:50.881 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:07:25.142 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:50.882 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:07:25.144 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:50.894 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.893+0000 7f507e778640 10 monclient: get_monmap_and_config 2026-02-24T19:23:50.895 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.893+0000 7f507e778640 10 monclient: build_initial_monmap 2026-02-24T19:23:50.895 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.893+0000 7f507e778640 10 monclient: monmap: 2026-02-24T19:23:50.895 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:50.895 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:50.895 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:23:50.893877+0000 2026-02-24T19:23:50.895 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:23:50.893877+0000 2026-02-24T19:23:50.895 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:50.895 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:50.895 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:50.895 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:50.895 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:50.896 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:50.897 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.893+0000 7f507e778640 1 Processor -- start 2026-02-24T19:23:50.897 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.893+0000 7f507e778640 1 -- start start 2026-02-24T19:23:50.897 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.893+0000 7f507e778640 10 monclient: init 2026-02-24T19:23:50.897 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.894+0000 7f507e778640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:50.897 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.894+0000 7f507e778640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:23:50.897 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.894+0000 7f507e778640 10 monclient(hunting): picked mon.noname-b con 0x7f5078157780 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:50.897 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.894+0000 7f507e778640 10 monclient(hunting): picked mon.noname-a con 0x7f5078157b50 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:50.898 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.894+0000 7f507e778640 10 monclient(hunting): picked mon.noname-c con 0x7f5078164d00 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:50.898 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.894+0000 7f507e778640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f507805de70 con 0x7f5078157b50 2026-02-24T19:23:50.898 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.894+0000 7f507e778640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5078055b20 con 0x7f5078157780 2026-02-24T19:23:50.898 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.894+0000 7f507e778640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5078055e00 con 0x7f5078164d00 2026-02-24T19:23:50.898 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.894+0000 7f507e778640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:50.898 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.894+0000 7f507e778640 10 monclient(hunting): authenticate will time out at 4005.575263s 2026-02-24T19:23:50.898 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.894+0000 7f50777fe640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f5078157b50 0x7f50781645f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:50872/0 (socket says 10.20.193.14:50872) 2026-02-24T19:23:50.898 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.894+0000 7f50777fe640 1 -- 10.20.193.14:0/933401626 learned_addr learned my addr 10.20.193.14:0/933401626 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:50.899 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.897+0000 7f5076ffd640 1 -- 10.20.193.14:0/933401626 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2068835621 0 0) 0x7f507805de70 con 0x7f5078157b50 2026-02-24T19:23:50.899 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.897+0000 7f5076ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:23:50.899 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.897+0000 7f5076ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:50.899 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.897+0000 7f5076ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:50.899 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.897+0000 7f5076ffd640 10 monclient(hunting): my global_id is 30804 2026-02-24T19:23:50.899 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.897+0000 7f5076ffd640 1 -- 10.20.193.14:0/933401626 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f505c003610 con 0x7f5078157b50 2026-02-24T19:23:50.903 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.900+0000 7f5076ffd640 1 -- 10.20.193.14:0/933401626 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1198215091 0 0) 0x7f505c003610 con 0x7f5078157b50 2026-02-24T19:23:50.903 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.901+0000 7f5076ffd640 1 -- 10.20.193.14:0/933401626 >> v1:10.20.193.170:6789/0 conn(0x7f5078164d00 legacy=0x7f50781c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:23:50.903 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.901+0000 7f5076ffd640 1 -- 10.20.193.14:0/933401626 >> v1:10.20.193.44:6789/0 conn(0x7f5078157780 legacy=0x7f5078056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:23:50.903 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.901+0000 7f5076ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:23:50.903 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.901+0000 7f5076ffd640 1 monclient: found mon.noname-a 2026-02-24T19:23:50.903 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.901+0000 7f5076ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:50.903 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.901+0000 7f5076ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:23:50.903 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.901+0000 7f5076ffd640 1 -- 10.20.193.14:0/933401626 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50780560e0 con 0x7f5078157b50 2026-02-24T19:23:50.903 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.901+0000 7f5076ffd640 10 monclient: _finish_auth 0 2026-02-24T19:23:50.903 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.901+0000 7f5076ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:23:50.904 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.901+0000 7f5076ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:50.904 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.901+0000 7f5076ffd640 1 -- 10.20.193.14:0/933401626 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5068002df0 con 0x7f5078157b50 2026-02-24T19:23:50.904 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.901+0000 7f507e778640 5 monclient: authenticate success, global_id 30804 2026-02-24T19:23:50.904 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.901+0000 7f507e778640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:50.904 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.901+0000 7f5076ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:50.904 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.901+0000 7f5076ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:23:50.904 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.901+0000 7f5076ffd640 10 monclient: dump: 2026-02-24T19:23:50.904 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:50.904 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:50.904 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.904 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.904 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:50.905 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:50.905 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:50.905 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:50.905 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:50.905 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:50.905 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.901+0000 7f507e778640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:50.906 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.902+0000 7f5076ffd640 1 -- 10.20.193.14:0/933401626 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5068003000 con 0x7f5078157b50 2026-02-24T19:23:50.906 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.902+0000 7f5076ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:50.906 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.902+0000 7f5076ffd640 1 -- 10.20.193.14:0/933401626 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5068003440 con 0x7f5078157b50 2026-02-24T19:23:50.906 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.902+0000 7f507e778640 10 monclient: get_monmap_and_config success 2026-02-24T19:23:50.906 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.902+0000 7f507e778640 4 set_mon_vals no callback set 2026-02-24T19:23:50.906 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.902+0000 7f5076ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:50.906 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.902+0000 7f5076ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:50.906 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.902+0000 7f5076ffd640 10 monclient: dump: 2026-02-24T19:23:50.906 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:50.906 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:50.907 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.907 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.907 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:50.907 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:50.907 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:50.907 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:50.907 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:50.907 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:50.907 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:07:25.165 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:50.910 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.902+0000 7f507e778640 10 monclient: shutdown 2026-02-24T19:23:50.910 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.902+0000 7f507e778640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:50.910 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.902+0000 7f507e778640 1 -- 10.20.193.14:0/933401626 >> v1:10.20.193.14:6789/0 conn(0x7f5078157b50 legacy=0x7f50781645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:50.910 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.902+0000 7f507e778640 1 -- 10.20.193.14:0/933401626 shutdown_connections 2026-02-24T19:23:50.910 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.902+0000 7f507e778640 1 -- 10.20.193.14:0/933401626 >> 10.20.193.14:0/933401626 conn(0x7f50780b2ef0 msgr2=0x7f50780b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:50.910 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.902+0000 7f507e778640 1 -- 10.20.193.14:0/933401626 shutdown_connections 2026-02-24T19:23:50.910 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.902+0000 7f507e778640 1 -- 10.20.193.14:0/933401626 wait complete. 2026-02-24T19:23:50.910 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.903+0000 7f507e778640 10 monclient: build_initial_monmap 2026-02-24T19:23:50.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.903+0000 7f507e778640 10 monclient: monmap: 2026-02-24T19:23:50.911 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:50.911 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:23:50.911 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:23:50.911 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:23:50.911 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:50.911 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:23:50.911 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:50.911 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:50.911 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:50.911 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:50.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.903+0000 7f507e778640 1 librados: starting msgr at 2026-02-24T19:23:50.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.903+0000 7f507e778640 1 librados: starting objecter 2026-02-24T19:23:50.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.903+0000 7f507e778640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:23:50.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.903+0000 7f507e778640 1 Processor -- start 2026-02-24T19:23:50.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.903+0000 7f507e778640 1 -- start start 2026-02-24T19:23:50.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.903+0000 7f507e778640 1 librados: setting wanted keys 2026-02-24T19:23:50.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.903+0000 7f507e778640 1 librados: calling monclient init 2026-02-24T19:23:50.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.903+0000 7f507e778640 10 monclient: init 2026-02-24T19:23:50.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.904+0000 7f507e778640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:50.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.904+0000 7f507e778640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:23:50.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.904+0000 7f507e778640 10 monclient(hunting): picked mon.noname-b con 0x7f5078157780 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:50.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.904+0000 7f507e778640 10 monclient(hunting): picked mon.noname-c con 0x7f5078157b50 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:50.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.904+0000 7f507e778640 10 monclient(hunting): picked mon.noname-a con 0x7f5078164d00 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:50.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.904+0000 7f507e778640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f507805bc70 con 0x7f5078164d00 2026-02-24T19:23:50.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.904+0000 7f507e778640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f507805bf50 con 0x7f5078157780 2026-02-24T19:23:50.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.904+0000 7f507e778640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f507805c230 con 0x7f5078157b50 2026-02-24T19:23:50.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.904+0000 7f507e778640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:50.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.904+0000 7f507e778640 10 monclient(hunting): authenticate will time out at 4005.585171s 2026-02-24T19:23:50.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.905+0000 7f507ccee640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f5078164d00 0x7f50781609b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:50874/0 (socket says 10.20.193.14:50874) 2026-02-24T19:23:50.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.905+0000 7f507ccee640 1 -- 10.20.193.14:0/1659196104 learned_addr learned my addr 10.20.193.14:0/1659196104 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:50.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.906+0000 7f5074ff9640 10 client.?.objecter ms_handle_connect 0x7f5078164d00 2026-02-24T19:23:50.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.906+0000 7f5074ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:50.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.908+0000 7f5074ff9640 1 -- 10.20.193.14:0/1659196104 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3277413337 0 0) 0x7f507805bc70 con 0x7f5078164d00 2026-02-24T19:23:50.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.908+0000 7f5074ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:23:50.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.908+0000 7f5074ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:50.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.908+0000 7f5074ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:50.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.908+0000 7f5074ff9640 10 monclient(hunting): my global_id is 30807 2026-02-24T19:23:50.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.908+0000 7f5074ff9640 1 -- 10.20.193.14:0/1659196104 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5048003610 con 0x7f5078164d00 2026-02-24T19:23:50.915 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.910+0000 7f5074ff9640 10 client.?.objecter ms_handle_connect 0x7f5078157780 2026-02-24T19:23:50.915 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.910+0000 7f5074ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:50.915 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:07:25.130 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:50.915 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:07:25.131 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:50.915 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:07:25.167 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:50.915 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:07:25.171 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:50.916 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.913+0000 7f5074ff9640 1 -- 10.20.193.14:0/1659196104 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 889618025 0 0) 0x7f5048003610 con 0x7f5078164d00 2026-02-24T19:23:50.916 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.913+0000 7f5074ff9640 1 -- 10.20.193.14:0/1659196104 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f507805bc70 con 0x7f5078164d00 2026-02-24T19:23:50.917 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.913+0000 7f5074ff9640 1 -- 10.20.193.14:0/1659196104 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f506c003230 con 0x7f5078164d00 2026-02-24T19:23:50.917 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.913+0000 7f5074ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:50.917 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.913+0000 7f5074ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:23:50.917 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.913+0000 7f5074ff9640 10 monclient(hunting): dump: 2026-02-24T19:23:50.917 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:50.917 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:50.917 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.917 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:50.917 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:50.917 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:50.917 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:50.917 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:50.918 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:50.918 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:50.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.913+0000 7f5074ff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:23:50.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.917+0000 7f5074ff9640 1 -- 10.20.193.14:0/1659196104 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1963962828 0 0) 0x7f507805bc70 con 0x7f5078164d00 2026-02-24T19:23:50.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.917+0000 7f5074ff9640 1 -- 10.20.193.14:0/1659196104 >> v1:10.20.193.170:6789/0 conn(0x7f5078157b50 legacy=0x7f50781569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:50.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.917+0000 7f5074ff9640 1 -- 10.20.193.14:0/1659196104 >> v1:10.20.193.44:6789/0 conn(0x7f5078157780 legacy=0x7f5078147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:50.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.917+0000 7f5074ff9640 10 monclient: _finish_hunting 0 2026-02-24T19:23:50.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.917+0000 7f5074ff9640 1 monclient: found mon.a 2026-02-24T19:23:50.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.917+0000 7f5074ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:50.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.917+0000 7f5074ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:50.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.917+0000 7f5074ff9640 1 -- 10.20.193.14:0/1659196104 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f507805c510 con 0x7f5078164d00 2026-02-24T19:23:50.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.917+0000 7f5074ff9640 10 monclient: _finish_auth 0 2026-02-24T19:23:50.921 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.917+0000 7f5074ff9640 10 monclient: _check_auth_tickets 2026-02-24T19:23:50.921 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.917+0000 7f5074ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:50.921 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.917+0000 7f507e778640 5 monclient: authenticate success, global_id 30807 2026-02-24T19:23:50.921 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.917+0000 7f507e778640 10 monclient: _renew_subs 2026-02-24T19:23:50.921 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.917+0000 7f507e778640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:50.921 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.917+0000 7f507e778640 1 -- 10.20.193.14:0/1659196104 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f507805c7f0 con 0x7f5078164d00 2026-02-24T19:23:50.921 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.917+0000 7f507e778640 10 client.30807.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:50.921 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.917+0000 7f507e778640 10 monclient: _renew_subs 2026-02-24T19:23:50.921 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.917+0000 7f507e778640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:50.921 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.917+0000 7f507e778640 1 -- 10.20.193.14:0/1659196104 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f507805d1d0 con 0x7f5078164d00 2026-02-24T19:23:50.921 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.917+0000 7f507e778640 1 librados: init done 2026-02-24T19:23:50.921 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.918+0000 7f507e778640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:50.922 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.918+0000 7f507e778640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:50.922 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.918+0000 7f507e778640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:50.922 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:50.918+0000 7f507e778640 1 -- 10.20.193.14:0/1659196104 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f507813bbf0 con 0x7f5078164d00 2026-02-24T19:23:50.929 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:07:25.150 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:50.933 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:07:25.192 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:51.016 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.014+0000 7f5074ff9640 1 -- 10.20.193.14:0/1659196104 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f506c0038b0 con 0x7f5078164d00 2026-02-24T19:23:51.016 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.014+0000 7f5074ff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:51.016 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.014+0000 7f5074ff9640 1 -- 10.20.193.14:0/1659196104 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f506c004e70 con 0x7f5078164d00 2026-02-24T19:23:51.016 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.014+0000 7f5074ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:51.016 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.014+0000 7f5074ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:51.016 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.014+0000 7f5074ff9640 10 monclient: dump: 2026-02-24T19:23:51.016 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:51.016 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:51.016 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.016 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.016 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:51.017 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:51.017 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:51.017 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:51.017 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:51.017 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:51.017 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.014+0000 7f50767fc640 4 set_mon_vals no callback set 2026-02-24T19:23:51.018 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.015+0000 7f5074ff9640 1 -- 10.20.193.14:0/1659196104 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f506c01dce0 con 0x7f5078164d00 2026-02-24T19:23:51.018 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.015+0000 7f5077fff640 10 monclient: get_auth_request con 0x7f5048077df0 auth_method 0 2026-02-24T19:23:51.018 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.015+0000 7f5074ff9640 10 client.30807.objecter ms_handle_connect 0x7f5048077df0 2026-02-24T19:23:51.020 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.018+0000 7f5074ff9640 1 -- 10.20.193.14:0/1659196104 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7f506c093650 con 0x7f5078164d00 2026-02-24T19:23:51.020 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.018+0000 7f5074ff9640 10 client.30807.objecter ms_dispatch2 0x7f5078000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:23:51.020 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.018+0000 7f5074ff9640 3 client.30807.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:23:51.021 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.018+0000 7f5074ff9640 3 client.30807.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:23:51.021 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.018+0000 7f5074ff9640 20 client.30807.objecter dump_active .. 0 homeless 2026-02-24T19:23:51.021 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.018+0000 7f5074ff9640 1 -- 10.20.193.14:0/1659196104 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f506c05e080 con 0x7f5078164d00 2026-02-24T19:23:51.021 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.019+0000 7f5074ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:51.021 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.019+0000 7f5074ff9640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:23:51.129 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.127+0000 7f507e778640 1 -- 10.20.193.14:0/1659196104 --> v1:10.20.193.14:6800/4014096310 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "9", "target": ["mon-mgr", ""]}) -- 0x7f5078157100 con 0x7f5048077df0 2026-02-24T19:23:51.129 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.127+0000 7f5074ff9640 1 -- 10.20.193.14:0/1659196104 <== mgr.4110 v1:10.20.193.14:6800/4014096310 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 9 to deep-scrub) ==== 41+0+0 (unknown 795720238 0 0) 0x7f5064004dd0 con 0x7f5048077df0 2026-02-24T19:23:51.129 INFO:teuthology.orchestra.run.trial014.stderr:instructed osd(s) 9 to deep-scrub 2026-02-24T19:23:51.132 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.129+0000 7f507e778640 10 librados: watch_flush enter 2026-02-24T19:23:51.132 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.129+0000 7f507e778640 10 librados: watch_flush exit 2026-02-24T19:23:51.132 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.129+0000 7f507e778640 20 client.30807.objecter shutdown clearing up homeless session... 2026-02-24T19:23:51.132 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.129+0000 7f507e778640 10 client.30807.objecter successfully canceled tick 2026-02-24T19:23:51.132 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.129+0000 7f507e778640 1 -- 10.20.193.14:0/1659196104 >> v1:10.20.193.14:6800/4014096310 conn(0x7f5048077df0 legacy=0x7f50480982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:51.132 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.129+0000 7f507e778640 10 monclient: shutdown 2026-02-24T19:23:51.132 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.129+0000 7f507e778640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:51.132 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.129+0000 7f507e778640 1 -- 10.20.193.14:0/1659196104 >> v1:10.20.193.14:6789/0 conn(0x7f5078164d00 legacy=0x7f50781609b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:51.132 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.129+0000 7f507e778640 1 -- 10.20.193.14:0/1659196104 shutdown_connections 2026-02-24T19:23:51.132 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.129+0000 7f507e778640 1 -- 10.20.193.14:0/1659196104 >> 10.20.193.14:0/1659196104 conn(0x7f50780b2ef0 msgr2=0x7f50780b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:51.133 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.130+0000 7f507e778640 1 -- 10.20.193.14:0/1659196104 shutdown_connections 2026-02-24T19:23:51.133 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.130+0000 7f507e778640 1 -- 10.20.193.14:0/1659196104 wait complete. 2026-02-24T19:23:51.133 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.130+0000 7f507e778640 1 librados: shutdown 2026-02-24T19:23:51.140 INFO:tasks.ceph:Scrubbing osd.13 2026-02-24T19:23:51.140 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:23:51.211 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.209+0000 7fe1e3acd640 10 monclient: get_monmap_and_config 2026-02-24T19:23:51.211 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.209+0000 7fe1e3acd640 10 monclient: build_initial_monmap 2026-02-24T19:23:51.211 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.209+0000 7fe1e3acd640 10 monclient: monmap: 2026-02-24T19:23:51.211 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:51.211 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:51.211 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:23:51.210120+0000 2026-02-24T19:23:51.211 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:23:51.210120+0000 2026-02-24T19:23:51.211 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:51.211 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:51.212 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:51.212 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:51.212 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:51.212 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:51.213 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.210+0000 7fe1e3acd640 1 Processor -- start 2026-02-24T19:23:51.213 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.210+0000 7fe1e3acd640 1 -- start start 2026-02-24T19:23:51.213 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.210+0000 7fe1e3acd640 10 monclient: init 2026-02-24T19:23:51.213 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.210+0000 7fe1e3acd640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:51.214 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.210+0000 7fe1e3acd640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:23:51.214 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.210+0000 7fe1e3acd640 10 monclient(hunting): picked mon.noname-c con 0x7fe1dc1667a0 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:51.214 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.210+0000 7fe1e3acd640 10 monclient(hunting): picked mon.noname-b con 0x7fe1dc165cf0 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:51.214 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.210+0000 7fe1e3acd640 10 monclient(hunting): picked mon.noname-a con 0x7fe1dc159b10 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:51.214 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.210+0000 7fe1e3acd640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1dc05e260 con 0x7fe1dc159b10 2026-02-24T19:23:51.214 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.210+0000 7fe1e3acd640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1dc164540 con 0x7fe1dc165cf0 2026-02-24T19:23:51.214 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.210+0000 7fe1e3acd640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1dc164820 con 0x7fe1dc1667a0 2026-02-24T19:23:51.214 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.210+0000 7fe1e3acd640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:51.214 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.210+0000 7fe1e3acd640 10 monclient(hunting): authenticate will time out at 4005.891592s 2026-02-24T19:23:51.214 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.211+0000 7fe1e1041640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7fe1dc165cf0 0x7fe1dc159400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:40132/0 (socket says 10.20.193.14:40132) 2026-02-24T19:23:51.214 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.211+0000 7fe1e1041640 1 -- 10.20.193.14:0/2444979694 learned_addr learned my addr 10.20.193.14:0/2444979694 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:51.218 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.212+0000 7fe1e0840640 1 -- 10.20.193.14:0/2444979694 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3150421821 0 0) 0x7fe1dc164540 con 0x7fe1dc165cf0 2026-02-24T19:23:51.218 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.212+0000 7fe1e0840640 10 monclient(hunting): _negotiate 2026-02-24T19:23:51.218 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.212+0000 7fe1e0840640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:51.219 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.212+0000 7fe1e0840640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:51.219 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.212+0000 7fe1e0840640 10 monclient(hunting): my global_id is 29128 2026-02-24T19:23:51.219 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.212+0000 7fe1e0840640 1 -- 10.20.193.14:0/2444979694 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1c4003610 con 0x7fe1dc165cf0 2026-02-24T19:23:51.219 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.212+0000 7fe1e0840640 1 -- 10.20.193.14:0/2444979694 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3032624910 0 0) 0x7fe1dc164820 con 0x7fe1dc1667a0 2026-02-24T19:23:51.219 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.212+0000 7fe1e0840640 10 monclient(hunting): _negotiate 2026-02-24T19:23:51.219 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.212+0000 7fe1e0840640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:51.219 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.212+0000 7fe1e0840640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:51.219 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.212+0000 7fe1e0840640 10 monclient(hunting): my global_id is 28763 2026-02-24T19:23:51.219 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.212+0000 7fe1e0840640 1 -- 10.20.193.14:0/2444979694 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1dc164540 con 0x7fe1dc1667a0 2026-02-24T19:23:51.219 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.214+0000 7fe1e0840640 1 -- 10.20.193.14:0/2444979694 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 126930304 0 0) 0x7fe1c4003610 con 0x7fe1dc165cf0 2026-02-24T19:23:51.219 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.214+0000 7fe1e0840640 1 -- 10.20.193.14:0/2444979694 >> v1:10.20.193.170:6789/0 conn(0x7fe1dc1667a0 legacy=0x7fe1dc1655e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:51.220 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.214+0000 7fe1e0840640 1 -- 10.20.193.14:0/2444979694 >> v1:10.20.193.14:6789/0 conn(0x7fe1dc159b10 legacy=0x7fe1dc1c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:51.220 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.214+0000 7fe1e0840640 10 monclient: _finish_hunting 0 2026-02-24T19:23:51.220 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.214+0000 7fe1e0840640 1 monclient: found mon.noname-b 2026-02-24T19:23:51.220 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.214+0000 7fe1e0840640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:51.220 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.214+0000 7fe1e0840640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.44:6789/0 2026-02-24T19:23:51.220 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.214+0000 7fe1e0840640 1 -- 10.20.193.14:0/2444979694 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1dc164b00 con 0x7fe1dc165cf0 2026-02-24T19:23:51.220 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.214+0000 7fe1e0840640 10 monclient: _finish_auth 0 2026-02-24T19:23:51.220 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.214+0000 7fe1e0840640 10 monclient: _check_auth_tickets 2026-02-24T19:23:51.220 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.214+0000 7fe1e0840640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:51.220 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.214+0000 7fe1e0840640 1 -- 10.20.193.14:0/2444979694 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fe1d0002df0 con 0x7fe1dc165cf0 2026-02-24T19:23:51.220 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.214+0000 7fe1e0840640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:51.220 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.214+0000 7fe1e0840640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:23:51.221 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.214+0000 7fe1e0840640 10 monclient: dump: 2026-02-24T19:23:51.221 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:51.221 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:51.221 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.221 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.221 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:51.221 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:51.221 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:51.221 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:51.221 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:51.221 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:51.221 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.214+0000 7fe1e3acd640 5 monclient: authenticate success, global_id 29128 2026-02-24T19:23:51.222 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.214+0000 7fe1e3acd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:51.222 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.215+0000 7fe1e0840640 1 -- 10.20.193.14:0/2444979694 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe1d0003000 con 0x7fe1dc165cf0 2026-02-24T19:23:51.222 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.215+0000 7fe1e0840640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:51.222 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.215+0000 7fe1e0840640 1 -- 10.20.193.14:0/2444979694 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fe1d0003440 con 0x7fe1dc165cf0 2026-02-24T19:23:51.222 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.215+0000 7fe1e0840640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:51.222 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.215+0000 7fe1e0840640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:51.222 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.215+0000 7fe1e0840640 10 monclient: dump: 2026-02-24T19:23:51.222 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:51.222 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:51.222 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.222 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.222 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:51.222 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:51.223 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:51.223 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:51.223 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:51.223 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:51.223 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.215+0000 7fe1e3acd640 10 monclient: get_monmap_and_config success 2026-02-24T19:23:51.223 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.215+0000 7fe1e3acd640 4 set_mon_vals no callback set 2026-02-24T19:23:51.223 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.215+0000 7fe1e3acd640 10 monclient: shutdown 2026-02-24T19:23:51.223 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.215+0000 7fe1e3acd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:51.223 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.215+0000 7fe1e3acd640 1 -- 10.20.193.14:0/2444979694 >> v1:10.20.193.44:6789/0 conn(0x7fe1dc165cf0 legacy=0x7fe1dc159400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:51.223 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.215+0000 7fe1e3acd640 1 -- 10.20.193.14:0/2444979694 shutdown_connections 2026-02-24T19:23:51.223 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.215+0000 7fe1e3acd640 1 -- 10.20.193.14:0/2444979694 >> 10.20.193.14:0/2444979694 conn(0x7fe1dc0b2f60 msgr2=0x7fe1dc0b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:51.223 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.215+0000 7fe1e3acd640 1 -- 10.20.193.14:0/2444979694 shutdown_connections 2026-02-24T19:23:51.224 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.215+0000 7fe1e3acd640 1 -- 10.20.193.14:0/2444979694 wait complete. 2026-02-24T19:23:51.224 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.215+0000 7fe1e3acd640 10 monclient: build_initial_monmap 2026-02-24T19:23:51.224 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.215+0000 7fe1e3acd640 10 monclient: monmap: 2026-02-24T19:23:51.224 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:51.224 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:23:51.224 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:23:51.224 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:23:51.224 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:51.224 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:23:51.224 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:51.224 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:51.224 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:51.224 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:51.225 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.215+0000 7fe1e3acd640 1 librados: starting msgr at 2026-02-24T19:23:51.225 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.215+0000 7fe1e3acd640 1 librados: starting objecter 2026-02-24T19:23:51.225 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.215+0000 7fe1e3acd640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:23:51.225 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.215+0000 7fe1e3acd640 1 Processor -- start 2026-02-24T19:23:51.225 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.216+0000 7fe1e3acd640 1 -- start start 2026-02-24T19:23:51.225 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.216+0000 7fe1e3acd640 1 librados: setting wanted keys 2026-02-24T19:23:51.225 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.216+0000 7fe1e3acd640 1 librados: calling monclient init 2026-02-24T19:23:51.225 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.216+0000 7fe1e3acd640 10 monclient: init 2026-02-24T19:23:51.225 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.216+0000 7fe1e3acd640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:51.225 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.216+0000 7fe1e3acd640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:23:51.225 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.216+0000 7fe1e3acd640 10 monclient(hunting): picked mon.noname-c con 0x7fe1dc159b10 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:51.225 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.216+0000 7fe1e3acd640 10 monclient(hunting): picked mon.noname-a con 0x7fe1dc165cf0 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:51.226 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.216+0000 7fe1e3acd640 10 monclient(hunting): picked mon.noname-b con 0x7fe1dc1667a0 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:51.226 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.216+0000 7fe1e3acd640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1dc15ae30 con 0x7fe1dc165cf0 2026-02-24T19:23:51.226 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.216+0000 7fe1e3acd640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1dc15a590 con 0x7fe1dc1667a0 2026-02-24T19:23:51.226 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.216+0000 7fe1e3acd640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1dc15a870 con 0x7fe1dc159b10 2026-02-24T19:23:51.226 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.216+0000 7fe1e3acd640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:51.226 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.216+0000 7fe1e3acd640 10 monclient(hunting): authenticate will time out at 4005.897390s 2026-02-24T19:23:51.226 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.216+0000 7fe1e2043640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7fe1dc1667a0 0x7fe1dc13f7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:40138/0 (socket says 10.20.193.14:40138) 2026-02-24T19:23:51.226 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.216+0000 7fe1e2043640 1 -- 10.20.193.14:0/238593850 learned_addr learned my addr 10.20.193.14:0/238593850 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:51.226 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.216+0000 7fe1ca7fc640 10 client.?.objecter ms_handle_connect 0x7fe1dc1667a0 2026-02-24T19:23:51.226 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.216+0000 7fe1ca7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:51.226 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.217+0000 7fe1ca7fc640 10 client.?.objecter ms_handle_connect 0x7fe1dc159b10 2026-02-24T19:23:51.226 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.217+0000 7fe1ca7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:51.229 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.217+0000 7fe1ca7fc640 1 -- 10.20.193.14:0/238593850 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 700066554 0 0) 0x7fe1dc15a590 con 0x7fe1dc1667a0 2026-02-24T19:23:51.230 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.217+0000 7fe1ca7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:23:51.230 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.217+0000 7fe1ca7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:51.230 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.217+0000 7fe1ca7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:51.230 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.217+0000 7fe1ca7fc640 10 monclient(hunting): my global_id is 29131 2026-02-24T19:23:51.230 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.217+0000 7fe1ca7fc640 1 -- 10.20.193.14:0/238593850 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1ac003610 con 0x7fe1dc1667a0 2026-02-24T19:23:51.230 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.218+0000 7fe1ca7fc640 1 -- 10.20.193.14:0/238593850 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4272250016 0 0) 0x7fe1dc15a870 con 0x7fe1dc159b10 2026-02-24T19:23:51.230 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.218+0000 7fe1ca7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:23:51.230 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.218+0000 7fe1ca7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:51.230 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.218+0000 7fe1ca7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:51.230 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.218+0000 7fe1ca7fc640 10 monclient(hunting): my global_id is 28766 2026-02-24T19:23:51.231 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.218+0000 7fe1ca7fc640 1 -- 10.20.193.14:0/238593850 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1dc15a590 con 0x7fe1dc159b10 2026-02-24T19:23:51.231 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.218+0000 7fe1ca7fc640 10 client.?.objecter ms_handle_connect 0x7fe1dc165cf0 2026-02-24T19:23:51.231 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.218+0000 7fe1ca7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:51.231 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.220+0000 7fe1ca7fc640 1 -- 10.20.193.14:0/238593850 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1556636618 0 0) 0x7fe1ac003610 con 0x7fe1dc1667a0 2026-02-24T19:23:51.231 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.220+0000 7fe1ca7fc640 1 -- 10.20.193.14:0/238593850 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe1dc15a870 con 0x7fe1dc1667a0 2026-02-24T19:23:51.231 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.220+0000 7fe1ca7fc640 1 -- 10.20.193.14:0/238593850 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fe1d8003490 con 0x7fe1dc1667a0 2026-02-24T19:23:51.231 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.220+0000 7fe1ca7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:51.231 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.220+0000 7fe1ca7fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:23:51.231 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.220+0000 7fe1ca7fc640 10 monclient(hunting): dump: 2026-02-24T19:23:51.231 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:51.231 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:51.231 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.231 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.232 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:51.232 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:51.232 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:51.232 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:51.232 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:51.232 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:51.232 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.220+0000 7fe1ca7fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:23:51.232 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.220+0000 7fe1ca7fc640 1 -- 10.20.193.14:0/238593850 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1377278606 0 0) 0x7fe1dc15a590 con 0x7fe1dc159b10 2026-02-24T19:23:51.232 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.220+0000 7fe1ca7fc640 1 -- 10.20.193.14:0/238593850 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe1ac003610 con 0x7fe1dc159b10 2026-02-24T19:23:51.232 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.220+0000 7fe1ca7fc640 1 -- 10.20.193.14:0/238593850 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fe1cc002f60 con 0x7fe1dc159b10 2026-02-24T19:23:51.232 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.220+0000 7fe1ca7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:51.232 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.220+0000 7fe1ca7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:51.232 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.220+0000 7fe1ca7fc640 10 monclient(hunting): dump: 2026-02-24T19:23:51.233 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:51.233 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:51.233 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.233 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.233 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:51.233 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:51.233 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:51.233 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:51.233 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:51.233 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:51.233 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.220+0000 7fe1ca7fc640 1 -- 10.20.193.14:0/238593850 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1362670171 0 0) 0x7fe1dc15ae30 con 0x7fe1dc165cf0 2026-02-24T19:23:51.233 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.220+0000 7fe1ca7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:23:51.234 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.220+0000 7fe1ca7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:51.234 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.220+0000 7fe1ca7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:51.234 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.220+0000 7fe1ca7fc640 10 monclient(hunting): my global_id is 30813 2026-02-24T19:23:51.234 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.220+0000 7fe1ca7fc640 1 -- 10.20.193.14:0/238593850 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1dc15a590 con 0x7fe1dc165cf0 2026-02-24T19:23:51.234 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.221+0000 7fe1ca7fc640 1 -- 10.20.193.14:0/238593850 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3339751342 0 0) 0x7fe1ac003610 con 0x7fe1dc159b10 2026-02-24T19:23:51.234 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.222+0000 7fe1ca7fc640 1 -- 10.20.193.14:0/238593850 >> v1:10.20.193.44:6789/0 conn(0x7fe1dc1667a0 legacy=0x7fe1dc13f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:51.234 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.222+0000 7fe1ca7fc640 1 -- 10.20.193.14:0/238593850 >> v1:10.20.193.14:6789/0 conn(0x7fe1dc165cf0 legacy=0x7fe1dc0596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:51.234 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.222+0000 7fe1ca7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:23:51.234 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.222+0000 7fe1ca7fc640 1 monclient: found mon.c 2026-02-24T19:23:51.234 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.222+0000 7fe1ca7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:51.234 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.222+0000 7fe1ca7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:51.234 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.222+0000 7fe1ca7fc640 1 -- 10.20.193.14:0/238593850 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1dc15ab50 con 0x7fe1dc159b10 2026-02-24T19:23:51.234 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.222+0000 7fe1ca7fc640 10 monclient: _finish_auth 0 2026-02-24T19:23:51.235 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.222+0000 7fe1ca7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:23:51.235 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.222+0000 7fe1ca7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:51.235 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.222+0000 7fe1e3acd640 5 monclient: authenticate success, global_id 28766 2026-02-24T19:23:51.235 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.222+0000 7fe1e3acd640 10 monclient: _renew_subs 2026-02-24T19:23:51.235 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.222+0000 7fe1e3acd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:51.235 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.222+0000 7fe1e3acd640 1 -- 10.20.193.14:0/238593850 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe1dc15b150 con 0x7fe1dc159b10 2026-02-24T19:23:51.235 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.222+0000 7fe1e3acd640 10 client.28766.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:51.235 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.222+0000 7fe1e3acd640 10 monclient: _renew_subs 2026-02-24T19:23:51.235 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.222+0000 7fe1e3acd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:51.235 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.222+0000 7fe1e3acd640 1 -- 10.20.193.14:0/238593850 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe1dc15c240 con 0x7fe1dc159b10 2026-02-24T19:23:51.235 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.222+0000 7fe1e3acd640 1 librados: init done 2026-02-24T19:23:51.235 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.222+0000 7fe1e3acd640 10 client.28766.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:51.235 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.222+0000 7fe1e3acd640 15 client.28766.objecter _session_command_op_assign -1 1 2026-02-24T19:23:51.236 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.222+0000 7fe1e3acd640 20 client.28766.objecter _get_session osd=-1 returning homeless 2026-02-24T19:23:51.236 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.222+0000 7fe1e3acd640 10 client.28766.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:51.236 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.222+0000 7fe1e3acd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:51.236 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.222+0000 7fe1e3acd640 1 -- 10.20.193.14:0/238593850 --> v1:10.20.193.170:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fe1dc1607b0 con 0x7fe1dc159b10 2026-02-24T19:23:51.238 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.230+0000 7fe1ca7fc640 1 -- 10.20.193.14:0/238593850 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe1dc1607b0 con 0x7fe1dc159b10 2026-02-24T19:23:51.238 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.230+0000 7fe1ca7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:51.238 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.230+0000 7fe1ca7fc640 1 -- 10.20.193.14:0/238593850 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fe1cc003700 con 0x7fe1dc159b10 2026-02-24T19:23:51.238 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.230+0000 7fe1ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:51.238 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.230+0000 7fe1ca7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:51.238 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.230+0000 7fe1ca7fc640 10 monclient: dump: 2026-02-24T19:23:51.239 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:51.239 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:51.239 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.239 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.239 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:51.239 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:51.239 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:51.239 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:51.239 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:51.239 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:51.239 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.230+0000 7fe1cbfff640 4 set_mon_vals no callback set 2026-02-24T19:23:51.239 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.231+0000 7fe1ca7fc640 1 -- 10.20.193.14:0/238593850 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7fe1cc0038a0 con 0x7fe1dc159b10 2026-02-24T19:23:51.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.232+0000 7fe1e1041640 10 monclient: get_auth_request con 0x7fe1ac077d70 auth_method 0 2026-02-24T19:23:51.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.232+0000 7fe1ca7fc640 10 client.28766.objecter ms_handle_connect 0x7fe1ac077d70 2026-02-24T19:23:51.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.232+0000 7fe1ca7fc640 1 -- 10.20.193.14:0/238593850 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7fe1cc091e70 con 0x7fe1dc159b10 2026-02-24T19:23:51.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.232+0000 7fe1ca7fc640 10 client.28766.objecter ms_dispatch2 0x7fe1dc000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:23:51.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.232+0000 7fe1ca7fc640 3 client.28766.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:23:51.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.232+0000 7fe1ca7fc640 3 client.28766.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:23:51.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.232+0000 7fe1ca7fc640 10 client.28766.objecter checking command 1 2026-02-24T19:23:51.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.232+0000 7fe1ca7fc640 20 client.28766.objecter _get_session s=0x7fe1ac0a2090 osd=13 3 2026-02-24T19:23:51.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.232+0000 7fe1ca7fc640 20 client.28766.objecter put_session s=0x7fe1ac0a2090 osd=13 3 2026-02-24T19:23:51.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.232+0000 7fe1ca7fc640 15 client.28766.objecter _session_command_op_remove -1 1 2026-02-24T19:23:51.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.232+0000 7fe1ca7fc640 20 client.28766.objecter _get_session s=0x7fe1ac0a2090 osd=13 3 2026-02-24T19:23:51.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.232+0000 7fe1ca7fc640 20 client.28766.objecter get_session s=0x7fe1ac0a2090 osd=13 3 2026-02-24T19:23:51.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.232+0000 7fe1ca7fc640 15 client.28766.objecter _session_command_op_assign 13 1 2026-02-24T19:23:51.241 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.232+0000 7fe1ca7fc640 20 client.28766.objecter put_session s=0x7fe1ac0a2090 osd=13 4 2026-02-24T19:23:51.241 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.232+0000 7fe1ca7fc640 10 client.28766.objecter _send_command 1 2026-02-24T19:23:51.241 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.232+0000 7fe1ca7fc640 1 -- 10.20.193.14:0/238593850 --> v1:10.20.193.44:6800/3795416779 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe1ac0c43a0 con 0x7fe1ac0a2740 2026-02-24T19:23:51.241 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.232+0000 7fe1ca7fc640 20 client.28766.objecter dump_active .. 0 homeless 2026-02-24T19:23:51.241 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.232+0000 7fe1ca7fc640 1 -- 10.20.193.14:0/238593850 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_get_version_reply(handle=1 version=354) ==== 24+0+0 (unknown 31317031 0 0) 0x7fe1cc05bf70 con 0x7fe1dc159b10 2026-02-24T19:23:51.241 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.232+0000 7fe1ca7fc640 10 monclient: handle_get_version_reply finishing 1 version 354 2026-02-24T19:23:51.241 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.233+0000 7fe1e2043640 10 monclient: get_auth_request con 0x7fe1ac0a2740 auth_method 0 2026-02-24T19:23:51.241 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.234+0000 7fe1ca7fc640 10 client.28766.objecter ms_handle_connect 0x7fe1ac0a2740 2026-02-24T19:23:51.244 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.243+0000 7fe1ca7fc640 1 -- 10.20.193.14:0/238593850 <== osd.13 v1:10.20.193.44:6800/3795416779 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fe1ac0c43a0 con 0x7fe1ac0a2740 2026-02-24T19:23:51.245 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.243+0000 7fe1ca7fc640 10 client.28766.objecter ms_dispatch2 0x7fe1dc000b90 command_reply(tid 1: 0 ) 2026-02-24T19:23:51.245 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.243+0000 7fe1ca7fc640 10 client.28766.objecter _finish_command 1 = system:0 2026-02-24T19:23:51.245 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.243+0000 7fe1ca7fc640 20 client.28766.objecter put_session s=0x7fe1ac0a2090 osd=13 4 2026-02-24T19:23:51.245 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.243+0000 7fe1ca7fc640 15 client.28766.objecter _session_command_op_remove 13 1 2026-02-24T19:23:51.252 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.250+0000 7fe1e3acd640 10 client.28766.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:23:51.252 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.250+0000 7fe1e3acd640 15 client.28766.objecter _session_command_op_assign -1 2 2026-02-24T19:23:51.252 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.250+0000 7fe1e3acd640 20 client.28766.objecter _get_session s=0x7fe1ac0a2090 osd=13 3 2026-02-24T19:23:51.252 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.250+0000 7fe1e3acd640 20 client.28766.objecter put_session s=0x7fe1ac0a2090 osd=13 3 2026-02-24T19:23:51.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.250+0000 7fe1e3acd640 20 client.28766.objecter _get_session s=0x7fe1ac0a2090 osd=13 3 2026-02-24T19:23:51.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.250+0000 7fe1e3acd640 15 client.28766.objecter _session_command_op_remove -1 2 2026-02-24T19:23:51.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.250+0000 7fe1e3acd640 20 client.28766.objecter get_session s=0x7fe1ac0a2090 osd=13 3 2026-02-24T19:23:51.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.250+0000 7fe1e3acd640 15 client.28766.objecter _session_command_op_assign 13 2 2026-02-24T19:23:51.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.250+0000 7fe1e3acd640 20 client.28766.objecter put_session s=0x7fe1ac0a2090 osd=13 4 2026-02-24T19:23:51.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.250+0000 7fe1e3acd640 10 client.28766.objecter _send_command 2 2026-02-24T19:23:51.253 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.250+0000 7fe1e3acd640 1 -- 10.20.193.14:0/238593850 --> v1:10.20.193.44:6800/3795416779 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe1dc059180 con 0x7fe1ac0a2740 2026-02-24T19:23:51.259 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.258+0000 7fe1ca7fc640 1 -- 10.20.193.14:0/238593850 <== osd.13 v1:10.20.193.44:6800/3795416779 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fe1dc059180 con 0x7fe1ac0a2740 2026-02-24T19:23:51.260 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.258+0000 7fe1ca7fc640 10 client.28766.objecter ms_dispatch2 0x7fe1dc000b90 command_reply(tid 2: 0 ) 2026-02-24T19:23:51.260 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.258+0000 7fe1ca7fc640 10 client.28766.objecter _finish_command 2 = system:0 2026-02-24T19:23:51.260 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.258+0000 7fe1ca7fc640 20 client.28766.objecter put_session s=0x7fe1ac0a2090 osd=13 4 2026-02-24T19:23:51.260 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.258+0000 7fe1ca7fc640 15 client.28766.objecter _session_command_op_remove 13 2 2026-02-24T19:23:51.260 INFO:teuthology.orchestra.run.trial014.stdout:{ 2026-02-24T19:23:51.260 INFO:teuthology.orchestra.run.trial014.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:23:51.260 INFO:teuthology.orchestra.run.trial014.stdout:} 2026-02-24T19:23:51.262 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.258+0000 7fe1e3acd640 10 librados: watch_flush enter 2026-02-24T19:23:51.262 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.258+0000 7fe1e3acd640 10 librados: watch_flush exit 2026-02-24T19:23:51.262 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.258+0000 7fe1e3acd640 10 client.28766.objecter close_session for osd.13 2026-02-24T19:23:51.262 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.258+0000 7fe1e3acd640 1 -- 10.20.193.14:0/238593850 >> v1:10.20.193.44:6800/3795416779 conn(0x7fe1ac0a2740 legacy=0x7fe1ac0c2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:51.262 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.258+0000 7fe1e3acd640 20 client.28766.objecter put_session s=0x7fe1ac0a2090 osd=13 1 2026-02-24T19:23:51.262 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.258+0000 7fe1e3acd640 20 client.28766.objecter shutdown clearing up homeless session... 2026-02-24T19:23:51.262 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.258+0000 7fe1e3acd640 10 client.28766.objecter successfully canceled tick 2026-02-24T19:23:51.262 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.258+0000 7fe1e3acd640 1 -- 10.20.193.14:0/238593850 >> v1:10.20.193.14:6800/4014096310 conn(0x7fe1ac077d70 legacy=0x7fe1ac098220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:51.262 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.258+0000 7fe1e3acd640 10 monclient: shutdown 2026-02-24T19:23:51.263 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.258+0000 7fe1e3acd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:51.263 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.258+0000 7fe1e3acd640 1 -- 10.20.193.14:0/238593850 >> v1:10.20.193.170:6789/0 conn(0x7fe1dc159b10 legacy=0x7fe1dc15b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:51.263 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.258+0000 7fe1e2043640 1 -- 10.20.193.14:0/238593850 reap_dead start 2026-02-24T19:23:51.263 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.258+0000 7fe1e3acd640 1 -- 10.20.193.14:0/238593850 shutdown_connections 2026-02-24T19:23:51.263 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.258+0000 7fe1e3acd640 1 -- 10.20.193.14:0/238593850 >> 10.20.193.14:0/238593850 conn(0x7fe1dc0b2f60 msgr2=0x7fe1dc1591d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:51.263 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.258+0000 7fe1e3acd640 1 -- 10.20.193.14:0/238593850 shutdown_connections 2026-02-24T19:23:51.263 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.258+0000 7fe1e3acd640 1 -- 10.20.193.14:0/238593850 wait complete. 2026-02-24T19:23:51.263 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.258+0000 7fe1e3acd640 1 librados: shutdown 2026-02-24T19:23:51.268 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 13 2026-02-24T19:23:51.337 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.336+0000 7fcf37a13640 10 monclient: get_monmap_and_config 2026-02-24T19:23:51.338 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.336+0000 7fcf37a13640 10 monclient: build_initial_monmap 2026-02-24T19:23:51.338 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.336+0000 7fcf37a13640 10 monclient: monmap: 2026-02-24T19:23:51.338 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:51.338 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:51.338 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:23:51.336897+0000 2026-02-24T19:23:51.338 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:23:51.336897+0000 2026-02-24T19:23:51.338 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:51.338 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:51.338 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:51.338 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:51.339 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:51.339 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:51.340 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.336+0000 7fcf37a13640 1 Processor -- start 2026-02-24T19:23:51.340 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.336+0000 7fcf37a13640 1 -- start start 2026-02-24T19:23:51.340 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.336+0000 7fcf37a13640 10 monclient: init 2026-02-24T19:23:51.340 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.337+0000 7fcf37a13640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:51.340 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.337+0000 7fcf37a13640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:23:51.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.337+0000 7fcf37a13640 10 monclient(hunting): picked mon.noname-a con 0x7fcf300b9f80 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:51.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.337+0000 7fcf37a13640 10 monclient(hunting): picked mon.noname-b con 0x7fcf300ba350 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:51.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.337+0000 7fcf37a13640 10 monclient(hunting): picked mon.noname-c con 0x7fcf300585e0 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:51.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.337+0000 7fcf37a13640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf30163930 con 0x7fcf300b9f80 2026-02-24T19:23:51.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.337+0000 7fcf37a13640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf30163bb0 con 0x7fcf300ba350 2026-02-24T19:23:51.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.337+0000 7fcf37a13640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf30163e90 con 0x7fcf300585e0 2026-02-24T19:23:51.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.337+0000 7fcf37a13640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:51.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.337+0000 7fcf37a13640 10 monclient(hunting): authenticate will time out at 4006.018676s 2026-02-24T19:23:51.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.337+0000 7fcf35788640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7fcf300b9f80 0x7fcf30163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:50902/0 (socket says 10.20.193.14:50902) 2026-02-24T19:23:51.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.337+0000 7fcf35788640 1 -- 10.20.193.14:0/24727776 learned_addr learned my addr 10.20.193.14:0/24727776 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:51.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.339+0000 7fcf1ffff640 1 -- 10.20.193.14:0/24727776 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2860641113 0 0) 0x7fcf20002910 con 0x7fcf300b9f80 2026-02-24T19:23:51.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.339+0000 7fcf1ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:23:51.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.339+0000 7fcf1ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:51.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.339+0000 7fcf1ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:51.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.339+0000 7fcf1ffff640 10 monclient(hunting): my global_id is 30816 2026-02-24T19:23:51.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.339+0000 7fcf1ffff640 1 -- 10.20.193.14:0/24727776 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf18003610 con 0x7fcf300b9f80 2026-02-24T19:23:51.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.339+0000 7fcf1ffff640 1 -- 10.20.193.14:0/24727776 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1045838018 0 0) 0x7fcf30163e90 con 0x7fcf300585e0 2026-02-24T19:23:51.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.339+0000 7fcf1ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:23:51.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.339+0000 7fcf1ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:51.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.339+0000 7fcf1ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:51.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.339+0000 7fcf1ffff640 10 monclient(hunting): my global_id is 28769 2026-02-24T19:23:51.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.339+0000 7fcf1ffff640 1 -- 10.20.193.14:0/24727776 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf20002910 con 0x7fcf300585e0 2026-02-24T19:23:51.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.339+0000 7fcf1ffff640 1 -- 10.20.193.14:0/24727776 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4251086405 0 0) 0x7fcf30163bb0 con 0x7fcf300ba350 2026-02-24T19:23:51.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.339+0000 7fcf1ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:23:51.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.339+0000 7fcf1ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:51.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.339+0000 7fcf1ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:51.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.339+0000 7fcf1ffff640 10 monclient(hunting): my global_id is 29134 2026-02-24T19:23:51.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.339+0000 7fcf1ffff640 1 -- 10.20.193.14:0/24727776 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf30163e90 con 0x7fcf300ba350 2026-02-24T19:23:51.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.341+0000 7fcf1ffff640 1 -- 10.20.193.14:0/24727776 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 701261660 0 0) 0x7fcf20002910 con 0x7fcf300585e0 2026-02-24T19:23:51.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.341+0000 7fcf1ffff640 1 -- 10.20.193.14:0/24727776 >> v1:10.20.193.44:6789/0 conn(0x7fcf300ba350 legacy=0x7fcf30057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:51.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.341+0000 7fcf1ffff640 1 -- 10.20.193.14:0/24727776 >> v1:10.20.193.14:6789/0 conn(0x7fcf300b9f80 legacy=0x7fcf30163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:51.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.341+0000 7fcf1ffff640 10 monclient: _finish_hunting 0 2026-02-24T19:23:51.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.341+0000 7fcf1ffff640 1 monclient: found mon.noname-c 2026-02-24T19:23:51.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.341+0000 7fcf1ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:51.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.341+0000 7fcf1ffff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.170:6789/0 2026-02-24T19:23:51.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.341+0000 7fcf1ffff640 1 -- 10.20.193.14:0/24727776 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf300573f0 con 0x7fcf300585e0 2026-02-24T19:23:51.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.341+0000 7fcf1ffff640 10 monclient: _finish_auth 0 2026-02-24T19:23:51.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.341+0000 7fcf1ffff640 10 monclient: _check_auth_tickets 2026-02-24T19:23:51.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.341+0000 7fcf1ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:51.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.341+0000 7fcf1ffff640 1 -- 10.20.193.14:0/24727776 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fcf2c003170 con 0x7fcf300585e0 2026-02-24T19:23:51.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.341+0000 7fcf37a13640 5 monclient: authenticate success, global_id 28769 2026-02-24T19:23:51.349 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.341+0000 7fcf37a13640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:51.349 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.341+0000 7fcf1ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:51.349 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.341+0000 7fcf1ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:23:51.349 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.341+0000 7fcf1ffff640 10 monclient: dump: 2026-02-24T19:23:51.349 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:51.349 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:51.349 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.349 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.349 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:51.349 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:51.349 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:51.349 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:51.349 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:51.350 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:51.350 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.341+0000 7fcf37a13640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:51.350 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.341+0000 7fcf1ffff640 1 -- 10.20.193.14:0/24727776 <== mon.2 v1:10.20.193.170:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcf2c003340 con 0x7fcf300585e0 2026-02-24T19:23:51.350 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.341+0000 7fcf1ffff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:51.350 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.341+0000 7fcf1ffff640 1 -- 10.20.193.14:0/24727776 <== mon.2 v1:10.20.193.170:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fcf2c003780 con 0x7fcf300585e0 2026-02-24T19:23:51.350 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.341+0000 7fcf1ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:51.350 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.341+0000 7fcf1ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:51.350 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.341+0000 7fcf1ffff640 10 monclient: dump: 2026-02-24T19:23:51.350 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:51.350 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:51.350 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.350 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.351 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:51.351 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:51.351 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:51.351 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:51.351 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:51.351 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:51.351 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.341+0000 7fcf37a13640 10 monclient: get_monmap_and_config success 2026-02-24T19:23:51.351 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.341+0000 7fcf37a13640 4 set_mon_vals no callback set 2026-02-24T19:23:51.351 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.342+0000 7fcf37a13640 10 monclient: shutdown 2026-02-24T19:23:51.351 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.342+0000 7fcf37a13640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:51.351 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.342+0000 7fcf37a13640 1 -- 10.20.193.14:0/24727776 >> v1:10.20.193.170:6789/0 conn(0x7fcf300585e0 legacy=0x7fcf30166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:51.351 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.342+0000 7fcf37a13640 1 -- 10.20.193.14:0/24727776 shutdown_connections 2026-02-24T19:23:51.351 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.342+0000 7fcf37a13640 1 -- 10.20.193.14:0/24727776 >> 10.20.193.14:0/24727776 conn(0x7fcf300b7990 msgr2=0x7fcf300b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:51.352 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.342+0000 7fcf37a13640 1 -- 10.20.193.14:0/24727776 shutdown_connections 2026-02-24T19:23:51.352 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.342+0000 7fcf37a13640 1 -- 10.20.193.14:0/24727776 wait complete. 2026-02-24T19:23:51.352 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.342+0000 7fcf37a13640 10 monclient: build_initial_monmap 2026-02-24T19:23:51.352 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.342+0000 7fcf37a13640 10 monclient: monmap: 2026-02-24T19:23:51.352 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:51.352 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:23:51.352 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:23:51.352 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:23:51.352 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:51.352 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:23:51.352 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:51.352 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:51.352 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:51.353 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:51.353 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.342+0000 7fcf37a13640 1 librados: starting msgr at 2026-02-24T19:23:51.353 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.342+0000 7fcf37a13640 1 librados: starting objecter 2026-02-24T19:23:51.353 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.343+0000 7fcf37a13640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:23:51.353 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.343+0000 7fcf37a13640 1 Processor -- start 2026-02-24T19:23:51.353 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.343+0000 7fcf37a13640 1 -- start start 2026-02-24T19:23:51.353 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.343+0000 7fcf37a13640 1 librados: setting wanted keys 2026-02-24T19:23:51.353 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.343+0000 7fcf37a13640 1 librados: calling monclient init 2026-02-24T19:23:51.353 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.343+0000 7fcf37a13640 10 monclient: init 2026-02-24T19:23:51.353 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.343+0000 7fcf37a13640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:51.353 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.343+0000 7fcf37a13640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:23:51.353 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.343+0000 7fcf37a13640 10 monclient(hunting): picked mon.noname-b con 0x7fcf300585e0 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:51.353 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.343+0000 7fcf37a13640 10 monclient(hunting): picked mon.noname-a con 0x7fcf300b9f80 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:51.354 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.343+0000 7fcf37a13640 10 monclient(hunting): picked mon.noname-c con 0x7fcf300ba350 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:51.354 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.343+0000 7fcf37a13640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf3013b400 con 0x7fcf300b9f80 2026-02-24T19:23:51.354 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.343+0000 7fcf37a13640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf30165940 con 0x7fcf300585e0 2026-02-24T19:23:51.354 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.343+0000 7fcf37a13640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf30165c20 con 0x7fcf300ba350 2026-02-24T19:23:51.354 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.343+0000 7fcf37a13640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:51.354 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.343+0000 7fcf37a13640 10 monclient(hunting): authenticate will time out at 4006.024633s 2026-02-24T19:23:51.354 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.343+0000 7fcf35f89640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7fcf300ba350 0x7fcf300b4550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:48258/0 (socket says 10.20.193.14:48258) 2026-02-24T19:23:51.354 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.343+0000 7fcf35f89640 1 -- 10.20.193.14:0/3522809421 learned_addr learned my addr 10.20.193.14:0/3522809421 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:51.354 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.344+0000 7fcf1dffb640 10 client.?.objecter ms_handle_connect 0x7fcf300b9f80 2026-02-24T19:23:51.354 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.344+0000 7fcf1dffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:51.354 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.344+0000 7fcf1dffb640 10 client.?.objecter ms_handle_connect 0x7fcf300ba350 2026-02-24T19:23:51.354 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.344+0000 7fcf1dffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:51.355 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.344+0000 7fcf1dffb640 10 client.?.objecter ms_handle_connect 0x7fcf300585e0 2026-02-24T19:23:51.355 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.344+0000 7fcf1dffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:51.358 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.345+0000 7fcf1dffb640 1 -- 10.20.193.14:0/3522809421 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4246488707 0 0) 0x7fcf30165c20 con 0x7fcf300ba350 2026-02-24T19:23:51.358 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.345+0000 7fcf1dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:23:51.358 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.345+0000 7fcf1dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:51.358 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.345+0000 7fcf1dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:51.358 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.345+0000 7fcf1dffb640 10 monclient(hunting): my global_id is 28772 2026-02-24T19:23:51.358 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.345+0000 7fcf1dffb640 1 -- 10.20.193.14:0/3522809421 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf00003610 con 0x7fcf300ba350 2026-02-24T19:23:51.359 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.345+0000 7fcf1dffb640 1 -- 10.20.193.14:0/3522809421 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2071501840 0 0) 0x7fcf30165940 con 0x7fcf300585e0 2026-02-24T19:23:51.359 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.345+0000 7fcf1dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:23:51.359 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.345+0000 7fcf1dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:51.359 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.345+0000 7fcf1dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:51.359 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.345+0000 7fcf1dffb640 10 monclient(hunting): my global_id is 29137 2026-02-24T19:23:51.359 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.345+0000 7fcf1dffb640 1 -- 10.20.193.14:0/3522809421 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf30165c20 con 0x7fcf300585e0 2026-02-24T19:23:51.359 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.346+0000 7fcf1dffb640 1 -- 10.20.193.14:0/3522809421 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4196516253 0 0) 0x7fcf3013b400 con 0x7fcf300b9f80 2026-02-24T19:23:51.359 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.346+0000 7fcf1dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:23:51.359 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.346+0000 7fcf1dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:51.359 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.346+0000 7fcf1dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:51.359 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.346+0000 7fcf1dffb640 10 monclient(hunting): my global_id is 30819 2026-02-24T19:23:51.359 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.346+0000 7fcf1dffb640 1 -- 10.20.193.14:0/3522809421 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf30165940 con 0x7fcf300b9f80 2026-02-24T19:23:51.360 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.347+0000 7fcf1dffb640 1 -- 10.20.193.14:0/3522809421 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3059635743 0 0) 0x7fcf00003610 con 0x7fcf300ba350 2026-02-24T19:23:51.360 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.347+0000 7fcf1dffb640 1 -- 10.20.193.14:0/3522809421 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcf3013b400 con 0x7fcf300ba350 2026-02-24T19:23:51.360 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.347+0000 7fcf1dffb640 1 -- 10.20.193.14:0/3522809421 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fcf2c003690 con 0x7fcf300ba350 2026-02-24T19:23:51.360 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.347+0000 7fcf1dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:51.360 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.347+0000 7fcf1dffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:23:51.360 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.347+0000 7fcf1dffb640 10 monclient(hunting): dump: 2026-02-24T19:23:51.360 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:51.360 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:51.360 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.360 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.360 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:51.360 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:51.361 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:51.361 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:51.361 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:51.361 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:51.361 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.347+0000 7fcf1dffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:23:51.361 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.348+0000 7fcf1dffb640 1 -- 10.20.193.14:0/3522809421 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1034001176 0 0) 0x7fcf30165c20 con 0x7fcf300585e0 2026-02-24T19:23:51.361 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.348+0000 7fcf1dffb640 1 -- 10.20.193.14:0/3522809421 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcf00003610 con 0x7fcf300585e0 2026-02-24T19:23:51.361 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.348+0000 7fcf1dffb640 1 -- 10.20.193.14:0/3522809421 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fcf20003280 con 0x7fcf300585e0 2026-02-24T19:23:51.361 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.348+0000 7fcf1dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:51.361 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.348+0000 7fcf1dffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:51.361 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.348+0000 7fcf1dffb640 10 monclient(hunting): dump: 2026-02-24T19:23:51.361 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:51.361 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:51.362 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.362 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.362 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:51.362 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:51.362 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:51.362 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:51.362 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:51.362 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:51.362 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.349+0000 7fcf1dffb640 1 -- 10.20.193.14:0/3522809421 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1326006166 0 0) 0x7fcf30165940 con 0x7fcf300b9f80 2026-02-24T19:23:51.362 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.349+0000 7fcf1dffb640 1 -- 10.20.193.14:0/3522809421 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcf30165c20 con 0x7fcf300b9f80 2026-02-24T19:23:51.362 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.349+0000 7fcf1dffb640 1 -- 10.20.193.14:0/3522809421 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fcf24002fb0 con 0x7fcf300b9f80 2026-02-24T19:23:51.362 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.349+0000 7fcf1dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:51.363 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.349+0000 7fcf1dffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:51.363 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.349+0000 7fcf1dffb640 10 monclient(hunting): dump: 2026-02-24T19:23:51.363 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:51.363 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:51.363 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.363 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.363 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:51.363 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:51.363 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:51.363 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:51.363 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:51.363 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:51.363 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.350+0000 7fcf1dffb640 1 -- 10.20.193.14:0/3522809421 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 789586053 0 0) 0x7fcf3013b400 con 0x7fcf300ba350 2026-02-24T19:23:51.364 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.350+0000 7fcf1dffb640 1 -- 10.20.193.14:0/3522809421 >> v1:10.20.193.44:6789/0 conn(0x7fcf300585e0 legacy=0x7fcf3013acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:51.364 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.350+0000 7fcf1dffb640 1 -- 10.20.193.14:0/3522809421 >> v1:10.20.193.14:6789/0 conn(0x7fcf300b9f80 legacy=0x7fcf301610b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:51.364 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.350+0000 7fcf1dffb640 10 monclient: _finish_hunting 0 2026-02-24T19:23:51.364 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.350+0000 7fcf1dffb640 1 monclient: found mon.c 2026-02-24T19:23:51.364 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.350+0000 7fcf1dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:51.364 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.350+0000 7fcf1dffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:51.364 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.350+0000 7fcf1dffb640 1 -- 10.20.193.14:0/3522809421 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf30165f00 con 0x7fcf300ba350 2026-02-24T19:23:51.364 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.350+0000 7fcf1dffb640 10 monclient: _finish_auth 0 2026-02-24T19:23:51.364 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.350+0000 7fcf1dffb640 10 monclient: _check_auth_tickets 2026-02-24T19:23:51.364 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.350+0000 7fcf1dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:51.364 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.350+0000 7fcf37a13640 5 monclient: authenticate success, global_id 28772 2026-02-24T19:23:51.364 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.350+0000 7fcf37a13640 10 monclient: _renew_subs 2026-02-24T19:23:51.364 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.350+0000 7fcf37a13640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:51.365 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.350+0000 7fcf37a13640 1 -- 10.20.193.14:0/3522809421 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcf301661e0 con 0x7fcf300ba350 2026-02-24T19:23:51.365 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.350+0000 7fcf37a13640 10 client.28772.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:51.365 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.350+0000 7fcf37a13640 10 monclient: _renew_subs 2026-02-24T19:23:51.365 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.350+0000 7fcf37a13640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:51.365 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.350+0000 7fcf37a13640 1 -- 10.20.193.14:0/3522809421 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fcf301617c0 con 0x7fcf300ba350 2026-02-24T19:23:51.365 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.350+0000 7fcf37a13640 1 librados: init done 2026-02-24T19:23:51.365 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.350+0000 7fcf37a13640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:51.365 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.350+0000 7fcf37a13640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:51.365 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.350+0000 7fcf37a13640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:51.365 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.350+0000 7fcf37a13640 1 -- 10.20.193.14:0/3522809421 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf30161a50 con 0x7fcf300ba350 2026-02-24T19:23:51.365 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.356+0000 7fcf1dffb640 1 -- 10.20.193.14:0/3522809421 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcf2c0032c0 con 0x7fcf300ba350 2026-02-24T19:23:51.365 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.356+0000 7fcf1dffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:51.366 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.356+0000 7fcf1dffb640 1 -- 10.20.193.14:0/3522809421 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fcf2c003e80 con 0x7fcf300ba350 2026-02-24T19:23:51.366 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.356+0000 7fcf1dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:51.366 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.356+0000 7fcf1dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:51.366 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.356+0000 7fcf1dffb640 10 monclient: dump: 2026-02-24T19:23:51.366 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:51.366 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:51.366 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.366 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.366 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:51.366 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:51.366 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:51.366 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:51.366 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:51.367 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:51.367 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.356+0000 7fcf1f7fe640 4 set_mon_vals no callback set 2026-02-24T19:23:51.367 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.359+0000 7fcf1dffb640 1 -- 10.20.193.14:0/3522809421 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7fcf2c003e80 con 0x7fcf300ba350 2026-02-24T19:23:51.368 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.359+0000 7fcf35788640 10 monclient: get_auth_request con 0x7fcf00077ed0 auth_method 0 2026-02-24T19:23:51.368 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.359+0000 7fcf1dffb640 10 client.28772.objecter ms_handle_connect 0x7fcf00077ed0 2026-02-24T19:23:51.368 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.360+0000 7fcf1dffb640 1 -- 10.20.193.14:0/3522809421 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7fcf2c0933f0 con 0x7fcf300ba350 2026-02-24T19:23:51.368 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.360+0000 7fcf1dffb640 10 client.28772.objecter ms_dispatch2 0x7fcf30000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:23:51.368 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.360+0000 7fcf1dffb640 3 client.28772.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:23:51.368 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.360+0000 7fcf1dffb640 3 client.28772.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:23:51.368 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.360+0000 7fcf1dffb640 20 client.28772.objecter dump_active .. 0 homeless 2026-02-24T19:23:51.445 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.443+0000 7fcf1dffb640 1 -- 10.20.193.14:0/3522809421 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fcf2c05de20 con 0x7fcf300ba350 2026-02-24T19:23:51.445 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.443+0000 7fcf1dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:51.445 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.443+0000 7fcf1dffb640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:23:51.550 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.548+0000 7fcf37a13640 1 -- 10.20.193.14:0/3522809421 --> v1:10.20.193.14:6800/4014096310 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "13", "target": ["mon-mgr", ""]}) -- 0x7fcf301656f0 con 0x7fcf00077ed0 2026-02-24T19:23:51.550 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.549+0000 7fcf1dffb640 1 -- 10.20.193.14:0/3522809421 <== mgr.4110 v1:10.20.193.14:6800/4014096310 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 13 to deep-scrub) ==== 42+0+0 (unknown 1087616222 0 0) 0x7fcf301656f0 con 0x7fcf00077ed0 2026-02-24T19:23:51.550 INFO:teuthology.orchestra.run.trial014.stderr:instructed osd(s) 13 to deep-scrub 2026-02-24T19:23:51.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.549+0000 7fcf37a13640 10 librados: watch_flush enter 2026-02-24T19:23:51.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.549+0000 7fcf37a13640 10 librados: watch_flush exit 2026-02-24T19:23:51.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.549+0000 7fcf37a13640 20 client.28772.objecter shutdown clearing up homeless session... 2026-02-24T19:23:51.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.549+0000 7fcf37a13640 10 client.28772.objecter successfully canceled tick 2026-02-24T19:23:51.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.550+0000 7fcf37a13640 1 -- 10.20.193.14:0/3522809421 >> v1:10.20.193.14:6800/4014096310 conn(0x7fcf00077ed0 legacy=0x7fcf00098380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:51.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.550+0000 7fcf37a13640 10 monclient: shutdown 2026-02-24T19:23:51.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.550+0000 7fcf37a13640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:51.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.550+0000 7fcf37a13640 1 -- 10.20.193.14:0/3522809421 >> v1:10.20.193.170:6789/0 conn(0x7fcf300ba350 legacy=0x7fcf300b4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:51.552 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.550+0000 7fcf37a13640 1 -- 10.20.193.14:0/3522809421 shutdown_connections 2026-02-24T19:23:51.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.550+0000 7fcf37a13640 1 -- 10.20.193.14:0/3522809421 >> 10.20.193.14:0/3522809421 conn(0x7fcf300b7990 msgr2=0x7fcf300b66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:51.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.550+0000 7fcf37a13640 1 -- 10.20.193.14:0/3522809421 shutdown_connections 2026-02-24T19:23:51.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.550+0000 7fcf37a13640 1 -- 10.20.193.14:0/3522809421 wait complete. 2026-02-24T19:23:51.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.550+0000 7fcf37a13640 1 librados: shutdown 2026-02-24T19:23:51.560 INFO:tasks.ceph:Scrubbing osd.2 2026-02-24T19:23:51.560 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:23:51.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.628+0000 7fd55ebc3640 10 monclient: get_monmap_and_config 2026-02-24T19:23:51.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.628+0000 7fd55ebc3640 10 monclient: build_initial_monmap 2026-02-24T19:23:51.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.628+0000 7fd55ebc3640 10 monclient: monmap: 2026-02-24T19:23:51.630 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:51.630 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:51.630 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:23:51.629057+0000 2026-02-24T19:23:51.630 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:23:51.629057+0000 2026-02-24T19:23:51.630 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:51.630 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:51.631 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:51.631 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:51.631 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:51.631 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:51.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.628+0000 7fd55ebc3640 1 Processor -- start 2026-02-24T19:23:51.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.628+0000 7fd55ebc3640 1 -- start start 2026-02-24T19:23:51.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.628+0000 7fd55ebc3640 10 monclient: init 2026-02-24T19:23:51.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.629+0000 7fd55ebc3640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:51.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.629+0000 7fd55ebc3640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:23:51.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.629+0000 7fd55ebc3640 10 monclient(hunting): picked mon.noname-b con 0x7fd55815e2a0 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:51.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.629+0000 7fd55ebc3640 10 monclient(hunting): picked mon.noname-a con 0x7fd558059e10 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:51.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.629+0000 7fd55ebc3640 10 monclient(hunting): picked mon.noname-c con 0x7fd5581a5660 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:51.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.629+0000 7fd55ebc3640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd558162df0 con 0x7fd558059e10 2026-02-24T19:23:51.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.629+0000 7fd55ebc3640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5581630d0 con 0x7fd55815e2a0 2026-02-24T19:23:51.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.629+0000 7fd55ebc3640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5581633b0 con 0x7fd5581a5660 2026-02-24T19:23:51.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.629+0000 7fd55ebc3640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:51.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.629+0000 7fd55ebc3640 10 monclient(hunting): authenticate will time out at 4006.310775s 2026-02-24T19:23:51.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.629+0000 7fd54ffff640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7fd558059e10 0x7fd55815ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:50918/0 (socket says 10.20.193.14:50918) 2026-02-24T19:23:51.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.630+0000 7fd54ffff640 1 -- 10.20.193.14:0/3235626663 learned_addr learned my addr 10.20.193.14:0/3235626663 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:51.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.631+0000 7fd54f7fe640 1 -- 10.20.193.14:0/3235626663 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3555541060 0 0) 0x7fd558162df0 con 0x7fd558059e10 2026-02-24T19:23:51.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.631+0000 7fd54f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:23:51.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.631+0000 7fd54f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:51.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.631+0000 7fd54f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:51.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.631+0000 7fd54f7fe640 10 monclient(hunting): my global_id is 30822 2026-02-24T19:23:51.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.631+0000 7fd54f7fe640 1 -- 10.20.193.14:0/3235626663 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd544003610 con 0x7fd558059e10 2026-02-24T19:23:51.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.631+0000 7fd54f7fe640 1 -- 10.20.193.14:0/3235626663 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3646345356 0 0) 0x7fd5581630d0 con 0x7fd55815e2a0 2026-02-24T19:23:51.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.631+0000 7fd54f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:23:51.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.631+0000 7fd54f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:51.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.631+0000 7fd54f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:51.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.631+0000 7fd54f7fe640 10 monclient(hunting): my global_id is 29140 2026-02-24T19:23:51.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.631+0000 7fd54f7fe640 1 -- 10.20.193.14:0/3235626663 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd558162df0 con 0x7fd55815e2a0 2026-02-24T19:23:51.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.631+0000 7fd54f7fe640 1 -- 10.20.193.14:0/3235626663 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1242800368 0 0) 0x7fd5581633b0 con 0x7fd5581a5660 2026-02-24T19:23:51.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.631+0000 7fd54f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:23:51.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.631+0000 7fd54f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:51.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.631+0000 7fd54f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:51.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.631+0000 7fd54f7fe640 10 monclient(hunting): my global_id is 28775 2026-02-24T19:23:51.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.631+0000 7fd54f7fe640 1 -- 10.20.193.14:0/3235626663 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5581630d0 con 0x7fd5581a5660 2026-02-24T19:23:51.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.632+0000 7fd54f7fe640 1 -- 10.20.193.14:0/3235626663 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3522871773 0 0) 0x7fd544003610 con 0x7fd558059e10 2026-02-24T19:23:51.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.632+0000 7fd54f7fe640 1 -- 10.20.193.14:0/3235626663 >> v1:10.20.193.170:6789/0 conn(0x7fd5581a5660 legacy=0x7fd5581c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:51.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.633+0000 7fd54f7fe640 1 -- 10.20.193.14:0/3235626663 >> v1:10.20.193.44:6789/0 conn(0x7fd55815e2a0 legacy=0x7fd55805da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:51.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.633+0000 7fd54f7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:23:51.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.633+0000 7fd54f7fe640 1 monclient: found mon.noname-a 2026-02-24T19:23:51.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.633+0000 7fd54f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:51.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.633+0000 7fd54f7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:23:51.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.633+0000 7fd54f7fe640 1 -- 10.20.193.14:0/3235626663 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd558163690 con 0x7fd558059e10 2026-02-24T19:23:51.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.633+0000 7fd54f7fe640 10 monclient: _finish_auth 0 2026-02-24T19:23:51.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.633+0000 7fd54f7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:23:51.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.633+0000 7fd54f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:51.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.633+0000 7fd55ebc3640 5 monclient: authenticate success, global_id 30822 2026-02-24T19:23:51.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.633+0000 7fd55ebc3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:51.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.633+0000 7fd54f7fe640 1 -- 10.20.193.14:0/3235626663 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fd540002df0 con 0x7fd558059e10 2026-02-24T19:23:51.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.633+0000 7fd54f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:51.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.633+0000 7fd54f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:23:51.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.633+0000 7fd54f7fe640 10 monclient: dump: 2026-02-24T19:23:51.641 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:51.641 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:51.641 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.641 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.641 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:51.642 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:51.642 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:51.642 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:51.642 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:51.642 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:51.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.633+0000 7fd55ebc3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:51.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.633+0000 7fd54f7fe640 1 -- 10.20.193.14:0/3235626663 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd540002fc0 con 0x7fd558059e10 2026-02-24T19:23:51.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.633+0000 7fd54f7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:51.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.633+0000 7fd55ebc3640 10 monclient: get_monmap_and_config success 2026-02-24T19:23:51.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.633+0000 7fd54f7fe640 1 -- 10.20.193.14:0/3235626663 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fd540003400 con 0x7fd558059e10 2026-02-24T19:23:51.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.633+0000 7fd54f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:51.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.633+0000 7fd55ebc3640 4 set_mon_vals no callback set 2026-02-24T19:23:51.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.633+0000 7fd54f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:51.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.633+0000 7fd54f7fe640 10 monclient: dump: 2026-02-24T19:23:51.643 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:51.643 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:51.643 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.643 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.643 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:51.643 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:51.643 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:51.643 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:51.643 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:51.643 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:51.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.634+0000 7fd55ebc3640 10 monclient: shutdown 2026-02-24T19:23:51.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.634+0000 7fd55ebc3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:51.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.634+0000 7fd55ebc3640 1 -- 10.20.193.14:0/3235626663 >> v1:10.20.193.14:6789/0 conn(0x7fd558059e10 legacy=0x7fd55815ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:51.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.634+0000 7fd55ebc3640 1 -- 10.20.193.14:0/3235626663 shutdown_connections 2026-02-24T19:23:51.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.634+0000 7fd55ebc3640 1 -- 10.20.193.14:0/3235626663 >> 10.20.193.14:0/3235626663 conn(0x7fd5580b2f60 msgr2=0x7fd5580b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:51.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.634+0000 7fd55ebc3640 1 -- 10.20.193.14:0/3235626663 shutdown_connections 2026-02-24T19:23:51.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.634+0000 7fd55ebc3640 1 -- 10.20.193.14:0/3235626663 wait complete. 2026-02-24T19:23:51.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.634+0000 7fd55ebc3640 10 monclient: build_initial_monmap 2026-02-24T19:23:51.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.634+0000 7fd55ebc3640 10 monclient: monmap: 2026-02-24T19:23:51.644 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:51.644 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:23:51.644 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:23:51.644 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:23:51.645 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:51.645 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:23:51.645 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:51.645 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:51.645 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:51.645 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:51.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.634+0000 7fd55ebc3640 1 librados: starting msgr at 2026-02-24T19:23:51.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.634+0000 7fd55ebc3640 1 librados: starting objecter 2026-02-24T19:23:51.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.634+0000 7fd55ebc3640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:23:51.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.634+0000 7fd55ebc3640 1 Processor -- start 2026-02-24T19:23:51.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.634+0000 7fd55ebc3640 1 -- start start 2026-02-24T19:23:51.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.634+0000 7fd55ebc3640 1 librados: setting wanted keys 2026-02-24T19:23:51.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.634+0000 7fd55ebc3640 1 librados: calling monclient init 2026-02-24T19:23:51.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.634+0000 7fd55ebc3640 10 monclient: init 2026-02-24T19:23:51.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.635+0000 7fd55ebc3640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:51.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.635+0000 7fd55ebc3640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:23:51.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.635+0000 7fd55ebc3640 10 monclient(hunting): picked mon.noname-a con 0x7fd558059e10 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:51.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.635+0000 7fd55ebc3640 10 monclient(hunting): picked mon.noname-b con 0x7fd55815e2a0 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:51.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.635+0000 7fd55ebc3640 10 monclient(hunting): picked mon.noname-c con 0x7fd5581a5660 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:51.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.635+0000 7fd55ebc3640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd55815d980 con 0x7fd558059e10 2026-02-24T19:23:51.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.635+0000 7fd55ebc3640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd558191fa0 con 0x7fd55815e2a0 2026-02-24T19:23:51.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.635+0000 7fd55ebc3640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd558192280 con 0x7fd5581a5660 2026-02-24T19:23:51.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.635+0000 7fd55ebc3640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:51.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.635+0000 7fd55ebc3640 10 monclient(hunting): authenticate will time out at 4006.316371s 2026-02-24T19:23:51.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.635+0000 7fd55c938640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7fd558059e10 0x7fd55815d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:50922/0 (socket says 10.20.193.14:50922) 2026-02-24T19:23:51.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.635+0000 7fd55c938640 1 -- 10.20.193.14:0/745310899 learned_addr learned my addr 10.20.193.14:0/745310899 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:51.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.635+0000 7fd54d7fa640 10 client.?.objecter ms_handle_connect 0x7fd558059e10 2026-02-24T19:23:51.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.635+0000 7fd54d7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:51.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.635+0000 7fd54d7fa640 10 client.?.objecter ms_handle_connect 0x7fd55815e2a0 2026-02-24T19:23:51.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.635+0000 7fd54d7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:51.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.635+0000 7fd54d7fa640 10 client.?.objecter ms_handle_connect 0x7fd5581a5660 2026-02-24T19:23:51.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.635+0000 7fd54d7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:51.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.636+0000 7fd54d7fa640 1 -- 10.20.193.14:0/745310899 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 120666861 0 0) 0x7fd55815d980 con 0x7fd558059e10 2026-02-24T19:23:51.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.636+0000 7fd54d7fa640 10 monclient(hunting): _negotiate 2026-02-24T19:23:51.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.636+0000 7fd54d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:51.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.636+0000 7fd54d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:51.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.636+0000 7fd54d7fa640 10 monclient(hunting): my global_id is 30825 2026-02-24T19:23:51.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.636+0000 7fd54d7fa640 1 -- 10.20.193.14:0/745310899 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd528003610 con 0x7fd558059e10 2026-02-24T19:23:51.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.636+0000 7fd54d7fa640 1 -- 10.20.193.14:0/745310899 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 453582471 0 0) 0x7fd558192280 con 0x7fd5581a5660 2026-02-24T19:23:51.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.636+0000 7fd54d7fa640 10 monclient(hunting): _negotiate 2026-02-24T19:23:51.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.636+0000 7fd54d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:51.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.636+0000 7fd54d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:51.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.636+0000 7fd54d7fa640 10 monclient(hunting): my global_id is 28778 2026-02-24T19:23:51.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.636+0000 7fd54d7fa640 1 -- 10.20.193.14:0/745310899 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd55815d980 con 0x7fd5581a5660 2026-02-24T19:23:51.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.636+0000 7fd54d7fa640 1 -- 10.20.193.14:0/745310899 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2416809881 0 0) 0x7fd558191fa0 con 0x7fd55815e2a0 2026-02-24T19:23:51.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.636+0000 7fd54d7fa640 10 monclient(hunting): _negotiate 2026-02-24T19:23:51.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.636+0000 7fd54d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:51.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.636+0000 7fd54d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:51.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.636+0000 7fd54d7fa640 10 monclient(hunting): my global_id is 29143 2026-02-24T19:23:51.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.636+0000 7fd54d7fa640 1 -- 10.20.193.14:0/745310899 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd558192280 con 0x7fd55815e2a0 2026-02-24T19:23:51.652 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.639+0000 7fd54d7fa640 1 -- 10.20.193.14:0/745310899 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2920769790 0 0) 0x7fd528003610 con 0x7fd558059e10 2026-02-24T19:23:51.652 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.639+0000 7fd54d7fa640 1 -- 10.20.193.14:0/745310899 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd558191fa0 con 0x7fd558059e10 2026-02-24T19:23:51.652 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.639+0000 7fd54d7fa640 1 -- 10.20.193.14:0/745310899 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fd548003190 con 0x7fd558059e10 2026-02-24T19:23:51.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.639+0000 7fd54d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:51.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.639+0000 7fd54d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:23:51.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.639+0000 7fd54d7fa640 10 monclient(hunting): dump: 2026-02-24T19:23:51.653 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:51.653 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:51.653 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.653 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.653 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:51.653 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:51.653 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:51.653 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:51.653 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:51.654 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:51.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.639+0000 7fd54d7fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:23:51.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.639+0000 7fd54d7fa640 1 -- 10.20.193.14:0/745310899 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2488014114 0 0) 0x7fd55815d980 con 0x7fd5581a5660 2026-02-24T19:23:51.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.639+0000 7fd54d7fa640 1 -- 10.20.193.14:0/745310899 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd528003610 con 0x7fd5581a5660 2026-02-24T19:23:51.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.639+0000 7fd54d7fa640 1 -- 10.20.193.14:0/745310899 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fd554003390 con 0x7fd5581a5660 2026-02-24T19:23:51.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.639+0000 7fd54d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:51.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.639+0000 7fd54d7fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:51.654 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.639+0000 7fd54d7fa640 10 monclient(hunting): dump: 2026-02-24T19:23:51.654 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:51.654 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:51.654 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.654 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.655 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:51.655 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:51.655 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:51.655 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:51.655 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:51.655 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:51.655 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.639+0000 7fd54d7fa640 1 -- 10.20.193.14:0/745310899 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1622384576 0 0) 0x7fd558192280 con 0x7fd55815e2a0 2026-02-24T19:23:51.655 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.639+0000 7fd54d7fa640 1 -- 10.20.193.14:0/745310899 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd55815d980 con 0x7fd55815e2a0 2026-02-24T19:23:51.655 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.639+0000 7fd54d7fa640 1 -- 10.20.193.14:0/745310899 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fd540003310 con 0x7fd55815e2a0 2026-02-24T19:23:51.655 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.639+0000 7fd54d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:51.655 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.639+0000 7fd54d7fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:51.655 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.639+0000 7fd54d7fa640 10 monclient(hunting): dump: 2026-02-24T19:23:51.655 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:51.656 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:51.656 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.656 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.656 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:51.656 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:51.656 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:51.656 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:51.656 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:51.656 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:51.656 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.640+0000 7fd54d7fa640 1 -- 10.20.193.14:0/745310899 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1620376850 0 0) 0x7fd558191fa0 con 0x7fd558059e10 2026-02-24T19:23:51.656 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.640+0000 7fd54d7fa640 1 -- 10.20.193.14:0/745310899 >> v1:10.20.193.170:6789/0 conn(0x7fd5581a5660 legacy=0x7fd5581207d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:51.656 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.640+0000 7fd54d7fa640 1 -- 10.20.193.14:0/745310899 >> v1:10.20.193.44:6789/0 conn(0x7fd55815e2a0 legacy=0x7fd5580560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:51.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.640+0000 7fd54d7fa640 10 monclient: _finish_hunting 0 2026-02-24T19:23:51.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.640+0000 7fd54d7fa640 1 monclient: found mon.a 2026-02-24T19:23:51.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.640+0000 7fd54d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:51.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.640+0000 7fd54d7fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:51.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.640+0000 7fd54d7fa640 1 -- 10.20.193.14:0/745310899 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd558192560 con 0x7fd558059e10 2026-02-24T19:23:51.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.640+0000 7fd54d7fa640 10 monclient: _finish_auth 0 2026-02-24T19:23:51.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.640+0000 7fd54d7fa640 10 monclient: _check_auth_tickets 2026-02-24T19:23:51.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.640+0000 7fd54d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:51.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.640+0000 7fd55ebc3640 5 monclient: authenticate success, global_id 30825 2026-02-24T19:23:51.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.640+0000 7fd55ebc3640 10 monclient: _renew_subs 2026-02-24T19:23:51.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.640+0000 7fd55ebc3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:51.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.640+0000 7fd55ebc3640 1 -- 10.20.193.14:0/745310899 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd558192840 con 0x7fd558059e10 2026-02-24T19:23:51.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.640+0000 7fd55ebc3640 10 client.30825.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:51.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.640+0000 7fd55ebc3640 10 monclient: _renew_subs 2026-02-24T19:23:51.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.640+0000 7fd55ebc3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:51.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.640+0000 7fd55ebc3640 1 -- 10.20.193.14:0/745310899 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd558192e00 con 0x7fd558059e10 2026-02-24T19:23:51.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.640+0000 7fd55ebc3640 1 librados: init done 2026-02-24T19:23:51.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.641+0000 7fd55ebc3640 10 client.30825.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:51.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.641+0000 7fd55ebc3640 15 client.30825.objecter _session_command_op_assign -1 1 2026-02-24T19:23:51.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.641+0000 7fd55ebc3640 20 client.30825.objecter _get_session osd=-1 returning homeless 2026-02-24T19:23:51.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.641+0000 7fd55ebc3640 10 client.30825.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:51.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.641+0000 7fd55ebc3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:51.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.641+0000 7fd55ebc3640 1 -- 10.20.193.14:0/745310899 --> v1:10.20.193.14:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fd55815e720 con 0x7fd558059e10 2026-02-24T19:23:51.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.649+0000 7fd54d7fa640 1 -- 10.20.193.14:0/745310899 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd55815e720 con 0x7fd558059e10 2026-02-24T19:23:51.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.649+0000 7fd54d7fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:51.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.649+0000 7fd54d7fa640 1 -- 10.20.193.14:0/745310899 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fd5480039b0 con 0x7fd558059e10 2026-02-24T19:23:51.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.649+0000 7fd54d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:51.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.649+0000 7fd54d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:51.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.649+0000 7fd54d7fa640 10 monclient: dump: 2026-02-24T19:23:51.659 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:51.659 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:51.659 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.659 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.659 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:51.659 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:51.659 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:51.659 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:51.659 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:51.659 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:51.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.649+0000 7fd54effd640 4 set_mon_vals no callback set 2026-02-24T19:23:51.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.650+0000 7fd54d7fa640 1 -- 10.20.193.14:0/745310899 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7fd548003bc0 con 0x7fd558059e10 2026-02-24T19:23:51.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.651+0000 7fd54ffff640 10 monclient: get_auth_request con 0x7fd528077e20 auth_method 0 2026-02-24T19:23:51.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.651+0000 7fd54d7fa640 10 client.30825.objecter ms_handle_connect 0x7fd528077e20 2026-02-24T19:23:51.661 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.651+0000 7fd54d7fa640 1 -- 10.20.193.14:0/745310899 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7fd5480039b0 con 0x7fd558059e10 2026-02-24T19:23:51.661 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.651+0000 7fd54d7fa640 10 client.30825.objecter ms_dispatch2 0x7fd558000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:23:51.661 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.651+0000 7fd54d7fa640 3 client.30825.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:23:51.661 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.651+0000 7fd54d7fa640 3 client.30825.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:23:51.661 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.651+0000 7fd54d7fa640 10 client.30825.objecter checking command 1 2026-02-24T19:23:51.661 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.651+0000 7fd54d7fa640 20 client.30825.objecter _get_session s=0x7fd5280a20e0 osd=2 3 2026-02-24T19:23:51.661 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.651+0000 7fd54d7fa640 20 client.30825.objecter put_session s=0x7fd5280a20e0 osd=2 3 2026-02-24T19:23:51.661 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.651+0000 7fd54d7fa640 15 client.30825.objecter _session_command_op_remove -1 1 2026-02-24T19:23:51.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.651+0000 7fd54d7fa640 20 client.30825.objecter _get_session s=0x7fd5280a20e0 osd=2 3 2026-02-24T19:23:51.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.651+0000 7fd54d7fa640 20 client.30825.objecter get_session s=0x7fd5280a20e0 osd=2 3 2026-02-24T19:23:51.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.651+0000 7fd54d7fa640 15 client.30825.objecter _session_command_op_assign 2 1 2026-02-24T19:23:51.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.651+0000 7fd54d7fa640 20 client.30825.objecter put_session s=0x7fd5280a20e0 osd=2 4 2026-02-24T19:23:51.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.651+0000 7fd54d7fa640 10 client.30825.objecter _send_command 1 2026-02-24T19:23:51.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.651+0000 7fd54d7fa640 1 -- 10.20.193.14:0/745310899 --> v1:10.20.193.170:6804/993713135 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd5280c43f0 con 0x7fd5280a2790 2026-02-24T19:23:51.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.651+0000 7fd54d7fa640 20 client.30825.objecter dump_active .. 0 homeless 2026-02-24T19:23:51.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.651+0000 7fd54d7fa640 1 -- 10.20.193.14:0/745310899 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_get_version_reply(handle=1 version=354) ==== 24+0+0 (unknown 31317031 0 0) 0x7fd5480596f0 con 0x7fd558059e10 2026-02-24T19:23:51.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.651+0000 7fd54d7fa640 10 monclient: handle_get_version_reply finishing 1 version 354 2026-02-24T19:23:51.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.652+0000 7fd55d139640 10 monclient: get_auth_request con 0x7fd5280a2790 auth_method 0 2026-02-24T19:23:51.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.653+0000 7fd54d7fa640 10 client.30825.objecter ms_handle_connect 0x7fd5280a2790 2026-02-24T19:23:51.664 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.662+0000 7fd54d7fa640 1 -- 10.20.193.14:0/745310899 <== osd.2 v1:10.20.193.170:6804/993713135 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fd5280c43f0 con 0x7fd5280a2790 2026-02-24T19:23:51.664 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.662+0000 7fd54d7fa640 10 client.30825.objecter ms_dispatch2 0x7fd558000b90 command_reply(tid 1: 0 ) 2026-02-24T19:23:51.664 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.662+0000 7fd54d7fa640 10 client.30825.objecter _finish_command 1 = system:0 2026-02-24T19:23:51.664 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.662+0000 7fd54d7fa640 20 client.30825.objecter put_session s=0x7fd5280a20e0 osd=2 4 2026-02-24T19:23:51.664 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.662+0000 7fd54d7fa640 15 client.30825.objecter _session_command_op_remove 2 1 2026-02-24T19:23:51.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.669+0000 7fd55ebc3640 10 client.30825.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:23:51.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.669+0000 7fd55ebc3640 15 client.30825.objecter _session_command_op_assign -1 2 2026-02-24T19:23:51.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.669+0000 7fd55ebc3640 20 client.30825.objecter _get_session s=0x7fd5280a20e0 osd=2 3 2026-02-24T19:23:51.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.669+0000 7fd55ebc3640 20 client.30825.objecter put_session s=0x7fd5280a20e0 osd=2 3 2026-02-24T19:23:51.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.669+0000 7fd55ebc3640 20 client.30825.objecter _get_session s=0x7fd5280a20e0 osd=2 3 2026-02-24T19:23:51.671 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.669+0000 7fd55ebc3640 15 client.30825.objecter _session_command_op_remove -1 2 2026-02-24T19:23:51.672 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.669+0000 7fd55ebc3640 20 client.30825.objecter get_session s=0x7fd5280a20e0 osd=2 3 2026-02-24T19:23:51.672 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.669+0000 7fd55ebc3640 15 client.30825.objecter _session_command_op_assign 2 2 2026-02-24T19:23:51.672 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.669+0000 7fd55ebc3640 20 client.30825.objecter put_session s=0x7fd5280a20e0 osd=2 4 2026-02-24T19:23:51.672 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.669+0000 7fd55ebc3640 10 client.30825.objecter _send_command 2 2026-02-24T19:23:51.672 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.669+0000 7fd55ebc3640 1 -- 10.20.193.14:0/745310899 --> v1:10.20.193.170:6804/993713135 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd558164210 con 0x7fd5280a2790 2026-02-24T19:23:51.678 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.677+0000 7fd54d7fa640 1 -- 10.20.193.14:0/745310899 <== osd.2 v1:10.20.193.170:6804/993713135 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fd558164210 con 0x7fd5280a2790 2026-02-24T19:23:51.679 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.677+0000 7fd54d7fa640 10 client.30825.objecter ms_dispatch2 0x7fd558000b90 command_reply(tid 2: 0 ) 2026-02-24T19:23:51.679 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.677+0000 7fd54d7fa640 10 client.30825.objecter _finish_command 2 = system:0 2026-02-24T19:23:51.679 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.677+0000 7fd54d7fa640 20 client.30825.objecter put_session s=0x7fd5280a20e0 osd=2 4 2026-02-24T19:23:51.679 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.677+0000 7fd54d7fa640 15 client.30825.objecter _session_command_op_remove 2 2 2026-02-24T19:23:51.679 INFO:teuthology.orchestra.run.trial014.stdout:{ 2026-02-24T19:23:51.679 INFO:teuthology.orchestra.run.trial014.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:23:51.679 INFO:teuthology.orchestra.run.trial014.stdout:} 2026-02-24T19:23:51.681 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.677+0000 7fd55ebc3640 10 librados: watch_flush enter 2026-02-24T19:23:51.681 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.677+0000 7fd55ebc3640 10 librados: watch_flush exit 2026-02-24T19:23:51.681 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.677+0000 7fd55ebc3640 10 client.30825.objecter close_session for osd.2 2026-02-24T19:23:51.681 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.677+0000 7fd55ebc3640 1 -- 10.20.193.14:0/745310899 >> v1:10.20.193.170:6804/993713135 conn(0x7fd5280a2790 legacy=0x7fd5280c2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:51.681 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.677+0000 7fd55ebc3640 20 client.30825.objecter put_session s=0x7fd5280a20e0 osd=2 1 2026-02-24T19:23:51.681 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.677+0000 7fd55ebc3640 20 client.30825.objecter shutdown clearing up homeless session... 2026-02-24T19:23:51.681 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.677+0000 7fd55ebc3640 10 client.30825.objecter successfully canceled tick 2026-02-24T19:23:51.681 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.677+0000 7fd55ebc3640 1 -- 10.20.193.14:0/745310899 >> v1:10.20.193.14:6800/4014096310 conn(0x7fd528077e20 legacy=0x7fd5280982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:51.681 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.677+0000 7fd55ebc3640 10 monclient: shutdown 2026-02-24T19:23:51.681 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.677+0000 7fd55ebc3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:51.682 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.677+0000 7fd55ebc3640 1 -- 10.20.193.14:0/745310899 >> v1:10.20.193.14:6789/0 conn(0x7fd558059e10 legacy=0x7fd55815d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:51.682 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.677+0000 7fd55d139640 1 -- 10.20.193.14:0/745310899 reap_dead start 2026-02-24T19:23:51.682 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.677+0000 7fd55ebc3640 1 -- 10.20.193.14:0/745310899 shutdown_connections 2026-02-24T19:23:51.682 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.677+0000 7fd55ebc3640 1 -- 10.20.193.14:0/745310899 >> 10.20.193.14:0/745310899 conn(0x7fd5580b2f60 msgr2=0x7fd5581a4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:51.682 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.677+0000 7fd55ebc3640 1 -- 10.20.193.14:0/745310899 shutdown_connections 2026-02-24T19:23:51.682 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.677+0000 7fd55ebc3640 1 -- 10.20.193.14:0/745310899 wait complete. 2026-02-24T19:23:51.682 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.677+0000 7fd55ebc3640 1 librados: shutdown 2026-02-24T19:23:51.687 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-24T19:23:51.755 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.753+0000 7ff43c9d7640 10 monclient: get_monmap_and_config 2026-02-24T19:23:51.755 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.753+0000 7ff43c9d7640 10 monclient: build_initial_monmap 2026-02-24T19:23:51.755 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.753+0000 7ff43c9d7640 10 monclient: monmap: 2026-02-24T19:23:51.755 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:51.756 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:51.756 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:23:51.754422+0000 2026-02-24T19:23:51.756 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:23:51.754422+0000 2026-02-24T19:23:51.756 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:51.756 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:51.756 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:51.756 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:51.756 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:51.756 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:51.758 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.754+0000 7ff43c9d7640 1 Processor -- start 2026-02-24T19:23:51.758 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.754+0000 7ff43c9d7640 1 -- start start 2026-02-24T19:23:51.759 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.754+0000 7ff43c9d7640 10 monclient: init 2026-02-24T19:23:51.759 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.754+0000 7ff43c9d7640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:51.759 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.754+0000 7ff43c9d7640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:23:51.759 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.754+0000 7ff43c9d7640 10 monclient(hunting): picked mon.noname-c con 0x7ff434157780 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:51.759 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.754+0000 7ff43c9d7640 10 monclient(hunting): picked mon.noname-a con 0x7ff434157b50 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:51.759 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.754+0000 7ff43c9d7640 10 monclient(hunting): picked mon.noname-b con 0x7ff434164d00 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:51.759 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.754+0000 7ff43c9d7640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff43405de70 con 0x7ff434157b50 2026-02-24T19:23:51.759 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.754+0000 7ff43c9d7640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff434055b20 con 0x7ff434164d00 2026-02-24T19:23:51.759 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.754+0000 7ff43c9d7640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff434055e00 con 0x7ff434157780 2026-02-24T19:23:51.759 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.754+0000 7ff43c9d7640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:51.759 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.754+0000 7ff43c9d7640 10 monclient(hunting): authenticate will time out at 4006.435872s 2026-02-24T19:23:51.759 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.755+0000 7ff439f4b640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7ff434157b50 0x7ff4341645f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:50936/0 (socket says 10.20.193.14:50936) 2026-02-24T19:23:51.760 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.755+0000 7ff439f4b640 1 -- 10.20.193.14:0/2059328556 learned_addr learned my addr 10.20.193.14:0/2059328556 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:51.760 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.756+0000 7ff43974a640 1 -- 10.20.193.14:0/2059328556 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3731757894 0 0) 0x7ff43405de70 con 0x7ff434157b50 2026-02-24T19:23:51.760 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.756+0000 7ff43974a640 10 monclient(hunting): _negotiate 2026-02-24T19:23:51.760 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.756+0000 7ff43974a640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:51.760 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.756+0000 7ff43974a640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:51.760 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.756+0000 7ff43974a640 10 monclient(hunting): my global_id is 30828 2026-02-24T19:23:51.760 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.756+0000 7ff43974a640 1 -- 10.20.193.14:0/2059328556 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff424003610 con 0x7ff434157b50 2026-02-24T19:23:51.760 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.756+0000 7ff43974a640 1 -- 10.20.193.14:0/2059328556 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2696482465 0 0) 0x7ff434055b20 con 0x7ff434164d00 2026-02-24T19:23:51.760 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.756+0000 7ff43974a640 10 monclient(hunting): _negotiate 2026-02-24T19:23:51.760 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.756+0000 7ff43974a640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:51.760 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.756+0000 7ff43974a640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:51.760 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.756+0000 7ff43974a640 10 monclient(hunting): my global_id is 29146 2026-02-24T19:23:51.760 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.756+0000 7ff43974a640 1 -- 10.20.193.14:0/2059328556 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff43405de70 con 0x7ff434164d00 2026-02-24T19:23:51.761 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.756+0000 7ff43974a640 1 -- 10.20.193.14:0/2059328556 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 487064198 0 0) 0x7ff434055e00 con 0x7ff434157780 2026-02-24T19:23:51.761 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.756+0000 7ff43974a640 10 monclient(hunting): _negotiate 2026-02-24T19:23:51.761 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.756+0000 7ff43974a640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:51.761 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.756+0000 7ff43974a640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:51.761 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.756+0000 7ff43974a640 10 monclient(hunting): my global_id is 28781 2026-02-24T19:23:51.761 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.756+0000 7ff43974a640 1 -- 10.20.193.14:0/2059328556 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff434055b20 con 0x7ff434157780 2026-02-24T19:23:51.765 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.758+0000 7ff43974a640 1 -- 10.20.193.14:0/2059328556 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3911629090 0 0) 0x7ff43405de70 con 0x7ff434164d00 2026-02-24T19:23:51.765 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.758+0000 7ff43974a640 1 -- 10.20.193.14:0/2059328556 >> v1:10.20.193.170:6789/0 conn(0x7ff434157780 legacy=0x7ff434056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:51.765 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.758+0000 7ff43974a640 1 -- 10.20.193.14:0/2059328556 >> v1:10.20.193.14:6789/0 conn(0x7ff434157b50 legacy=0x7ff4341645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:51.765 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.758+0000 7ff43974a640 10 monclient: _finish_hunting 0 2026-02-24T19:23:51.765 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.758+0000 7ff43974a640 1 monclient: found mon.noname-b 2026-02-24T19:23:51.766 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.758+0000 7ff43974a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:51.766 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.758+0000 7ff43974a640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.44:6789/0 2026-02-24T19:23:51.766 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.758+0000 7ff43974a640 1 -- 10.20.193.14:0/2059328556 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4340560e0 con 0x7ff434164d00 2026-02-24T19:23:51.766 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.758+0000 7ff43974a640 10 monclient: _finish_auth 0 2026-02-24T19:23:51.766 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.758+0000 7ff43974a640 10 monclient: _check_auth_tickets 2026-02-24T19:23:51.766 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.758+0000 7ff43974a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:51.766 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.758+0000 7ff43974a640 1 -- 10.20.193.14:0/2059328556 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ff428003170 con 0x7ff434164d00 2026-02-24T19:23:51.766 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.758+0000 7ff43974a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:51.766 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.758+0000 7ff43974a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:23:51.766 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.758+0000 7ff43974a640 10 monclient: dump: 2026-02-24T19:23:51.766 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:51.766 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:51.766 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.767 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.767 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:51.767 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:51.767 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:51.767 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:51.767 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:51.767 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:51.767 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.758+0000 7ff43c9d7640 5 monclient: authenticate success, global_id 29146 2026-02-24T19:23:51.767 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.758+0000 7ff43c9d7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:51.767 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.759+0000 7ff43974a640 1 -- 10.20.193.14:0/2059328556 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff428003340 con 0x7ff434164d00 2026-02-24T19:23:51.767 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.759+0000 7ff43974a640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:51.767 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.759+0000 7ff43974a640 1 -- 10.20.193.14:0/2059328556 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ff428003780 con 0x7ff434164d00 2026-02-24T19:23:51.768 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.759+0000 7ff43974a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:51.768 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.759+0000 7ff43974a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:51.768 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.759+0000 7ff43974a640 10 monclient: dump: 2026-02-24T19:23:51.768 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:51.768 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:51.768 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.768 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.768 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:51.768 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:51.768 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:51.768 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:51.768 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:51.768 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:51.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.759+0000 7ff43c9d7640 10 monclient: get_monmap_and_config success 2026-02-24T19:23:51.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.759+0000 7ff43c9d7640 4 set_mon_vals no callback set 2026-02-24T19:23:51.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.759+0000 7ff43c9d7640 10 monclient: shutdown 2026-02-24T19:23:51.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.759+0000 7ff43c9d7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:51.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.759+0000 7ff43c9d7640 1 -- 10.20.193.14:0/2059328556 >> v1:10.20.193.44:6789/0 conn(0x7ff434164d00 legacy=0x7ff4341c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:51.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.759+0000 7ff43c9d7640 1 -- 10.20.193.14:0/2059328556 shutdown_connections 2026-02-24T19:23:51.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.759+0000 7ff43c9d7640 1 -- 10.20.193.14:0/2059328556 >> 10.20.193.14:0/2059328556 conn(0x7ff4340b2ef0 msgr2=0x7ff4340b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:51.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.759+0000 7ff43c9d7640 1 -- 10.20.193.14:0/2059328556 shutdown_connections 2026-02-24T19:23:51.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.759+0000 7ff43c9d7640 1 -- 10.20.193.14:0/2059328556 wait complete. 2026-02-24T19:23:51.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.759+0000 7ff43c9d7640 10 monclient: build_initial_monmap 2026-02-24T19:23:51.769 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.759+0000 7ff43c9d7640 10 monclient: monmap: 2026-02-24T19:23:51.769 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:51.770 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:23:51.770 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:23:51.770 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:23:51.770 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:51.770 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:23:51.770 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:51.770 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:51.770 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:51.770 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:51.770 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.760+0000 7ff43c9d7640 1 librados: starting msgr at 2026-02-24T19:23:51.770 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.760+0000 7ff43c9d7640 1 librados: starting objecter 2026-02-24T19:23:51.770 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.760+0000 7ff43c9d7640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:23:51.770 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.760+0000 7ff43c9d7640 1 Processor -- start 2026-02-24T19:23:51.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.760+0000 7ff43c9d7640 1 -- start start 2026-02-24T19:23:51.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.760+0000 7ff43c9d7640 1 librados: setting wanted keys 2026-02-24T19:23:51.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.760+0000 7ff43c9d7640 1 librados: calling monclient init 2026-02-24T19:23:51.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.760+0000 7ff43c9d7640 10 monclient: init 2026-02-24T19:23:51.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.760+0000 7ff43c9d7640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:51.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.760+0000 7ff43c9d7640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:23:51.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.760+0000 7ff43c9d7640 10 monclient(hunting): picked mon.noname-b con 0x7ff434157780 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:51.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.760+0000 7ff43c9d7640 10 monclient(hunting): picked mon.noname-c con 0x7ff434157b50 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:51.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.760+0000 7ff43c9d7640 10 monclient(hunting): picked mon.noname-a con 0x7ff434164d00 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:51.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.760+0000 7ff43c9d7640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4340ae5d0 con 0x7ff434164d00 2026-02-24T19:23:51.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.760+0000 7ff43c9d7640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4340ae8b0 con 0x7ff434157780 2026-02-24T19:23:51.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.760+0000 7ff43c9d7640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4340aeb90 con 0x7ff434157b50 2026-02-24T19:23:51.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.760+0000 7ff43c9d7640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:51.772 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.760+0000 7ff43c9d7640 10 monclient(hunting): authenticate will time out at 4006.441672s 2026-02-24T19:23:51.772 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.760+0000 7ff43af4d640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7ff434164d00 0x7ff434123100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:50946/0 (socket says 10.20.193.14:50946) 2026-02-24T19:23:51.772 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.760+0000 7ff43af4d640 1 -- 10.20.193.14:0/1182408538 learned_addr learned my addr 10.20.193.14:0/1182408538 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:51.772 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.761+0000 7ff41effd640 10 client.?.objecter ms_handle_connect 0x7ff434164d00 2026-02-24T19:23:51.772 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.761+0000 7ff41effd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:51.772 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.761+0000 7ff41effd640 10 client.?.objecter ms_handle_connect 0x7ff434157b50 2026-02-24T19:23:51.772 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.761+0000 7ff41effd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:51.772 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.761+0000 7ff41effd640 10 client.?.objecter ms_handle_connect 0x7ff434157780 2026-02-24T19:23:51.772 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.761+0000 7ff41effd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:51.772 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.762+0000 7ff41effd640 1 -- 10.20.193.14:0/1182408538 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1419787552 0 0) 0x7ff4340aeb90 con 0x7ff434157b50 2026-02-24T19:23:51.772 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.762+0000 7ff41effd640 10 monclient(hunting): _negotiate 2026-02-24T19:23:51.772 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.762+0000 7ff41effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:51.772 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.762+0000 7ff41effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:51.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.762+0000 7ff41effd640 10 monclient(hunting): my global_id is 28784 2026-02-24T19:23:51.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.762+0000 7ff41effd640 1 -- 10.20.193.14:0/1182408538 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff404003610 con 0x7ff434157b50 2026-02-24T19:23:51.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.762+0000 7ff41effd640 1 -- 10.20.193.14:0/1182408538 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 692247296 0 0) 0x7ff4340ae5d0 con 0x7ff434164d00 2026-02-24T19:23:51.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.762+0000 7ff41effd640 10 monclient(hunting): _negotiate 2026-02-24T19:23:51.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.762+0000 7ff41effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:51.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.762+0000 7ff41effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:51.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.762+0000 7ff41effd640 10 monclient(hunting): my global_id is 30831 2026-02-24T19:23:51.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.762+0000 7ff41effd640 1 -- 10.20.193.14:0/1182408538 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4340aeb90 con 0x7ff434164d00 2026-02-24T19:23:51.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.762+0000 7ff41effd640 1 -- 10.20.193.14:0/1182408538 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2830436986 0 0) 0x7ff4340ae8b0 con 0x7ff434157780 2026-02-24T19:23:51.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.762+0000 7ff41effd640 10 monclient(hunting): _negotiate 2026-02-24T19:23:51.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.762+0000 7ff41effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:51.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.762+0000 7ff41effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:51.773 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.762+0000 7ff41effd640 10 monclient(hunting): my global_id is 29149 2026-02-24T19:23:51.774 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.762+0000 7ff41effd640 1 -- 10.20.193.14:0/1182408538 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4340ae5d0 con 0x7ff434157780 2026-02-24T19:23:51.776 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.764+0000 7ff41effd640 1 -- 10.20.193.14:0/1182408538 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2429983566 0 0) 0x7ff404003610 con 0x7ff434157b50 2026-02-24T19:23:51.776 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.764+0000 7ff41effd640 1 -- 10.20.193.14:0/1182408538 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff4340ae8b0 con 0x7ff434157b50 2026-02-24T19:23:51.776 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.764+0000 7ff41effd640 1 -- 10.20.193.14:0/1182408538 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ff4200030b0 con 0x7ff434157b50 2026-02-24T19:23:51.776 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.764+0000 7ff41effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:51.776 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.764+0000 7ff41effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:23:51.777 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.764+0000 7ff41effd640 10 monclient(hunting): dump: 2026-02-24T19:23:51.777 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:51.777 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:51.777 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.777 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.777 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:51.777 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:51.777 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:51.777 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:51.777 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:51.777 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:51.777 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.764+0000 7ff41effd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:23:51.778 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.765+0000 7ff41effd640 1 -- 10.20.193.14:0/1182408538 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1323705951 0 0) 0x7ff4340ae5d0 con 0x7ff434157780 2026-02-24T19:23:51.778 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.765+0000 7ff41effd640 1 -- 10.20.193.14:0/1182408538 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff404003610 con 0x7ff434157780 2026-02-24T19:23:51.778 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.765+0000 7ff41effd640 1 -- 10.20.193.14:0/1182408538 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ff42c002fd0 con 0x7ff434157780 2026-02-24T19:23:51.778 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.765+0000 7ff41effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:51.778 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.765+0000 7ff41effd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:51.778 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.765+0000 7ff41effd640 10 monclient(hunting): dump: 2026-02-24T19:23:51.778 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:51.778 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:51.778 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.778 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.778 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:51.778 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:51.778 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:51.779 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:51.779 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:51.779 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:51.779 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.765+0000 7ff41effd640 1 -- 10.20.193.14:0/1182408538 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2533800485 0 0) 0x7ff4340aeb90 con 0x7ff434164d00 2026-02-24T19:23:51.779 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.765+0000 7ff41effd640 1 -- 10.20.193.14:0/1182408538 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff4340ae5d0 con 0x7ff434164d00 2026-02-24T19:23:51.779 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.765+0000 7ff41effd640 1 -- 10.20.193.14:0/1182408538 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ff428003690 con 0x7ff434164d00 2026-02-24T19:23:51.779 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.765+0000 7ff41effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:51.779 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.765+0000 7ff41effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:51.779 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.765+0000 7ff41effd640 10 monclient(hunting): dump: 2026-02-24T19:23:51.779 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:51.779 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:51.779 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.779 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.780 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:51.780 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:51.780 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:51.780 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:51.780 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:51.780 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:51.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.766+0000 7ff41effd640 1 -- 10.20.193.14:0/1182408538 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 268752287 0 0) 0x7ff4340ae8b0 con 0x7ff434157b50 2026-02-24T19:23:51.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.766+0000 7ff41effd640 1 -- 10.20.193.14:0/1182408538 >> v1:10.20.193.44:6789/0 conn(0x7ff434157780 legacy=0x7ff43415bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:51.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.766+0000 7ff41effd640 1 -- 10.20.193.14:0/1182408538 >> v1:10.20.193.14:6789/0 conn(0x7ff434164d00 legacy=0x7ff434123100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:51.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.766+0000 7ff41effd640 10 monclient: _finish_hunting 0 2026-02-24T19:23:51.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.766+0000 7ff41effd640 1 monclient: found mon.c 2026-02-24T19:23:51.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.766+0000 7ff41effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:51.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.766+0000 7ff41effd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:51.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.766+0000 7ff41effd640 1 -- 10.20.193.14:0/1182408538 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4340aee70 con 0x7ff434157b50 2026-02-24T19:23:51.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.766+0000 7ff41effd640 10 monclient: _finish_auth 0 2026-02-24T19:23:51.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.766+0000 7ff41effd640 10 monclient: _check_auth_tickets 2026-02-24T19:23:51.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.766+0000 7ff41effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:51.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.766+0000 7ff43c9d7640 5 monclient: authenticate success, global_id 28784 2026-02-24T19:23:51.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.766+0000 7ff43c9d7640 10 monclient: _renew_subs 2026-02-24T19:23:51.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.766+0000 7ff43c9d7640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:51.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.766+0000 7ff43c9d7640 1 -- 10.20.193.14:0/1182408538 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff4340af150 con 0x7ff434157b50 2026-02-24T19:23:51.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.766+0000 7ff43c9d7640 10 client.28784.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:51.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.766+0000 7ff43c9d7640 10 monclient: _renew_subs 2026-02-24T19:23:51.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.766+0000 7ff43c9d7640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:51.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.766+0000 7ff43c9d7640 1 -- 10.20.193.14:0/1182408538 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff434156ff0 con 0x7ff434157b50 2026-02-24T19:23:51.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.766+0000 7ff43c9d7640 1 librados: init done 2026-02-24T19:23:51.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.766+0000 7ff43c9d7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:51.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.766+0000 7ff43c9d7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:51.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.766+0000 7ff43c9d7640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:51.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.766+0000 7ff43c9d7640 1 -- 10.20.193.14:0/1182408538 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff43415b8f0 con 0x7ff434157b50 2026-02-24T19:23:51.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.858+0000 7ff41effd640 1 -- 10.20.193.14:0/1182408538 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff4200048d0 con 0x7ff434157b50 2026-02-24T19:23:51.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.858+0000 7ff41effd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:51.860 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.858+0000 7ff41effd640 1 -- 10.20.193.14:0/1182408538 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7ff420004c20 con 0x7ff434157b50 2026-02-24T19:23:51.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.858+0000 7ff41effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:51.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.858+0000 7ff41effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:51.861 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.858+0000 7ff41effd640 10 monclient: dump: 2026-02-24T19:23:51.861 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:51.861 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:51.861 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.861 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:51.861 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:51.861 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:51.861 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:51.861 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:51.862 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:51.862 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:51.862 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.858+0000 7ff438f49640 4 set_mon_vals no callback set 2026-02-24T19:23:51.863 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.859+0000 7ff41effd640 1 -- 10.20.193.14:0/1182408538 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7ff42001da90 con 0x7ff434157b50 2026-02-24T19:23:51.863 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.859+0000 7ff43a74c640 10 monclient: get_auth_request con 0x7ff404077e20 auth_method 0 2026-02-24T19:23:51.863 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.860+0000 7ff41effd640 10 client.28784.objecter ms_handle_connect 0x7ff404077e20 2026-02-24T19:23:51.863 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.860+0000 7ff41effd640 1 -- 10.20.193.14:0/1182408538 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7ff4200931d0 con 0x7ff434157b50 2026-02-24T19:23:51.863 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.860+0000 7ff41effd640 10 client.28784.objecter ms_dispatch2 0x7ff434000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:23:51.863 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.860+0000 7ff41effd640 3 client.28784.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:23:51.863 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.860+0000 7ff41effd640 3 client.28784.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:23:51.863 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.860+0000 7ff41effd640 20 client.28784.objecter dump_active .. 0 homeless 2026-02-24T19:23:51.864 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.862+0000 7ff41effd640 1 -- 10.20.193.14:0/1182408538 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7ff42005dc00 con 0x7ff434157b50 2026-02-24T19:23:51.864 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.862+0000 7ff41effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:51.864 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.862+0000 7ff41effd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:23:51.972 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.970+0000 7ff43c9d7640 1 -- 10.20.193.14:0/1182408538 --> v1:10.20.193.14:6800/4014096310 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7ff4340af390 con 0x7ff404077e20 2026-02-24T19:23:51.972 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.970+0000 7ff41effd640 1 -- 10.20.193.14:0/1182408538 <== mgr.4110 v1:10.20.193.14:6800/4014096310 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (unknown 3049115190 0 0) 0x7ff4340af390 con 0x7ff404077e20 2026-02-24T19:23:51.972 INFO:teuthology.orchestra.run.trial014.stderr:instructed osd(s) 2 to deep-scrub 2026-02-24T19:23:51.974 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.972+0000 7ff43c9d7640 10 librados: watch_flush enter 2026-02-24T19:23:51.974 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.972+0000 7ff43c9d7640 10 librados: watch_flush exit 2026-02-24T19:23:51.974 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.972+0000 7ff43c9d7640 20 client.28784.objecter shutdown clearing up homeless session... 2026-02-24T19:23:51.974 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.972+0000 7ff43c9d7640 10 client.28784.objecter successfully canceled tick 2026-02-24T19:23:51.974 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.972+0000 7ff43c9d7640 1 -- 10.20.193.14:0/1182408538 >> v1:10.20.193.14:6800/4014096310 conn(0x7ff404077e20 legacy=0x7ff4040982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:51.975 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.972+0000 7ff43c9d7640 10 monclient: shutdown 2026-02-24T19:23:51.975 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.972+0000 7ff43c9d7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:51.975 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.972+0000 7ff43c9d7640 1 -- 10.20.193.14:0/1182408538 >> v1:10.20.193.170:6789/0 conn(0x7ff434157b50 legacy=0x7ff43413a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:51.975 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.972+0000 7ff43c9d7640 1 -- 10.20.193.14:0/1182408538 shutdown_connections 2026-02-24T19:23:51.975 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.972+0000 7ff43c9d7640 1 -- 10.20.193.14:0/1182408538 >> 10.20.193.14:0/1182408538 conn(0x7ff4340b2ef0 msgr2=0x7ff4340b5550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:51.975 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.972+0000 7ff43c9d7640 1 -- 10.20.193.14:0/1182408538 shutdown_connections 2026-02-24T19:23:51.975 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.972+0000 7ff43c9d7640 1 -- 10.20.193.14:0/1182408538 wait complete. 2026-02-24T19:23:51.975 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:51.972+0000 7ff43c9d7640 1 librados: shutdown 2026-02-24T19:23:51.982 INFO:tasks.ceph:Scrubbing osd.6 2026-02-24T19:23:51.982 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:23:52.053 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.051+0000 7f7b96cc6640 10 monclient: get_monmap_and_config 2026-02-24T19:23:52.053 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.051+0000 7f7b96cc6640 10 monclient: build_initial_monmap 2026-02-24T19:23:52.053 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.051+0000 7f7b96cc6640 10 monclient: monmap: 2026-02-24T19:23:52.053 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:52.053 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:52.053 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:23:52.052042+0000 2026-02-24T19:23:52.053 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:23:52.052042+0000 2026-02-24T19:23:52.053 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:52.053 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:52.054 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:52.054 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:52.054 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:52.054 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.055 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.051+0000 7f7b96cc6640 1 Processor -- start 2026-02-24T19:23:52.055 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.051+0000 7f7b96cc6640 1 -- start start 2026-02-24T19:23:52.055 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.051+0000 7f7b96cc6640 10 monclient: init 2026-02-24T19:23:52.055 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.052+0000 7f7b96cc6640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:52.055 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.052+0000 7f7b96cc6640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:23:52.055 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.052+0000 7f7b96cc6640 10 monclient(hunting): picked mon.noname-a con 0x7f7b9015e2a0 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:52.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.052+0000 7f7b96cc6640 10 monclient(hunting): picked mon.noname-c con 0x7f7b90059e10 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:52.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.052+0000 7f7b96cc6640 10 monclient(hunting): picked mon.noname-b con 0x7f7b901a5660 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:52.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.052+0000 7f7b96cc6640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b90162df0 con 0x7f7b9015e2a0 2026-02-24T19:23:52.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.052+0000 7f7b96cc6640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b901630d0 con 0x7f7b901a5660 2026-02-24T19:23:52.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.052+0000 7f7b96cc6640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b901633b0 con 0x7f7b90059e10 2026-02-24T19:23:52.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.052+0000 7f7b96cc6640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:52.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.052+0000 7f7b96cc6640 10 monclient(hunting): authenticate will time out at 4006.733560s 2026-02-24T19:23:52.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.052+0000 7f7b94a3b640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f7b9015e2a0 0x7f7b9005da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:50954/0 (socket says 10.20.193.14:50954) 2026-02-24T19:23:52.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.052+0000 7f7b94a3b640 1 -- 10.20.193.14:0/3226813345 learned_addr learned my addr 10.20.193.14:0/3226813345 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:52.061 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.054+0000 7f7b877fe640 1 -- 10.20.193.14:0/3226813345 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1430986317 0 0) 0x7f7b90162df0 con 0x7f7b9015e2a0 2026-02-24T19:23:52.061 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.054+0000 7f7b877fe640 10 monclient(hunting): _negotiate 2026-02-24T19:23:52.061 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.054+0000 7f7b877fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:52.061 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.054+0000 7f7b877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:52.062 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.054+0000 7f7b877fe640 10 monclient(hunting): my global_id is 30834 2026-02-24T19:23:52.062 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.054+0000 7f7b877fe640 1 -- 10.20.193.14:0/3226813345 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b7c003610 con 0x7f7b9015e2a0 2026-02-24T19:23:52.062 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.054+0000 7f7b877fe640 1 -- 10.20.193.14:0/3226813345 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 647571837 0 0) 0x7f7b901633b0 con 0x7f7b90059e10 2026-02-24T19:23:52.062 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.054+0000 7f7b877fe640 10 monclient(hunting): _negotiate 2026-02-24T19:23:52.062 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.054+0000 7f7b877fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:52.062 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.054+0000 7f7b877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:52.062 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.054+0000 7f7b877fe640 10 monclient(hunting): my global_id is 28787 2026-02-24T19:23:52.062 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.054+0000 7f7b877fe640 1 -- 10.20.193.14:0/3226813345 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b90162df0 con 0x7f7b90059e10 2026-02-24T19:23:52.062 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.054+0000 7f7b877fe640 1 -- 10.20.193.14:0/3226813345 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2371730814 0 0) 0x7f7b901630d0 con 0x7f7b901a5660 2026-02-24T19:23:52.062 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.054+0000 7f7b877fe640 10 monclient(hunting): _negotiate 2026-02-24T19:23:52.062 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.054+0000 7f7b877fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:52.062 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.054+0000 7f7b877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:52.063 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.054+0000 7f7b877fe640 10 monclient(hunting): my global_id is 29152 2026-02-24T19:23:52.063 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.054+0000 7f7b877fe640 1 -- 10.20.193.14:0/3226813345 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b901633b0 con 0x7f7b901a5660 2026-02-24T19:23:52.063 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.055+0000 7f7b877fe640 1 -- 10.20.193.14:0/3226813345 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1875860439 0 0) 0x7f7b7c003610 con 0x7f7b9015e2a0 2026-02-24T19:23:52.063 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.055+0000 7f7b877fe640 1 -- 10.20.193.14:0/3226813345 >> v1:10.20.193.170:6789/0 conn(0x7f7b90059e10 legacy=0x7f7b9015ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:52.063 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.055+0000 7f7b877fe640 1 -- 10.20.193.14:0/3226813345 >> v1:10.20.193.44:6789/0 conn(0x7f7b901a5660 legacy=0x7f7b901c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:52.063 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.055+0000 7f7b877fe640 10 monclient: _finish_hunting 0 2026-02-24T19:23:52.063 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.055+0000 7f7b877fe640 1 monclient: found mon.noname-a 2026-02-24T19:23:52.063 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.055+0000 7f7b877fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:52.063 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.055+0000 7f7b877fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:23:52.063 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.055+0000 7f7b877fe640 1 -- 10.20.193.14:0/3226813345 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b90163690 con 0x7f7b9015e2a0 2026-02-24T19:23:52.063 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.055+0000 7f7b877fe640 10 monclient: _finish_auth 0 2026-02-24T19:23:52.063 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.055+0000 7f7b877fe640 10 monclient: _check_auth_tickets 2026-02-24T19:23:52.064 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.055+0000 7f7b877fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:52.064 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.055+0000 7f7b877fe640 1 -- 10.20.193.14:0/3226813345 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7b80002df0 con 0x7f7b9015e2a0 2026-02-24T19:23:52.064 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.055+0000 7f7b877fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:52.064 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.055+0000 7f7b877fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:23:52.064 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.055+0000 7f7b877fe640 10 monclient: dump: 2026-02-24T19:23:52.064 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:52.064 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:52.064 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.064 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.064 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:52.064 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:52.064 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:52.064 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:52.065 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:52.065 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.065 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.056+0000 7f7b96cc6640 5 monclient: authenticate success, global_id 30834 2026-02-24T19:23:52.065 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.056+0000 7f7b96cc6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:52.065 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.056+0000 7f7b877fe640 1 -- 10.20.193.14:0/3226813345 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7b80002fc0 con 0x7f7b9015e2a0 2026-02-24T19:23:52.065 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.056+0000 7f7b877fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:52.065 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.056+0000 7f7b877fe640 1 -- 10.20.193.14:0/3226813345 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7b80003400 con 0x7f7b9015e2a0 2026-02-24T19:23:52.065 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.056+0000 7f7b877fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:52.065 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.056+0000 7f7b877fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:52.065 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.056+0000 7f7b877fe640 10 monclient: dump: 2026-02-24T19:23:52.065 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:52.065 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:52.065 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.066 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.066 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:52.066 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:52.066 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:52.066 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:52.066 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:52.066 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.066 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.056+0000 7f7b96cc6640 10 monclient: get_monmap_and_config success 2026-02-24T19:23:52.066 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.056+0000 7f7b96cc6640 4 set_mon_vals no callback set 2026-02-24T19:23:52.066 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.057+0000 7f7b96cc6640 10 monclient: shutdown 2026-02-24T19:23:52.066 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.057+0000 7f7b96cc6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:52.066 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.057+0000 7f7b96cc6640 1 -- 10.20.193.14:0/3226813345 >> v1:10.20.193.14:6789/0 conn(0x7f7b9015e2a0 legacy=0x7f7b9005da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:52.066 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.057+0000 7f7b96cc6640 1 -- 10.20.193.14:0/3226813345 shutdown_connections 2026-02-24T19:23:52.067 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.057+0000 7f7b96cc6640 1 -- 10.20.193.14:0/3226813345 >> 10.20.193.14:0/3226813345 conn(0x7f7b900b2f60 msgr2=0x7f7b900b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:52.067 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.057+0000 7f7b96cc6640 1 -- 10.20.193.14:0/3226813345 shutdown_connections 2026-02-24T19:23:52.067 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.057+0000 7f7b96cc6640 1 -- 10.20.193.14:0/3226813345 wait complete. 2026-02-24T19:23:52.067 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.057+0000 7f7b96cc6640 10 monclient: build_initial_monmap 2026-02-24T19:23:52.067 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.057+0000 7f7b96cc6640 10 monclient: monmap: 2026-02-24T19:23:52.067 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:52.067 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:23:52.067 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:23:52.067 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:23:52.067 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:52.067 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:23:52.067 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:52.068 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:52.068 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:52.068 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.068 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.057+0000 7f7b96cc6640 1 librados: starting msgr at 2026-02-24T19:23:52.068 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.057+0000 7f7b96cc6640 1 librados: starting objecter 2026-02-24T19:23:52.068 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.057+0000 7f7b96cc6640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:23:52.068 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.057+0000 7f7b96cc6640 1 Processor -- start 2026-02-24T19:23:52.068 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.057+0000 7f7b96cc6640 1 -- start start 2026-02-24T19:23:52.068 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.057+0000 7f7b96cc6640 1 librados: setting wanted keys 2026-02-24T19:23:52.068 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.057+0000 7f7b96cc6640 1 librados: calling monclient init 2026-02-24T19:23:52.068 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.057+0000 7f7b96cc6640 10 monclient: init 2026-02-24T19:23:52.068 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.058+0000 7f7b96cc6640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:52.068 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.058+0000 7f7b96cc6640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:23:52.069 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.058+0000 7f7b96cc6640 10 monclient(hunting): picked mon.noname-b con 0x7f7b90059e10 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:52.069 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.058+0000 7f7b96cc6640 10 monclient(hunting): picked mon.noname-c con 0x7f7b9015e2a0 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:52.069 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.058+0000 7f7b96cc6640 10 monclient(hunting): picked mon.noname-a con 0x7f7b901a5660 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:52.069 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.058+0000 7f7b96cc6640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b90195040 con 0x7f7b901a5660 2026-02-24T19:23:52.069 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.058+0000 7f7b96cc6640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b90195320 con 0x7f7b90059e10 2026-02-24T19:23:52.069 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.058+0000 7f7b96cc6640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b90195600 con 0x7f7b9015e2a0 2026-02-24T19:23:52.069 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.058+0000 7f7b96cc6640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:52.069 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.058+0000 7f7b96cc6640 10 monclient(hunting): authenticate will time out at 4006.739286s 2026-02-24T19:23:52.069 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.058+0000 7f7b9523c640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f7b901a5660 0x7f7b900b1ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:50960/0 (socket says 10.20.193.14:50960) 2026-02-24T19:23:52.069 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.058+0000 7f7b9523c640 1 -- 10.20.193.14:0/3604177601 learned_addr learned my addr 10.20.193.14:0/3604177601 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:52.069 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.058+0000 7f7b857fa640 10 client.?.objecter ms_handle_connect 0x7f7b901a5660 2026-02-24T19:23:52.069 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.058+0000 7f7b857fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:52.069 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.058+0000 7f7b857fa640 10 client.?.objecter ms_handle_connect 0x7f7b9015e2a0 2026-02-24T19:23:52.070 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.058+0000 7f7b857fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:52.070 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.058+0000 7f7b857fa640 10 client.?.objecter ms_handle_connect 0x7f7b90059e10 2026-02-24T19:23:52.070 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.058+0000 7f7b857fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:52.070 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.059+0000 7f7b857fa640 1 -- 10.20.193.14:0/3604177601 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2861655901 0 0) 0x7f7b90195040 con 0x7f7b901a5660 2026-02-24T19:23:52.070 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.059+0000 7f7b857fa640 10 monclient(hunting): _negotiate 2026-02-24T19:23:52.070 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.059+0000 7f7b857fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:52.070 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.059+0000 7f7b857fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:52.070 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.059+0000 7f7b857fa640 10 monclient(hunting): my global_id is 30837 2026-02-24T19:23:52.070 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.059+0000 7f7b857fa640 1 -- 10.20.193.14:0/3604177601 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b60003610 con 0x7f7b901a5660 2026-02-24T19:23:52.070 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.059+0000 7f7b857fa640 1 -- 10.20.193.14:0/3604177601 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2455425528 0 0) 0x7f7b90195600 con 0x7f7b9015e2a0 2026-02-24T19:23:52.070 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.059+0000 7f7b857fa640 10 monclient(hunting): _negotiate 2026-02-24T19:23:52.070 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.059+0000 7f7b857fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:52.070 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.059+0000 7f7b857fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:52.071 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.059+0000 7f7b857fa640 10 monclient(hunting): my global_id is 28790 2026-02-24T19:23:52.071 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.059+0000 7f7b857fa640 1 -- 10.20.193.14:0/3604177601 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b90195040 con 0x7f7b9015e2a0 2026-02-24T19:23:52.071 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.060+0000 7f7b857fa640 1 -- 10.20.193.14:0/3604177601 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 496366852 0 0) 0x7f7b90195320 con 0x7f7b90059e10 2026-02-24T19:23:52.071 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.060+0000 7f7b857fa640 10 monclient(hunting): _negotiate 2026-02-24T19:23:52.071 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.060+0000 7f7b857fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:52.071 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.060+0000 7f7b857fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:52.071 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.060+0000 7f7b857fa640 10 monclient(hunting): my global_id is 29155 2026-02-24T19:23:52.071 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.060+0000 7f7b857fa640 1 -- 10.20.193.14:0/3604177601 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b90195600 con 0x7f7b90059e10 2026-02-24T19:23:52.074 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.062+0000 7f7b857fa640 1 -- 10.20.193.14:0/3604177601 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 925338963 0 0) 0x7f7b60003610 con 0x7f7b901a5660 2026-02-24T19:23:52.074 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.062+0000 7f7b857fa640 1 -- 10.20.193.14:0/3604177601 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7b90195320 con 0x7f7b901a5660 2026-02-24T19:23:52.074 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.062+0000 7f7b857fa640 1 -- 10.20.193.14:0/3604177601 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7b8c003470 con 0x7f7b901a5660 2026-02-24T19:23:52.074 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.062+0000 7f7b857fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:52.074 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.062+0000 7f7b857fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:23:52.074 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.062+0000 7f7b857fa640 10 monclient(hunting): dump: 2026-02-24T19:23:52.074 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:52.074 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:52.075 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.075 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.075 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:52.075 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:52.075 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:52.075 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:52.075 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:52.075 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.075 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.062+0000 7f7b857fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:23:52.075 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.062+0000 7f7b857fa640 1 -- 10.20.193.14:0/3604177601 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 314162603 0 0) 0x7f7b90195040 con 0x7f7b9015e2a0 2026-02-24T19:23:52.075 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.062+0000 7f7b857fa640 1 -- 10.20.193.14:0/3604177601 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7b60003610 con 0x7f7b9015e2a0 2026-02-24T19:23:52.075 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.062+0000 7f7b857fa640 1 -- 10.20.193.14:0/3604177601 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7b78002ff0 con 0x7f7b9015e2a0 2026-02-24T19:23:52.075 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.062+0000 7f7b857fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:52.076 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.062+0000 7f7b857fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:52.076 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.062+0000 7f7b857fa640 10 monclient(hunting): dump: 2026-02-24T19:23:52.076 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:52.076 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:52.076 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.076 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.076 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:52.076 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:52.076 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:52.076 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:52.076 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:52.076 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.077 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.062+0000 7f7b857fa640 1 -- 10.20.193.14:0/3604177601 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 39592364 0 0) 0x7f7b90195600 con 0x7f7b90059e10 2026-02-24T19:23:52.077 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.062+0000 7f7b857fa640 1 -- 10.20.193.14:0/3604177601 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7b90195040 con 0x7f7b90059e10 2026-02-24T19:23:52.077 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.062+0000 7f7b857fa640 1 -- 10.20.193.14:0/3604177601 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7b80003310 con 0x7f7b90059e10 2026-02-24T19:23:52.077 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.062+0000 7f7b857fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:52.077 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.062+0000 7f7b857fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:52.077 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.062+0000 7f7b857fa640 10 monclient(hunting): dump: 2026-02-24T19:23:52.077 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:52.077 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:52.077 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.077 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.077 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:52.077 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:52.077 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:52.078 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:52.078 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:52.078 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.078 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.063+0000 7f7b857fa640 1 -- 10.20.193.14:0/3604177601 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3387555991 0 0) 0x7f7b90195320 con 0x7f7b901a5660 2026-02-24T19:23:52.078 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.063+0000 7f7b857fa640 1 -- 10.20.193.14:0/3604177601 >> v1:10.20.193.170:6789/0 conn(0x7f7b9015e2a0 legacy=0x7f7b90190e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:52.078 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.063+0000 7f7b857fa640 1 -- 10.20.193.14:0/3604177601 >> v1:10.20.193.44:6789/0 conn(0x7f7b90059e10 legacy=0x7f7b90194870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:52.078 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.063+0000 7f7b857fa640 10 monclient: _finish_hunting 0 2026-02-24T19:23:52.078 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.063+0000 7f7b857fa640 1 monclient: found mon.a 2026-02-24T19:23:52.078 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.063+0000 7f7b857fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:52.078 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.063+0000 7f7b857fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:52.078 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.063+0000 7f7b857fa640 1 -- 10.20.193.14:0/3604177601 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b90190670 con 0x7f7b901a5660 2026-02-24T19:23:52.078 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.063+0000 7f7b857fa640 10 monclient: _finish_auth 0 2026-02-24T19:23:52.078 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.063+0000 7f7b857fa640 10 monclient: _check_auth_tickets 2026-02-24T19:23:52.079 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.063+0000 7f7b857fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:52.079 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.063+0000 7f7b96cc6640 5 monclient: authenticate success, global_id 30837 2026-02-24T19:23:52.079 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.063+0000 7f7b96cc6640 10 monclient: _renew_subs 2026-02-24T19:23:52.079 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.063+0000 7f7b96cc6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:52.079 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.063+0000 7f7b96cc6640 1 -- 10.20.193.14:0/3604177601 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7b90191580 con 0x7f7b901a5660 2026-02-24T19:23:52.079 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.063+0000 7f7b96cc6640 10 client.30837.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:52.079 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.063+0000 7f7b96cc6640 10 monclient: _renew_subs 2026-02-24T19:23:52.079 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.063+0000 7f7b96cc6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:52.079 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.063+0000 7f7b96cc6640 1 -- 10.20.193.14:0/3604177601 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7b900b27d0 con 0x7f7b901a5660 2026-02-24T19:23:52.079 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.063+0000 7f7b96cc6640 1 librados: init done 2026-02-24T19:23:52.079 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.064+0000 7f7b96cc6640 10 client.30837.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:52.079 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.064+0000 7f7b96cc6640 15 client.30837.objecter _session_command_op_assign -1 1 2026-02-24T19:23:52.079 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.064+0000 7f7b96cc6640 20 client.30837.objecter _get_session osd=-1 returning homeless 2026-02-24T19:23:52.080 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.064+0000 7f7b96cc6640 10 client.30837.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:52.080 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.064+0000 7f7b96cc6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:52.080 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.064+0000 7f7b96cc6640 1 -- 10.20.193.14:0/3604177601 --> v1:10.20.193.14:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f7b90195840 con 0x7f7b901a5660 2026-02-24T19:23:52.080 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.072+0000 7f7b857fa640 1 -- 10.20.193.14:0/3604177601 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7b90195840 con 0x7f7b901a5660 2026-02-24T19:23:52.080 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.072+0000 7f7b857fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:52.080 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.072+0000 7f7b857fa640 1 -- 10.20.193.14:0/3604177601 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7b8c003d30 con 0x7f7b901a5660 2026-02-24T19:23:52.080 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.072+0000 7f7b857fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:52.080 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.072+0000 7f7b857fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:52.080 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.072+0000 7f7b857fa640 10 monclient: dump: 2026-02-24T19:23:52.080 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:52.080 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:52.080 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.080 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.081 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:52.081 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:52.081 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:52.081 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:52.081 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:52.081 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.081 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.072+0000 7f7b86ffd640 4 set_mon_vals no callback set 2026-02-24T19:23:52.081 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.072+0000 7f7b857fa640 1 -- 10.20.193.14:0/3604177601 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f7b8c003f10 con 0x7f7b901a5660 2026-02-24T19:23:52.083 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.073+0000 7f7b94a3b640 10 monclient: get_auth_request con 0x7f7b60077ea0 auth_method 0 2026-02-24T19:23:52.083 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.073+0000 7f7b857fa640 10 client.30837.objecter ms_handle_connect 0x7f7b60077ea0 2026-02-24T19:23:52.083 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.073+0000 7f7b857fa640 1 -- 10.20.193.14:0/3604177601 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7f7b8c093350 con 0x7f7b901a5660 2026-02-24T19:23:52.083 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.074+0000 7f7b857fa640 10 client.30837.objecter ms_dispatch2 0x7f7b90000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:23:52.083 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.074+0000 7f7b857fa640 3 client.30837.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:23:52.083 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.074+0000 7f7b857fa640 3 client.30837.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:23:52.083 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.074+0000 7f7b857fa640 10 client.30837.objecter checking command 1 2026-02-24T19:23:52.083 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.074+0000 7f7b857fa640 20 client.30837.objecter _get_session s=0x7f7b600a2160 osd=6 3 2026-02-24T19:23:52.083 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.074+0000 7f7b857fa640 20 client.30837.objecter put_session s=0x7f7b600a2160 osd=6 3 2026-02-24T19:23:52.083 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.074+0000 7f7b857fa640 15 client.30837.objecter _session_command_op_remove -1 1 2026-02-24T19:23:52.083 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.074+0000 7f7b857fa640 20 client.30837.objecter _get_session s=0x7f7b600a2160 osd=6 3 2026-02-24T19:23:52.084 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.074+0000 7f7b857fa640 20 client.30837.objecter get_session s=0x7f7b600a2160 osd=6 3 2026-02-24T19:23:52.084 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.074+0000 7f7b857fa640 15 client.30837.objecter _session_command_op_assign 6 1 2026-02-24T19:23:52.084 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.074+0000 7f7b857fa640 20 client.30837.objecter put_session s=0x7f7b600a2160 osd=6 4 2026-02-24T19:23:52.084 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.074+0000 7f7b857fa640 10 client.30837.objecter _send_command 1 2026-02-24T19:23:52.084 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.074+0000 7f7b857fa640 1 -- 10.20.193.14:0/3604177601 --> v1:10.20.193.170:6800/3031579126 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7b600c4470 con 0x7f7b600a2810 2026-02-24T19:23:52.084 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.074+0000 7f7b857fa640 20 client.30837.objecter dump_active .. 0 homeless 2026-02-24T19:23:52.084 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.074+0000 7f7b857fa640 1 -- 10.20.193.14:0/3604177601 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_get_version_reply(handle=1 version=354) ==== 24+0+0 (unknown 31317031 0 0) 0x7f7b8c0599f0 con 0x7f7b901a5660 2026-02-24T19:23:52.084 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.074+0000 7f7b857fa640 10 monclient: handle_get_version_reply finishing 1 version 354 2026-02-24T19:23:52.084 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.074+0000 7f7b87fff640 10 monclient: get_auth_request con 0x7f7b600a2810 auth_method 0 2026-02-24T19:23:52.084 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.075+0000 7f7b857fa640 10 client.30837.objecter ms_handle_connect 0x7f7b600a2810 2026-02-24T19:23:52.086 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.085+0000 7f7b857fa640 1 -- 10.20.193.14:0/3604177601 <== osd.6 v1:10.20.193.170:6800/3031579126 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f7b600c4470 con 0x7f7b600a2810 2026-02-24T19:23:52.087 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.085+0000 7f7b857fa640 10 client.30837.objecter ms_dispatch2 0x7f7b90000b90 command_reply(tid 1: 0 ) 2026-02-24T19:23:52.087 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.085+0000 7f7b857fa640 10 client.30837.objecter _finish_command 1 = system:0 2026-02-24T19:23:52.087 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.085+0000 7f7b857fa640 20 client.30837.objecter put_session s=0x7f7b600a2160 osd=6 4 2026-02-24T19:23:52.087 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.085+0000 7f7b857fa640 15 client.30837.objecter _session_command_op_remove 6 1 2026-02-24T19:23:52.094 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.092+0000 7f7b96cc6640 10 client.30837.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:23:52.094 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.092+0000 7f7b96cc6640 15 client.30837.objecter _session_command_op_assign -1 2 2026-02-24T19:23:52.094 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.092+0000 7f7b96cc6640 20 client.30837.objecter _get_session s=0x7f7b600a2160 osd=6 3 2026-02-24T19:23:52.094 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.092+0000 7f7b96cc6640 20 client.30837.objecter put_session s=0x7f7b600a2160 osd=6 3 2026-02-24T19:23:52.094 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.092+0000 7f7b96cc6640 20 client.30837.objecter _get_session s=0x7f7b600a2160 osd=6 3 2026-02-24T19:23:52.094 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.092+0000 7f7b96cc6640 15 client.30837.objecter _session_command_op_remove -1 2 2026-02-24T19:23:52.094 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.092+0000 7f7b96cc6640 20 client.30837.objecter get_session s=0x7f7b600a2160 osd=6 3 2026-02-24T19:23:52.094 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.092+0000 7f7b96cc6640 15 client.30837.objecter _session_command_op_assign 6 2 2026-02-24T19:23:52.094 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.092+0000 7f7b96cc6640 20 client.30837.objecter put_session s=0x7f7b600a2160 osd=6 4 2026-02-24T19:23:52.094 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.092+0000 7f7b96cc6640 10 client.30837.objecter _send_command 2 2026-02-24T19:23:52.095 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.092+0000 7f7b96cc6640 1 -- 10.20.193.14:0/3604177601 --> v1:10.20.193.170:6800/3031579126 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7b90190ca0 con 0x7f7b600a2810 2026-02-24T19:23:52.103 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.101+0000 7f7b857fa640 1 -- 10.20.193.14:0/3604177601 <== osd.6 v1:10.20.193.170:6800/3031579126 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f7b90190ca0 con 0x7f7b600a2810 2026-02-24T19:23:52.103 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.101+0000 7f7b857fa640 10 client.30837.objecter ms_dispatch2 0x7f7b90000b90 command_reply(tid 2: 0 ) 2026-02-24T19:23:52.103 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.101+0000 7f7b857fa640 10 client.30837.objecter _finish_command 2 = system:0 2026-02-24T19:23:52.103 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.101+0000 7f7b857fa640 20 client.30837.objecter put_session s=0x7f7b600a2160 osd=6 4 2026-02-24T19:23:52.103 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.101+0000 7f7b857fa640 15 client.30837.objecter _session_command_op_remove 6 2 2026-02-24T19:23:52.104 INFO:teuthology.orchestra.run.trial014.stdout:{ 2026-02-24T19:23:52.104 INFO:teuthology.orchestra.run.trial014.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:23:52.104 INFO:teuthology.orchestra.run.trial014.stdout:} 2026-02-24T19:23:52.105 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.101+0000 7f7b96cc6640 10 librados: watch_flush enter 2026-02-24T19:23:52.105 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.101+0000 7f7b96cc6640 10 librados: watch_flush exit 2026-02-24T19:23:52.105 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.101+0000 7f7b96cc6640 10 client.30837.objecter close_session for osd.6 2026-02-24T19:23:52.106 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.101+0000 7f7b96cc6640 1 -- 10.20.193.14:0/3604177601 >> v1:10.20.193.170:6800/3031579126 conn(0x7f7b600a2810 legacy=0x7f7b600c2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:52.106 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.101+0000 7f7b96cc6640 20 client.30837.objecter put_session s=0x7f7b600a2160 osd=6 1 2026-02-24T19:23:52.106 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.101+0000 7f7b96cc6640 20 client.30837.objecter shutdown clearing up homeless session... 2026-02-24T19:23:52.106 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.101+0000 7f7b96cc6640 10 client.30837.objecter successfully canceled tick 2026-02-24T19:23:52.106 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.101+0000 7f7b96cc6640 1 -- 10.20.193.14:0/3604177601 >> v1:10.20.193.14:6800/4014096310 conn(0x7f7b60077ea0 legacy=0x7f7b60098350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:52.106 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.101+0000 7f7b96cc6640 10 monclient: shutdown 2026-02-24T19:23:52.106 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.101+0000 7f7b96cc6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:52.106 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.101+0000 7f7b96cc6640 1 -- 10.20.193.14:0/3604177601 >> v1:10.20.193.14:6789/0 conn(0x7f7b901a5660 legacy=0x7f7b900b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:52.106 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.101+0000 7f7b9523c640 1 -- 10.20.193.14:0/3604177601 reap_dead start 2026-02-24T19:23:52.106 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.101+0000 7f7b96cc6640 1 -- 10.20.193.14:0/3604177601 shutdown_connections 2026-02-24T19:23:52.106 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.101+0000 7f7b96cc6640 1 -- 10.20.193.14:0/3604177601 >> 10.20.193.14:0/3604177601 conn(0x7f7b900b2f60 msgr2=0x7f7b9015d490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:52.106 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.101+0000 7f7b96cc6640 1 -- 10.20.193.14:0/3604177601 shutdown_connections 2026-02-24T19:23:52.107 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.101+0000 7f7b96cc6640 1 -- 10.20.193.14:0/3604177601 wait complete. 2026-02-24T19:23:52.107 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.101+0000 7f7b96cc6640 1 librados: shutdown 2026-02-24T19:23:52.111 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2026-02-24T19:23:52.179 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.177+0000 7fc0ab5c0640 10 monclient: get_monmap_and_config 2026-02-24T19:23:52.179 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.177+0000 7fc0ab5c0640 10 monclient: build_initial_monmap 2026-02-24T19:23:52.179 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.177+0000 7fc0ab5c0640 10 monclient: monmap: 2026-02-24T19:23:52.179 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:52.180 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:52.180 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:23:52.178496+0000 2026-02-24T19:23:52.180 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:23:52.178496+0000 2026-02-24T19:23:52.180 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:52.180 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:52.180 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:52.180 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:52.180 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:52.180 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.182 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.178+0000 7fc0ab5c0640 1 Processor -- start 2026-02-24T19:23:52.182 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.178+0000 7fc0ab5c0640 1 -- start start 2026-02-24T19:23:52.182 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.178+0000 7fc0ab5c0640 10 monclient: init 2026-02-24T19:23:52.182 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.178+0000 7fc0ab5c0640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:52.182 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.179+0000 7fc0ab5c0640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:23:52.182 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.179+0000 7fc0ab5c0640 10 monclient(hunting): picked mon.noname-b con 0x7fc0a41566e0 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:52.182 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.179+0000 7fc0ab5c0640 10 monclient(hunting): picked mon.noname-c con 0x7fc0a4160c00 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:52.182 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.179+0000 7fc0ab5c0640 10 monclient(hunting): picked mon.noname-a con 0x7fc0a4156ab0 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:52.182 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.179+0000 7fc0ab5c0640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0a4058480 con 0x7fc0a4156ab0 2026-02-24T19:23:52.183 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.179+0000 7fc0ab5c0640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0a4058760 con 0x7fc0a41566e0 2026-02-24T19:23:52.183 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.179+0000 7fc0ab5c0640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0a40b0f90 con 0x7fc0a4160c00 2026-02-24T19:23:52.183 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.179+0000 7fc0ab5c0640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:52.183 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.179+0000 7fc0ab5c0640 10 monclient(hunting): authenticate will time out at 4006.860066s 2026-02-24T19:23:52.183 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.179+0000 7fc0a9b36640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7fc0a4156ab0 0x7fc0a4055980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:50972/0 (socket says 10.20.193.14:50972) 2026-02-24T19:23:52.183 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.179+0000 7fc0a9b36640 1 -- 10.20.193.14:0/2328448718 learned_addr learned my addr 10.20.193.14:0/2328448718 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:52.187 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.180+0000 7fc093fff640 1 -- 10.20.193.14:0/2328448718 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 569544237 0 0) 0x7fc0a4058480 con 0x7fc0a4156ab0 2026-02-24T19:23:52.187 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.180+0000 7fc093fff640 10 monclient(hunting): _negotiate 2026-02-24T19:23:52.188 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.180+0000 7fc093fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:52.188 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.180+0000 7fc093fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:52.188 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.180+0000 7fc093fff640 10 monclient(hunting): my global_id is 30840 2026-02-24T19:23:52.188 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.180+0000 7fc093fff640 1 -- 10.20.193.14:0/2328448718 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc08c003610 con 0x7fc0a4156ab0 2026-02-24T19:23:52.188 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.180+0000 7fc093fff640 1 -- 10.20.193.14:0/2328448718 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3292912433 0 0) 0x7fc0a40b0f90 con 0x7fc0a4160c00 2026-02-24T19:23:52.188 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.180+0000 7fc093fff640 10 monclient(hunting): _negotiate 2026-02-24T19:23:52.188 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.180+0000 7fc093fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:52.188 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.180+0000 7fc093fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:52.188 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.180+0000 7fc093fff640 10 monclient(hunting): my global_id is 28793 2026-02-24T19:23:52.188 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.180+0000 7fc093fff640 1 -- 10.20.193.14:0/2328448718 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0a4058480 con 0x7fc0a4160c00 2026-02-24T19:23:52.188 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.181+0000 7fc093fff640 1 -- 10.20.193.14:0/2328448718 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2172279508 0 0) 0x7fc0a4058760 con 0x7fc0a41566e0 2026-02-24T19:23:52.188 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.181+0000 7fc093fff640 10 monclient(hunting): _negotiate 2026-02-24T19:23:52.189 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.181+0000 7fc093fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:52.189 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.181+0000 7fc093fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:52.189 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.181+0000 7fc093fff640 10 monclient(hunting): my global_id is 29158 2026-02-24T19:23:52.189 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.181+0000 7fc093fff640 1 -- 10.20.193.14:0/2328448718 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0a40b0f90 con 0x7fc0a41566e0 2026-02-24T19:23:52.189 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.182+0000 7fc093fff640 1 -- 10.20.193.14:0/2328448718 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1844722069 0 0) 0x7fc0a4058480 con 0x7fc0a4160c00 2026-02-24T19:23:52.189 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.182+0000 7fc093fff640 1 -- 10.20.193.14:0/2328448718 >> v1:10.20.193.44:6789/0 conn(0x7fc0a41566e0 legacy=0x7fc0a40b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:52.189 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.182+0000 7fc093fff640 1 -- 10.20.193.14:0/2328448718 >> v1:10.20.193.14:6789/0 conn(0x7fc0a4156ab0 legacy=0x7fc0a4055980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:52.189 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.182+0000 7fc093fff640 10 monclient: _finish_hunting 0 2026-02-24T19:23:52.189 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.182+0000 7fc093fff640 1 monclient: found mon.noname-c 2026-02-24T19:23:52.189 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.182+0000 7fc093fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:52.189 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.182+0000 7fc093fff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.170:6789/0 2026-02-24T19:23:52.189 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.182+0000 7fc093fff640 1 -- 10.20.193.14:0/2328448718 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0a40b1270 con 0x7fc0a4160c00 2026-02-24T19:23:52.190 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.182+0000 7fc093fff640 10 monclient: _finish_auth 0 2026-02-24T19:23:52.190 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.182+0000 7fc093fff640 10 monclient: _check_auth_tickets 2026-02-24T19:23:52.190 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.182+0000 7fc093fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:52.190 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.182+0000 7fc093fff640 1 -- 10.20.193.14:0/2328448718 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc098002df0 con 0x7fc0a4160c00 2026-02-24T19:23:52.190 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.182+0000 7fc093fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:52.190 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.182+0000 7fc093fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:23:52.190 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.182+0000 7fc093fff640 10 monclient: dump: 2026-02-24T19:23:52.190 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:52.190 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:52.190 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.190 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.190 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:52.190 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:52.191 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:52.191 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:52.191 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:52.191 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.191 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.182+0000 7fc0ab5c0640 5 monclient: authenticate success, global_id 28793 2026-02-24T19:23:52.191 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.182+0000 7fc0ab5c0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:52.191 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.183+0000 7fc093fff640 1 -- 10.20.193.14:0/2328448718 <== mon.2 v1:10.20.193.170:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc098002fc0 con 0x7fc0a4160c00 2026-02-24T19:23:52.191 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.183+0000 7fc093fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:52.191 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.183+0000 7fc093fff640 1 -- 10.20.193.14:0/2328448718 <== mon.2 v1:10.20.193.170:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc098003400 con 0x7fc0a4160c00 2026-02-24T19:23:52.191 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.183+0000 7fc0ab5c0640 10 monclient: get_monmap_and_config success 2026-02-24T19:23:52.191 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.183+0000 7fc0ab5c0640 4 set_mon_vals no callback set 2026-02-24T19:23:52.191 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.183+0000 7fc093fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:52.191 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.183+0000 7fc093fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:52.192 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.183+0000 7fc093fff640 10 monclient: dump: 2026-02-24T19:23:52.192 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:52.192 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:52.192 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.192 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.192 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:52.192 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:52.192 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:52.192 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:52.192 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:52.192 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.192 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.183+0000 7fc0ab5c0640 10 monclient: shutdown 2026-02-24T19:23:52.192 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.183+0000 7fc0ab5c0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:52.193 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.183+0000 7fc0ab5c0640 1 -- 10.20.193.14:0/2328448718 >> v1:10.20.193.170:6789/0 conn(0x7fc0a4160c00 legacy=0x7fc0a4057920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:52.193 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.184+0000 7fc0ab5c0640 1 -- 10.20.193.14:0/2328448718 shutdown_connections 2026-02-24T19:23:52.193 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.184+0000 7fc0ab5c0640 1 -- 10.20.193.14:0/2328448718 >> 10.20.193.14:0/2328448718 conn(0x7fc0a40b2ef0 msgr2=0x7fc0a40b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:52.193 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.184+0000 7fc0ab5c0640 1 -- 10.20.193.14:0/2328448718 shutdown_connections 2026-02-24T19:23:52.193 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.184+0000 7fc0ab5c0640 1 -- 10.20.193.14:0/2328448718 wait complete. 2026-02-24T19:23:52.193 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.184+0000 7fc0ab5c0640 10 monclient: build_initial_monmap 2026-02-24T19:23:52.193 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.184+0000 7fc0ab5c0640 10 monclient: monmap: 2026-02-24T19:23:52.193 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:52.193 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:23:52.193 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:23:52.193 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:23:52.193 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:52.193 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:23:52.194 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:52.194 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:52.194 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:52.194 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.184+0000 7fc0ab5c0640 1 librados: starting msgr at 2026-02-24T19:23:52.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.184+0000 7fc0ab5c0640 1 librados: starting objecter 2026-02-24T19:23:52.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.184+0000 7fc0ab5c0640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:23:52.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.184+0000 7fc0ab5c0640 1 Processor -- start 2026-02-24T19:23:52.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.184+0000 7fc0ab5c0640 1 -- start start 2026-02-24T19:23:52.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.184+0000 7fc0ab5c0640 1 librados: setting wanted keys 2026-02-24T19:23:52.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.184+0000 7fc0ab5c0640 1 librados: calling monclient init 2026-02-24T19:23:52.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.184+0000 7fc0ab5c0640 10 monclient: init 2026-02-24T19:23:52.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.185+0000 7fc0ab5c0640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:52.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.185+0000 7fc0ab5c0640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:23:52.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.185+0000 7fc0ab5c0640 10 monclient(hunting): picked mon.noname-c con 0x7fc0a41566e0 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:52.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.185+0000 7fc0ab5c0640 10 monclient(hunting): picked mon.noname-a con 0x7fc0a4156ab0 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:52.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.185+0000 7fc0ab5c0640 10 monclient(hunting): picked mon.noname-b con 0x7fc0a4160c00 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:52.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.185+0000 7fc0ab5c0640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0a40a7600 con 0x7fc0a4156ab0 2026-02-24T19:23:52.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.185+0000 7fc0ab5c0640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0a40a9760 con 0x7fc0a4160c00 2026-02-24T19:23:52.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.185+0000 7fc0ab5c0640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0a40a9a40 con 0x7fc0a41566e0 2026-02-24T19:23:52.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.185+0000 7fc0ab5c0640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:52.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.185+0000 7fc0ab5c0640 10 monclient(hunting): authenticate will time out at 4006.866368s 2026-02-24T19:23:52.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.185+0000 7fc0a9335640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7fc0a41566e0 0x7fc0a412b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:48308/0 (socket says 10.20.193.14:48308) 2026-02-24T19:23:52.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.185+0000 7fc0a9335640 1 -- 10.20.193.14:0/2578113299 learned_addr learned my addr 10.20.193.14:0/2578113299 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:52.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.185+0000 7fc091ffb640 10 client.?.objecter ms_handle_connect 0x7fc0a41566e0 2026-02-24T19:23:52.196 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.185+0000 7fc091ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:52.196 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.186+0000 7fc091ffb640 10 client.?.objecter ms_handle_connect 0x7fc0a4160c00 2026-02-24T19:23:52.196 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.186+0000 7fc091ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:52.196 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.186+0000 7fc091ffb640 10 client.?.objecter ms_handle_connect 0x7fc0a4156ab0 2026-02-24T19:23:52.196 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.186+0000 7fc091ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:52.200 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.186+0000 7fc091ffb640 1 -- 10.20.193.14:0/2578113299 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 565593892 0 0) 0x7fc0a40a9a40 con 0x7fc0a41566e0 2026-02-24T19:23:52.200 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.186+0000 7fc091ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:23:52.200 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.186+0000 7fc091ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:52.200 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.186+0000 7fc091ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:52.200 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.186+0000 7fc091ffb640 10 monclient(hunting): my global_id is 28796 2026-02-24T19:23:52.200 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.186+0000 7fc091ffb640 1 -- 10.20.193.14:0/2578113299 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc074003610 con 0x7fc0a41566e0 2026-02-24T19:23:52.200 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.186+0000 7fc091ffb640 1 -- 10.20.193.14:0/2578113299 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4126659794 0 0) 0x7fc0a40a9760 con 0x7fc0a4160c00 2026-02-24T19:23:52.200 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.186+0000 7fc091ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:23:52.200 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.186+0000 7fc091ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:52.200 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.186+0000 7fc091ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:52.200 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.186+0000 7fc091ffb640 10 monclient(hunting): my global_id is 29161 2026-02-24T19:23:52.201 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.186+0000 7fc091ffb640 1 -- 10.20.193.14:0/2578113299 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0a40a9a40 con 0x7fc0a4160c00 2026-02-24T19:23:52.201 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.187+0000 7fc091ffb640 1 -- 10.20.193.14:0/2578113299 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1940226053 0 0) 0x7fc0a40a7600 con 0x7fc0a4156ab0 2026-02-24T19:23:52.201 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.187+0000 7fc091ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:23:52.201 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.187+0000 7fc091ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:52.201 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.187+0000 7fc091ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:52.201 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.187+0000 7fc091ffb640 10 monclient(hunting): my global_id is 30843 2026-02-24T19:23:52.201 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.187+0000 7fc091ffb640 1 -- 10.20.193.14:0/2578113299 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0a40a9760 con 0x7fc0a4156ab0 2026-02-24T19:23:52.201 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.189+0000 7fc091ffb640 1 -- 10.20.193.14:0/2578113299 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1405102784 0 0) 0x7fc074003610 con 0x7fc0a41566e0 2026-02-24T19:23:52.201 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.189+0000 7fc091ffb640 1 -- 10.20.193.14:0/2578113299 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc0a40a7600 con 0x7fc0a41566e0 2026-02-24T19:23:52.201 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.189+0000 7fc091ffb640 1 -- 10.20.193.14:0/2578113299 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc094003170 con 0x7fc0a41566e0 2026-02-24T19:23:52.201 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.189+0000 7fc091ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:52.201 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.189+0000 7fc091ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:23:52.201 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.189+0000 7fc091ffb640 10 monclient(hunting): dump: 2026-02-24T19:23:52.202 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:52.202 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:52.202 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.202 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.202 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:52.202 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:52.202 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:52.202 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:52.202 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:52.202 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.202 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.189+0000 7fc091ffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:23:52.202 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.189+0000 7fc091ffb640 1 -- 10.20.193.14:0/2578113299 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2262745862 0 0) 0x7fc0a40a9a40 con 0x7fc0a4160c00 2026-02-24T19:23:52.202 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.189+0000 7fc091ffb640 1 -- 10.20.193.14:0/2578113299 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc074003610 con 0x7fc0a4160c00 2026-02-24T19:23:52.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.189+0000 7fc091ffb640 1 -- 10.20.193.14:0/2578113299 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc0a0003430 con 0x7fc0a4160c00 2026-02-24T19:23:52.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.189+0000 7fc091ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:52.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.189+0000 7fc091ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:52.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.189+0000 7fc091ffb640 10 monclient(hunting): dump: 2026-02-24T19:23:52.203 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:52.203 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:52.203 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.203 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.203 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:52.203 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:52.203 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:52.203 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:52.204 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:52.204 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.204 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.189+0000 7fc091ffb640 1 -- 10.20.193.14:0/2578113299 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4152298736 0 0) 0x7fc0a40a9760 con 0x7fc0a4156ab0 2026-02-24T19:23:52.204 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.189+0000 7fc091ffb640 1 -- 10.20.193.14:0/2578113299 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc0a40a9a40 con 0x7fc0a4156ab0 2026-02-24T19:23:52.204 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.189+0000 7fc091ffb640 1 -- 10.20.193.14:0/2578113299 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc098003310 con 0x7fc0a4156ab0 2026-02-24T19:23:52.204 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.189+0000 7fc091ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:52.204 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.189+0000 7fc091ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:52.204 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.189+0000 7fc091ffb640 10 monclient(hunting): dump: 2026-02-24T19:23:52.204 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:52.204 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:52.204 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.204 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.204 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:52.205 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:52.205 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:52.205 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:52.205 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:52.205 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.205 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.190+0000 7fc091ffb640 1 -- 10.20.193.14:0/2578113299 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4067530573 0 0) 0x7fc0a40a7600 con 0x7fc0a41566e0 2026-02-24T19:23:52.205 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.190+0000 7fc091ffb640 1 -- 10.20.193.14:0/2578113299 >> v1:10.20.193.44:6789/0 conn(0x7fc0a4160c00 legacy=0x7fc0a415d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:52.205 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.190+0000 7fc091ffb640 1 -- 10.20.193.14:0/2578113299 >> v1:10.20.193.14:6789/0 conn(0x7fc0a4156ab0 legacy=0x7fc0a40a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:52.205 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.190+0000 7fc091ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:23:52.205 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.190+0000 7fc091ffb640 1 monclient: found mon.c 2026-02-24T19:23:52.205 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.190+0000 7fc091ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:52.205 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.190+0000 7fc091ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:52.206 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.190+0000 7fc091ffb640 1 -- 10.20.193.14:0/2578113299 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0a40a7890 con 0x7fc0a41566e0 2026-02-24T19:23:52.206 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.190+0000 7fc091ffb640 10 monclient: _finish_auth 0 2026-02-24T19:23:52.206 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.190+0000 7fc091ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:23:52.206 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.190+0000 7fc091ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:52.206 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.190+0000 7fc0ab5c0640 5 monclient: authenticate success, global_id 28796 2026-02-24T19:23:52.206 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.190+0000 7fc0ab5c0640 10 monclient: _renew_subs 2026-02-24T19:23:52.206 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.190+0000 7fc0ab5c0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:52.206 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.190+0000 7fc0ab5c0640 1 -- 10.20.193.14:0/2578113299 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc0a40a7b70 con 0x7fc0a41566e0 2026-02-24T19:23:52.206 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.190+0000 7fc0ab5c0640 10 client.28796.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:52.206 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.190+0000 7fc0ab5c0640 10 monclient: _renew_subs 2026-02-24T19:23:52.206 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.190+0000 7fc0ab5c0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:52.206 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.190+0000 7fc0ab5c0640 1 -- 10.20.193.14:0/2578113299 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc0a40a8350 con 0x7fc0a41566e0 2026-02-24T19:23:52.206 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.190+0000 7fc0ab5c0640 1 librados: init done 2026-02-24T19:23:52.206 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.191+0000 7fc0ab5c0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:52.207 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.191+0000 7fc0ab5c0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:52.207 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.191+0000 7fc0ab5c0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:52.207 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.191+0000 7fc0ab5c0640 1 -- 10.20.193.14:0/2578113299 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0a415a520 con 0x7fc0a41566e0 2026-02-24T19:23:52.207 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.191+0000 7fc091ffb640 1 -- 10.20.193.14:0/2578113299 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc094003310 con 0x7fc0a41566e0 2026-02-24T19:23:52.207 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.191+0000 7fc091ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:52.207 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.191+0000 7fc0937fe640 4 set_mon_vals no callback set 2026-02-24T19:23:52.208 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.198+0000 7fc091ffb640 1 -- 10.20.193.14:0/2578113299 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc094003b50 con 0x7fc0a41566e0 2026-02-24T19:23:52.208 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.198+0000 7fc091ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:52.208 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.198+0000 7fc091ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:52.208 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.198+0000 7fc091ffb640 10 monclient: dump: 2026-02-24T19:23:52.209 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:52.209 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:52.209 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.209 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.209 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:52.209 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:52.209 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:52.209 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:52.209 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:52.209 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.209 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.199+0000 7fc091ffb640 1 -- 10.20.193.14:0/2578113299 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7fc094003d70 con 0x7fc0a41566e0 2026-02-24T19:23:52.209 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.200+0000 7fc0a8b34640 10 monclient: get_auth_request con 0x7fc074077e70 auth_method 0 2026-02-24T19:23:52.210 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.200+0000 7fc091ffb640 10 client.28796.objecter ms_handle_connect 0x7fc074077e70 2026-02-24T19:23:52.210 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.200+0000 7fc091ffb640 1 -- 10.20.193.14:0/2578113299 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7fc0940932d0 con 0x7fc0a41566e0 2026-02-24T19:23:52.210 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.200+0000 7fc091ffb640 10 client.28796.objecter ms_dispatch2 0x7fc0a4000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:23:52.210 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.200+0000 7fc091ffb640 3 client.28796.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:23:52.210 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.200+0000 7fc091ffb640 3 client.28796.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:23:52.210 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.201+0000 7fc091ffb640 20 client.28796.objecter dump_active .. 0 homeless 2026-02-24T19:23:52.291 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.289+0000 7fc091ffb640 1 -- 10.20.193.14:0/2578113299 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fc09405dd00 con 0x7fc0a41566e0 2026-02-24T19:23:52.291 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.289+0000 7fc091ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:52.291 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.289+0000 7fc091ffb640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:23:52.399 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.397+0000 7fc0ab5c0640 1 -- 10.20.193.14:0/2578113299 --> v1:10.20.193.14:6800/4014096310 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fc0a4056060 con 0x7fc074077e70 2026-02-24T19:23:52.399 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.398+0000 7fc091ffb640 1 -- 10.20.193.14:0/2578113299 <== mgr.4110 v1:10.20.193.14:6800/4014096310 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (unknown 778718403 0 0) 0x7fc0a4056060 con 0x7fc074077e70 2026-02-24T19:23:52.399 INFO:teuthology.orchestra.run.trial014.stderr:instructed osd(s) 6 to deep-scrub 2026-02-24T19:23:52.400 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.398+0000 7fc0ab5c0640 10 librados: watch_flush enter 2026-02-24T19:23:52.401 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.398+0000 7fc0ab5c0640 10 librados: watch_flush exit 2026-02-24T19:23:52.401 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.398+0000 7fc0ab5c0640 20 client.28796.objecter shutdown clearing up homeless session... 2026-02-24T19:23:52.401 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.398+0000 7fc0ab5c0640 10 client.28796.objecter successfully canceled tick 2026-02-24T19:23:52.401 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.398+0000 7fc0ab5c0640 1 -- 10.20.193.14:0/2578113299 >> v1:10.20.193.14:6800/4014096310 conn(0x7fc074077e70 legacy=0x7fc074098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:52.401 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.398+0000 7fc0ab5c0640 10 monclient: shutdown 2026-02-24T19:23:52.401 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.398+0000 7fc0ab5c0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:52.401 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.398+0000 7fc0ab5c0640 1 -- 10.20.193.14:0/2578113299 >> v1:10.20.193.170:6789/0 conn(0x7fc0a41566e0 legacy=0x7fc0a412b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:52.401 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.399+0000 7fc0ab5c0640 1 -- 10.20.193.14:0/2578113299 shutdown_connections 2026-02-24T19:23:52.401 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.399+0000 7fc0ab5c0640 1 -- 10.20.193.14:0/2578113299 >> 10.20.193.14:0/2578113299 conn(0x7fc0a40b2ef0 msgr2=0x7fc0a405b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:52.401 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.399+0000 7fc0ab5c0640 1 -- 10.20.193.14:0/2578113299 shutdown_connections 2026-02-24T19:23:52.401 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.399+0000 7fc0ab5c0640 1 -- 10.20.193.14:0/2578113299 wait complete. 2026-02-24T19:23:52.402 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.399+0000 7fc0ab5c0640 1 librados: shutdown 2026-02-24T19:23:52.409 INFO:tasks.ceph:Scrubbing osd.10 2026-02-24T19:23:52.409 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:23:52.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.476+0000 7f562c08b640 10 monclient: get_monmap_and_config 2026-02-24T19:23:52.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.476+0000 7f562c08b640 10 monclient: build_initial_monmap 2026-02-24T19:23:52.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.476+0000 7f562c08b640 10 monclient: monmap: 2026-02-24T19:23:52.479 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:52.479 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:52.479 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:23:52.477574+0000 2026-02-24T19:23:52.479 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:23:52.477574+0000 2026-02-24T19:23:52.479 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:52.479 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:52.479 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:52.479 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:52.479 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:52.479 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.477+0000 7f562c08b640 1 Processor -- start 2026-02-24T19:23:52.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.477+0000 7f562c08b640 1 -- start start 2026-02-24T19:23:52.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.477+0000 7f562c08b640 10 monclient: init 2026-02-24T19:23:52.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.478+0000 7f562c08b640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:52.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.478+0000 7f562c08b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:23:52.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.478+0000 7f562c08b640 10 monclient(hunting): picked mon.noname-b con 0x7f562415e2a0 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:52.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.478+0000 7f562c08b640 10 monclient(hunting): picked mon.noname-a con 0x7f5624059e10 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:52.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.478+0000 7f562c08b640 10 monclient(hunting): picked mon.noname-c con 0x7f56241a5660 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:52.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.478+0000 7f562c08b640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5624162df0 con 0x7f5624059e10 2026-02-24T19:23:52.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.478+0000 7f562c08b640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56241630d0 con 0x7f562415e2a0 2026-02-24T19:23:52.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.478+0000 7f562c08b640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56241633b0 con 0x7f56241a5660 2026-02-24T19:23:52.482 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.478+0000 7f562c08b640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:52.482 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.478+0000 7f562c08b640 10 monclient(hunting): authenticate will time out at 4007.159076s 2026-02-24T19:23:52.482 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.478+0000 7f56295ff640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f5624059e10 0x7f562415ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:50982/0 (socket says 10.20.193.14:50982) 2026-02-24T19:23:52.482 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.478+0000 7f56295ff640 1 -- 10.20.193.14:0/2923761740 learned_addr learned my addr 10.20.193.14:0/2923761740 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:52.487 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.479+0000 7f5628dfe640 1 -- 10.20.193.14:0/2923761740 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 8509018 0 0) 0x7f56241630d0 con 0x7f562415e2a0 2026-02-24T19:23:52.487 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.479+0000 7f5628dfe640 10 monclient(hunting): _negotiate 2026-02-24T19:23:52.487 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.479+0000 7f5628dfe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:52.487 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.479+0000 7f5628dfe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:52.487 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.479+0000 7f5628dfe640 10 monclient(hunting): my global_id is 29164 2026-02-24T19:23:52.487 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.479+0000 7f5628dfe640 1 -- 10.20.193.14:0/2923761740 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f560c003610 con 0x7f562415e2a0 2026-02-24T19:23:52.487 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.479+0000 7f5628dfe640 1 -- 10.20.193.14:0/2923761740 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2340699154 0 0) 0x7f5624162df0 con 0x7f5624059e10 2026-02-24T19:23:52.487 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.479+0000 7f5628dfe640 10 monclient(hunting): _negotiate 2026-02-24T19:23:52.487 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.479+0000 7f5628dfe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:52.488 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.479+0000 7f5628dfe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:52.488 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.479+0000 7f5628dfe640 10 monclient(hunting): my global_id is 30846 2026-02-24T19:23:52.488 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.479+0000 7f5628dfe640 1 -- 10.20.193.14:0/2923761740 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56241630d0 con 0x7f5624059e10 2026-02-24T19:23:52.488 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.480+0000 7f5628dfe640 1 -- 10.20.193.14:0/2923761740 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2641745645 0 0) 0x7f56241633b0 con 0x7f56241a5660 2026-02-24T19:23:52.488 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.480+0000 7f5628dfe640 10 monclient(hunting): _negotiate 2026-02-24T19:23:52.488 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.480+0000 7f5628dfe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:52.488 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.480+0000 7f5628dfe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:52.488 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.480+0000 7f5628dfe640 10 monclient(hunting): my global_id is 28799 2026-02-24T19:23:52.488 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.480+0000 7f5628dfe640 1 -- 10.20.193.14:0/2923761740 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5624162df0 con 0x7f56241a5660 2026-02-24T19:23:52.488 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.481+0000 7f5628dfe640 1 -- 10.20.193.14:0/2923761740 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 662664781 0 0) 0x7f560c003610 con 0x7f562415e2a0 2026-02-24T19:23:52.488 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.481+0000 7f5628dfe640 1 -- 10.20.193.14:0/2923761740 >> v1:10.20.193.170:6789/0 conn(0x7f56241a5660 legacy=0x7f56241c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:52.488 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.481+0000 7f5628dfe640 1 -- 10.20.193.14:0/2923761740 >> v1:10.20.193.14:6789/0 conn(0x7f5624059e10 legacy=0x7f562415ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:52.489 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.481+0000 7f5628dfe640 10 monclient: _finish_hunting 0 2026-02-24T19:23:52.489 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.481+0000 7f5628dfe640 1 monclient: found mon.noname-b 2026-02-24T19:23:52.489 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.481+0000 7f5628dfe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:52.489 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.481+0000 7f5628dfe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.44:6789/0 2026-02-24T19:23:52.489 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.481+0000 7f5628dfe640 1 -- 10.20.193.14:0/2923761740 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5624163690 con 0x7f562415e2a0 2026-02-24T19:23:52.489 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.481+0000 7f5628dfe640 10 monclient: _finish_auth 0 2026-02-24T19:23:52.489 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.481+0000 7f5628dfe640 10 monclient: _check_auth_tickets 2026-02-24T19:23:52.489 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.481+0000 7f5628dfe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:52.489 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.481+0000 7f5628dfe640 1 -- 10.20.193.14:0/2923761740 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5614002df0 con 0x7f562415e2a0 2026-02-24T19:23:52.489 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.481+0000 7f5628dfe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:52.489 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.481+0000 7f5628dfe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:23:52.489 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.481+0000 7f5628dfe640 10 monclient: dump: 2026-02-24T19:23:52.489 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:52.490 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:52.490 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.490 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.490 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:52.490 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:52.490 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:52.490 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:52.490 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:52.490 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.490 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.481+0000 7f562c08b640 5 monclient: authenticate success, global_id 29164 2026-02-24T19:23:52.490 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.481+0000 7f562c08b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:52.490 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.482+0000 7f5628dfe640 1 -- 10.20.193.14:0/2923761740 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5614002fc0 con 0x7f562415e2a0 2026-02-24T19:23:52.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.482+0000 7f5628dfe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:52.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.482+0000 7f5628dfe640 1 -- 10.20.193.14:0/2923761740 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5614003400 con 0x7f562415e2a0 2026-02-24T19:23:52.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.482+0000 7f562c08b640 10 monclient: get_monmap_and_config success 2026-02-24T19:23:52.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.482+0000 7f562c08b640 4 set_mon_vals no callback set 2026-02-24T19:23:52.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.482+0000 7f5628dfe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:52.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.482+0000 7f5628dfe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:52.491 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.482+0000 7f5628dfe640 10 monclient: dump: 2026-02-24T19:23:52.491 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:52.491 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:52.491 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.491 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.491 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:52.491 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:52.492 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:52.492 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:52.492 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:52.492 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.482+0000 7f562c08b640 10 monclient: shutdown 2026-02-24T19:23:52.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.482+0000 7f562c08b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:52.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.482+0000 7f562c08b640 1 -- 10.20.193.14:0/2923761740 >> v1:10.20.193.44:6789/0 conn(0x7f562415e2a0 legacy=0x7f562405da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:52.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.482+0000 7f562c08b640 1 -- 10.20.193.14:0/2923761740 shutdown_connections 2026-02-24T19:23:52.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.482+0000 7f562c08b640 1 -- 10.20.193.14:0/2923761740 >> 10.20.193.14:0/2923761740 conn(0x7f56240b2f60 msgr2=0x7f56240b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:52.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.482+0000 7f562c08b640 1 -- 10.20.193.14:0/2923761740 shutdown_connections 2026-02-24T19:23:52.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.482+0000 7f562c08b640 1 -- 10.20.193.14:0/2923761740 wait complete. 2026-02-24T19:23:52.492 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.483+0000 7f562c08b640 10 monclient: build_initial_monmap 2026-02-24T19:23:52.493 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.483+0000 7f562c08b640 10 monclient: monmap: 2026-02-24T19:23:52.493 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:52.493 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:23:52.493 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:23:52.493 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:23:52.493 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:52.493 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:23:52.493 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:52.493 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:52.493 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:52.493 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.493 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.483+0000 7f562c08b640 1 librados: starting msgr at 2026-02-24T19:23:52.493 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.483+0000 7f562c08b640 1 librados: starting objecter 2026-02-24T19:23:52.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.483+0000 7f562c08b640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:23:52.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.483+0000 7f562c08b640 1 Processor -- start 2026-02-24T19:23:52.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.483+0000 7f562c08b640 1 -- start start 2026-02-24T19:23:52.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.483+0000 7f562c08b640 1 librados: setting wanted keys 2026-02-24T19:23:52.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.483+0000 7f562c08b640 1 librados: calling monclient init 2026-02-24T19:23:52.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.483+0000 7f562c08b640 10 monclient: init 2026-02-24T19:23:52.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.483+0000 7f562c08b640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:52.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.483+0000 7f562c08b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:23:52.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.483+0000 7f562c08b640 10 monclient(hunting): picked mon.noname-c con 0x7f5624059e10 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:52.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.483+0000 7f562c08b640 10 monclient(hunting): picked mon.noname-a con 0x7f562415e2a0 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:52.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.483+0000 7f562c08b640 10 monclient(hunting): picked mon.noname-b con 0x7f56241a5660 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:52.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.483+0000 7f562c08b640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f562411eec0 con 0x7f562415e2a0 2026-02-24T19:23:52.494 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.483+0000 7f562c08b640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5624196120 con 0x7f56241a5660 2026-02-24T19:23:52.495 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.483+0000 7f562c08b640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5624196400 con 0x7f5624059e10 2026-02-24T19:23:52.495 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.483+0000 7f562c08b640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:52.495 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.483+0000 7f562c08b640 10 monclient(hunting): authenticate will time out at 4007.164954s 2026-02-24T19:23:52.495 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.484+0000 7f56295ff640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f562415e2a0 0x7f5624195730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:50984/0 (socket says 10.20.193.14:50984) 2026-02-24T19:23:52.495 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.484+0000 7f56295ff640 1 -- 10.20.193.14:0/135292177 learned_addr learned my addr 10.20.193.14:0/135292177 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:52.495 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.484+0000 7f56127fc640 10 client.?.objecter ms_handle_connect 0x7f562415e2a0 2026-02-24T19:23:52.495 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.484+0000 7f56127fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:52.495 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.484+0000 7f56127fc640 10 client.?.objecter ms_handle_connect 0x7f56241a5660 2026-02-24T19:23:52.495 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.484+0000 7f56127fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:52.495 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.484+0000 7f56127fc640 10 client.?.objecter ms_handle_connect 0x7f5624059e10 2026-02-24T19:23:52.495 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.484+0000 7f56127fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:52.495 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.484+0000 7f562a601640 1 -- 10.20.193.14:0/135292177 >> v1:10.20.193.44:6789/0 conn(0x7f56241a5660 legacy=0x7f56240b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-24T19:23:52.495 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.484+0000 7f562a601640 1 -- 10.20.193.14:0/135292177 >> v1:10.20.193.44:6789/0 conn(0x7f56241a5660 legacy=0x7f56240b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-24T19:23:52.496 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.484+0000 7f562a601640 1 --1- 10.20.193.14:0/135292177 >> v1:10.20.193.44:6789/0 conn(0x7f56241a5660 0x7f56240b0b10 :-1 s=OPENED pgs=9164 cs=1 l=1).handle_message read tag failed 2026-02-24T19:23:52.496 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.484+0000 7f562a601640 1 --1- 10.20.193.14:0/135292177 >> v1:10.20.193.44:6789/0 conn(0x7f56241a5660 0x7f56240b0b10 :-1 s=OPENED pgs=9164 cs=1 l=1).fault on lossy channel, failing 2026-02-24T19:23:52.496 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.484+0000 7f56127fc640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.44:6789/0 2026-02-24T19:23:52.496 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.485+0000 7f56127fc640 1 -- 10.20.193.14:0/135292177 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3918984155 0 0) 0x7f56241630d0 con 0x7f562415e2a0 2026-02-24T19:23:52.496 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.485+0000 7f56127fc640 10 monclient(hunting): _negotiate 2026-02-24T19:23:52.496 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.485+0000 7f56127fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:52.496 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.485+0000 7f56127fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:52.496 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.485+0000 7f56127fc640 10 monclient(hunting): my global_id is 30849 2026-02-24T19:23:52.496 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.485+0000 7f56127fc640 1 -- 10.20.193.14:0/135292177 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55f4003610 con 0x7f562415e2a0 2026-02-24T19:23:52.499 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.485+0000 7f56127fc640 1 -- 10.20.193.14:0/135292177 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1490529355 0 0) 0x7f5624196400 con 0x7f5624059e10 2026-02-24T19:23:52.499 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.485+0000 7f56127fc640 10 monclient(hunting): _negotiate 2026-02-24T19:23:52.499 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.485+0000 7f56127fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:52.499 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.485+0000 7f56127fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:52.499 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.485+0000 7f56127fc640 10 monclient(hunting): my global_id is 28802 2026-02-24T19:23:52.499 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.485+0000 7f56127fc640 1 -- 10.20.193.14:0/135292177 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56241630d0 con 0x7f5624059e10 2026-02-24T19:23:52.499 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.487+0000 7f56127fc640 1 -- 10.20.193.14:0/135292177 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 564461216 0 0) 0x7f55f4003610 con 0x7f562415e2a0 2026-02-24T19:23:52.499 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.487+0000 7f56127fc640 1 -- 10.20.193.14:0/135292177 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5624196400 con 0x7f562415e2a0 2026-02-24T19:23:52.500 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.488+0000 7f56127fc640 1 -- 10.20.193.14:0/135292177 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5618003090 con 0x7f562415e2a0 2026-02-24T19:23:52.500 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.488+0000 7f56127fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:52.500 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.488+0000 7f56127fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:23:52.500 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.488+0000 7f56127fc640 10 monclient(hunting): dump: 2026-02-24T19:23:52.500 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:52.500 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:52.500 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.500 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.500 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:52.500 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:52.500 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:52.500 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:52.500 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:52.501 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.501 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.488+0000 7f56127fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:23:52.501 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.488+0000 7f56127fc640 1 -- 10.20.193.14:0/135292177 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2660205311 0 0) 0x7f56241630d0 con 0x7f5624059e10 2026-02-24T19:23:52.501 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.488+0000 7f56127fc640 1 -- 10.20.193.14:0/135292177 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f55f4003610 con 0x7f5624059e10 2026-02-24T19:23:52.501 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.488+0000 7f56127fc640 1 -- 10.20.193.14:0/135292177 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5614003310 con 0x7f5624059e10 2026-02-24T19:23:52.501 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.488+0000 7f56127fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:52.501 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.488+0000 7f56127fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:52.501 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.488+0000 7f56127fc640 10 monclient(hunting): dump: 2026-02-24T19:23:52.501 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:52.501 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:52.501 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.501 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.502 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:52.502 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:52.502 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:52.502 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:52.502 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:52.502 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.502 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.489+0000 7f56127fc640 1 -- 10.20.193.14:0/135292177 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3751761941 0 0) 0x7f5624196400 con 0x7f562415e2a0 2026-02-24T19:23:52.502 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.489+0000 7f56127fc640 1 -- 10.20.193.14:0/135292177 >> v1:10.20.193.170:6789/0 conn(0x7f5624059e10 legacy=0x7f562411e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:52.502 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.489+0000 7f56127fc640 1 -- 10.20.193.14:0/135292177 >> v1:10.20.193.44:6789/0 conn(0x7f56241a5660 legacy=0x7f56240b0b10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-24T19:23:52.502 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.489+0000 7f56127fc640 10 monclient: _finish_hunting 0 2026-02-24T19:23:52.502 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.489+0000 7f56127fc640 1 monclient: found mon.a 2026-02-24T19:23:52.502 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.489+0000 7f56127fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:52.502 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.489+0000 7f56127fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:52.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.489+0000 7f56127fc640 1 -- 10.20.193.14:0/135292177 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56240560e0 con 0x7f562415e2a0 2026-02-24T19:23:52.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.489+0000 7f56127fc640 10 monclient: _finish_auth 0 2026-02-24T19:23:52.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.489+0000 7f56127fc640 10 monclient: _check_auth_tickets 2026-02-24T19:23:52.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.489+0000 7f56127fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:52.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.489+0000 7f562c08b640 5 monclient: authenticate success, global_id 30849 2026-02-24T19:23:52.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.489+0000 7f562c08b640 10 monclient: _renew_subs 2026-02-24T19:23:52.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.489+0000 7f562c08b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:52.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.489+0000 7f562c08b640 1 -- 10.20.193.14:0/135292177 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f56240563c0 con 0x7f562415e2a0 2026-02-24T19:23:52.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.489+0000 7f562c08b640 10 client.30849.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:52.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.489+0000 7f562c08b640 10 monclient: _renew_subs 2026-02-24T19:23:52.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.489+0000 7f562c08b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:52.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.489+0000 7f562c08b640 1 -- 10.20.193.14:0/135292177 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f56240b1220 con 0x7f562415e2a0 2026-02-24T19:23:52.503 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.489+0000 7f562c08b640 1 librados: init done 2026-02-24T19:23:52.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.490+0000 7f562c08b640 10 client.30849.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:52.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.490+0000 7f562c08b640 15 client.30849.objecter _session_command_op_assign -1 1 2026-02-24T19:23:52.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.490+0000 7f562c08b640 20 client.30849.objecter _get_session osd=-1 returning homeless 2026-02-24T19:23:52.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.490+0000 7f562c08b640 10 client.30849.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:52.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.490+0000 7f562c08b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:52.504 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.490+0000 7f562c08b640 1 -- 10.20.193.14:0/135292177 --> v1:10.20.193.14:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f5624055a20 con 0x7f562415e2a0 2026-02-24T19:23:52.506 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.498+0000 7f56127fc640 1 -- 10.20.193.14:0/135292177 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5624055a20 con 0x7f562415e2a0 2026-02-24T19:23:52.506 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.498+0000 7f56127fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:52.506 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.498+0000 7f56127fc640 1 -- 10.20.193.14:0/135292177 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f5618004a70 con 0x7f562415e2a0 2026-02-24T19:23:52.506 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.498+0000 7f56127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:52.506 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.498+0000 7f56127fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:52.506 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.498+0000 7f5613fff640 4 set_mon_vals no callback set 2026-02-24T19:23:52.506 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.498+0000 7f56127fc640 10 monclient: dump: 2026-02-24T19:23:52.507 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:52.507 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:52.507 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.507 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.507 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:52.507 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:52.507 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:52.507 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:52.507 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:52.507 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.507 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.499+0000 7f56127fc640 1 -- 10.20.193.14:0/135292177 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f561801d8e0 con 0x7f562415e2a0 2026-02-24T19:23:52.507 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.499+0000 7f5629e00640 10 monclient: get_auth_request con 0x7f55f4077cd0 auth_method 0 2026-02-24T19:23:52.508 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.499+0000 7f56127fc640 10 client.30849.objecter ms_handle_connect 0x7f55f4077cd0 2026-02-24T19:23:52.508 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.500+0000 7f56127fc640 1 -- 10.20.193.14:0/135292177 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7f5618059440 con 0x7f562415e2a0 2026-02-24T19:23:52.508 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.500+0000 7f56127fc640 10 client.30849.objecter ms_dispatch2 0x7f5624000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:23:52.508 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.500+0000 7f56127fc640 3 client.30849.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:23:52.508 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.500+0000 7f56127fc640 3 client.30849.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:23:52.508 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.500+0000 7f56127fc640 10 client.30849.objecter checking command 1 2026-02-24T19:23:52.508 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.500+0000 7f56127fc640 20 client.30849.objecter _get_session s=0x7f55f40a1ff0 osd=10 3 2026-02-24T19:23:52.508 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.500+0000 7f56127fc640 20 client.30849.objecter put_session s=0x7f55f40a1ff0 osd=10 3 2026-02-24T19:23:52.508 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.500+0000 7f56127fc640 15 client.30849.objecter _session_command_op_remove -1 1 2026-02-24T19:23:52.508 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.500+0000 7f56127fc640 20 client.30849.objecter _get_session s=0x7f55f40a1ff0 osd=10 3 2026-02-24T19:23:52.508 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.500+0000 7f56127fc640 20 client.30849.objecter get_session s=0x7f55f40a1ff0 osd=10 3 2026-02-24T19:23:52.508 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.500+0000 7f56127fc640 15 client.30849.objecter _session_command_op_assign 10 1 2026-02-24T19:23:52.509 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.500+0000 7f56127fc640 20 client.30849.objecter put_session s=0x7f55f40a1ff0 osd=10 4 2026-02-24T19:23:52.509 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.500+0000 7f56127fc640 10 client.30849.objecter _send_command 1 2026-02-24T19:23:52.509 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.500+0000 7f56127fc640 1 -- 10.20.193.14:0/135292177 --> v1:10.20.193.170:6808/983512563 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f55f40c4300 con 0x7f55f40a26a0 2026-02-24T19:23:52.509 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.500+0000 7f56127fc640 20 client.30849.objecter dump_active .. 0 homeless 2026-02-24T19:23:52.509 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.500+0000 7f56127fc640 1 -- 10.20.193.14:0/135292177 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_get_version_reply(handle=1 version=354) ==== 24+0+0 (unknown 31317031 0 0) 0x7f5618059820 con 0x7f562415e2a0 2026-02-24T19:23:52.509 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.500+0000 7f56127fc640 10 monclient: handle_get_version_reply finishing 1 version 354 2026-02-24T19:23:52.509 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.501+0000 7f562a601640 10 monclient: get_auth_request con 0x7f55f40a26a0 auth_method 0 2026-02-24T19:23:52.509 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.502+0000 7f56127fc640 10 client.30849.objecter ms_handle_connect 0x7f55f40a26a0 2026-02-24T19:23:52.513 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.511+0000 7f56127fc640 1 -- 10.20.193.14:0/135292177 <== osd.10 v1:10.20.193.170:6808/983512563 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f55f40c4300 con 0x7f55f40a26a0 2026-02-24T19:23:52.513 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.511+0000 7f56127fc640 10 client.30849.objecter ms_dispatch2 0x7f5624000b90 command_reply(tid 1: 0 ) 2026-02-24T19:23:52.513 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.511+0000 7f56127fc640 10 client.30849.objecter _finish_command 1 = system:0 2026-02-24T19:23:52.513 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.511+0000 7f56127fc640 20 client.30849.objecter put_session s=0x7f55f40a1ff0 osd=10 4 2026-02-24T19:23:52.513 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.511+0000 7f56127fc640 15 client.30849.objecter _session_command_op_remove 10 1 2026-02-24T19:23:52.520 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.519+0000 7f562c08b640 10 client.30849.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:23:52.520 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.519+0000 7f562c08b640 15 client.30849.objecter _session_command_op_assign -1 2 2026-02-24T19:23:52.521 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.519+0000 7f562c08b640 20 client.30849.objecter _get_session s=0x7f55f40a1ff0 osd=10 3 2026-02-24T19:23:52.521 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.519+0000 7f562c08b640 20 client.30849.objecter put_session s=0x7f55f40a1ff0 osd=10 3 2026-02-24T19:23:52.521 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.519+0000 7f562c08b640 20 client.30849.objecter _get_session s=0x7f55f40a1ff0 osd=10 3 2026-02-24T19:23:52.521 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.519+0000 7f562c08b640 15 client.30849.objecter _session_command_op_remove -1 2 2026-02-24T19:23:52.521 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.519+0000 7f562c08b640 20 client.30849.objecter get_session s=0x7f55f40a1ff0 osd=10 3 2026-02-24T19:23:52.521 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.519+0000 7f562c08b640 15 client.30849.objecter _session_command_op_assign 10 2 2026-02-24T19:23:52.521 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.519+0000 7f562c08b640 20 client.30849.objecter put_session s=0x7f55f40a1ff0 osd=10 4 2026-02-24T19:23:52.521 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.519+0000 7f562c08b640 10 client.30849.objecter _send_command 2 2026-02-24T19:23:52.521 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.519+0000 7f562c08b640 1 -- 10.20.193.14:0/135292177 --> v1:10.20.193.170:6808/983512563 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f56241607d0 con 0x7f55f40a26a0 2026-02-24T19:23:52.529 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.527+0000 7f56127fc640 1 -- 10.20.193.14:0/135292177 <== osd.10 v1:10.20.193.170:6808/983512563 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f56241607d0 con 0x7f55f40a26a0 2026-02-24T19:23:52.529 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.527+0000 7f56127fc640 10 client.30849.objecter ms_dispatch2 0x7f5624000b90 command_reply(tid 2: 0 ) 2026-02-24T19:23:52.529 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.527+0000 7f56127fc640 10 client.30849.objecter _finish_command 2 = system:0 2026-02-24T19:23:52.529 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.527+0000 7f56127fc640 20 client.30849.objecter put_session s=0x7f55f40a1ff0 osd=10 4 2026-02-24T19:23:52.529 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.527+0000 7f56127fc640 15 client.30849.objecter _session_command_op_remove 10 2 2026-02-24T19:23:52.529 INFO:teuthology.orchestra.run.trial014.stdout:{ 2026-02-24T19:23:52.529 INFO:teuthology.orchestra.run.trial014.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:23:52.530 INFO:teuthology.orchestra.run.trial014.stdout:} 2026-02-24T19:23:52.531 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.527+0000 7f562c08b640 10 librados: watch_flush enter 2026-02-24T19:23:52.531 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.527+0000 7f562c08b640 10 librados: watch_flush exit 2026-02-24T19:23:52.531 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.527+0000 7f562c08b640 10 client.30849.objecter close_session for osd.10 2026-02-24T19:23:52.531 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.527+0000 7f562c08b640 1 -- 10.20.193.14:0/135292177 >> v1:10.20.193.170:6808/983512563 conn(0x7f55f40a26a0 legacy=0x7f55f40c2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:52.531 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.527+0000 7f562c08b640 20 client.30849.objecter put_session s=0x7f55f40a1ff0 osd=10 1 2026-02-24T19:23:52.531 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.527+0000 7f562c08b640 20 client.30849.objecter shutdown clearing up homeless session... 2026-02-24T19:23:52.531 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.527+0000 7f562c08b640 10 client.30849.objecter successfully canceled tick 2026-02-24T19:23:52.531 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.527+0000 7f562c08b640 1 -- 10.20.193.14:0/135292177 >> v1:10.20.193.14:6800/4014096310 conn(0x7f55f4077cd0 legacy=0x7f55f4098180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:52.532 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.527+0000 7f562c08b640 10 monclient: shutdown 2026-02-24T19:23:52.532 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.527+0000 7f562c08b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:52.532 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.527+0000 7f562c08b640 1 -- 10.20.193.14:0/135292177 >> v1:10.20.193.14:6789/0 conn(0x7f562415e2a0 legacy=0x7f5624195730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:52.532 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.527+0000 7f562a601640 1 -- 10.20.193.14:0/135292177 reap_dead start 2026-02-24T19:23:52.532 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.527+0000 7f562c08b640 1 -- 10.20.193.14:0/135292177 shutdown_connections 2026-02-24T19:23:52.532 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.527+0000 7f562c08b640 1 -- 10.20.193.14:0/135292177 >> 10.20.193.14:0/135292177 conn(0x7f56240b2f60 msgr2=0x7f562415f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:52.532 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.527+0000 7f562c08b640 1 -- 10.20.193.14:0/135292177 shutdown_connections 2026-02-24T19:23:52.532 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.527+0000 7f562c08b640 1 -- 10.20.193.14:0/135292177 wait complete. 2026-02-24T19:23:52.532 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.527+0000 7f562c08b640 1 librados: shutdown 2026-02-24T19:23:52.537 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 10 2026-02-24T19:23:52.605 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.604+0000 7f6b30655640 10 monclient: get_monmap_and_config 2026-02-24T19:23:52.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.604+0000 7f6b30655640 10 monclient: build_initial_monmap 2026-02-24T19:23:52.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.604+0000 7f6b30655640 10 monclient: monmap: 2026-02-24T19:23:52.606 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:52.606 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:52.606 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:23:52.604862+0000 2026-02-24T19:23:52.606 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:23:52.604862+0000 2026-02-24T19:23:52.606 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:52.606 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:52.606 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:52.606 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:52.606 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:52.607 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.604+0000 7f6b30655640 1 Processor -- start 2026-02-24T19:23:52.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.604+0000 7f6b30655640 1 -- start start 2026-02-24T19:23:52.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.604+0000 7f6b30655640 10 monclient: init 2026-02-24T19:23:52.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.605+0000 7f6b30655640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:52.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.605+0000 7f6b30655640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:23:52.608 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.605+0000 7f6b30655640 10 monclient(hunting): picked mon.noname-b con 0x7f6b28157780 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:52.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.605+0000 7f6b30655640 10 monclient(hunting): picked mon.noname-c con 0x7f6b28157b50 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:52.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.605+0000 7f6b30655640 10 monclient(hunting): picked mon.noname-a con 0x7f6b28164d00 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:52.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.605+0000 7f6b30655640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b2805de70 con 0x7f6b28164d00 2026-02-24T19:23:52.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.605+0000 7f6b30655640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b28055b20 con 0x7f6b28157780 2026-02-24T19:23:52.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.605+0000 7f6b30655640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b28055e00 con 0x7f6b28157b50 2026-02-24T19:23:52.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.605+0000 7f6b30655640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:52.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.605+0000 7f6b30655640 10 monclient(hunting): authenticate will time out at 4007.286247s 2026-02-24T19:23:52.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.616+0000 7f6b2ebcb640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f6b28164d00 0x7f6b281c5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:50986/0 (socket says 10.20.193.14:50986) 2026-02-24T19:23:52.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.616+0000 7f6b2ebcb640 1 -- 10.20.193.14:0/955675097 learned_addr learned my addr 10.20.193.14:0/955675097 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:52.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.619+0000 7f6b2d3c8640 1 -- 10.20.193.14:0/955675097 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1638839135 0 0) 0x7f6b28055e00 con 0x7f6b28157b50 2026-02-24T19:23:52.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.619+0000 7f6b2d3c8640 10 monclient(hunting): _negotiate 2026-02-24T19:23:52.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.619+0000 7f6b2d3c8640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:52.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.619+0000 7f6b2d3c8640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:52.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.619+0000 7f6b2d3c8640 10 monclient(hunting): my global_id is 28805 2026-02-24T19:23:52.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.619+0000 7f6b2d3c8640 1 -- 10.20.193.14:0/955675097 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b10003610 con 0x7f6b28157b50 2026-02-24T19:23:52.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.619+0000 7f6b2d3c8640 1 -- 10.20.193.14:0/955675097 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 384516822 0 0) 0x7f6b2805de70 con 0x7f6b28164d00 2026-02-24T19:23:52.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.619+0000 7f6b2d3c8640 10 monclient(hunting): _negotiate 2026-02-24T19:23:52.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.619+0000 7f6b2d3c8640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:52.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.619+0000 7f6b2d3c8640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:52.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.619+0000 7f6b2d3c8640 10 monclient(hunting): my global_id is 30852 2026-02-24T19:23:52.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.619+0000 7f6b2d3c8640 1 -- 10.20.193.14:0/955675097 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b28055e00 con 0x7f6b28164d00 2026-02-24T19:23:52.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.621+0000 7f6b2d3c8640 1 -- 10.20.193.14:0/955675097 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1366583677 0 0) 0x7f6b10003610 con 0x7f6b28157b50 2026-02-24T19:23:52.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.621+0000 7f6b2d3c8640 1 -- 10.20.193.14:0/955675097 >> v1:10.20.193.44:6789/0 conn(0x7f6b28157780 legacy=0x7f6b28056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:52.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.621+0000 7f6b2d3c8640 1 -- 10.20.193.14:0/955675097 >> v1:10.20.193.14:6789/0 conn(0x7f6b28164d00 legacy=0x7f6b281c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:52.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.621+0000 7f6b2d3c8640 10 monclient: _finish_hunting 0 2026-02-24T19:23:52.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.621+0000 7f6b2d3c8640 1 monclient: found mon.noname-c 2026-02-24T19:23:52.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.621+0000 7f6b2d3c8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:52.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.621+0000 7f6b2d3c8640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.170:6789/0 2026-02-24T19:23:52.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.621+0000 7f6b2d3c8640 1 -- 10.20.193.14:0/955675097 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b280560e0 con 0x7f6b28157b50 2026-02-24T19:23:52.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.621+0000 7f6b2d3c8640 10 monclient: _finish_auth 0 2026-02-24T19:23:52.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.621+0000 7f6b2d3c8640 10 monclient: _check_auth_tickets 2026-02-24T19:23:52.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.621+0000 7f6b2d3c8640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:52.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.621+0000 7f6b2d3c8640 1 -- 10.20.193.14:0/955675097 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f6b1c002df0 con 0x7f6b28157b50 2026-02-24T19:23:52.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.621+0000 7f6b2d3c8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:52.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.621+0000 7f6b2d3c8640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:23:52.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.621+0000 7f6b2d3c8640 10 monclient: dump: 2026-02-24T19:23:52.627 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:52.627 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:52.627 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.627 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.627 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:52.627 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:52.627 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:52.627 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:52.627 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:52.628 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.621+0000 7f6b30655640 5 monclient: authenticate success, global_id 28805 2026-02-24T19:23:52.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.621+0000 7f6b30655640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:52.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.622+0000 7f6b2d3c8640 1 -- 10.20.193.14:0/955675097 <== mon.2 v1:10.20.193.170:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6b1c003000 con 0x7f6b28157b50 2026-02-24T19:23:52.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.622+0000 7f6b2d3c8640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:52.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.622+0000 7f6b2d3c8640 1 -- 10.20.193.14:0/955675097 <== mon.2 v1:10.20.193.170:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f6b1c003440 con 0x7f6b28157b50 2026-02-24T19:23:52.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.622+0000 7f6b2d3c8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:52.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.622+0000 7f6b2d3c8640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:52.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.622+0000 7f6b2d3c8640 10 monclient: dump: 2026-02-24T19:23:52.628 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:52.628 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:52.629 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.629 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.629 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:52.629 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:52.629 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:52.629 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:52.629 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:52.629 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.622+0000 7f6b30655640 10 monclient: get_monmap_and_config success 2026-02-24T19:23:52.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.622+0000 7f6b30655640 4 set_mon_vals no callback set 2026-02-24T19:23:52.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.622+0000 7f6b30655640 10 monclient: shutdown 2026-02-24T19:23:52.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.622+0000 7f6b30655640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:52.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.622+0000 7f6b30655640 1 -- 10.20.193.14:0/955675097 >> v1:10.20.193.170:6789/0 conn(0x7f6b28157b50 legacy=0x7f6b281645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:52.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.622+0000 7f6b30655640 1 -- 10.20.193.14:0/955675097 shutdown_connections 2026-02-24T19:23:52.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.622+0000 7f6b30655640 1 -- 10.20.193.14:0/955675097 >> 10.20.193.14:0/955675097 conn(0x7f6b280b2ef0 msgr2=0x7f6b280b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:52.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.622+0000 7f6b30655640 1 -- 10.20.193.14:0/955675097 shutdown_connections 2026-02-24T19:23:52.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.622+0000 7f6b30655640 1 -- 10.20.193.14:0/955675097 wait complete. 2026-02-24T19:23:52.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.622+0000 7f6b30655640 10 monclient: build_initial_monmap 2026-02-24T19:23:52.630 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.622+0000 7f6b30655640 10 monclient: monmap: 2026-02-24T19:23:52.630 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:52.630 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:23:52.630 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:23:52.630 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:23:52.630 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:52.630 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:23:52.630 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:52.631 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:52.631 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:52.631 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.623+0000 7f6b30655640 1 librados: starting msgr at 2026-02-24T19:23:52.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.623+0000 7f6b30655640 1 librados: starting objecter 2026-02-24T19:23:52.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.623+0000 7f6b30655640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:23:52.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.623+0000 7f6b30655640 1 Processor -- start 2026-02-24T19:23:52.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.623+0000 7f6b30655640 1 -- start start 2026-02-24T19:23:52.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.623+0000 7f6b30655640 1 librados: setting wanted keys 2026-02-24T19:23:52.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.623+0000 7f6b30655640 1 librados: calling monclient init 2026-02-24T19:23:52.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.623+0000 7f6b30655640 10 monclient: init 2026-02-24T19:23:52.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.623+0000 7f6b30655640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:52.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.623+0000 7f6b30655640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:23:52.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.623+0000 7f6b30655640 10 monclient(hunting): picked mon.noname-a con 0x7f6b28157780 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:52.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.623+0000 7f6b30655640 10 monclient(hunting): picked mon.noname-b con 0x7f6b28157b50 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:52.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.623+0000 7f6b30655640 10 monclient(hunting): picked mon.noname-c con 0x7f6b28164d00 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:52.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.623+0000 7f6b30655640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b280b04d0 con 0x7f6b28157780 2026-02-24T19:23:52.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.623+0000 7f6b30655640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b2812db80 con 0x7f6b28157b50 2026-02-24T19:23:52.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.623+0000 7f6b30655640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b2812de60 con 0x7f6b28164d00 2026-02-24T19:23:52.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.623+0000 7f6b30655640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:52.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.623+0000 7f6b30655640 10 monclient(hunting): authenticate will time out at 4007.304602s 2026-02-24T19:23:52.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.623+0000 7f6b2e3ca640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f6b28157780 0x7f6b280afdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:50994/0 (socket says 10.20.193.14:50994) 2026-02-24T19:23:52.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.623+0000 7f6b2e3ca640 1 -- 10.20.193.14:0/2071515296 learned_addr learned my addr 10.20.193.14:0/2071515296 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:52.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.624+0000 7f6b0effd640 10 client.?.objecter ms_handle_connect 0x7f6b28157780 2026-02-24T19:23:52.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.624+0000 7f6b0effd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:52.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.624+0000 7f6b0effd640 10 client.?.objecter ms_handle_connect 0x7f6b28157b50 2026-02-24T19:23:52.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.624+0000 7f6b0effd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:52.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.624+0000 7f6b0effd640 10 client.?.objecter ms_handle_connect 0x7f6b28164d00 2026-02-24T19:23:52.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.624+0000 7f6b0effd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:52.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.624+0000 7f6b0effd640 1 -- 10.20.193.14:0/2071515296 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 65224311 0 0) 0x7f6b280b04d0 con 0x7f6b28157780 2026-02-24T19:23:52.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.624+0000 7f6b0effd640 10 monclient(hunting): _negotiate 2026-02-24T19:23:52.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.624+0000 7f6b0effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:52.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.624+0000 7f6b0effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:52.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.624+0000 7f6b0effd640 10 monclient(hunting): my global_id is 30855 2026-02-24T19:23:52.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.624+0000 7f6b0effd640 1 -- 10.20.193.14:0/2071515296 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6af8003610 con 0x7f6b28157780 2026-02-24T19:23:52.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.625+0000 7f6b0effd640 1 -- 10.20.193.14:0/2071515296 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3565464259 0 0) 0x7f6b2812db80 con 0x7f6b28157b50 2026-02-24T19:23:52.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.625+0000 7f6b0effd640 10 monclient(hunting): _negotiate 2026-02-24T19:23:52.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.625+0000 7f6b0effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:52.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.625+0000 7f6b0effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:52.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.625+0000 7f6b0effd640 10 monclient(hunting): my global_id is 29170 2026-02-24T19:23:52.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.625+0000 7f6b0effd640 1 -- 10.20.193.14:0/2071515296 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b280b04d0 con 0x7f6b28157b50 2026-02-24T19:23:52.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.625+0000 7f6b0effd640 1 -- 10.20.193.14:0/2071515296 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 746969382 0 0) 0x7f6b2812de60 con 0x7f6b28164d00 2026-02-24T19:23:52.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.625+0000 7f6b0effd640 10 monclient(hunting): _negotiate 2026-02-24T19:23:52.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.625+0000 7f6b0effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:52.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.625+0000 7f6b0effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:52.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.625+0000 7f6b0effd640 10 monclient(hunting): my global_id is 28808 2026-02-24T19:23:52.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.625+0000 7f6b0effd640 1 -- 10.20.193.14:0/2071515296 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b2812db80 con 0x7f6b28164d00 2026-02-24T19:23:52.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.627+0000 7f6b0effd640 1 -- 10.20.193.14:0/2071515296 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1655390449 0 0) 0x7f6b2812db80 con 0x7f6b28164d00 2026-02-24T19:23:52.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.627+0000 7f6b0effd640 1 -- 10.20.193.14:0/2071515296 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6b2812de60 con 0x7f6b28164d00 2026-02-24T19:23:52.638 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.627+0000 7f6b0effd640 1 -- 10.20.193.14:0/2071515296 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f6b24003370 con 0x7f6b28164d00 2026-02-24T19:23:52.638 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.627+0000 7f6b0effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:52.638 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.627+0000 7f6b0effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:23:52.638 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.627+0000 7f6b0effd640 10 monclient(hunting): dump: 2026-02-24T19:23:52.638 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:52.638 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:52.638 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.638 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.638 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:52.638 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:52.638 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:52.638 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:52.639 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:52.639 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.639 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.627+0000 7f6b0effd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:23:52.639 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.627+0000 7f6b0effd640 1 -- 10.20.193.14:0/2071515296 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 131211445 0 0) 0x7f6af8003610 con 0x7f6b28157780 2026-02-24T19:23:52.639 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.627+0000 7f6b0effd640 1 -- 10.20.193.14:0/2071515296 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6b2812db80 con 0x7f6b28157780 2026-02-24T19:23:52.639 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.627+0000 7f6b0effd640 1 -- 10.20.193.14:0/2071515296 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f6b18003110 con 0x7f6b28157780 2026-02-24T19:23:52.639 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.627+0000 7f6b0effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:52.639 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.627+0000 7f6b0effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:52.639 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.627+0000 7f6b0effd640 10 monclient(hunting): dump: 2026-02-24T19:23:52.639 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:52.639 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:52.639 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.639 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.640 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:52.640 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:52.640 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:52.640 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:52.640 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:52.640 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.627+0000 7f6b0effd640 1 -- 10.20.193.14:0/2071515296 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1730712962 0 0) 0x7f6b280b04d0 con 0x7f6b28157b50 2026-02-24T19:23:52.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.627+0000 7f6b0effd640 1 -- 10.20.193.14:0/2071515296 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6af8003610 con 0x7f6b28157b50 2026-02-24T19:23:52.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.627+0000 7f6b0effd640 1 -- 10.20.193.14:0/2071515296 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f6b1c003350 con 0x7f6b28157b50 2026-02-24T19:23:52.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.627+0000 7f6b0effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:52.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.627+0000 7f6b0effd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:52.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.627+0000 7f6b0effd640 10 monclient(hunting): dump: 2026-02-24T19:23:52.641 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:52.641 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:52.641 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.641 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.641 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:52.641 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:52.641 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:52.641 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:52.641 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:52.641 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.629+0000 7f6b0effd640 1 -- 10.20.193.14:0/2071515296 <== mon.2 v1:10.20.193.170:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3718857607 0 0) 0x7f6b2812de60 con 0x7f6b28164d00 2026-02-24T19:23:52.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.629+0000 7f6b0effd640 1 -- 10.20.193.14:0/2071515296 >> v1:10.20.193.44:6789/0 conn(0x7f6b28157b50 legacy=0x7f6b281298e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:52.641 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.629+0000 7f6b0effd640 1 -- 10.20.193.14:0/2071515296 >> v1:10.20.193.14:6789/0 conn(0x7f6b28157780 legacy=0x7f6b280afdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:52.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.629+0000 7f6b0effd640 10 monclient: _finish_hunting 0 2026-02-24T19:23:52.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.629+0000 7f6b0effd640 1 monclient: found mon.c 2026-02-24T19:23:52.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.629+0000 7f6b0effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:52.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.629+0000 7f6b0effd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:52.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.629+0000 7f6b0effd640 1 -- 10.20.193.14:0/2071515296 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b2812e140 con 0x7f6b28164d00 2026-02-24T19:23:52.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.629+0000 7f6b0effd640 10 monclient: _finish_auth 0 2026-02-24T19:23:52.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.629+0000 7f6b0effd640 10 monclient: _check_auth_tickets 2026-02-24T19:23:52.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.629+0000 7f6b0effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:52.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.629+0000 7f6b30655640 5 monclient: authenticate success, global_id 28808 2026-02-24T19:23:52.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.629+0000 7f6b30655640 10 monclient: _renew_subs 2026-02-24T19:23:52.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.629+0000 7f6b30655640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:52.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.629+0000 7f6b30655640 1 -- 10.20.193.14:0/2071515296 --> v1:10.20.193.170:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6b281290e0 con 0x7f6b28164d00 2026-02-24T19:23:52.642 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.629+0000 7f6b30655640 10 client.28808.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:52.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.629+0000 7f6b30655640 10 monclient: _renew_subs 2026-02-24T19:23:52.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.629+0000 7f6b30655640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:52.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.629+0000 7f6b30655640 1 -- 10.20.193.14:0/2071515296 --> v1:10.20.193.170:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6b2812e420 con 0x7f6b28164d00 2026-02-24T19:23:52.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.629+0000 7f6b30655640 1 librados: init done 2026-02-24T19:23:52.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.629+0000 7f6b30655640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:52.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.629+0000 7f6b30655640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:52.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.629+0000 7f6b30655640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.170:6789/0 2026-02-24T19:23:52.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.629+0000 7f6b30655640 1 -- 10.20.193.14:0/2071515296 --> v1:10.20.193.170:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b281653e0 con 0x7f6b28164d00 2026-02-24T19:23:52.720 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.718+0000 7f6b0effd640 1 -- 10.20.193.14:0/2071515296 <== mon.2 v1:10.20.193.170:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6b24004c50 con 0x7f6b28164d00 2026-02-24T19:23:52.720 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.718+0000 7f6b0effd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:52.720 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.718+0000 7f6b0effd640 1 -- 10.20.193.14:0/2071515296 <== mon.2 v1:10.20.193.170:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f6b24004fa0 con 0x7f6b28164d00 2026-02-24T19:23:52.720 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.718+0000 7f6b0effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:52.720 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.718+0000 7f6b0effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:52.720 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.718+0000 7f6b2cbc7640 4 set_mon_vals no callback set 2026-02-24T19:23:52.720 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.718+0000 7f6b0effd640 10 monclient: dump: 2026-02-24T19:23:52.721 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:52.721 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:52.721 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.721 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.721 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:52.721 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:52.721 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:52.721 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:52.721 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:52.721 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.722 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.719+0000 7f6b0effd640 1 -- 10.20.193.14:0/2071515296 <== mon.2 v1:10.20.193.170:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f6b2401de10 con 0x7f6b28164d00 2026-02-24T19:23:52.722 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.719+0000 7f6b2e3ca640 10 monclient: get_auth_request con 0x7f6af8077e70 auth_method 0 2026-02-24T19:23:52.722 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.719+0000 7f6b0effd640 10 client.28808.objecter ms_handle_connect 0x7f6af8077e70 2026-02-24T19:23:52.723 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.720+0000 7f6b0effd640 1 -- 10.20.193.14:0/2071515296 <== mon.2 v1:10.20.193.170:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7f6b24093490 con 0x7f6b28164d00 2026-02-24T19:23:52.723 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.720+0000 7f6b0effd640 10 client.28808.objecter ms_dispatch2 0x7f6b28000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:23:52.723 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.720+0000 7f6b0effd640 3 client.28808.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:23:52.723 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.720+0000 7f6b0effd640 3 client.28808.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:23:52.723 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.720+0000 7f6b0effd640 20 client.28808.objecter dump_active .. 0 homeless 2026-02-24T19:23:52.723 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.721+0000 7f6b0effd640 1 -- 10.20.193.14:0/2071515296 <== mon.2 v1:10.20.193.170:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f6b2405dec0 con 0x7f6b28164d00 2026-02-24T19:23:52.723 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.721+0000 7f6b0effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:52.723 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.721+0000 7f6b0effd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:23:52.829 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.827+0000 7f6b30655640 1 -- 10.20.193.14:0/2071515296 --> v1:10.20.193.14:6800/4014096310 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "10", "target": ["mon-mgr", ""]}) -- 0x7f6b2815fe20 con 0x7f6af8077e70 2026-02-24T19:23:52.829 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.827+0000 7f6b0effd640 1 -- 10.20.193.14:0/2071515296 <== mgr.4110 v1:10.20.193.14:6800/4014096310 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 10 to deep-scrub) ==== 42+0+0 (unknown 3896554461 0 0) 0x7f6b2815fe20 con 0x7f6af8077e70 2026-02-24T19:23:52.829 INFO:teuthology.orchestra.run.trial014.stderr:instructed osd(s) 10 to deep-scrub 2026-02-24T19:23:52.830 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.828+0000 7f6b30655640 10 librados: watch_flush enter 2026-02-24T19:23:52.830 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.828+0000 7f6b30655640 10 librados: watch_flush exit 2026-02-24T19:23:52.830 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.828+0000 7f6b30655640 20 client.28808.objecter shutdown clearing up homeless session... 2026-02-24T19:23:52.830 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.828+0000 7f6b30655640 10 client.28808.objecter successfully canceled tick 2026-02-24T19:23:52.831 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.828+0000 7f6b30655640 1 -- 10.20.193.14:0/2071515296 >> v1:10.20.193.14:6800/4014096310 conn(0x7f6af8077e70 legacy=0x7f6af8098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:52.831 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.828+0000 7f6b30655640 10 monclient: shutdown 2026-02-24T19:23:52.831 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.828+0000 7f6b30655640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:52.831 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.828+0000 7f6b30655640 1 -- 10.20.193.14:0/2071515296 >> v1:10.20.193.170:6789/0 conn(0x7f6b28164d00 legacy=0x7f6b2812b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:52.831 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.828+0000 7f6b30655640 1 -- 10.20.193.14:0/2071515296 shutdown_connections 2026-02-24T19:23:52.831 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.828+0000 7f6b30655640 1 -- 10.20.193.14:0/2071515296 >> 10.20.193.14:0/2071515296 conn(0x7f6b280b2ef0 msgr2=0x7f6b28160340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:52.831 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.828+0000 7f6b30655640 1 -- 10.20.193.14:0/2071515296 shutdown_connections 2026-02-24T19:23:52.831 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.828+0000 7f6b30655640 1 -- 10.20.193.14:0/2071515296 wait complete. 2026-02-24T19:23:52.831 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.828+0000 7f6b30655640 1 librados: shutdown 2026-02-24T19:23:52.838 INFO:tasks.ceph:Scrubbing osd.14 2026-02-24T19:23:52.838 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:23:52.908 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.906+0000 7f4b79145640 10 monclient: get_monmap_and_config 2026-02-24T19:23:52.908 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.906+0000 7f4b79145640 10 monclient: build_initial_monmap 2026-02-24T19:23:52.908 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.906+0000 7f4b79145640 10 monclient: monmap: 2026-02-24T19:23:52.908 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:52.908 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:52.908 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:23:52.907015+0000 2026-02-24T19:23:52.908 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:23:52.907015+0000 2026-02-24T19:23:52.908 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:52.908 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:52.908 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:52.909 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:52.909 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:52.909 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.906+0000 7f4b79145640 1 Processor -- start 2026-02-24T19:23:52.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.906+0000 7f4b79145640 1 -- start start 2026-02-24T19:23:52.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.906+0000 7f4b79145640 10 monclient: init 2026-02-24T19:23:52.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.907+0000 7f4b79145640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:52.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.907+0000 7f4b79145640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:23:52.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.907+0000 7f4b79145640 10 monclient(hunting): picked mon.noname-a con 0x7f4b7415e2a0 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:52.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.907+0000 7f4b79145640 10 monclient(hunting): picked mon.noname-b con 0x7f4b74059e10 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:52.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.907+0000 7f4b79145640 10 monclient(hunting): picked mon.noname-c con 0x7f4b741a5660 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:52.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.907+0000 7f4b79145640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b74162df0 con 0x7f4b7415e2a0 2026-02-24T19:23:52.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.907+0000 7f4b79145640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b741630d0 con 0x7f4b74059e10 2026-02-24T19:23:52.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.907+0000 7f4b79145640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b741633b0 con 0x7f4b741a5660 2026-02-24T19:23:52.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.907+0000 7f4b79145640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:52.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.907+0000 7f4b79145640 10 monclient(hunting): authenticate will time out at 4007.588404s 2026-02-24T19:23:52.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.907+0000 7f4b72d76640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f4b7415e2a0 0x7f4b7405da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:51006/0 (socket says 10.20.193.14:51006) 2026-02-24T19:23:52.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.907+0000 7f4b72d76640 1 -- 10.20.193.14:0/995318839 learned_addr learned my addr 10.20.193.14:0/995318839 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:52.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.909+0000 7f4b71d74640 1 -- 10.20.193.14:0/995318839 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1531987799 0 0) 0x7f4b741630d0 con 0x7f4b74059e10 2026-02-24T19:23:52.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.909+0000 7f4b71d74640 10 monclient(hunting): _negotiate 2026-02-24T19:23:52.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.909+0000 7f4b71d74640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:52.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.909+0000 7f4b71d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:52.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.909+0000 7f4b71d74640 10 monclient(hunting): my global_id is 29173 2026-02-24T19:23:52.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.909+0000 7f4b71d74640 1 -- 10.20.193.14:0/995318839 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b60003610 con 0x7f4b74059e10 2026-02-24T19:23:52.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.909+0000 7f4b71d74640 1 -- 10.20.193.14:0/995318839 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1924357646 0 0) 0x7f4b74162df0 con 0x7f4b7415e2a0 2026-02-24T19:23:52.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.909+0000 7f4b71d74640 10 monclient(hunting): _negotiate 2026-02-24T19:23:52.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.909+0000 7f4b71d74640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:52.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.909+0000 7f4b71d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:52.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.909+0000 7f4b71d74640 10 monclient(hunting): my global_id is 30858 2026-02-24T19:23:52.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.909+0000 7f4b71d74640 1 -- 10.20.193.14:0/995318839 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b741630d0 con 0x7f4b7415e2a0 2026-02-24T19:23:52.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.909+0000 7f4b71d74640 1 -- 10.20.193.14:0/995318839 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3260607636 0 0) 0x7f4b741633b0 con 0x7f4b741a5660 2026-02-24T19:23:52.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.909+0000 7f4b71d74640 10 monclient(hunting): _negotiate 2026-02-24T19:23:52.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.909+0000 7f4b71d74640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:52.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.909+0000 7f4b71d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:52.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.909+0000 7f4b71d74640 10 monclient(hunting): my global_id is 28811 2026-02-24T19:23:52.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.909+0000 7f4b71d74640 1 -- 10.20.193.14:0/995318839 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b74162df0 con 0x7f4b741a5660 2026-02-24T19:23:52.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.910+0000 7f4b71d74640 1 -- 10.20.193.14:0/995318839 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 764698656 0 0) 0x7f4b60003610 con 0x7f4b74059e10 2026-02-24T19:23:52.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.910+0000 7f4b71d74640 1 -- 10.20.193.14:0/995318839 >> v1:10.20.193.170:6789/0 conn(0x7f4b741a5660 legacy=0x7f4b741c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:52.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.910+0000 7f4b71d74640 1 -- 10.20.193.14:0/995318839 >> v1:10.20.193.14:6789/0 conn(0x7f4b7415e2a0 legacy=0x7f4b7405da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:52.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.910+0000 7f4b71d74640 10 monclient: _finish_hunting 0 2026-02-24T19:23:52.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.910+0000 7f4b71d74640 1 monclient: found mon.noname-b 2026-02-24T19:23:52.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.910+0000 7f4b71d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:52.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.910+0000 7f4b71d74640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.44:6789/0 2026-02-24T19:23:52.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.910+0000 7f4b71d74640 1 -- 10.20.193.14:0/995318839 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b74163690 con 0x7f4b74059e10 2026-02-24T19:23:52.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.910+0000 7f4b71d74640 10 monclient: _finish_auth 0 2026-02-24T19:23:52.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.910+0000 7f4b71d74640 10 monclient: _check_auth_tickets 2026-02-24T19:23:52.919 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.910+0000 7f4b71d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:52.919 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.910+0000 7f4b71d74640 1 -- 10.20.193.14:0/995318839 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4b5c002df0 con 0x7f4b74059e10 2026-02-24T19:23:52.919 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.910+0000 7f4b71d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:52.919 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.910+0000 7f4b71d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:23:52.919 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.910+0000 7f4b71d74640 10 monclient: dump: 2026-02-24T19:23:52.919 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:52.919 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:52.919 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.919 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.919 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:52.919 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:52.919 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:52.920 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:52.920 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:52.920 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.910+0000 7f4b79145640 5 monclient: authenticate success, global_id 29173 2026-02-24T19:23:52.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.910+0000 7f4b79145640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:52.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.911+0000 7f4b71d74640 1 -- 10.20.193.14:0/995318839 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4b5c002fc0 con 0x7f4b74059e10 2026-02-24T19:23:52.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.911+0000 7f4b71d74640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:52.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.911+0000 7f4b71d74640 1 -- 10.20.193.14:0/995318839 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4b5c003400 con 0x7f4b74059e10 2026-02-24T19:23:52.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.911+0000 7f4b71d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:52.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.911+0000 7f4b71d74640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:52.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.911+0000 7f4b71d74640 10 monclient: dump: 2026-02-24T19:23:52.920 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:52.921 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:52.921 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.921 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.921 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:52.921 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:52.921 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:52.921 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:52.921 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:52.921 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.921 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.911+0000 7f4b79145640 10 monclient: get_monmap_and_config success 2026-02-24T19:23:52.921 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.911+0000 7f4b79145640 4 set_mon_vals no callback set 2026-02-24T19:23:52.921 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.912+0000 7f4b79145640 10 monclient: shutdown 2026-02-24T19:23:52.921 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.912+0000 7f4b79145640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:52.922 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.912+0000 7f4b79145640 1 -- 10.20.193.14:0/995318839 >> v1:10.20.193.44:6789/0 conn(0x7f4b74059e10 legacy=0x7f4b7415ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:52.922 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.912+0000 7f4b79145640 1 -- 10.20.193.14:0/995318839 shutdown_connections 2026-02-24T19:23:52.922 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.912+0000 7f4b79145640 1 -- 10.20.193.14:0/995318839 >> 10.20.193.14:0/995318839 conn(0x7f4b740b2f60 msgr2=0x7f4b740b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:52.922 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.912+0000 7f4b79145640 1 -- 10.20.193.14:0/995318839 shutdown_connections 2026-02-24T19:23:52.922 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.912+0000 7f4b79145640 1 -- 10.20.193.14:0/995318839 wait complete. 2026-02-24T19:23:52.922 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.912+0000 7f4b79145640 10 monclient: build_initial_monmap 2026-02-24T19:23:52.922 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.912+0000 7f4b79145640 10 monclient: monmap: 2026-02-24T19:23:52.922 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:52.922 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:23:52.922 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:23:52.922 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:23:52.922 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:52.922 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:23:52.923 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:52.923 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:52.923 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:52.923 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.923 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.912+0000 7f4b79145640 1 librados: starting msgr at 2026-02-24T19:23:52.923 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.912+0000 7f4b79145640 1 librados: starting objecter 2026-02-24T19:23:52.923 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.912+0000 7f4b79145640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:23:52.923 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.912+0000 7f4b79145640 1 Processor -- start 2026-02-24T19:23:52.923 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.912+0000 7f4b79145640 1 -- start start 2026-02-24T19:23:52.923 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.912+0000 7f4b79145640 1 librados: setting wanted keys 2026-02-24T19:23:52.923 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.912+0000 7f4b79145640 1 librados: calling monclient init 2026-02-24T19:23:52.923 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.912+0000 7f4b79145640 10 monclient: init 2026-02-24T19:23:52.924 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.913+0000 7f4b79145640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:52.924 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.913+0000 7f4b79145640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:23:52.924 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.913+0000 7f4b79145640 10 monclient(hunting): picked mon.noname-b con 0x7f4b74059e10 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:52.924 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.913+0000 7f4b79145640 10 monclient(hunting): picked mon.noname-a con 0x7f4b7415e2a0 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:52.924 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.913+0000 7f4b79145640 10 monclient(hunting): picked mon.noname-c con 0x7f4b741a5660 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:52.924 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.913+0000 7f4b79145640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b740a88f0 con 0x7f4b7415e2a0 2026-02-24T19:23:52.924 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.913+0000 7f4b79145640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b7412ab60 con 0x7f4b74059e10 2026-02-24T19:23:52.924 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.913+0000 7f4b79145640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b7412ae40 con 0x7f4b741a5660 2026-02-24T19:23:52.924 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.913+0000 7f4b79145640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:52.924 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.913+0000 7f4b79145640 10 monclient(hunting): authenticate will time out at 4007.594355s 2026-02-24T19:23:52.924 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.913+0000 7f4b72575640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f4b7415e2a0 0x7f4b740a81e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:51018/0 (socket says 10.20.193.14:51018) 2026-02-24T19:23:52.924 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.913+0000 7f4b72575640 1 -- 10.20.193.14:0/2687263965 learned_addr learned my addr 10.20.193.14:0/2687263965 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:52.924 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.913+0000 7f4b537fe640 10 client.?.objecter ms_handle_connect 0x7f4b7415e2a0 2026-02-24T19:23:52.925 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.913+0000 7f4b537fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:52.925 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.913+0000 7f4b537fe640 10 client.?.objecter ms_handle_connect 0x7f4b74059e10 2026-02-24T19:23:52.925 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.913+0000 7f4b537fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:52.925 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.914+0000 7f4b537fe640 10 client.?.objecter ms_handle_connect 0x7f4b741a5660 2026-02-24T19:23:52.925 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.914+0000 7f4b537fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:52.925 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.914+0000 7f4b537fe640 1 -- 10.20.193.14:0/2687263965 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1759117437 0 0) 0x7f4b7412ab60 con 0x7f4b74059e10 2026-02-24T19:23:52.925 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.914+0000 7f4b537fe640 10 monclient(hunting): _negotiate 2026-02-24T19:23:52.925 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.914+0000 7f4b537fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:52.925 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.914+0000 7f4b537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:52.925 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.914+0000 7f4b537fe640 10 monclient(hunting): my global_id is 29176 2026-02-24T19:23:52.925 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.914+0000 7f4b537fe640 1 -- 10.20.193.14:0/2687263965 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b40003610 con 0x7f4b74059e10 2026-02-24T19:23:52.925 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.914+0000 7f4b537fe640 1 -- 10.20.193.14:0/2687263965 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3415891127 0 0) 0x7f4b740a88f0 con 0x7f4b7415e2a0 2026-02-24T19:23:52.925 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.914+0000 7f4b537fe640 10 monclient(hunting): _negotiate 2026-02-24T19:23:52.926 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.914+0000 7f4b537fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:52.926 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.914+0000 7f4b537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:52.926 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.914+0000 7f4b537fe640 10 monclient(hunting): my global_id is 30861 2026-02-24T19:23:52.926 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.914+0000 7f4b537fe640 1 -- 10.20.193.14:0/2687263965 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b7412ab60 con 0x7f4b7415e2a0 2026-02-24T19:23:52.926 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.915+0000 7f4b537fe640 1 -- 10.20.193.14:0/2687263965 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3908777522 0 0) 0x7f4b7412ae40 con 0x7f4b741a5660 2026-02-24T19:23:52.926 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.915+0000 7f4b537fe640 10 monclient(hunting): _negotiate 2026-02-24T19:23:52.926 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.915+0000 7f4b537fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:52.926 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.915+0000 7f4b537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:52.926 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.915+0000 7f4b537fe640 10 monclient(hunting): my global_id is 28814 2026-02-24T19:23:52.926 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.915+0000 7f4b537fe640 1 -- 10.20.193.14:0/2687263965 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b740a88f0 con 0x7f4b741a5660 2026-02-24T19:23:52.928 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.917+0000 7f4b537fe640 1 -- 10.20.193.14:0/2687263965 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2618337162 0 0) 0x7f4b40003610 con 0x7f4b74059e10 2026-02-24T19:23:52.929 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.917+0000 7f4b537fe640 1 -- 10.20.193.14:0/2687263965 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4b7412ae40 con 0x7f4b74059e10 2026-02-24T19:23:52.929 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.917+0000 7f4b537fe640 1 -- 10.20.193.14:0/2687263965 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4b680030b0 con 0x7f4b74059e10 2026-02-24T19:23:52.929 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.917+0000 7f4b537fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:52.929 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.917+0000 7f4b537fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:23:52.929 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.917+0000 7f4b537fe640 10 monclient(hunting): dump: 2026-02-24T19:23:52.929 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:52.929 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:52.929 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.929 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.929 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:52.929 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:52.930 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:52.930 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:52.930 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:52.930 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.930 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.917+0000 7f4b537fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:23:52.930 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.917+0000 7f4b537fe640 1 -- 10.20.193.14:0/2687263965 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1162138059 0 0) 0x7f4b740a88f0 con 0x7f4b741a5660 2026-02-24T19:23:52.930 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.917+0000 7f4b537fe640 1 -- 10.20.193.14:0/2687263965 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4b40003610 con 0x7f4b741a5660 2026-02-24T19:23:52.930 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.917+0000 7f4b537fe640 1 -- 10.20.193.14:0/2687263965 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4b64003410 con 0x7f4b741a5660 2026-02-24T19:23:52.930 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.917+0000 7f4b537fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:52.930 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.917+0000 7f4b537fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:52.930 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.917+0000 7f4b537fe640 10 monclient(hunting): dump: 2026-02-24T19:23:52.930 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:52.930 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:52.931 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.931 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.931 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:52.931 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:52.931 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:52.931 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:52.931 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:52.931 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.931 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.918+0000 7f4b537fe640 1 -- 10.20.193.14:0/2687263965 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3495361189 0 0) 0x7f4b7412ab60 con 0x7f4b7415e2a0 2026-02-24T19:23:52.931 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.918+0000 7f4b537fe640 1 -- 10.20.193.14:0/2687263965 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4b740a88f0 con 0x7f4b7415e2a0 2026-02-24T19:23:52.931 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.918+0000 7f4b537fe640 1 -- 10.20.193.14:0/2687263965 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4b5c003310 con 0x7f4b7415e2a0 2026-02-24T19:23:52.931 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.918+0000 7f4b537fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:52.931 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.918+0000 7f4b537fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:52.932 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.918+0000 7f4b537fe640 10 monclient(hunting): dump: 2026-02-24T19:23:52.932 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:52.932 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:52.932 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.932 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.932 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:52.932 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:52.932 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:52.932 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:52.932 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:52.932 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.932 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.919+0000 7f4b537fe640 1 -- 10.20.193.14:0/2687263965 <== mon.1 v1:10.20.193.44:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1088326611 0 0) 0x7f4b7412ae40 con 0x7f4b74059e10 2026-02-24T19:23:52.933 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.919+0000 7f4b537fe640 1 -- 10.20.193.14:0/2687263965 >> v1:10.20.193.170:6789/0 conn(0x7f4b741a5660 legacy=0x7f4b74190e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:52.933 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.919+0000 7f4b537fe640 1 -- 10.20.193.14:0/2687263965 >> v1:10.20.193.14:6789/0 conn(0x7f4b7415e2a0 legacy=0x7f4b740a81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:52.933 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.919+0000 7f4b537fe640 10 monclient: _finish_hunting 0 2026-02-24T19:23:52.933 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.919+0000 7f4b537fe640 1 monclient: found mon.b 2026-02-24T19:23:52.933 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.919+0000 7f4b537fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:52.933 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.919+0000 7f4b537fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:23:52.933 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.919+0000 7f4b537fe640 1 -- 10.20.193.14:0/2687263965 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b7412b120 con 0x7f4b74059e10 2026-02-24T19:23:52.933 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.919+0000 7f4b537fe640 10 monclient: _finish_auth 0 2026-02-24T19:23:52.933 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.919+0000 7f4b537fe640 10 monclient: _check_auth_tickets 2026-02-24T19:23:52.933 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.919+0000 7f4b537fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:52.933 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.919+0000 7f4b79145640 5 monclient: authenticate success, global_id 29176 2026-02-24T19:23:52.933 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.919+0000 7f4b79145640 10 monclient: _renew_subs 2026-02-24T19:23:52.933 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.919+0000 7f4b79145640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:23:52.934 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.919+0000 7f4b79145640 1 -- 10.20.193.14:0/2687263965 --> v1:10.20.193.44:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4b740a79e0 con 0x7f4b74059e10 2026-02-24T19:23:52.934 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.919+0000 7f4b79145640 10 client.29176.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:52.934 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.919+0000 7f4b79145640 10 monclient: _renew_subs 2026-02-24T19:23:52.934 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.919+0000 7f4b79145640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:23:52.934 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.919+0000 7f4b79145640 1 -- 10.20.193.14:0/2687263965 --> v1:10.20.193.44:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4b7405bd60 con 0x7f4b74059e10 2026-02-24T19:23:52.934 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.919+0000 7f4b79145640 1 librados: init done 2026-02-24T19:23:52.934 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.919+0000 7f4b79145640 10 client.29176.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:52.934 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.919+0000 7f4b79145640 15 client.29176.objecter _session_command_op_assign -1 1 2026-02-24T19:23:52.934 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.919+0000 7f4b79145640 20 client.29176.objecter _get_session osd=-1 returning homeless 2026-02-24T19:23:52.934 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.919+0000 7f4b79145640 10 client.29176.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:52.934 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.919+0000 7f4b79145640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:23:52.934 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.919+0000 7f4b79145640 1 -- 10.20.193.14:0/2687263965 --> v1:10.20.193.44:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f4b7412b360 con 0x7f4b74059e10 2026-02-24T19:23:52.936 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.927+0000 7f4b537fe640 1 -- 10.20.193.14:0/2687263965 <== mon.1 v1:10.20.193.44:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4b7412b360 con 0x7f4b74059e10 2026-02-24T19:23:52.936 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.927+0000 7f4b537fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:52.936 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.927+0000 7f4b537fe640 1 -- 10.20.193.14:0/2687263965 <== mon.1 v1:10.20.193.44:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4b68004a70 con 0x7f4b74059e10 2026-02-24T19:23:52.937 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.927+0000 7f4b537fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:52.937 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.927+0000 7f4b537fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:52.937 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.927+0000 7f4b537fe640 10 monclient: dump: 2026-02-24T19:23:52.937 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:52.937 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:52.937 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.937 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:52.937 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:52.937 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:52.937 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:52.937 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:52.937 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:52.938 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:52.938 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.927+0000 7f4b71573640 4 set_mon_vals no callback set 2026-02-24T19:23:52.938 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.928+0000 7f4b537fe640 1 -- 10.20.193.14:0/2687263965 <== mon.1 v1:10.20.193.44:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f4b6801d8e0 con 0x7f4b74059e10 2026-02-24T19:23:52.938 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.929+0000 7f4b72575640 10 monclient: get_auth_request con 0x7f4b40077e20 auth_method 0 2026-02-24T19:23:52.938 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.929+0000 7f4b537fe640 10 client.29176.objecter ms_handle_connect 0x7f4b40077e20 2026-02-24T19:23:52.938 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.929+0000 7f4b537fe640 1 -- 10.20.193.14:0/2687263965 <== mon.1 v1:10.20.193.44:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7f4b68092fd0 con 0x7f4b74059e10 2026-02-24T19:23:52.938 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.929+0000 7f4b537fe640 10 client.29176.objecter ms_dispatch2 0x7f4b74000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:23:52.938 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.929+0000 7f4b537fe640 3 client.29176.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:23:52.938 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.929+0000 7f4b537fe640 3 client.29176.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:23:52.938 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.929+0000 7f4b537fe640 10 client.29176.objecter checking command 1 2026-02-24T19:23:52.938 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.929+0000 7f4b537fe640 20 client.29176.objecter _get_session s=0x7f4b400a20e0 osd=14 3 2026-02-24T19:23:52.938 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.929+0000 7f4b537fe640 20 client.29176.objecter put_session s=0x7f4b400a20e0 osd=14 3 2026-02-24T19:23:52.938 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.929+0000 7f4b537fe640 15 client.29176.objecter _session_command_op_remove -1 1 2026-02-24T19:23:52.939 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.929+0000 7f4b537fe640 20 client.29176.objecter _get_session s=0x7f4b400a20e0 osd=14 3 2026-02-24T19:23:52.939 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.929+0000 7f4b537fe640 20 client.29176.objecter get_session s=0x7f4b400a20e0 osd=14 3 2026-02-24T19:23:52.939 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.929+0000 7f4b537fe640 15 client.29176.objecter _session_command_op_assign 14 1 2026-02-24T19:23:52.939 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.929+0000 7f4b537fe640 20 client.29176.objecter put_session s=0x7f4b400a20e0 osd=14 4 2026-02-24T19:23:52.939 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.929+0000 7f4b537fe640 10 client.29176.objecter _send_command 1 2026-02-24T19:23:52.939 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.929+0000 7f4b537fe640 1 -- 10.20.193.14:0/2687263965 --> v1:10.20.193.170:6809/2177297767 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4b400c4490 con 0x7f4b400a2790 2026-02-24T19:23:52.939 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.929+0000 7f4b537fe640 20 client.29176.objecter dump_active .. 0 homeless 2026-02-24T19:23:52.939 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.929+0000 7f4b537fe640 1 -- 10.20.193.14:0/2687263965 <== mon.1 v1:10.20.193.44:6789/0 9 ==== mon_get_version_reply(handle=1 version=354) ==== 24+0+0 (unknown 31317031 0 0) 0x7f4b68059670 con 0x7f4b74059e10 2026-02-24T19:23:52.939 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.929+0000 7f4b537fe640 10 monclient: handle_get_version_reply finishing 1 version 354 2026-02-24T19:23:52.939 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.930+0000 7f4b73577640 10 monclient: get_auth_request con 0x7f4b400a2790 auth_method 0 2026-02-24T19:23:52.939 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.931+0000 7f4b537fe640 10 client.29176.objecter ms_handle_connect 0x7f4b400a2790 2026-02-24T19:23:52.942 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.940+0000 7f4b537fe640 1 -- 10.20.193.14:0/2687263965 <== osd.14 v1:10.20.193.170:6809/2177297767 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f4b400c4490 con 0x7f4b400a2790 2026-02-24T19:23:52.942 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.940+0000 7f4b537fe640 10 client.29176.objecter ms_dispatch2 0x7f4b74000b90 command_reply(tid 1: 0 ) 2026-02-24T19:23:52.942 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.940+0000 7f4b537fe640 10 client.29176.objecter _finish_command 1 = system:0 2026-02-24T19:23:52.942 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.940+0000 7f4b537fe640 20 client.29176.objecter put_session s=0x7f4b400a20e0 osd=14 4 2026-02-24T19:23:52.942 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.940+0000 7f4b537fe640 15 client.29176.objecter _session_command_op_remove 14 1 2026-02-24T19:23:52.950 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.948+0000 7f4b79145640 10 client.29176.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:23:52.950 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.948+0000 7f4b79145640 15 client.29176.objecter _session_command_op_assign -1 2 2026-02-24T19:23:52.950 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.948+0000 7f4b79145640 20 client.29176.objecter _get_session s=0x7f4b400a20e0 osd=14 3 2026-02-24T19:23:52.950 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.948+0000 7f4b79145640 20 client.29176.objecter put_session s=0x7f4b400a20e0 osd=14 3 2026-02-24T19:23:52.950 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.948+0000 7f4b79145640 20 client.29176.objecter _get_session s=0x7f4b400a20e0 osd=14 3 2026-02-24T19:23:52.950 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.948+0000 7f4b79145640 15 client.29176.objecter _session_command_op_remove -1 2 2026-02-24T19:23:52.950 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.948+0000 7f4b79145640 20 client.29176.objecter get_session s=0x7f4b400a20e0 osd=14 3 2026-02-24T19:23:52.950 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.948+0000 7f4b79145640 15 client.29176.objecter _session_command_op_assign 14 2 2026-02-24T19:23:52.950 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.948+0000 7f4b79145640 20 client.29176.objecter put_session s=0x7f4b400a20e0 osd=14 4 2026-02-24T19:23:52.950 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.948+0000 7f4b79145640 10 client.29176.objecter _send_command 2 2026-02-24T19:23:52.951 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.948+0000 7f4b79145640 1 -- 10.20.193.14:0/2687263965 --> v1:10.20.193.170:6809/2177297767 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4b741647d0 con 0x7f4b400a2790 2026-02-24T19:23:52.958 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.956+0000 7f4b537fe640 1 -- 10.20.193.14:0/2687263965 <== osd.14 v1:10.20.193.170:6809/2177297767 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f4b741647d0 con 0x7f4b400a2790 2026-02-24T19:23:52.958 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.956+0000 7f4b537fe640 10 client.29176.objecter ms_dispatch2 0x7f4b74000b90 command_reply(tid 2: 0 ) 2026-02-24T19:23:52.958 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.956+0000 7f4b537fe640 10 client.29176.objecter _finish_command 2 = system:0 2026-02-24T19:23:52.958 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.956+0000 7f4b537fe640 20 client.29176.objecter put_session s=0x7f4b400a20e0 osd=14 4 2026-02-24T19:23:52.958 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.956+0000 7f4b537fe640 15 client.29176.objecter _session_command_op_remove 14 2 2026-02-24T19:23:52.959 INFO:teuthology.orchestra.run.trial014.stdout:{ 2026-02-24T19:23:52.959 INFO:teuthology.orchestra.run.trial014.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:23:52.959 INFO:teuthology.orchestra.run.trial014.stdout:} 2026-02-24T19:23:52.960 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.957+0000 7f4b79145640 10 librados: watch_flush enter 2026-02-24T19:23:52.960 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.957+0000 7f4b79145640 10 librados: watch_flush exit 2026-02-24T19:23:52.960 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.957+0000 7f4b79145640 10 client.29176.objecter close_session for osd.14 2026-02-24T19:23:52.960 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.957+0000 7f4b79145640 1 -- 10.20.193.14:0/2687263965 >> v1:10.20.193.170:6809/2177297767 conn(0x7f4b400a2790 legacy=0x7f4b400c2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:52.960 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.957+0000 7f4b79145640 20 client.29176.objecter put_session s=0x7f4b400a20e0 osd=14 1 2026-02-24T19:23:52.961 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.957+0000 7f4b79145640 20 client.29176.objecter shutdown clearing up homeless session... 2026-02-24T19:23:52.961 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.957+0000 7f4b79145640 10 client.29176.objecter successfully canceled tick 2026-02-24T19:23:52.961 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.957+0000 7f4b79145640 1 -- 10.20.193.14:0/2687263965 >> v1:10.20.193.14:6800/4014096310 conn(0x7f4b40077e20 legacy=0x7f4b400982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:52.961 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.957+0000 7f4b79145640 10 monclient: shutdown 2026-02-24T19:23:52.961 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.957+0000 7f4b79145640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:52.961 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.957+0000 7f4b79145640 1 -- 10.20.193.14:0/2687263965 >> v1:10.20.193.44:6789/0 conn(0x7f4b74059e10 legacy=0x7f4b7412d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:52.961 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.957+0000 7f4b73577640 1 -- 10.20.193.14:0/2687263965 reap_dead start 2026-02-24T19:23:52.961 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.957+0000 7f4b79145640 1 -- 10.20.193.14:0/2687263965 shutdown_connections 2026-02-24T19:23:52.961 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.957+0000 7f4b79145640 1 -- 10.20.193.14:0/2687263965 >> 10.20.193.14:0/2687263965 conn(0x7f4b740b2f60 msgr2=0x7f4b74191da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:52.961 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.957+0000 7f4b79145640 1 -- 10.20.193.14:0/2687263965 shutdown_connections 2026-02-24T19:23:52.961 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.957+0000 7f4b79145640 1 -- 10.20.193.14:0/2687263965 wait complete. 2026-02-24T19:23:52.961 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:52.957+0000 7f4b79145640 1 librados: shutdown 2026-02-24T19:23:52.966 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 14 2026-02-24T19:23:53.034 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.033+0000 7f45f152e640 10 monclient: get_monmap_and_config 2026-02-24T19:23:53.035 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.033+0000 7f45f152e640 10 monclient: build_initial_monmap 2026-02-24T19:23:53.035 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.033+0000 7f45f152e640 10 monclient: monmap: 2026-02-24T19:23:53.035 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:53.035 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:53.035 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:23:53.033858+0000 2026-02-24T19:23:53.035 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:23:53.033858+0000 2026-02-24T19:23:53.035 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:53.035 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:53.035 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:53.035 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:53.035 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:53.036 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.038 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.033+0000 7f45f152e640 1 Processor -- start 2026-02-24T19:23:53.038 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.033+0000 7f45f152e640 1 -- start start 2026-02-24T19:23:53.038 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.033+0000 7f45f152e640 10 monclient: init 2026-02-24T19:23:53.038 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.034+0000 7f45f152e640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:53.038 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.034+0000 7f45f152e640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:23:53.038 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.034+0000 7f45f152e640 10 monclient(hunting): picked mon.noname-a con 0x7f45ec157780 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:53.038 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.034+0000 7f45f152e640 10 monclient(hunting): picked mon.noname-c con 0x7f45ec157b50 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:53.038 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.034+0000 7f45f152e640 10 monclient(hunting): picked mon.noname-b con 0x7f45ec164d00 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:53.039 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.034+0000 7f45f152e640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45ec05de70 con 0x7f45ec157780 2026-02-24T19:23:53.039 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.034+0000 7f45f152e640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45ec055b20 con 0x7f45ec164d00 2026-02-24T19:23:53.039 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.034+0000 7f45f152e640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45ec055e00 con 0x7f45ec157b50 2026-02-24T19:23:53.039 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.034+0000 7f45f152e640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:53.039 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.034+0000 7f45f152e640 10 monclient(hunting): authenticate will time out at 4007.715233s 2026-02-24T19:23:53.039 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.034+0000 7f45eaffd640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f45ec157780 0x7f45ec056ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:51022/0 (socket says 10.20.193.14:51022) 2026-02-24T19:23:53.039 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.034+0000 7f45eaffd640 1 -- 10.20.193.14:0/1529431324 learned_addr learned my addr 10.20.193.14:0/1529431324 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:53.039 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.035+0000 7f45e9ffb640 1 -- 10.20.193.14:0/1529431324 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2712658262 0 0) 0x7f45ec05de70 con 0x7f45ec157780 2026-02-24T19:23:53.039 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.035+0000 7f45e9ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:23:53.039 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.035+0000 7f45e9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:53.039 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.035+0000 7f45e9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:53.039 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.035+0000 7f45e9ffb640 10 monclient(hunting): my global_id is 30864 2026-02-24T19:23:53.040 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.035+0000 7f45e9ffb640 1 -- 10.20.193.14:0/1529431324 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45d8003610 con 0x7f45ec157780 2026-02-24T19:23:53.040 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.035+0000 7f45e9ffb640 1 -- 10.20.193.14:0/1529431324 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 605515124 0 0) 0x7f45ec055b20 con 0x7f45ec164d00 2026-02-24T19:23:53.040 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.035+0000 7f45e9ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:23:53.040 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.035+0000 7f45e9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:53.040 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.035+0000 7f45e9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:53.040 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.035+0000 7f45e9ffb640 10 monclient(hunting): my global_id is 29179 2026-02-24T19:23:53.040 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.035+0000 7f45e9ffb640 1 -- 10.20.193.14:0/1529431324 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45ec05de70 con 0x7f45ec164d00 2026-02-24T19:23:53.040 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.036+0000 7f45e9ffb640 1 -- 10.20.193.14:0/1529431324 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3392719916 0 0) 0x7f45ec055e00 con 0x7f45ec157b50 2026-02-24T19:23:53.040 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.036+0000 7f45e9ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:23:53.040 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.036+0000 7f45e9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:53.040 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.036+0000 7f45e9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:53.040 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.036+0000 7f45e9ffb640 10 monclient(hunting): my global_id is 28817 2026-02-24T19:23:53.040 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.036+0000 7f45e9ffb640 1 -- 10.20.193.14:0/1529431324 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45ec055b20 con 0x7f45ec157b50 2026-02-24T19:23:53.046 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.037+0000 7f45e9ffb640 1 -- 10.20.193.14:0/1529431324 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3685798393 0 0) 0x7f45d8003610 con 0x7f45ec157780 2026-02-24T19:23:53.046 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.037+0000 7f45e9ffb640 1 -- 10.20.193.14:0/1529431324 >> v1:10.20.193.170:6789/0 conn(0x7f45ec157b50 legacy=0x7f45ec1645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:53.046 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.037+0000 7f45e9ffb640 1 -- 10.20.193.14:0/1529431324 >> v1:10.20.193.44:6789/0 conn(0x7f45ec164d00 legacy=0x7f45ec1c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:53.046 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.037+0000 7f45e9ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:23:53.046 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.037+0000 7f45e9ffb640 1 monclient: found mon.noname-a 2026-02-24T19:23:53.046 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.037+0000 7f45e9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:53.046 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.037+0000 7f45e9ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:23:53.047 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.037+0000 7f45e9ffb640 1 -- 10.20.193.14:0/1529431324 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45ec0560e0 con 0x7f45ec157780 2026-02-24T19:23:53.047 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.037+0000 7f45e9ffb640 10 monclient: _finish_auth 0 2026-02-24T19:23:53.047 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.037+0000 7f45e9ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:23:53.047 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.037+0000 7f45e9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:53.047 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.037+0000 7f45e9ffb640 1 -- 10.20.193.14:0/1529431324 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f45e0002df0 con 0x7f45ec157780 2026-02-24T19:23:53.047 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.037+0000 7f45e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:53.047 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.037+0000 7f45e9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:23:53.047 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.037+0000 7f45e9ffb640 10 monclient: dump: 2026-02-24T19:23:53.047 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:53.047 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:53.047 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.047 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.048 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:53.048 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:53.048 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:53.048 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:53.048 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:53.048 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.048 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.037+0000 7f45f152e640 5 monclient: authenticate success, global_id 30864 2026-02-24T19:23:53.048 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.037+0000 7f45f152e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:53.048 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.038+0000 7f45e9ffb640 1 -- 10.20.193.14:0/1529431324 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f45e0002fc0 con 0x7f45ec157780 2026-02-24T19:23:53.048 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.038+0000 7f45e9ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:53.048 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.038+0000 7f45e9ffb640 1 -- 10.20.193.14:0/1529431324 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f45e0003400 con 0x7f45ec157780 2026-02-24T19:23:53.048 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.038+0000 7f45e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:53.049 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.038+0000 7f45e9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:53.049 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.038+0000 7f45e9ffb640 10 monclient: dump: 2026-02-24T19:23:53.049 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:53.049 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:53.049 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.049 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.049 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:53.049 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:53.049 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:53.049 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:53.049 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:53.049 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.049 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.038+0000 7f45f152e640 10 monclient: get_monmap_and_config success 2026-02-24T19:23:53.050 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.038+0000 7f45f152e640 4 set_mon_vals no callback set 2026-02-24T19:23:53.050 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.038+0000 7f45f152e640 10 monclient: shutdown 2026-02-24T19:23:53.050 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.038+0000 7f45f152e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:53.050 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.038+0000 7f45f152e640 1 -- 10.20.193.14:0/1529431324 >> v1:10.20.193.14:6789/0 conn(0x7f45ec157780 legacy=0x7f45ec056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:53.050 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.038+0000 7f45f152e640 1 -- 10.20.193.14:0/1529431324 shutdown_connections 2026-02-24T19:23:53.050 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.038+0000 7f45f152e640 1 -- 10.20.193.14:0/1529431324 >> 10.20.193.14:0/1529431324 conn(0x7f45ec0b2ef0 msgr2=0x7f45ec0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:53.050 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.038+0000 7f45f152e640 1 -- 10.20.193.14:0/1529431324 shutdown_connections 2026-02-24T19:23:53.050 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.038+0000 7f45f152e640 1 -- 10.20.193.14:0/1529431324 wait complete. 2026-02-24T19:23:53.050 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.039+0000 7f45f152e640 10 monclient: build_initial_monmap 2026-02-24T19:23:53.050 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.039+0000 7f45f152e640 10 monclient: monmap: 2026-02-24T19:23:53.050 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:53.050 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:23:53.050 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:23:53.051 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:23:53.051 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:53.051 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:23:53.051 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:53.051 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:53.051 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:53.051 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.051 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.039+0000 7f45f152e640 1 librados: starting msgr at 2026-02-24T19:23:53.051 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.039+0000 7f45f152e640 1 librados: starting objecter 2026-02-24T19:23:53.051 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.039+0000 7f45f152e640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:23:53.051 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.039+0000 7f45f152e640 1 Processor -- start 2026-02-24T19:23:53.051 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.039+0000 7f45f152e640 1 -- start start 2026-02-24T19:23:53.051 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.039+0000 7f45f152e640 1 librados: setting wanted keys 2026-02-24T19:23:53.052 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.039+0000 7f45f152e640 1 librados: calling monclient init 2026-02-24T19:23:53.052 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.039+0000 7f45f152e640 10 monclient: init 2026-02-24T19:23:53.052 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.039+0000 7f45f152e640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:53.052 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.039+0000 7f45f152e640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:23:53.052 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.039+0000 7f45f152e640 10 monclient(hunting): picked mon.noname-b con 0x7f45ec157780 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:53.052 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.039+0000 7f45f152e640 10 monclient(hunting): picked mon.noname-a con 0x7f45ec157b50 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:53.052 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.039+0000 7f45f152e640 10 monclient(hunting): picked mon.noname-c con 0x7f45ec164d00 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:53.052 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.039+0000 7f45f152e640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45ec0a7ee0 con 0x7f45ec157b50 2026-02-24T19:23:53.052 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.039+0000 7f45f152e640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45ec12ed70 con 0x7f45ec157780 2026-02-24T19:23:53.052 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.039+0000 7f45f152e640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45ec0a81a0 con 0x7f45ec164d00 2026-02-24T19:23:53.052 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.039+0000 7f45f152e640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:53.052 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.039+0000 7f45f152e640 10 monclient(hunting): authenticate will time out at 4007.720839s 2026-02-24T19:23:53.052 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.040+0000 7f45ea7fc640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f45ec157b50 0x7f45ec12e660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:51034/0 (socket says 10.20.193.14:51034) 2026-02-24T19:23:53.053 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.040+0000 7f45ea7fc640 1 -- 10.20.193.14:0/170467877 learned_addr learned my addr 10.20.193.14:0/170467877 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:53.053 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.040+0000 7f45cb7fe640 10 client.?.objecter ms_handle_connect 0x7f45ec157b50 2026-02-24T19:23:53.053 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.040+0000 7f45cb7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:53.053 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.040+0000 7f45cb7fe640 10 client.?.objecter ms_handle_connect 0x7f45ec164d00 2026-02-24T19:23:53.053 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.040+0000 7f45cb7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:53.053 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.040+0000 7f45cb7fe640 10 client.?.objecter ms_handle_connect 0x7f45ec157780 2026-02-24T19:23:53.053 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.040+0000 7f45cb7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:53.053 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.041+0000 7f45cb7fe640 1 -- 10.20.193.14:0/170467877 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 889777076 0 0) 0x7f45ec0a7ee0 con 0x7f45ec157b50 2026-02-24T19:23:53.053 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.041+0000 7f45cb7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:23:53.053 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.041+0000 7f45cb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:53.053 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.041+0000 7f45cb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:53.053 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.041+0000 7f45cb7fe640 10 monclient(hunting): my global_id is 30867 2026-02-24T19:23:53.053 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.041+0000 7f45cb7fe640 1 -- 10.20.193.14:0/170467877 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45b8003610 con 0x7f45ec157b50 2026-02-24T19:23:53.054 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.041+0000 7f45cb7fe640 1 -- 10.20.193.14:0/170467877 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2392646335 0 0) 0x7f45ec0a81a0 con 0x7f45ec164d00 2026-02-24T19:23:53.054 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.041+0000 7f45cb7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:23:53.054 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.041+0000 7f45cb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:53.054 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.041+0000 7f45cb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:53.054 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.041+0000 7f45cb7fe640 10 monclient(hunting): my global_id is 28820 2026-02-24T19:23:53.054 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.041+0000 7f45cb7fe640 1 -- 10.20.193.14:0/170467877 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45ec0a7ee0 con 0x7f45ec164d00 2026-02-24T19:23:53.054 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.041+0000 7f45cb7fe640 1 -- 10.20.193.14:0/170467877 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4025111903 0 0) 0x7f45ec12ed70 con 0x7f45ec157780 2026-02-24T19:23:53.054 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.041+0000 7f45cb7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:23:53.054 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.041+0000 7f45cb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:53.054 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.041+0000 7f45cb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:53.054 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.041+0000 7f45cb7fe640 10 monclient(hunting): my global_id is 29182 2026-02-24T19:23:53.054 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.041+0000 7f45cb7fe640 1 -- 10.20.193.14:0/170467877 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45ec0a81a0 con 0x7f45ec157780 2026-02-24T19:23:53.054 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.043+0000 7f45cb7fe640 1 -- 10.20.193.14:0/170467877 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1336672586 0 0) 0x7f45b8003610 con 0x7f45ec157b50 2026-02-24T19:23:53.055 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.043+0000 7f45cb7fe640 1 -- 10.20.193.14:0/170467877 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f45ec12ed70 con 0x7f45ec157b50 2026-02-24T19:23:53.055 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.043+0000 7f45cb7fe640 1 -- 10.20.193.14:0/170467877 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f45d4003170 con 0x7f45ec157b50 2026-02-24T19:23:53.055 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.043+0000 7f45cb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:53.055 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.043+0000 7f45cb7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:23:53.055 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.043+0000 7f45cb7fe640 10 monclient(hunting): dump: 2026-02-24T19:23:53.055 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:53.055 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:53.055 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.055 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.055 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:53.055 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:53.055 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:53.055 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:53.056 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:53.056 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.043+0000 7f45cb7fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:23:53.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.044+0000 7f45cb7fe640 1 -- 10.20.193.14:0/170467877 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1501605886 0 0) 0x7f45ec0a81a0 con 0x7f45ec157780 2026-02-24T19:23:53.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.044+0000 7f45cb7fe640 1 -- 10.20.193.14:0/170467877 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f45b8003610 con 0x7f45ec157780 2026-02-24T19:23:53.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.044+0000 7f45cb7fe640 1 -- 10.20.193.14:0/170467877 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f45e0003310 con 0x7f45ec157780 2026-02-24T19:23:53.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.044+0000 7f45cb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:53.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.044+0000 7f45cb7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:53.056 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.044+0000 7f45cb7fe640 10 monclient(hunting): dump: 2026-02-24T19:23:53.056 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:53.056 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:53.056 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.057 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.057 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:53.057 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:53.057 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:53.057 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:53.057 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:53.057 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.044+0000 7f45cb7fe640 1 -- 10.20.193.14:0/170467877 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 145468625 0 0) 0x7f45ec0a7ee0 con 0x7f45ec164d00 2026-02-24T19:23:53.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.044+0000 7f45cb7fe640 1 -- 10.20.193.14:0/170467877 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f45ec0a81a0 con 0x7f45ec164d00 2026-02-24T19:23:53.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.044+0000 7f45cb7fe640 1 -- 10.20.193.14:0/170467877 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f45dc0032f0 con 0x7f45ec164d00 2026-02-24T19:23:53.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.044+0000 7f45cb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:53.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.044+0000 7f45cb7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:53.057 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.044+0000 7f45cb7fe640 10 monclient(hunting): dump: 2026-02-24T19:23:53.058 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:53.058 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:53.058 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.058 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.058 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:53.058 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:53.058 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:53.058 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:53.058 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:53.058 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.060 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.045+0000 7f45cb7fe640 1 -- 10.20.193.14:0/170467877 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3534289740 0 0) 0x7f45ec12ed70 con 0x7f45ec157b50 2026-02-24T19:23:53.060 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.045+0000 7f45cb7fe640 1 -- 10.20.193.14:0/170467877 >> v1:10.20.193.170:6789/0 conn(0x7f45ec164d00 legacy=0x7f45ec0ac220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:53.060 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.045+0000 7f45cb7fe640 1 -- 10.20.193.14:0/170467877 >> v1:10.20.193.44:6789/0 conn(0x7f45ec157780 legacy=0x7f45ec0a9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:53.060 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.045+0000 7f45cb7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:23:53.060 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.045+0000 7f45cb7fe640 1 monclient: found mon.a 2026-02-24T19:23:53.060 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.045+0000 7f45cb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:53.061 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.045+0000 7f45cb7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:53.061 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.045+0000 7f45cb7fe640 1 -- 10.20.193.14:0/170467877 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45ec0a8480 con 0x7f45ec157b50 2026-02-24T19:23:53.061 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.045+0000 7f45cb7fe640 10 monclient: _finish_auth 0 2026-02-24T19:23:53.061 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.045+0000 7f45cb7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:23:53.061 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.045+0000 7f45cb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:53.061 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.045+0000 7f45f152e640 5 monclient: authenticate success, global_id 30867 2026-02-24T19:23:53.061 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.045+0000 7f45f152e640 10 monclient: _renew_subs 2026-02-24T19:23:53.061 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.045+0000 7f45f152e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:53.061 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.045+0000 7f45f152e640 1 -- 10.20.193.14:0/170467877 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f45ec0a8760 con 0x7f45ec157b50 2026-02-24T19:23:53.061 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.045+0000 7f45f152e640 10 client.30867.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:53.061 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.045+0000 7f45f152e640 10 monclient: _renew_subs 2026-02-24T19:23:53.061 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.045+0000 7f45f152e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:53.061 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.045+0000 7f45f152e640 1 -- 10.20.193.14:0/170467877 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f45ec0a8d20 con 0x7f45ec157b50 2026-02-24T19:23:53.062 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.045+0000 7f45f152e640 1 librados: init done 2026-02-24T19:23:53.062 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.045+0000 7f45f152e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:53.062 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.045+0000 7f45f152e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:53.062 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.045+0000 7f45f152e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:53.062 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.045+0000 7f45f152e640 1 -- 10.20.193.14:0/170467877 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45ec059e10 con 0x7f45ec157b50 2026-02-24T19:23:53.137 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.135+0000 7f45cb7fe640 1 -- 10.20.193.14:0/170467877 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f45d4003520 con 0x7f45ec157b50 2026-02-24T19:23:53.137 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.135+0000 7f45cb7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:53.137 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.135+0000 7f45cb7fe640 1 -- 10.20.193.14:0/170467877 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f45d4003b50 con 0x7f45ec157b50 2026-02-24T19:23:53.137 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.135+0000 7f45cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:53.137 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.135+0000 7f45cb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:53.137 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.135+0000 7f45e97fa640 4 set_mon_vals no callback set 2026-02-24T19:23:53.137 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.135+0000 7f45cb7fe640 10 monclient: dump: 2026-02-24T19:23:53.137 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:53.137 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:53.137 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.137 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.138 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:53.138 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:53.138 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:53.138 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:53.138 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:53.138 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.138 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.135+0000 7f45cb7fe640 1 -- 10.20.193.14:0/170467877 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f45d4003d30 con 0x7f45ec157b50 2026-02-24T19:23:53.139 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.136+0000 7f45eaffd640 10 monclient: get_auth_request con 0x7f45b8077e70 auth_method 0 2026-02-24T19:23:53.139 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.136+0000 7f45cb7fe640 10 client.30867.objecter ms_handle_connect 0x7f45b8077e70 2026-02-24T19:23:53.139 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.138+0000 7f45cb7fe640 1 -- 10.20.193.14:0/170467877 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7f45d40932a0 con 0x7f45ec157b50 2026-02-24T19:23:53.140 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.138+0000 7f45cb7fe640 10 client.30867.objecter ms_dispatch2 0x7f45ec000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:23:53.140 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.138+0000 7f45cb7fe640 3 client.30867.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:23:53.140 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.138+0000 7f45cb7fe640 3 client.30867.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:23:53.140 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.138+0000 7f45cb7fe640 20 client.30867.objecter dump_active .. 0 homeless 2026-02-24T19:23:53.140 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.138+0000 7f45cb7fe640 1 -- 10.20.193.14:0/170467877 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f45ec059e10 con 0x7f45ec157b50 2026-02-24T19:23:53.140 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.138+0000 7f45cb7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:53.140 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.138+0000 7f45cb7fe640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:23:53.248 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.246+0000 7f45f152e640 1 -- 10.20.193.14:0/170467877 --> v1:10.20.193.14:6800/4014096310 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "14", "target": ["mon-mgr", ""]}) -- 0x7f45ec057460 con 0x7f45b8077e70 2026-02-24T19:23:53.248 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.246+0000 7f45cb7fe640 1 -- 10.20.193.14:0/170467877 <== mgr.4110 v1:10.20.193.14:6800/4014096310 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 14 to deep-scrub) ==== 42+0+0 (unknown 1939288360 0 0) 0x7f45ec057460 con 0x7f45b8077e70 2026-02-24T19:23:53.248 INFO:teuthology.orchestra.run.trial014.stderr:instructed osd(s) 14 to deep-scrub 2026-02-24T19:23:53.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.247+0000 7f45f152e640 10 librados: watch_flush enter 2026-02-24T19:23:53.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.247+0000 7f45f152e640 10 librados: watch_flush exit 2026-02-24T19:23:53.249 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.247+0000 7f45f152e640 20 client.30867.objecter shutdown clearing up homeless session... 2026-02-24T19:23:53.250 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.247+0000 7f45f152e640 10 client.30867.objecter successfully canceled tick 2026-02-24T19:23:53.250 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.247+0000 7f45f152e640 1 -- 10.20.193.14:0/170467877 >> v1:10.20.193.14:6800/4014096310 conn(0x7f45b8077e70 legacy=0x7f45b8098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:53.250 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.247+0000 7f45f152e640 10 monclient: shutdown 2026-02-24T19:23:53.250 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.247+0000 7f45f152e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:53.250 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.247+0000 7f45f152e640 1 -- 10.20.193.14:0/170467877 >> v1:10.20.193.14:6789/0 conn(0x7f45ec157b50 legacy=0x7f45ec12e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:53.250 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.247+0000 7f45f152e640 1 -- 10.20.193.14:0/170467877 shutdown_connections 2026-02-24T19:23:53.250 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.247+0000 7f45f152e640 1 -- 10.20.193.14:0/170467877 >> 10.20.193.14:0/170467877 conn(0x7f45ec0b2ef0 msgr2=0x7f45ec156850 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:53.250 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.247+0000 7f45f152e640 1 -- 10.20.193.14:0/170467877 shutdown_connections 2026-02-24T19:23:53.250 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.247+0000 7f45f152e640 1 -- 10.20.193.14:0/170467877 wait complete. 2026-02-24T19:23:53.250 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.247+0000 7f45f152e640 1 librados: shutdown 2026-02-24T19:23:53.257 INFO:tasks.ceph:Scrubbing osd.3 2026-02-24T19:23:53.257 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:23:53.327 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.326+0000 7f9420513640 10 monclient: get_monmap_and_config 2026-02-24T19:23:53.328 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.326+0000 7f9420513640 10 monclient: build_initial_monmap 2026-02-24T19:23:53.328 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.326+0000 7f9420513640 10 monclient: monmap: 2026-02-24T19:23:53.328 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:53.328 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:53.328 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:23:53.326828+0000 2026-02-24T19:23:53.328 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:23:53.326828+0000 2026-02-24T19:23:53.328 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:53.328 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:53.328 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:53.328 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:53.329 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:53.329 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.331 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.326+0000 7f9420513640 1 Processor -- start 2026-02-24T19:23:53.331 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.326+0000 7f9420513640 1 -- start start 2026-02-24T19:23:53.331 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.326+0000 7f9420513640 10 monclient: init 2026-02-24T19:23:53.331 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.327+0000 7f9420513640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:53.331 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.327+0000 7f9420513640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:23:53.331 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.327+0000 7f9420513640 10 monclient(hunting): picked mon.noname-a con 0x7f941815e2a0 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:53.331 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.327+0000 7f9420513640 10 monclient(hunting): picked mon.noname-c con 0x7f9418059e10 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:53.331 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.327+0000 7f9420513640 10 monclient(hunting): picked mon.noname-b con 0x7f94181a5660 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:53.331 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.327+0000 7f9420513640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9418162df0 con 0x7f941815e2a0 2026-02-24T19:23:53.332 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.327+0000 7f9420513640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94181630d0 con 0x7f94181a5660 2026-02-24T19:23:53.332 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.327+0000 7f9420513640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94181633b0 con 0x7f9418059e10 2026-02-24T19:23:53.332 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.327+0000 7f9420513640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:53.332 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.327+0000 7f9420513640 10 monclient(hunting): authenticate will time out at 4008.008314s 2026-02-24T19:23:53.332 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.327+0000 7f941e288640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f941815e2a0 0x7f941805da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:51046/0 (socket says 10.20.193.14:51046) 2026-02-24T19:23:53.332 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.327+0000 7f941e288640 1 -- 10.20.193.14:0/2032023813 learned_addr learned my addr 10.20.193.14:0/2032023813 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:53.332 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.328+0000 7f941d286640 1 -- 10.20.193.14:0/2032023813 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1911161669 0 0) 0x7f9418162df0 con 0x7f941815e2a0 2026-02-24T19:23:53.332 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.328+0000 7f941d286640 10 monclient(hunting): _negotiate 2026-02-24T19:23:53.332 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.328+0000 7f941d286640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:53.332 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.328+0000 7f941d286640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:53.332 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.328+0000 7f941d286640 10 monclient(hunting): my global_id is 30870 2026-02-24T19:23:53.332 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.328+0000 7f941d286640 1 -- 10.20.193.14:0/2032023813 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9400003610 con 0x7f941815e2a0 2026-02-24T19:23:53.332 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.329+0000 7f941d286640 1 -- 10.20.193.14:0/2032023813 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 768568339 0 0) 0x7f94181633b0 con 0x7f9418059e10 2026-02-24T19:23:53.333 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.329+0000 7f941d286640 10 monclient(hunting): _negotiate 2026-02-24T19:23:53.333 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.329+0000 7f941d286640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:53.333 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.329+0000 7f941d286640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:53.333 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.329+0000 7f941d286640 10 monclient(hunting): my global_id is 28823 2026-02-24T19:23:53.333 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.329+0000 7f941d286640 1 -- 10.20.193.14:0/2032023813 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9418162df0 con 0x7f9418059e10 2026-02-24T19:23:53.333 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.329+0000 7f941d286640 1 -- 10.20.193.14:0/2032023813 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2408410776 0 0) 0x7f94181630d0 con 0x7f94181a5660 2026-02-24T19:23:53.333 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.329+0000 7f941d286640 10 monclient(hunting): _negotiate 2026-02-24T19:23:53.333 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.329+0000 7f941d286640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:53.333 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.329+0000 7f941d286640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:53.333 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.329+0000 7f941d286640 10 monclient(hunting): my global_id is 29185 2026-02-24T19:23:53.333 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.329+0000 7f941d286640 1 -- 10.20.193.14:0/2032023813 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94181633b0 con 0x7f94181a5660 2026-02-24T19:23:53.338 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.330+0000 7f941d286640 1 -- 10.20.193.14:0/2032023813 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1425676999 0 0) 0x7f9400003610 con 0x7f941815e2a0 2026-02-24T19:23:53.338 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.330+0000 7f941d286640 1 -- 10.20.193.14:0/2032023813 >> v1:10.20.193.170:6789/0 conn(0x7f9418059e10 legacy=0x7f941815ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:53.338 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.330+0000 7f941d286640 1 -- 10.20.193.14:0/2032023813 >> v1:10.20.193.44:6789/0 conn(0x7f94181a5660 legacy=0x7f94181c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:53.338 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.330+0000 7f941d286640 10 monclient: _finish_hunting 0 2026-02-24T19:23:53.338 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.330+0000 7f941d286640 1 monclient: found mon.noname-a 2026-02-24T19:23:53.338 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.330+0000 7f941d286640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:53.338 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.330+0000 7f941d286640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:23:53.338 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.330+0000 7f941d286640 1 -- 10.20.193.14:0/2032023813 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9418163690 con 0x7f941815e2a0 2026-02-24T19:23:53.338 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.330+0000 7f941d286640 10 monclient: _finish_auth 0 2026-02-24T19:23:53.339 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.330+0000 7f941d286640 10 monclient: _check_auth_tickets 2026-02-24T19:23:53.339 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.330+0000 7f941d286640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:53.339 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.330+0000 7f941d286640 1 -- 10.20.193.14:0/2032023813 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f9408002df0 con 0x7f941815e2a0 2026-02-24T19:23:53.339 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.330+0000 7f941d286640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:53.339 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.330+0000 7f941d286640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:23:53.339 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.330+0000 7f941d286640 10 monclient: dump: 2026-02-24T19:23:53.339 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:53.339 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:53.339 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.339 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.339 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:53.339 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:53.339 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:53.340 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:53.340 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:53.340 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.340 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.330+0000 7f9420513640 5 monclient: authenticate success, global_id 30870 2026-02-24T19:23:53.340 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.330+0000 7f9420513640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:53.340 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.331+0000 7f941d286640 1 -- 10.20.193.14:0/2032023813 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9408002fc0 con 0x7f941815e2a0 2026-02-24T19:23:53.340 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.331+0000 7f941d286640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:53.340 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.331+0000 7f941d286640 1 -- 10.20.193.14:0/2032023813 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f9408003400 con 0x7f941815e2a0 2026-02-24T19:23:53.340 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.331+0000 7f941d286640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:53.340 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.331+0000 7f941d286640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:53.340 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.331+0000 7f941d286640 10 monclient: dump: 2026-02-24T19:23:53.340 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:53.341 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:53.341 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.341 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.341 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:53.341 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:53.341 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:53.341 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:53.341 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:53.341 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.331+0000 7f9420513640 10 monclient: get_monmap_and_config success 2026-02-24T19:23:53.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.331+0000 7f9420513640 4 set_mon_vals no callback set 2026-02-24T19:23:53.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.331+0000 7f9420513640 10 monclient: shutdown 2026-02-24T19:23:53.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.331+0000 7f9420513640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:53.342 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.331+0000 7f9420513640 1 -- 10.20.193.14:0/2032023813 >> v1:10.20.193.14:6789/0 conn(0x7f941815e2a0 legacy=0x7f941805da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:53.342 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.331+0000 7f9420513640 1 -- 10.20.193.14:0/2032023813 shutdown_connections 2026-02-24T19:23:53.342 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.331+0000 7f9420513640 1 -- 10.20.193.14:0/2032023813 >> 10.20.193.14:0/2032023813 conn(0x7f94180b2f60 msgr2=0x7f94180b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:53.342 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.331+0000 7f9420513640 1 -- 10.20.193.14:0/2032023813 shutdown_connections 2026-02-24T19:23:53.342 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.331+0000 7f9420513640 1 -- 10.20.193.14:0/2032023813 wait complete. 2026-02-24T19:23:53.342 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.332+0000 7f9420513640 10 monclient: build_initial_monmap 2026-02-24T19:23:53.342 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.332+0000 7f9420513640 10 monclient: monmap: 2026-02-24T19:23:53.342 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:53.342 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:23:53.342 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:23:53.342 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:23:53.342 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:53.343 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:23:53.343 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:53.343 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:53.343 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:53.343 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.343 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.332+0000 7f9420513640 1 librados: starting msgr at 2026-02-24T19:23:53.343 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.332+0000 7f9420513640 1 librados: starting objecter 2026-02-24T19:23:53.343 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.332+0000 7f9420513640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:23:53.343 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.332+0000 7f9420513640 1 Processor -- start 2026-02-24T19:23:53.343 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.332+0000 7f9420513640 1 -- start start 2026-02-24T19:23:53.343 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.332+0000 7f9420513640 1 librados: setting wanted keys 2026-02-24T19:23:53.343 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.332+0000 7f9420513640 1 librados: calling monclient init 2026-02-24T19:23:53.343 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.332+0000 7f9420513640 10 monclient: init 2026-02-24T19:23:53.344 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.333+0000 7f9420513640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:53.344 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.333+0000 7f9420513640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:23:53.344 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.333+0000 7f9420513640 10 monclient(hunting): picked mon.noname-a con 0x7f9418059e10 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:53.344 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.333+0000 7f9420513640 10 monclient(hunting): picked mon.noname-c con 0x7f941815e2a0 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:53.344 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.333+0000 7f9420513640 10 monclient(hunting): picked mon.noname-b con 0x7f94181a5660 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:53.344 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.333+0000 7f9420513640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9418161cb0 con 0x7f9418059e10 2026-02-24T19:23:53.344 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.333+0000 7f9420513640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9418057410 con 0x7f94181a5660 2026-02-24T19:23:53.344 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.333+0000 7f9420513640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9418160dc0 con 0x7f941815e2a0 2026-02-24T19:23:53.344 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.333+0000 7f9420513640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:53.344 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.333+0000 7f9420513640 10 monclient(hunting): authenticate will time out at 4008.014235s 2026-02-24T19:23:53.344 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.333+0000 7f941e288640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f9418059e10 0x7f94181605b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:51060/0 (socket says 10.20.193.14:51060) 2026-02-24T19:23:53.344 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.333+0000 7f941e288640 1 -- 10.20.193.14:0/3174800518 learned_addr learned my addr 10.20.193.14:0/3174800518 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:53.344 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.333+0000 7f93feffd640 10 client.?.objecter ms_handle_connect 0x7f9418059e10 2026-02-24T19:23:53.345 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.333+0000 7f93feffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:53.345 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.333+0000 7f93feffd640 10 client.?.objecter ms_handle_connect 0x7f941815e2a0 2026-02-24T19:23:53.345 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.333+0000 7f93feffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:53.345 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.333+0000 7f93feffd640 10 client.?.objecter ms_handle_connect 0x7f94181a5660 2026-02-24T19:23:53.345 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.333+0000 7f93feffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:53.345 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.334+0000 7f93feffd640 1 -- 10.20.193.14:0/3174800518 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1766601400 0 0) 0x7f9418161cb0 con 0x7f9418059e10 2026-02-24T19:23:53.345 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.334+0000 7f93feffd640 10 monclient(hunting): _negotiate 2026-02-24T19:23:53.345 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.334+0000 7f93feffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:53.345 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.334+0000 7f93feffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:53.345 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.334+0000 7f93feffd640 10 monclient(hunting): my global_id is 30873 2026-02-24T19:23:53.345 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.334+0000 7f93feffd640 1 -- 10.20.193.14:0/3174800518 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93e8003610 con 0x7f9418059e10 2026-02-24T19:23:53.345 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.335+0000 7f93feffd640 1 -- 10.20.193.14:0/3174800518 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3333474132 0 0) 0x7f9418057410 con 0x7f94181a5660 2026-02-24T19:23:53.345 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.335+0000 7f93feffd640 10 monclient(hunting): _negotiate 2026-02-24T19:23:53.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.335+0000 7f93feffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:53.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.335+0000 7f93feffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:53.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.335+0000 7f93feffd640 10 monclient(hunting): my global_id is 29188 2026-02-24T19:23:53.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.335+0000 7f93feffd640 1 -- 10.20.193.14:0/3174800518 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9418161cb0 con 0x7f94181a5660 2026-02-24T19:23:53.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.335+0000 7f93feffd640 1 -- 10.20.193.14:0/3174800518 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2926798774 0 0) 0x7f9418160dc0 con 0x7f941815e2a0 2026-02-24T19:23:53.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.335+0000 7f93feffd640 10 monclient(hunting): _negotiate 2026-02-24T19:23:53.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.335+0000 7f93feffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:53.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.335+0000 7f93feffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:53.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.335+0000 7f93feffd640 10 monclient(hunting): my global_id is 28826 2026-02-24T19:23:53.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.335+0000 7f93feffd640 1 -- 10.20.193.14:0/3174800518 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9418057410 con 0x7f941815e2a0 2026-02-24T19:23:53.350 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.336+0000 7f93feffd640 1 -- 10.20.193.14:0/3174800518 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1801523005 0 0) 0x7f93e8003610 con 0x7f9418059e10 2026-02-24T19:23:53.350 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.336+0000 7f93feffd640 1 -- 10.20.193.14:0/3174800518 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9418160dc0 con 0x7f9418059e10 2026-02-24T19:23:53.350 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.336+0000 7f93feffd640 1 -- 10.20.193.14:0/3174800518 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f9408003310 con 0x7f9418059e10 2026-02-24T19:23:53.350 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.336+0000 7f93feffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:53.350 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.336+0000 7f93feffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:23:53.350 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.336+0000 7f93feffd640 10 monclient(hunting): dump: 2026-02-24T19:23:53.350 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:53.350 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:53.350 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.350 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.351 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:53.351 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:53.351 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:53.351 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:53.351 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:53.351 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.351 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.336+0000 7f93feffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:23:53.351 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.337+0000 7f93feffd640 1 -- 10.20.193.14:0/3174800518 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 21092908 0 0) 0x7f9418161cb0 con 0x7f94181a5660 2026-02-24T19:23:53.351 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.337+0000 7f93feffd640 1 -- 10.20.193.14:0/3174800518 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f93e8003610 con 0x7f94181a5660 2026-02-24T19:23:53.351 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.337+0000 7f93feffd640 1 -- 10.20.193.14:0/3174800518 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f9414003410 con 0x7f94181a5660 2026-02-24T19:23:53.351 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.337+0000 7f93feffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:53.351 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.337+0000 7f93feffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:53.352 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.337+0000 7f93feffd640 10 monclient(hunting): dump: 2026-02-24T19:23:53.352 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:53.352 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:53.352 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.352 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.352 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:53.352 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:53.352 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:53.352 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:53.352 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:53.352 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.352 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.338+0000 7f93feffd640 1 -- 10.20.193.14:0/3174800518 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 380903896 0 0) 0x7f9418057410 con 0x7f941815e2a0 2026-02-24T19:23:53.352 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.338+0000 7f93feffd640 1 -- 10.20.193.14:0/3174800518 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9418161cb0 con 0x7f941815e2a0 2026-02-24T19:23:53.353 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.338+0000 7f93feffd640 1 -- 10.20.193.14:0/3174800518 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f940c002ff0 con 0x7f941815e2a0 2026-02-24T19:23:53.353 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.338+0000 7f93feffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:53.353 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.338+0000 7f93feffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:53.353 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.338+0000 7f93feffd640 10 monclient(hunting): dump: 2026-02-24T19:23:53.353 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:53.353 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:53.353 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.353 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.353 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:53.353 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:53.353 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:53.353 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:53.353 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:53.354 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.354 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.338+0000 7f93feffd640 1 -- 10.20.193.14:0/3174800518 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3805497234 0 0) 0x7f9418160dc0 con 0x7f9418059e10 2026-02-24T19:23:53.354 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.338+0000 7f93feffd640 1 -- 10.20.193.14:0/3174800518 >> v1:10.20.193.170:6789/0 conn(0x7f941815e2a0 legacy=0x7f9418056d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:53.354 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.338+0000 7f93feffd640 1 -- 10.20.193.14:0/3174800518 >> v1:10.20.193.44:6789/0 conn(0x7f94181a5660 legacy=0x7f94180afd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:53.354 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.338+0000 7f93feffd640 10 monclient: _finish_hunting 0 2026-02-24T19:23:53.354 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.338+0000 7f93feffd640 1 monclient: found mon.a 2026-02-24T19:23:53.354 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.338+0000 7f93feffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:53.354 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.338+0000 7f93feffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:53.354 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.338+0000 7f93feffd640 1 -- 10.20.193.14:0/3174800518 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94181610a0 con 0x7f9418059e10 2026-02-24T19:23:53.354 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.338+0000 7f93feffd640 10 monclient: _finish_auth 0 2026-02-24T19:23:53.354 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.338+0000 7f93feffd640 10 monclient: _check_auth_tickets 2026-02-24T19:23:53.354 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.338+0000 7f93feffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:53.355 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.338+0000 7f9420513640 5 monclient: authenticate success, global_id 30873 2026-02-24T19:23:53.355 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.338+0000 7f9420513640 10 monclient: _renew_subs 2026-02-24T19:23:53.355 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.338+0000 7f9420513640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:53.355 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.338+0000 7f9420513640 1 -- 10.20.193.14:0/3174800518 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9418161380 con 0x7f9418059e10 2026-02-24T19:23:53.355 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.338+0000 7f9420513640 10 client.30873.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:53.355 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.338+0000 7f9420513640 10 monclient: _renew_subs 2026-02-24T19:23:53.355 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.338+0000 7f9420513640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:53.355 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.338+0000 7f9420513640 1 -- 10.20.193.14:0/3174800518 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9418161940 con 0x7f9418059e10 2026-02-24T19:23:53.355 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.338+0000 7f9420513640 1 librados: init done 2026-02-24T19:23:53.355 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.339+0000 7f9420513640 10 client.30873.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:53.355 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.339+0000 7f9420513640 15 client.30873.objecter _session_command_op_assign -1 1 2026-02-24T19:23:53.355 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.339+0000 7f9420513640 20 client.30873.objecter _get_session osd=-1 returning homeless 2026-02-24T19:23:53.355 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.339+0000 7f9420513640 10 client.30873.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:53.355 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.339+0000 7f9420513640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:53.356 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.339+0000 7f9420513640 1 -- 10.20.193.14:0/3174800518 --> v1:10.20.193.14:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f94181925b0 con 0x7f9418059e10 2026-02-24T19:23:53.356 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.347+0000 7f93feffd640 1 -- 10.20.193.14:0/3174800518 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f94181925b0 con 0x7f9418059e10 2026-02-24T19:23:53.356 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.347+0000 7f93feffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:53.356 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.347+0000 7f93feffd640 1 -- 10.20.193.14:0/3174800518 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f9408002f30 con 0x7f9418059e10 2026-02-24T19:23:53.356 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.347+0000 7f93feffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:53.356 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.347+0000 7f93feffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:53.356 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.347+0000 7f93feffd640 10 monclient: dump: 2026-02-24T19:23:53.356 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:53.356 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:53.356 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.356 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.356 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:53.356 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:53.357 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:53.357 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:53.357 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:53.357 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.357 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.347+0000 7f941ca85640 4 set_mon_vals no callback set 2026-02-24T19:23:53.357 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.348+0000 7f93feffd640 1 -- 10.20.193.14:0/3174800518 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f940801d850 con 0x7f9418059e10 2026-02-24T19:23:53.357 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.348+0000 7f941da87640 10 monclient: get_auth_request con 0x7f93e8077e70 auth_method 0 2026-02-24T19:23:53.357 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.348+0000 7f93feffd640 10 client.30873.objecter ms_handle_connect 0x7f93e8077e70 2026-02-24T19:23:53.358 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.348+0000 7f93feffd640 1 -- 10.20.193.14:0/3174800518 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7f9408092eb0 con 0x7f9418059e10 2026-02-24T19:23:53.358 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.348+0000 7f93feffd640 10 client.30873.objecter ms_dispatch2 0x7f9418000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:23:53.359 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.348+0000 7f93feffd640 3 client.30873.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:23:53.359 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.348+0000 7f93feffd640 3 client.30873.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:23:53.359 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.349+0000 7f93feffd640 10 client.30873.objecter checking command 1 2026-02-24T19:23:53.359 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.349+0000 7f93feffd640 20 client.30873.objecter _get_session s=0x7f93e80a2110 osd=3 3 2026-02-24T19:23:53.359 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.349+0000 7f93feffd640 20 client.30873.objecter put_session s=0x7f93e80a2110 osd=3 3 2026-02-24T19:23:53.359 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.349+0000 7f93feffd640 15 client.30873.objecter _session_command_op_remove -1 1 2026-02-24T19:23:53.359 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.349+0000 7f93feffd640 20 client.30873.objecter _get_session s=0x7f93e80a2110 osd=3 3 2026-02-24T19:23:53.359 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.349+0000 7f93feffd640 20 client.30873.objecter get_session s=0x7f93e80a2110 osd=3 3 2026-02-24T19:23:53.359 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.349+0000 7f93feffd640 15 client.30873.objecter _session_command_op_assign 3 1 2026-02-24T19:23:53.359 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.349+0000 7f93feffd640 20 client.30873.objecter put_session s=0x7f93e80a2110 osd=3 4 2026-02-24T19:23:53.359 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.349+0000 7f93feffd640 10 client.30873.objecter _send_command 1 2026-02-24T19:23:53.359 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.349+0000 7f93feffd640 1 -- 10.20.193.14:0/3174800518 --> v1:10.20.193.195:6800/3081016231 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f93e80c4420 con 0x7f93e80a27c0 2026-02-24T19:23:53.359 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.349+0000 7f93feffd640 20 client.30873.objecter dump_active .. 0 homeless 2026-02-24T19:23:53.360 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.349+0000 7f93feffd640 1 -- 10.20.193.14:0/3174800518 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_get_version_reply(handle=1 version=354) ==== 24+0+0 (unknown 31317031 0 0) 0x7f940805cfb0 con 0x7f9418059e10 2026-02-24T19:23:53.360 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.349+0000 7f93feffd640 10 monclient: handle_get_version_reply finishing 1 version 354 2026-02-24T19:23:53.360 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.349+0000 7f941ea89640 10 monclient: get_auth_request con 0x7f93e80a27c0 auth_method 0 2026-02-24T19:23:53.360 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.350+0000 7f93feffd640 10 client.30873.objecter ms_handle_connect 0x7f93e80a27c0 2026-02-24T19:23:53.361 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.359+0000 7f93feffd640 1 -- 10.20.193.14:0/3174800518 <== osd.3 v1:10.20.193.195:6800/3081016231 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f93e80c4420 con 0x7f93e80a27c0 2026-02-24T19:23:53.361 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.359+0000 7f93feffd640 10 client.30873.objecter ms_dispatch2 0x7f9418000b90 command_reply(tid 1: 0 ) 2026-02-24T19:23:53.361 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.359+0000 7f93feffd640 10 client.30873.objecter _finish_command 1 = system:0 2026-02-24T19:23:53.361 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.359+0000 7f93feffd640 20 client.30873.objecter put_session s=0x7f93e80a2110 osd=3 4 2026-02-24T19:23:53.361 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.359+0000 7f93feffd640 15 client.30873.objecter _session_command_op_remove 3 1 2026-02-24T19:23:53.368 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.366+0000 7f9420513640 10 client.30873.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:23:53.368 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.366+0000 7f9420513640 15 client.30873.objecter _session_command_op_assign -1 2 2026-02-24T19:23:53.368 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.366+0000 7f9420513640 20 client.30873.objecter _get_session s=0x7f93e80a2110 osd=3 3 2026-02-24T19:23:53.368 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.366+0000 7f9420513640 20 client.30873.objecter put_session s=0x7f93e80a2110 osd=3 3 2026-02-24T19:23:53.369 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.366+0000 7f9420513640 20 client.30873.objecter _get_session s=0x7f93e80a2110 osd=3 3 2026-02-24T19:23:53.369 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.366+0000 7f9420513640 15 client.30873.objecter _session_command_op_remove -1 2 2026-02-24T19:23:53.369 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.366+0000 7f9420513640 20 client.30873.objecter get_session s=0x7f93e80a2110 osd=3 3 2026-02-24T19:23:53.369 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.366+0000 7f9420513640 15 client.30873.objecter _session_command_op_assign 3 2 2026-02-24T19:23:53.369 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.366+0000 7f9420513640 20 client.30873.objecter put_session s=0x7f93e80a2110 osd=3 4 2026-02-24T19:23:53.369 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.366+0000 7f9420513640 10 client.30873.objecter _send_command 2 2026-02-24T19:23:53.369 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.366+0000 7f9420513640 1 -- 10.20.193.14:0/3174800518 --> v1:10.20.193.195:6800/3081016231 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f94181922d0 con 0x7f93e80a27c0 2026-02-24T19:23:53.382 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.381+0000 7f93feffd640 1 -- 10.20.193.14:0/3174800518 <== osd.3 v1:10.20.193.195:6800/3081016231 2 ==== command_reply(tid 2: 0 ) ==== 8+0+712 (unknown 0 0 714369635) 0x7f94181922d0 con 0x7f93e80a27c0 2026-02-24T19:23:53.382 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.381+0000 7f93feffd640 10 client.30873.objecter ms_dispatch2 0x7f9418000b90 command_reply(tid 2: 0 ) 2026-02-24T19:23:53.383 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.381+0000 7f93feffd640 10 client.30873.objecter _finish_command 2 = system:0 2026-02-24T19:23:53.383 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.381+0000 7f93feffd640 20 client.30873.objecter put_session s=0x7f93e80a2110 osd=3 4 2026-02-24T19:23:53.383 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.381+0000 7f93feffd640 15 client.30873.objecter _session_command_op_remove 3 2 2026-02-24T19:23:53.383 INFO:teuthology.orchestra.run.trial014.stdout:{ 2026-02-24T19:23:53.383 INFO:teuthology.orchestra.run.trial014.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-24T19:23:53.383 INFO:teuthology.orchestra.run.trial014.stdout:} 2026-02-24T19:23:53.385 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.381+0000 7f9420513640 10 librados: watch_flush enter 2026-02-24T19:23:53.385 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.381+0000 7f9420513640 10 librados: watch_flush exit 2026-02-24T19:23:53.385 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.381+0000 7f9420513640 10 client.30873.objecter close_session for osd.3 2026-02-24T19:23:53.385 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.381+0000 7f9420513640 1 -- 10.20.193.14:0/3174800518 >> v1:10.20.193.195:6800/3081016231 conn(0x7f93e80a27c0 legacy=0x7f93e80c2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:53.385 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.381+0000 7f9420513640 20 client.30873.objecter put_session s=0x7f93e80a2110 osd=3 1 2026-02-24T19:23:53.385 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.381+0000 7f9420513640 20 client.30873.objecter shutdown clearing up homeless session... 2026-02-24T19:23:53.385 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.381+0000 7f9420513640 10 client.30873.objecter successfully canceled tick 2026-02-24T19:23:53.385 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.381+0000 7f9420513640 1 -- 10.20.193.14:0/3174800518 >> v1:10.20.193.14:6800/4014096310 conn(0x7f93e8077e70 legacy=0x7f93e8098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:53.385 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.381+0000 7f9420513640 10 monclient: shutdown 2026-02-24T19:23:53.385 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.381+0000 7f9420513640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:53.386 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.381+0000 7f9420513640 1 -- 10.20.193.14:0/3174800518 >> v1:10.20.193.14:6789/0 conn(0x7f9418059e10 legacy=0x7f94181605b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:53.386 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.381+0000 7f941ea89640 1 -- 10.20.193.14:0/3174800518 reap_dead start 2026-02-24T19:23:53.386 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.381+0000 7f9420513640 1 -- 10.20.193.14:0/3174800518 shutdown_connections 2026-02-24T19:23:53.386 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.381+0000 7f9420513640 1 -- 10.20.193.14:0/3174800518 >> 10.20.193.14:0/3174800518 conn(0x7f94180b2f60 msgr2=0x7f941815d490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:53.386 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.381+0000 7f9420513640 1 -- 10.20.193.14:0/3174800518 shutdown_connections 2026-02-24T19:23:53.386 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.381+0000 7f9420513640 1 -- 10.20.193.14:0/3174800518 wait complete. 2026-02-24T19:23:53.386 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.381+0000 7f9420513640 1 librados: shutdown 2026-02-24T19:23:53.391 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-24T19:23:53.460 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.458+0000 7f772c1c3640 10 monclient: get_monmap_and_config 2026-02-24T19:23:53.460 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.458+0000 7f772c1c3640 10 monclient: build_initial_monmap 2026-02-24T19:23:53.460 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.458+0000 7f772c1c3640 10 monclient: monmap: 2026-02-24T19:23:53.460 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:53.460 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:53.460 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:23:53.459050+0000 2026-02-24T19:23:53.460 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:23:53.459050+0000 2026-02-24T19:23:53.460 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:53.460 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:53.461 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:53.461 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:53.461 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:53.461 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.463 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.458+0000 7f772c1c3640 1 Processor -- start 2026-02-24T19:23:53.463 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.458+0000 7f772c1c3640 1 -- start start 2026-02-24T19:23:53.463 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.458+0000 7f772c1c3640 10 monclient: init 2026-02-24T19:23:53.463 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.459+0000 7f772c1c3640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:53.463 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.459+0000 7f772c1c3640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:23:53.464 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.459+0000 7f772c1c3640 10 monclient(hunting): picked mon.noname-a con 0x7f7724157780 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:53.464 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.459+0000 7f772c1c3640 10 monclient(hunting): picked mon.noname-c con 0x7f7724157b50 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:53.464 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.459+0000 7f772c1c3640 10 monclient(hunting): picked mon.noname-b con 0x7f7724164d00 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:53.464 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.459+0000 7f772c1c3640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f772405de70 con 0x7f7724157780 2026-02-24T19:23:53.464 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.459+0000 7f772c1c3640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7724055b20 con 0x7f7724164d00 2026-02-24T19:23:53.464 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.459+0000 7f772c1c3640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7724055e00 con 0x7f7724157b50 2026-02-24T19:23:53.464 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.459+0000 7f772c1c3640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:53.464 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.459+0000 7f772c1c3640 10 monclient(hunting): authenticate will time out at 4008.140443s 2026-02-24T19:23:53.464 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.459+0000 7f7729f38640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f7724157780 0x7f7724056ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:51074/0 (socket says 10.20.193.14:51074) 2026-02-24T19:23:53.464 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.459+0000 7f7729f38640 1 -- 10.20.193.14:0/1363409893 learned_addr learned my addr 10.20.193.14:0/1363409893 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:53.464 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.461+0000 7f7728f36640 1 -- 10.20.193.14:0/1363409893 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1099640725 0 0) 0x7f772405de70 con 0x7f7724157780 2026-02-24T19:23:53.464 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.461+0000 7f7728f36640 10 monclient(hunting): _negotiate 2026-02-24T19:23:53.465 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.461+0000 7f7728f36640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:53.465 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.461+0000 7f7728f36640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:53.465 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.461+0000 7f7728f36640 10 monclient(hunting): my global_id is 30876 2026-02-24T19:23:53.465 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.461+0000 7f7728f36640 1 -- 10.20.193.14:0/1363409893 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f770c003610 con 0x7f7724157780 2026-02-24T19:23:53.465 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.461+0000 7f7728f36640 1 -- 10.20.193.14:0/1363409893 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 542549017 0 0) 0x7f7724055e00 con 0x7f7724157b50 2026-02-24T19:23:53.465 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.461+0000 7f7728f36640 10 monclient(hunting): _negotiate 2026-02-24T19:23:53.465 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.461+0000 7f7728f36640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:53.465 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.461+0000 7f7728f36640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:53.465 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.461+0000 7f7728f36640 10 monclient(hunting): my global_id is 28829 2026-02-24T19:23:53.465 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.461+0000 7f7728f36640 1 -- 10.20.193.14:0/1363409893 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f772405de70 con 0x7f7724157b50 2026-02-24T19:23:53.465 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.461+0000 7f7728f36640 1 -- 10.20.193.14:0/1363409893 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 842030473 0 0) 0x7f7724055b20 con 0x7f7724164d00 2026-02-24T19:23:53.465 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.461+0000 7f7728f36640 10 monclient(hunting): _negotiate 2026-02-24T19:23:53.465 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.461+0000 7f7728f36640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:53.466 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.461+0000 7f7728f36640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:53.466 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.461+0000 7f7728f36640 10 monclient(hunting): my global_id is 29191 2026-02-24T19:23:53.466 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.461+0000 7f7728f36640 1 -- 10.20.193.14:0/1363409893 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7724055e00 con 0x7f7724164d00 2026-02-24T19:23:53.471 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.462+0000 7f7728f36640 1 -- 10.20.193.14:0/1363409893 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4240455822 0 0) 0x7f770c003610 con 0x7f7724157780 2026-02-24T19:23:53.472 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.463+0000 7f7728f36640 1 -- 10.20.193.14:0/1363409893 >> v1:10.20.193.170:6789/0 conn(0x7f7724157b50 legacy=0x7f77241645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:53.472 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.463+0000 7f7728f36640 1 -- 10.20.193.14:0/1363409893 >> v1:10.20.193.44:6789/0 conn(0x7f7724164d00 legacy=0x7f77241c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:53.472 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.463+0000 7f7728f36640 10 monclient: _finish_hunting 0 2026-02-24T19:23:53.472 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.463+0000 7f7728f36640 1 monclient: found mon.noname-a 2026-02-24T19:23:53.472 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.463+0000 7f7728f36640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:53.472 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.463+0000 7f7728f36640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:23:53.472 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.463+0000 7f7728f36640 1 -- 10.20.193.14:0/1363409893 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77240560e0 con 0x7f7724157780 2026-02-24T19:23:53.472 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.463+0000 7f7728f36640 10 monclient: _finish_auth 0 2026-02-24T19:23:53.472 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.463+0000 7f7728f36640 10 monclient: _check_auth_tickets 2026-02-24T19:23:53.472 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.463+0000 7f7728f36640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:53.472 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.463+0000 7f7728f36640 1 -- 10.20.193.14:0/1363409893 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7714002df0 con 0x7f7724157780 2026-02-24T19:23:53.473 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.463+0000 7f772c1c3640 5 monclient: authenticate success, global_id 30876 2026-02-24T19:23:53.473 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.463+0000 7f772c1c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:53.473 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.463+0000 7f7728f36640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:53.473 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.463+0000 7f7728f36640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:23:53.473 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.463+0000 7f7728f36640 10 monclient: dump: 2026-02-24T19:23:53.473 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:53.473 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:53.473 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.473 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.473 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:53.473 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:53.473 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:53.473 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:53.474 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:53.474 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.474 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.463+0000 7f772c1c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:53.474 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.463+0000 7f7728f36640 1 -- 10.20.193.14:0/1363409893 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7714002fc0 con 0x7f7724157780 2026-02-24T19:23:53.474 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.463+0000 7f7728f36640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:53.474 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.463+0000 7f7728f36640 1 -- 10.20.193.14:0/1363409893 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7714003400 con 0x7f7724157780 2026-02-24T19:23:53.474 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.463+0000 7f7728f36640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:53.474 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.463+0000 7f7728f36640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:53.474 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.463+0000 7f7728f36640 10 monclient: dump: 2026-02-24T19:23:53.474 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:53.474 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:53.474 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.475 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.475 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:53.475 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:53.475 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:53.475 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:53.475 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:53.475 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.475 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.463+0000 7f772c1c3640 10 monclient: get_monmap_and_config success 2026-02-24T19:23:53.475 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.463+0000 7f772c1c3640 4 set_mon_vals no callback set 2026-02-24T19:23:53.475 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.464+0000 7f772c1c3640 10 monclient: shutdown 2026-02-24T19:23:53.475 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.464+0000 7f772c1c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:53.475 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.464+0000 7f772c1c3640 1 -- 10.20.193.14:0/1363409893 >> v1:10.20.193.14:6789/0 conn(0x7f7724157780 legacy=0x7f7724056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:53.475 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.464+0000 7f772c1c3640 1 -- 10.20.193.14:0/1363409893 shutdown_connections 2026-02-24T19:23:53.476 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.464+0000 7f772c1c3640 1 -- 10.20.193.14:0/1363409893 >> 10.20.193.14:0/1363409893 conn(0x7f77240b2ef0 msgr2=0x7f77240b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:53.476 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.464+0000 7f772c1c3640 1 -- 10.20.193.14:0/1363409893 shutdown_connections 2026-02-24T19:23:53.476 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.464+0000 7f772c1c3640 1 -- 10.20.193.14:0/1363409893 wait complete. 2026-02-24T19:23:53.476 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.464+0000 7f772c1c3640 10 monclient: build_initial_monmap 2026-02-24T19:23:53.476 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.464+0000 7f772c1c3640 10 monclient: monmap: 2026-02-24T19:23:53.476 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:53.476 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:23:53.476 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:23:53.476 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:23:53.476 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:53.476 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:23:53.476 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:53.476 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:53.477 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:53.477 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.477 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.464+0000 7f772c1c3640 1 librados: starting msgr at 2026-02-24T19:23:53.477 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.464+0000 7f772c1c3640 1 librados: starting objecter 2026-02-24T19:23:53.477 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.464+0000 7f772c1c3640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:23:53.477 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.465+0000 7f772c1c3640 1 Processor -- start 2026-02-24T19:23:53.477 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.465+0000 7f772c1c3640 1 -- start start 2026-02-24T19:23:53.477 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.465+0000 7f772c1c3640 1 librados: setting wanted keys 2026-02-24T19:23:53.477 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.465+0000 7f772c1c3640 1 librados: calling monclient init 2026-02-24T19:23:53.477 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.465+0000 7f772c1c3640 10 monclient: init 2026-02-24T19:23:53.477 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.465+0000 7f772c1c3640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:53.477 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.465+0000 7f772c1c3640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:23:53.477 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.465+0000 7f772c1c3640 10 monclient(hunting): picked mon.noname-a con 0x7f7724157780 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:53.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.465+0000 7f772c1c3640 10 monclient(hunting): picked mon.noname-b con 0x7f7724157b50 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:53.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.465+0000 7f772c1c3640 10 monclient(hunting): picked mon.noname-c con 0x7f7724164d00 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:53.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.465+0000 7f772c1c3640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77241443d0 con 0x7f7724157780 2026-02-24T19:23:53.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.465+0000 7f772c1c3640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77241446b0 con 0x7f7724157b50 2026-02-24T19:23:53.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.465+0000 7f772c1c3640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7724144990 con 0x7f7724164d00 2026-02-24T19:23:53.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.465+0000 7f772c1c3640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:53.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.465+0000 7f772c1c3640 10 monclient(hunting): authenticate will time out at 4008.146429s 2026-02-24T19:23:53.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.465+0000 7f7729f38640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f7724157780 0x7f7724131880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:51082/0 (socket says 10.20.193.14:51082) 2026-02-24T19:23:53.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.465+0000 7f7729f38640 1 -- 10.20.193.14:0/2089394515 learned_addr learned my addr 10.20.193.14:0/2089394515 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:53.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.465+0000 7f77127fc640 10 client.?.objecter ms_handle_connect 0x7f7724157780 2026-02-24T19:23:53.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.465+0000 7f77127fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:53.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.466+0000 7f77127fc640 10 client.?.objecter ms_handle_connect 0x7f7724157b50 2026-02-24T19:23:53.478 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.466+0000 7f77127fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:53.479 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.466+0000 7f77127fc640 10 client.?.objecter ms_handle_connect 0x7f7724164d00 2026-02-24T19:23:53.479 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.466+0000 7f77127fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:53.479 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.466+0000 7f77127fc640 1 -- 10.20.193.14:0/2089394515 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2610525516 0 0) 0x7f77241443d0 con 0x7f7724157780 2026-02-24T19:23:53.479 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.466+0000 7f77127fc640 10 monclient(hunting): _negotiate 2026-02-24T19:23:53.479 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.466+0000 7f77127fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:53.479 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.466+0000 7f77127fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:53.479 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.466+0000 7f77127fc640 10 monclient(hunting): my global_id is 30879 2026-02-24T19:23:53.479 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.466+0000 7f77127fc640 1 -- 10.20.193.14:0/2089394515 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76f4003610 con 0x7f7724157780 2026-02-24T19:23:53.479 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.467+0000 7f77127fc640 1 -- 10.20.193.14:0/2089394515 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3004093544 0 0) 0x7f77241446b0 con 0x7f7724157b50 2026-02-24T19:23:53.479 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.467+0000 7f77127fc640 10 monclient(hunting): _negotiate 2026-02-24T19:23:53.479 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.467+0000 7f77127fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:53.479 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.467+0000 7f77127fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:53.479 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.467+0000 7f77127fc640 10 monclient(hunting): my global_id is 29194 2026-02-24T19:23:53.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.467+0000 7f77127fc640 1 -- 10.20.193.14:0/2089394515 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77241443d0 con 0x7f7724157b50 2026-02-24T19:23:53.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.467+0000 7f77127fc640 1 -- 10.20.193.14:0/2089394515 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 143339963 0 0) 0x7f7724144990 con 0x7f7724164d00 2026-02-24T19:23:53.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.467+0000 7f77127fc640 10 monclient(hunting): _negotiate 2026-02-24T19:23:53.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.467+0000 7f77127fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:53.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.467+0000 7f77127fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:53.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.467+0000 7f77127fc640 10 monclient(hunting): my global_id is 28832 2026-02-24T19:23:53.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.467+0000 7f77127fc640 1 -- 10.20.193.14:0/2089394515 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77241446b0 con 0x7f7724164d00 2026-02-24T19:23:53.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.469+0000 7f77127fc640 1 -- 10.20.193.14:0/2089394515 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1095673468 0 0) 0x7f76f4003610 con 0x7f7724157780 2026-02-24T19:23:53.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.469+0000 7f77127fc640 1 -- 10.20.193.14:0/2089394515 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7724144990 con 0x7f7724157780 2026-02-24T19:23:53.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.469+0000 7f77127fc640 1 -- 10.20.193.14:0/2089394515 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7714003310 con 0x7f7724157780 2026-02-24T19:23:53.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.469+0000 7f77127fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:53.480 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.469+0000 7f77127fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:23:53.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.469+0000 7f77127fc640 10 monclient(hunting): dump: 2026-02-24T19:23:53.481 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:53.481 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:53.481 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.481 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.481 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:53.481 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:53.481 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:53.481 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:53.481 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:53.481 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.469+0000 7f77127fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:23:53.481 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.469+0000 7f77127fc640 1 -- 10.20.193.14:0/2089394515 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4025865910 0 0) 0x7f77241443d0 con 0x7f7724157b50 2026-02-24T19:23:53.482 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.469+0000 7f77127fc640 1 -- 10.20.193.14:0/2089394515 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f76f4003610 con 0x7f7724157b50 2026-02-24T19:23:53.482 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.469+0000 7f77127fc640 1 -- 10.20.193.14:0/2089394515 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f77180030b0 con 0x7f7724157b50 2026-02-24T19:23:53.482 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.469+0000 7f77127fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:53.482 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.469+0000 7f77127fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:53.482 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.469+0000 7f77127fc640 10 monclient(hunting): dump: 2026-02-24T19:23:53.482 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:53.482 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:53.482 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.482 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.482 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:53.482 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:53.482 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:53.482 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:53.483 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:53.483 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.483 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.469+0000 7f77127fc640 1 -- 10.20.193.14:0/2089394515 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2065170945 0 0) 0x7f77241446b0 con 0x7f7724164d00 2026-02-24T19:23:53.483 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.469+0000 7f77127fc640 1 -- 10.20.193.14:0/2089394515 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f77241443d0 con 0x7f7724164d00 2026-02-24T19:23:53.483 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.469+0000 7f77127fc640 1 -- 10.20.193.14:0/2089394515 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7720003330 con 0x7f7724164d00 2026-02-24T19:23:53.483 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.469+0000 7f77127fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:53.483 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.469+0000 7f77127fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:53.483 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.469+0000 7f77127fc640 10 monclient(hunting): dump: 2026-02-24T19:23:53.483 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:53.483 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:53.483 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.483 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.483 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:53.483 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:53.484 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:53.484 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:53.484 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:53.484 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.485 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.470+0000 7f77127fc640 1 -- 10.20.193.14:0/2089394515 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3215647094 0 0) 0x7f7724144990 con 0x7f7724157780 2026-02-24T19:23:53.485 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.470+0000 7f77127fc640 1 -- 10.20.193.14:0/2089394515 >> v1:10.20.193.170:6789/0 conn(0x7f7724164d00 legacy=0x7f77240b4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:53.485 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.470+0000 7f77127fc640 1 -- 10.20.193.14:0/2089394515 >> v1:10.20.193.44:6789/0 conn(0x7f7724157b50 legacy=0x7f772415a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:53.485 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.470+0000 7f77127fc640 10 monclient: _finish_hunting 0 2026-02-24T19:23:53.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.470+0000 7f77127fc640 1 monclient: found mon.a 2026-02-24T19:23:53.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.470+0000 7f77127fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:53.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.470+0000 7f77127fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:53.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.470+0000 7f77127fc640 1 -- 10.20.193.14:0/2089394515 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7724130da0 con 0x7f7724157780 2026-02-24T19:23:53.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.470+0000 7f77127fc640 10 monclient: _finish_auth 0 2026-02-24T19:23:53.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.470+0000 7f77127fc640 10 monclient: _check_auth_tickets 2026-02-24T19:23:53.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.470+0000 7f77127fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:53.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.470+0000 7f772c1c3640 5 monclient: authenticate success, global_id 30879 2026-02-24T19:23:53.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.470+0000 7f772c1c3640 10 monclient: _renew_subs 2026-02-24T19:23:53.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.470+0000 7f772c1c3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:53.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.470+0000 7f772c1c3640 1 -- 10.20.193.14:0/2089394515 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7724131080 con 0x7f7724157780 2026-02-24T19:23:53.486 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.470+0000 7f772c1c3640 10 client.30879.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:53.487 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.470+0000 7f772c1c3640 10 monclient: _renew_subs 2026-02-24T19:23:53.487 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.470+0000 7f772c1c3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:53.487 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.470+0000 7f772c1c3640 1 -- 10.20.193.14:0/2089394515 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7724144c70 con 0x7f7724157780 2026-02-24T19:23:53.487 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.470+0000 7f772c1c3640 1 librados: init done 2026-02-24T19:23:53.487 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.471+0000 7f772c1c3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:53.487 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.471+0000 7f772c1c3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:53.487 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.471+0000 7f772c1c3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:53.487 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.471+0000 7f772c1c3640 1 -- 10.20.193.14:0/2089394515 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f772415ea20 con 0x7f7724157780 2026-02-24T19:23:53.570 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.568+0000 7f77127fc640 1 -- 10.20.193.14:0/2089394515 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f77140029a0 con 0x7f7724157780 2026-02-24T19:23:53.570 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.568+0000 7f77127fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:53.570 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.568+0000 7f77127fc640 1 -- 10.20.193.14:0/2089394515 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f7714004b80 con 0x7f7724157780 2026-02-24T19:23:53.570 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.568+0000 7f77127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:53.570 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.568+0000 7f77127fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:53.570 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.568+0000 7f7713fff640 4 set_mon_vals no callback set 2026-02-24T19:23:53.570 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.568+0000 7f77127fc640 10 monclient: dump: 2026-02-24T19:23:53.570 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:53.570 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:53.570 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.570 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.571 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:53.571 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:53.571 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:53.571 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:53.571 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:53.571 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.572 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.569+0000 7f77127fc640 1 -- 10.20.193.14:0/2089394515 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f771401d9f0 con 0x7f7724157780 2026-02-24T19:23:53.572 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.569+0000 7f7729737640 10 monclient: get_auth_request con 0x7f76f4077ef0 auth_method 0 2026-02-24T19:23:53.572 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.569+0000 7f77127fc640 10 client.30879.objecter ms_handle_connect 0x7f76f4077ef0 2026-02-24T19:23:53.578 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.576+0000 7f77127fc640 1 -- 10.20.193.14:0/2089394515 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7f7714093170 con 0x7f7724157780 2026-02-24T19:23:53.578 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.576+0000 7f77127fc640 10 client.30879.objecter ms_dispatch2 0x7f7724000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:23:53.578 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.576+0000 7f77127fc640 3 client.30879.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:23:53.579 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.576+0000 7f77127fc640 3 client.30879.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:23:53.579 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.577+0000 7f77127fc640 20 client.30879.objecter dump_active .. 0 homeless 2026-02-24T19:23:53.579 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.577+0000 7f77127fc640 1 -- 10.20.193.14:0/2089394515 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f771405dba0 con 0x7f7724157780 2026-02-24T19:23:53.579 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.577+0000 7f77127fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:53.579 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.577+0000 7f77127fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:23:53.689 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.688+0000 7f772c1c3640 1 -- 10.20.193.14:0/2089394515 --> v1:10.20.193.14:6800/4014096310 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f7724056940 con 0x7f76f4077ef0 2026-02-24T19:23:53.690 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.688+0000 7f77127fc640 1 -- 10.20.193.14:0/2089394515 <== mgr.4110 v1:10.20.193.14:6800/4014096310 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (unknown 3526570807 0 0) 0x7f77180056e0 con 0x7f76f4077ef0 2026-02-24T19:23:53.690 INFO:teuthology.orchestra.run.trial014.stderr:instructed osd(s) 3 to deep-scrub 2026-02-24T19:23:53.692 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.690+0000 7f772c1c3640 10 librados: watch_flush enter 2026-02-24T19:23:53.692 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.690+0000 7f772c1c3640 10 librados: watch_flush exit 2026-02-24T19:23:53.692 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.690+0000 7f772c1c3640 20 client.30879.objecter shutdown clearing up homeless session... 2026-02-24T19:23:53.692 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.690+0000 7f772c1c3640 10 client.30879.objecter successfully canceled tick 2026-02-24T19:23:53.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.690+0000 7f772c1c3640 1 -- 10.20.193.14:0/2089394515 >> v1:10.20.193.14:6800/4014096310 conn(0x7f76f4077ef0 legacy=0x7f76f40983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:53.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.690+0000 7f772c1c3640 10 monclient: shutdown 2026-02-24T19:23:53.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.690+0000 7f772c1c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:53.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.690+0000 7f772c1c3640 1 -- 10.20.193.14:0/2089394515 >> v1:10.20.193.14:6789/0 conn(0x7f7724157780 legacy=0x7f7724131880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:53.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.690+0000 7f772c1c3640 1 -- 10.20.193.14:0/2089394515 shutdown_connections 2026-02-24T19:23:53.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.690+0000 7f772c1c3640 1 -- 10.20.193.14:0/2089394515 >> 10.20.193.14:0/2089394515 conn(0x7f77240b2ef0 msgr2=0x7f77240ad970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:53.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.690+0000 7f772c1c3640 1 -- 10.20.193.14:0/2089394515 shutdown_connections 2026-02-24T19:23:53.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.690+0000 7f772c1c3640 1 -- 10.20.193.14:0/2089394515 wait complete. 2026-02-24T19:23:53.693 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.690+0000 7f772c1c3640 1 librados: shutdown 2026-02-24T19:23:53.701 INFO:tasks.ceph:Scrubbing osd.7 2026-02-24T19:23:53.701 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:23:53.771 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.770+0000 7f60a2313640 10 monclient: get_monmap_and_config 2026-02-24T19:23:53.772 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.770+0000 7f60a2313640 10 monclient: build_initial_monmap 2026-02-24T19:23:53.772 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.770+0000 7f60a2313640 10 monclient: monmap: 2026-02-24T19:23:53.772 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:53.772 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:53.772 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:23:53.770895+0000 2026-02-24T19:23:53.772 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:23:53.770895+0000 2026-02-24T19:23:53.772 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:53.772 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:53.772 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:53.772 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:53.773 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:53.773 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.774 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.770+0000 7f60a2313640 1 Processor -- start 2026-02-24T19:23:53.774 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.770+0000 7f60a2313640 1 -- start start 2026-02-24T19:23:53.774 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.770+0000 7f60a2313640 10 monclient: init 2026-02-24T19:23:53.774 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.771+0000 7f60a2313640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:53.774 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.771+0000 7f60a2313640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:23:53.774 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.771+0000 7f60a2313640 10 monclient(hunting): picked mon.noname-a con 0x7f609c15d1c0 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:53.775 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.771+0000 7f60a2313640 10 monclient(hunting): picked mon.noname-c con 0x7f609c0b8330 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:53.775 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.771+0000 7f60a2313640 10 monclient(hunting): picked mon.noname-b con 0x7f609c0b5d10 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:53.775 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.771+0000 7f60a2313640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f609c15d590 con 0x7f609c15d1c0 2026-02-24T19:23:53.775 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.771+0000 7f60a2313640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f609c052650 con 0x7f609c0b5d10 2026-02-24T19:23:53.775 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.771+0000 7f60a2313640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f609c163ec0 con 0x7f609c0b8330 2026-02-24T19:23:53.775 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.771+0000 7f60a2313640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:53.775 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.771+0000 7f60a2313640 10 monclient(hunting): authenticate will time out at 4008.452484s 2026-02-24T19:23:53.775 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.771+0000 7f609bfff640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f609c15d1c0 0x7f609c059d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:51086/0 (socket says 10.20.193.14:51086) 2026-02-24T19:23:53.775 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.771+0000 7f609bfff640 1 -- 10.20.193.14:0/3150290459 learned_addr learned my addr 10.20.193.14:0/3150290459 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:53.779 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.773+0000 7f609affd640 1 -- 10.20.193.14:0/3150290459 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3104937986 0 0) 0x7f609c052650 con 0x7f609c0b5d10 2026-02-24T19:23:53.779 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.773+0000 7f609affd640 10 monclient(hunting): _negotiate 2026-02-24T19:23:53.779 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.773+0000 7f609affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:53.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.773+0000 7f609affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:53.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.773+0000 7f609affd640 10 monclient(hunting): my global_id is 29197 2026-02-24T19:23:53.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.773+0000 7f609affd640 1 -- 10.20.193.14:0/3150290459 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6080003610 con 0x7f609c0b5d10 2026-02-24T19:23:53.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.773+0000 7f609affd640 1 -- 10.20.193.14:0/3150290459 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3462595020 0 0) 0x7f609c15d590 con 0x7f609c15d1c0 2026-02-24T19:23:53.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.773+0000 7f609affd640 10 monclient(hunting): _negotiate 2026-02-24T19:23:53.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.773+0000 7f609affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:53.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.773+0000 7f609affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:53.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.773+0000 7f609affd640 10 monclient(hunting): my global_id is 30882 2026-02-24T19:23:53.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.773+0000 7f609affd640 1 -- 10.20.193.14:0/3150290459 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f609c052650 con 0x7f609c15d1c0 2026-02-24T19:23:53.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.773+0000 7f609affd640 1 -- 10.20.193.14:0/3150290459 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2543329170 0 0) 0x7f609c163ec0 con 0x7f609c0b8330 2026-02-24T19:23:53.780 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.773+0000 7f609affd640 10 monclient(hunting): _negotiate 2026-02-24T19:23:53.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.773+0000 7f609affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:53.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.773+0000 7f609affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:53.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.773+0000 7f609affd640 10 monclient(hunting): my global_id is 28835 2026-02-24T19:23:53.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.773+0000 7f609affd640 1 -- 10.20.193.14:0/3150290459 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f609c15d590 con 0x7f609c0b8330 2026-02-24T19:23:53.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.774+0000 7f609affd640 1 -- 10.20.193.14:0/3150290459 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3420407322 0 0) 0x7f6080003610 con 0x7f609c0b5d10 2026-02-24T19:23:53.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.774+0000 7f609affd640 1 -- 10.20.193.14:0/3150290459 >> v1:10.20.193.170:6789/0 conn(0x7f609c0b8330 legacy=0x7f609c05a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:53.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.774+0000 7f609affd640 1 -- 10.20.193.14:0/3150290459 >> v1:10.20.193.14:6789/0 conn(0x7f609c15d1c0 legacy=0x7f609c059d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:53.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.774+0000 7f609affd640 10 monclient: _finish_hunting 0 2026-02-24T19:23:53.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.774+0000 7f609affd640 1 monclient: found mon.noname-b 2026-02-24T19:23:53.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.774+0000 7f609affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:53.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.774+0000 7f609affd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.44:6789/0 2026-02-24T19:23:53.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.774+0000 7f609affd640 1 -- 10.20.193.14:0/3150290459 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f609c057a50 con 0x7f609c0b5d10 2026-02-24T19:23:53.781 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.774+0000 7f609affd640 10 monclient: _finish_auth 0 2026-02-24T19:23:53.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.774+0000 7f609affd640 10 monclient: _check_auth_tickets 2026-02-24T19:23:53.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.774+0000 7f609affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:53.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.774+0000 7f609affd640 1 -- 10.20.193.14:0/3150290459 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f6090003170 con 0x7f609c0b5d10 2026-02-24T19:23:53.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.774+0000 7f609affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:53.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.774+0000 7f609affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:23:53.782 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.774+0000 7f609affd640 10 monclient: dump: 2026-02-24T19:23:53.782 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:53.782 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:53.782 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.782 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.782 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:53.782 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:53.782 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:53.783 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:53.783 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:53.783 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.774+0000 7f60a2313640 5 monclient: authenticate success, global_id 29197 2026-02-24T19:23:53.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.774+0000 7f60a2313640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:53.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.775+0000 7f609affd640 1 -- 10.20.193.14:0/3150290459 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6090003340 con 0x7f609c0b5d10 2026-02-24T19:23:53.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.775+0000 7f609affd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:53.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.775+0000 7f609affd640 1 -- 10.20.193.14:0/3150290459 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f6090003780 con 0x7f609c0b5d10 2026-02-24T19:23:53.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.775+0000 7f609affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:53.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.775+0000 7f609affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:53.783 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.775+0000 7f609affd640 10 monclient: dump: 2026-02-24T19:23:53.783 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:53.783 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:53.784 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.784 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.784 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:53.784 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:53.784 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:53.784 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:53.784 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:53.784 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.775+0000 7f60a2313640 10 monclient: get_monmap_and_config success 2026-02-24T19:23:53.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.775+0000 7f60a2313640 4 set_mon_vals no callback set 2026-02-24T19:23:53.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.776+0000 7f60a2313640 10 monclient: shutdown 2026-02-24T19:23:53.784 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.776+0000 7f60a2313640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:53.785 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.776+0000 7f60a2313640 1 -- 10.20.193.14:0/3150290459 >> v1:10.20.193.44:6789/0 conn(0x7f609c0b5d10 legacy=0x7f609c1c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:53.785 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.776+0000 7f60a2313640 1 -- 10.20.193.14:0/3150290459 shutdown_connections 2026-02-24T19:23:53.785 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.776+0000 7f60a2313640 1 -- 10.20.193.14:0/3150290459 >> 10.20.193.14:0/3150290459 conn(0x7f609c0b5200 msgr2=0x7f609c0b5600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:53.785 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.776+0000 7f60a2313640 1 -- 10.20.193.14:0/3150290459 shutdown_connections 2026-02-24T19:23:53.785 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.776+0000 7f60a2313640 1 -- 10.20.193.14:0/3150290459 wait complete. 2026-02-24T19:23:53.785 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.776+0000 7f60a2313640 10 monclient: build_initial_monmap 2026-02-24T19:23:53.785 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.776+0000 7f60a2313640 10 monclient: monmap: 2026-02-24T19:23:53.785 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:53.785 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:23:53.785 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:23:53.785 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:23:53.785 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:53.785 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:23:53.786 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:53.786 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:53.786 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:53.786 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.786 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.776+0000 7f60a2313640 1 librados: starting msgr at 2026-02-24T19:23:53.786 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.776+0000 7f60a2313640 1 librados: starting objecter 2026-02-24T19:23:53.786 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.776+0000 7f60a2313640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:23:53.786 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.776+0000 7f60a2313640 1 Processor -- start 2026-02-24T19:23:53.786 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.776+0000 7f60a2313640 1 -- start start 2026-02-24T19:23:53.786 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.776+0000 7f60a2313640 1 librados: setting wanted keys 2026-02-24T19:23:53.786 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.776+0000 7f60a2313640 1 librados: calling monclient init 2026-02-24T19:23:53.786 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.776+0000 7f60a2313640 10 monclient: init 2026-02-24T19:23:53.786 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.777+0000 7f60a2313640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:53.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.777+0000 7f60a2313640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:23:53.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.777+0000 7f60a2313640 10 monclient(hunting): picked mon.noname-c con 0x7f609c0b5d10 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:53.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.777+0000 7f60a2313640 10 monclient(hunting): picked mon.noname-a con 0x7f609c0b8330 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:53.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.777+0000 7f60a2313640 10 monclient(hunting): picked mon.noname-b con 0x7f609c15d1c0 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:53.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.777+0000 7f60a2313640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f609c162a60 con 0x7f609c0b8330 2026-02-24T19:23:53.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.777+0000 7f60a2313640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f609c160fd0 con 0x7f609c15d1c0 2026-02-24T19:23:53.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.777+0000 7f60a2313640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f609c1612b0 con 0x7f609c0b5d10 2026-02-24T19:23:53.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.777+0000 7f60a2313640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:53.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.777+0000 7f60a2313640 10 monclient(hunting): authenticate will time out at 4008.458288s 2026-02-24T19:23:53.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.777+0000 7f609bfff640 1 --1- >> v1:10.20.193.170:6789/0 conn(0x7f609c0b5d10 0x7f609c152630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.170:6789/0 says I am v1:10.20.193.14:48402/0 (socket says 10.20.193.14:48402) 2026-02-24T19:23:53.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.777+0000 7f609bfff640 1 -- 10.20.193.14:0/1764823692 learned_addr learned my addr 10.20.193.14:0/1764823692 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:53.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.777+0000 7f6098ff9640 10 client.?.objecter ms_handle_connect 0x7f609c0b5d10 2026-02-24T19:23:53.787 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.777+0000 7f6098ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:53.788 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.778+0000 7f6098ff9640 10 client.?.objecter ms_handle_connect 0x7f609c15d1c0 2026-02-24T19:23:53.788 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.778+0000 7f6098ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:53.788 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.778+0000 7f6098ff9640 10 client.?.objecter ms_handle_connect 0x7f609c0b8330 2026-02-24T19:23:53.788 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.778+0000 7f6098ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:53.791 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.778+0000 7f6098ff9640 1 -- 10.20.193.14:0/1764823692 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1931965651 0 0) 0x7f609c1612b0 con 0x7f609c0b5d10 2026-02-24T19:23:53.791 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.778+0000 7f6098ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:23:53.791 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.778+0000 7f6098ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:53.791 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.778+0000 7f6098ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:53.792 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.778+0000 7f6098ff9640 10 monclient(hunting): my global_id is 28838 2026-02-24T19:23:53.792 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.778+0000 7f6098ff9640 1 -- 10.20.193.14:0/1764823692 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f606c003610 con 0x7f609c0b5d10 2026-02-24T19:23:53.792 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.778+0000 7f6098ff9640 1 -- 10.20.193.14:0/1764823692 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4268098706 0 0) 0x7f609c160fd0 con 0x7f609c15d1c0 2026-02-24T19:23:53.792 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.778+0000 7f6098ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:23:53.792 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.778+0000 7f6098ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:53.792 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.778+0000 7f6098ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:53.792 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.778+0000 7f6098ff9640 10 monclient(hunting): my global_id is 29200 2026-02-24T19:23:53.792 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.779+0000 7f6098ff9640 1 -- 10.20.193.14:0/1764823692 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f609c1612b0 con 0x7f609c15d1c0 2026-02-24T19:23:53.792 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.779+0000 7f6098ff9640 1 -- 10.20.193.14:0/1764823692 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 952988334 0 0) 0x7f609c162a60 con 0x7f609c0b8330 2026-02-24T19:23:53.792 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.779+0000 7f6098ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:23:53.792 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.779+0000 7f6098ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:53.792 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.779+0000 7f6098ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:53.793 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.779+0000 7f6098ff9640 10 monclient(hunting): my global_id is 30885 2026-02-24T19:23:53.793 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.779+0000 7f6098ff9640 1 -- 10.20.193.14:0/1764823692 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f609c160fd0 con 0x7f609c0b8330 2026-02-24T19:23:53.793 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.781+0000 7f6098ff9640 1 -- 10.20.193.14:0/1764823692 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 980426068 0 0) 0x7f609c1612b0 con 0x7f609c15d1c0 2026-02-24T19:23:53.793 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.781+0000 7f6098ff9640 1 -- 10.20.193.14:0/1764823692 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f609c162a60 con 0x7f609c15d1c0 2026-02-24T19:23:53.793 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.781+0000 7f6098ff9640 1 -- 10.20.193.14:0/1764823692 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f60900034f0 con 0x7f609c15d1c0 2026-02-24T19:23:53.793 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.781+0000 7f6098ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:53.793 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.781+0000 7f6098ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:23:53.793 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.781+0000 7f6098ff9640 10 monclient(hunting): dump: 2026-02-24T19:23:53.793 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:53.793 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:53.793 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.793 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.794 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:53.794 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:53.794 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:53.794 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:53.794 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:53.794 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.781+0000 7f6098ff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:23:53.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.781+0000 7f6098ff9640 1 -- 10.20.193.14:0/1764823692 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1193072570 0 0) 0x7f606c003610 con 0x7f609c0b5d10 2026-02-24T19:23:53.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.781+0000 7f6098ff9640 1 -- 10.20.193.14:0/1764823692 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f609c1612b0 con 0x7f609c0b5d10 2026-02-24T19:23:53.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.781+0000 7f6098ff9640 1 -- 10.20.193.14:0/1764823692 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f60880030d0 con 0x7f609c0b5d10 2026-02-24T19:23:53.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.781+0000 7f6098ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:53.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.781+0000 7f6098ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:53.794 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.781+0000 7f6098ff9640 10 monclient(hunting): dump: 2026-02-24T19:23:53.795 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:53.795 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:53.795 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.795 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.795 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:53.795 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:53.795 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:53.795 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:53.795 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:53.795 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.795 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.782+0000 7f6098ff9640 1 -- 10.20.193.14:0/1764823692 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 467510060 0 0) 0x7f609c160fd0 con 0x7f609c0b8330 2026-02-24T19:23:53.795 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.782+0000 7f6098ff9640 1 -- 10.20.193.14:0/1764823692 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f606c003610 con 0x7f609c0b8330 2026-02-24T19:23:53.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.782+0000 7f6098ff9640 1 -- 10.20.193.14:0/1764823692 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f608c003090 con 0x7f609c0b8330 2026-02-24T19:23:53.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.782+0000 7f6098ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:53.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.782+0000 7f6098ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:53.796 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.782+0000 7f6098ff9640 10 monclient(hunting): dump: 2026-02-24T19:23:53.796 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:53.796 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:53.796 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.796 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.796 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:53.796 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:53.796 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:53.796 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:53.796 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:53.797 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.782+0000 7f6098ff9640 1 -- 10.20.193.14:0/1764823692 <== mon.1 v1:10.20.193.44:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 106776947 0 0) 0x7f609c162a60 con 0x7f609c15d1c0 2026-02-24T19:23:53.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.782+0000 7f6098ff9640 1 -- 10.20.193.14:0/1764823692 >> v1:10.20.193.170:6789/0 conn(0x7f609c0b5d10 legacy=0x7f609c152630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:53.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.782+0000 7f6098ff9640 1 -- 10.20.193.14:0/1764823692 >> v1:10.20.193.14:6789/0 conn(0x7f609c0b8330 legacy=0x7f609c162350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:53.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.782+0000 7f6098ff9640 10 monclient: _finish_hunting 0 2026-02-24T19:23:53.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.782+0000 7f6098ff9640 1 monclient: found mon.b 2026-02-24T19:23:53.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.782+0000 7f6098ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:53.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.782+0000 7f6098ff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:23:53.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.782+0000 7f6098ff9640 1 -- 10.20.193.14:0/1764823692 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f609c161590 con 0x7f609c15d1c0 2026-02-24T19:23:53.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.782+0000 7f6098ff9640 10 monclient: _finish_auth 0 2026-02-24T19:23:53.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.782+0000 7f6098ff9640 10 monclient: _check_auth_tickets 2026-02-24T19:23:53.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.782+0000 7f6098ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:53.797 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.782+0000 7f60a2313640 5 monclient: authenticate success, global_id 29200 2026-02-24T19:23:53.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.782+0000 7f60a2313640 10 monclient: _renew_subs 2026-02-24T19:23:53.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.782+0000 7f60a2313640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:23:53.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.782+0000 7f60a2313640 1 -- 10.20.193.14:0/1764823692 --> v1:10.20.193.44:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f609c161870 con 0x7f609c15d1c0 2026-02-24T19:23:53.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.783+0000 7f60a2313640 10 client.29200.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:53.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.783+0000 7f60a2313640 10 monclient: _renew_subs 2026-02-24T19:23:53.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.783+0000 7f60a2313640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:23:53.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.783+0000 7f60a2313640 1 -- 10.20.193.14:0/1764823692 --> v1:10.20.193.44:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f609c161e30 con 0x7f609c15d1c0 2026-02-24T19:23:53.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.783+0000 7f60a2313640 1 librados: init done 2026-02-24T19:23:53.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.783+0000 7f60a2313640 10 client.29200.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:53.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.783+0000 7f60a2313640 15 client.29200.objecter _session_command_op_assign -1 1 2026-02-24T19:23:53.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.783+0000 7f60a2313640 20 client.29200.objecter _get_session osd=-1 returning homeless 2026-02-24T19:23:53.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.783+0000 7f60a2313640 10 client.29200.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:53.798 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.783+0000 7f60a2313640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:23:53.799 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.783+0000 7f60a2313640 1 -- 10.20.193.14:0/1764823692 --> v1:10.20.193.44:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f609c1fe490 con 0x7f609c15d1c0 2026-02-24T19:23:53.800 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.791+0000 7f6098ff9640 1 -- 10.20.193.14:0/1764823692 <== mon.1 v1:10.20.193.44:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f609c1fe490 con 0x7f609c15d1c0 2026-02-24T19:23:53.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.791+0000 7f6098ff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:53.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.791+0000 7f6098ff9640 1 -- 10.20.193.14:0/1764823692 <== mon.1 v1:10.20.193.44:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f60900032f0 con 0x7f609c15d1c0 2026-02-24T19:23:53.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.791+0000 7f6098ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:53.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.791+0000 7f6098ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:53.801 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.791+0000 7f6098ff9640 10 monclient: dump: 2026-02-24T19:23:53.801 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:53.801 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:53.801 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.801 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.801 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:53.801 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:53.801 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:53.802 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:53.802 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:53.802 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.791+0000 7f609a7fc640 4 set_mon_vals no callback set 2026-02-24T19:23:53.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.791+0000 7f6098ff9640 1 -- 10.20.193.14:0/1764823692 <== mon.1 v1:10.20.193.44:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f609001c9b0 con 0x7f609c15d1c0 2026-02-24T19:23:53.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.792+0000 7f609bfff640 10 monclient: get_auth_request con 0x7f606c077e10 auth_method 0 2026-02-24T19:23:53.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.792+0000 7f6098ff9640 10 client.29200.objecter ms_handle_connect 0x7f606c077e10 2026-02-24T19:23:53.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.792+0000 7f6098ff9640 1 -- 10.20.193.14:0/1764823692 <== mon.1 v1:10.20.193.44:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7f6090092190 con 0x7f609c15d1c0 2026-02-24T19:23:53.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.792+0000 7f6098ff9640 10 client.29200.objecter ms_dispatch2 0x7f609c000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:23:53.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.792+0000 7f6098ff9640 3 client.29200.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:23:53.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.792+0000 7f6098ff9640 3 client.29200.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:23:53.802 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.792+0000 7f6098ff9640 10 client.29200.objecter checking command 1 2026-02-24T19:23:53.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.792+0000 7f6098ff9640 20 client.29200.objecter _get_session s=0x7f606c0a20d0 osd=7 3 2026-02-24T19:23:53.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.792+0000 7f6098ff9640 20 client.29200.objecter put_session s=0x7f606c0a20d0 osd=7 3 2026-02-24T19:23:53.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.792+0000 7f6098ff9640 15 client.29200.objecter _session_command_op_remove -1 1 2026-02-24T19:23:53.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.792+0000 7f6098ff9640 20 client.29200.objecter _get_session s=0x7f606c0a20d0 osd=7 3 2026-02-24T19:23:53.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.792+0000 7f6098ff9640 20 client.29200.objecter get_session s=0x7f606c0a20d0 osd=7 3 2026-02-24T19:23:53.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.792+0000 7f6098ff9640 15 client.29200.objecter _session_command_op_assign 7 1 2026-02-24T19:23:53.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.792+0000 7f6098ff9640 20 client.29200.objecter put_session s=0x7f606c0a20d0 osd=7 4 2026-02-24T19:23:53.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.792+0000 7f6098ff9640 10 client.29200.objecter _send_command 1 2026-02-24T19:23:53.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.792+0000 7f6098ff9640 1 -- 10.20.193.14:0/1764823692 --> v1:10.20.193.195:6808/798109025 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6090002bf0 con 0x7f606c0a2780 2026-02-24T19:23:53.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.792+0000 7f6098ff9640 20 client.29200.objecter dump_active .. 0 homeless 2026-02-24T19:23:53.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.793+0000 7f609b7fe640 10 monclient: get_auth_request con 0x7f606c0a2780 auth_method 0 2026-02-24T19:23:53.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.793+0000 7f6098ff9640 1 -- 10.20.193.14:0/1764823692 <== mon.1 v1:10.20.193.44:6789/0 9 ==== mon_get_version_reply(handle=1 version=354) ==== 24+0+0 (unknown 31317031 0 0) 0x7f609005c290 con 0x7f609c15d1c0 2026-02-24T19:23:53.803 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.793+0000 7f6098ff9640 10 monclient: handle_get_version_reply finishing 1 version 354 2026-02-24T19:23:53.804 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.794+0000 7f6098ff9640 10 client.29200.objecter ms_handle_connect 0x7f606c0a2780 2026-02-24T19:23:53.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.803+0000 7f6098ff9640 1 -- 10.20.193.14:0/1764823692 <== osd.7 v1:10.20.193.195:6808/798109025 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f6090002bf0 con 0x7f606c0a2780 2026-02-24T19:23:53.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.803+0000 7f6098ff9640 10 client.29200.objecter ms_dispatch2 0x7f609c000b90 command_reply(tid 1: 0 ) 2026-02-24T19:23:53.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.803+0000 7f6098ff9640 10 client.29200.objecter _finish_command 1 = system:0 2026-02-24T19:23:53.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.803+0000 7f6098ff9640 20 client.29200.objecter put_session s=0x7f606c0a20d0 osd=7 4 2026-02-24T19:23:53.805 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.803+0000 7f6098ff9640 15 client.29200.objecter _session_command_op_remove 7 1 2026-02-24T19:23:53.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.810+0000 7f60a2313640 10 client.29200.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:23:53.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.810+0000 7f60a2313640 15 client.29200.objecter _session_command_op_assign -1 2 2026-02-24T19:23:53.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.810+0000 7f60a2313640 20 client.29200.objecter _get_session s=0x7f606c0a20d0 osd=7 3 2026-02-24T19:23:53.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.810+0000 7f60a2313640 20 client.29200.objecter put_session s=0x7f606c0a20d0 osd=7 3 2026-02-24T19:23:53.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.810+0000 7f60a2313640 20 client.29200.objecter _get_session s=0x7f606c0a20d0 osd=7 3 2026-02-24T19:23:53.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.810+0000 7f60a2313640 15 client.29200.objecter _session_command_op_remove -1 2 2026-02-24T19:23:53.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.810+0000 7f60a2313640 20 client.29200.objecter get_session s=0x7f606c0a20d0 osd=7 3 2026-02-24T19:23:53.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.810+0000 7f60a2313640 15 client.29200.objecter _session_command_op_assign 7 2 2026-02-24T19:23:53.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.810+0000 7f60a2313640 20 client.29200.objecter put_session s=0x7f606c0a20d0 osd=7 4 2026-02-24T19:23:53.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.810+0000 7f60a2313640 10 client.29200.objecter _send_command 2 2026-02-24T19:23:53.812 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.810+0000 7f60a2313640 1 -- 10.20.193.14:0/1764823692 --> v1:10.20.193.195:6808/798109025 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f609c056530 con 0x7f606c0a2780 2026-02-24T19:23:53.819 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.817+0000 7f6098ff9640 1 -- 10.20.193.14:0/1764823692 <== osd.7 v1:10.20.193.195:6808/798109025 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f609c056530 con 0x7f606c0a2780 2026-02-24T19:23:53.819 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.817+0000 7f6098ff9640 10 client.29200.objecter ms_dispatch2 0x7f609c000b90 command_reply(tid 2: 0 ) 2026-02-24T19:23:53.819 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.817+0000 7f6098ff9640 10 client.29200.objecter _finish_command 2 = system:0 2026-02-24T19:23:53.819 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.817+0000 7f6098ff9640 20 client.29200.objecter put_session s=0x7f606c0a20d0 osd=7 4 2026-02-24T19:23:53.819 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.817+0000 7f6098ff9640 15 client.29200.objecter _session_command_op_remove 7 2 2026-02-24T19:23:53.820 INFO:teuthology.orchestra.run.trial014.stdout:{ 2026-02-24T19:23:53.820 INFO:teuthology.orchestra.run.trial014.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:23:53.820 INFO:teuthology.orchestra.run.trial014.stdout:} 2026-02-24T19:23:53.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.818+0000 7f60a2313640 10 librados: watch_flush enter 2026-02-24T19:23:53.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.818+0000 7f60a2313640 10 librados: watch_flush exit 2026-02-24T19:23:53.821 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.818+0000 7f60a2313640 10 client.29200.objecter close_session for osd.7 2026-02-24T19:23:53.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.818+0000 7f60a2313640 1 -- 10.20.193.14:0/1764823692 >> v1:10.20.193.195:6808/798109025 conn(0x7f606c0a2780 legacy=0x7f606c0c2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:53.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.818+0000 7f60a2313640 20 client.29200.objecter put_session s=0x7f606c0a20d0 osd=7 1 2026-02-24T19:23:53.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.818+0000 7f60a2313640 20 client.29200.objecter shutdown clearing up homeless session... 2026-02-24T19:23:53.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.818+0000 7f60a2313640 10 client.29200.objecter successfully canceled tick 2026-02-24T19:23:53.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.818+0000 7f60a2313640 1 -- 10.20.193.14:0/1764823692 >> v1:10.20.193.14:6800/4014096310 conn(0x7f606c077e10 legacy=0x7f606c0982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:53.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.818+0000 7f60a2313640 10 monclient: shutdown 2026-02-24T19:23:53.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.818+0000 7f60a2313640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:53.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.818+0000 7f60a2313640 1 -- 10.20.193.14:0/1764823692 >> v1:10.20.193.44:6789/0 conn(0x7f609c15d1c0 legacy=0x7f609c1fe6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:53.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.818+0000 7f60a0889640 1 -- 10.20.193.14:0/1764823692 reap_dead start 2026-02-24T19:23:53.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.818+0000 7f60a2313640 1 -- 10.20.193.14:0/1764823692 shutdown_connections 2026-02-24T19:23:53.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.818+0000 7f60a2313640 1 -- 10.20.193.14:0/1764823692 >> 10.20.193.14:0/1764823692 conn(0x7f609c0b5200 msgr2=0x7f609c0b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:53.822 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.818+0000 7f60a2313640 1 -- 10.20.193.14:0/1764823692 shutdown_connections 2026-02-24T19:23:53.823 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.818+0000 7f60a2313640 1 -- 10.20.193.14:0/1764823692 wait complete. 2026-02-24T19:23:53.823 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.818+0000 7f60a2313640 1 librados: shutdown 2026-02-24T19:23:53.827 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2026-02-24T19:23:53.896 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.895+0000 7fc6f3ffa640 10 monclient: get_monmap_and_config 2026-02-24T19:23:53.896 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.895+0000 7fc6f3ffa640 10 monclient: build_initial_monmap 2026-02-24T19:23:53.897 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.895+0000 7fc6f3ffa640 10 monclient: monmap: 2026-02-24T19:23:53.897 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:53.897 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:53.897 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:23:53.895731+0000 2026-02-24T19:23:53.897 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:23:53.895731+0000 2026-02-24T19:23:53.897 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:53.897 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:53.897 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:53.897 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:53.897 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:53.897 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.899 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.895+0000 7fc6f3ffa640 1 Processor -- start 2026-02-24T19:23:53.899 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.895+0000 7fc6f3ffa640 1 -- start start 2026-02-24T19:23:53.899 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.895+0000 7fc6f3ffa640 10 monclient: init 2026-02-24T19:23:53.899 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.896+0000 7fc6f3ffa640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:53.899 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.896+0000 7fc6f3ffa640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:23:53.899 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.896+0000 7fc6f3ffa640 10 monclient(hunting): picked mon.noname-a con 0x7fc6ec0b9f80 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:53.899 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.896+0000 7fc6f3ffa640 10 monclient(hunting): picked mon.noname-c con 0x7fc6ec0ba350 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:53.899 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.896+0000 7fc6f3ffa640 10 monclient(hunting): picked mon.noname-b con 0x7fc6ec0585e0 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:53.900 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.896+0000 7fc6f3ffa640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6ec163930 con 0x7fc6ec0b9f80 2026-02-24T19:23:53.900 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.896+0000 7fc6f3ffa640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6ec163bb0 con 0x7fc6ec0585e0 2026-02-24T19:23:53.900 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.896+0000 7fc6f3ffa640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6ec163e90 con 0x7fc6ec0ba350 2026-02-24T19:23:53.900 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.896+0000 7fc6f3ffa640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:53.900 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.896+0000 7fc6f3ffa640 10 monclient(hunting): authenticate will time out at 4008.577145s 2026-02-24T19:23:53.900 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.896+0000 7fc6f1d6f640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7fc6ec0b9f80 0x7fc6ec163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:51096/0 (socket says 10.20.193.14:51096) 2026-02-24T19:23:53.900 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.896+0000 7fc6f1d6f640 1 -- 10.20.193.14:0/4192950325 learned_addr learned my addr 10.20.193.14:0/4192950325 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:53.904 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.898+0000 7fc6f0d6d640 1 -- 10.20.193.14:0/4192950325 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2464839223 0 0) 0x7fc6dc002910 con 0x7fc6ec0b9f80 2026-02-24T19:23:53.904 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.898+0000 7fc6f0d6d640 10 monclient(hunting): _negotiate 2026-02-24T19:23:53.905 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.898+0000 7fc6f0d6d640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:53.905 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.898+0000 7fc6f0d6d640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:53.905 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.898+0000 7fc6f0d6d640 10 monclient(hunting): my global_id is 30888 2026-02-24T19:23:53.905 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.898+0000 7fc6f0d6d640 1 -- 10.20.193.14:0/4192950325 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6d4003610 con 0x7fc6ec0b9f80 2026-02-24T19:23:53.905 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.898+0000 7fc6f0d6d640 1 -- 10.20.193.14:0/4192950325 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2146012921 0 0) 0x7fc6ec163e90 con 0x7fc6ec0ba350 2026-02-24T19:23:53.905 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.898+0000 7fc6f0d6d640 10 monclient(hunting): _negotiate 2026-02-24T19:23:53.905 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.898+0000 7fc6f0d6d640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:53.905 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.898+0000 7fc6f0d6d640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:53.905 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.898+0000 7fc6f0d6d640 10 monclient(hunting): my global_id is 28841 2026-02-24T19:23:53.905 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.898+0000 7fc6f0d6d640 1 -- 10.20.193.14:0/4192950325 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6dc002910 con 0x7fc6ec0ba350 2026-02-24T19:23:53.905 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.898+0000 7fc6f0d6d640 1 -- 10.20.193.14:0/4192950325 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 36942786 0 0) 0x7fc6ec163bb0 con 0x7fc6ec0585e0 2026-02-24T19:23:53.905 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.898+0000 7fc6f0d6d640 10 monclient(hunting): _negotiate 2026-02-24T19:23:53.906 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.898+0000 7fc6f0d6d640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:53.906 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.898+0000 7fc6f0d6d640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:53.906 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.898+0000 7fc6f0d6d640 10 monclient(hunting): my global_id is 29203 2026-02-24T19:23:53.906 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.898+0000 7fc6f0d6d640 1 -- 10.20.193.14:0/4192950325 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6ec163e90 con 0x7fc6ec0585e0 2026-02-24T19:23:53.906 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.899+0000 7fc6f0d6d640 1 -- 10.20.193.14:0/4192950325 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3610422276 0 0) 0x7fc6dc002910 con 0x7fc6ec0ba350 2026-02-24T19:23:53.906 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.899+0000 7fc6f0d6d640 1 -- 10.20.193.14:0/4192950325 >> v1:10.20.193.44:6789/0 conn(0x7fc6ec0585e0 legacy=0x7fc6ec166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:53.906 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.899+0000 7fc6f0d6d640 1 -- 10.20.193.14:0/4192950325 >> v1:10.20.193.14:6789/0 conn(0x7fc6ec0b9f80 legacy=0x7fc6ec163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:53.906 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.899+0000 7fc6f0d6d640 10 monclient: _finish_hunting 0 2026-02-24T19:23:53.906 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.899+0000 7fc6f0d6d640 1 monclient: found mon.noname-c 2026-02-24T19:23:53.906 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.899+0000 7fc6f0d6d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:53.906 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.899+0000 7fc6f0d6d640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.170:6789/0 2026-02-24T19:23:53.906 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.899+0000 7fc6f0d6d640 1 -- 10.20.193.14:0/4192950325 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6ec0573f0 con 0x7fc6ec0ba350 2026-02-24T19:23:53.907 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.899+0000 7fc6f0d6d640 10 monclient: _finish_auth 0 2026-02-24T19:23:53.907 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.899+0000 7fc6f0d6d640 10 monclient: _check_auth_tickets 2026-02-24T19:23:53.907 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.899+0000 7fc6f0d6d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:53.907 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.899+0000 7fc6f0d6d640 1 -- 10.20.193.14:0/4192950325 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc6e0002df0 con 0x7fc6ec0ba350 2026-02-24T19:23:53.907 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.899+0000 7fc6f0d6d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:53.907 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.899+0000 7fc6f0d6d640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:23:53.907 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.899+0000 7fc6f0d6d640 10 monclient: dump: 2026-02-24T19:23:53.907 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:53.907 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:53.907 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.907 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.907 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:53.907 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:53.908 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:53.908 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:53.908 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:53.908 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.908 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.899+0000 7fc6f3ffa640 5 monclient: authenticate success, global_id 28841 2026-02-24T19:23:53.908 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.899+0000 7fc6f3ffa640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:53.908 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.900+0000 7fc6f0d6d640 1 -- 10.20.193.14:0/4192950325 <== mon.2 v1:10.20.193.170:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc6e0002fc0 con 0x7fc6ec0ba350 2026-02-24T19:23:53.908 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.900+0000 7fc6f0d6d640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:53.908 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.900+0000 7fc6f0d6d640 1 -- 10.20.193.14:0/4192950325 <== mon.2 v1:10.20.193.170:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc6e0003400 con 0x7fc6ec0ba350 2026-02-24T19:23:53.908 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.900+0000 7fc6f0d6d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:53.908 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.900+0000 7fc6f0d6d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:53.908 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.900+0000 7fc6f0d6d640 10 monclient: dump: 2026-02-24T19:23:53.909 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:53.909 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:53.909 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.909 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.909 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:53.909 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:53.909 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:53.909 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:53.909 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:53.909 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.909 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.900+0000 7fc6f3ffa640 10 monclient: get_monmap_and_config success 2026-02-24T19:23:53.909 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.900+0000 7fc6f3ffa640 4 set_mon_vals no callback set 2026-02-24T19:23:53.909 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.901+0000 7fc6f3ffa640 10 monclient: shutdown 2026-02-24T19:23:53.910 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.901+0000 7fc6f3ffa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:53.910 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.901+0000 7fc6f3ffa640 1 -- 10.20.193.14:0/4192950325 >> v1:10.20.193.170:6789/0 conn(0x7fc6ec0ba350 legacy=0x7fc6ec057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:53.910 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.901+0000 7fc6f3ffa640 1 -- 10.20.193.14:0/4192950325 shutdown_connections 2026-02-24T19:23:53.910 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.901+0000 7fc6f3ffa640 1 -- 10.20.193.14:0/4192950325 >> 10.20.193.14:0/4192950325 conn(0x7fc6ec0b7990 msgr2=0x7fc6ec0b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:53.910 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.901+0000 7fc6f3ffa640 1 -- 10.20.193.14:0/4192950325 shutdown_connections 2026-02-24T19:23:53.910 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.901+0000 7fc6f3ffa640 1 -- 10.20.193.14:0/4192950325 wait complete. 2026-02-24T19:23:53.910 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.901+0000 7fc6f3ffa640 10 monclient: build_initial_monmap 2026-02-24T19:23:53.910 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.901+0000 7fc6f3ffa640 10 monclient: monmap: 2026-02-24T19:23:53.910 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:53.910 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:23:53.910 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:23:53.910 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:23:53.910 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:53.911 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:23:53.911 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:53.911 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:53.911 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:53.911 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.901+0000 7fc6f3ffa640 1 librados: starting msgr at 2026-02-24T19:23:53.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.901+0000 7fc6f3ffa640 1 librados: starting objecter 2026-02-24T19:23:53.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.901+0000 7fc6f3ffa640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:23:53.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.901+0000 7fc6f3ffa640 1 Processor -- start 2026-02-24T19:23:53.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.901+0000 7fc6f3ffa640 1 -- start start 2026-02-24T19:23:53.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.901+0000 7fc6f3ffa640 1 librados: setting wanted keys 2026-02-24T19:23:53.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.901+0000 7fc6f3ffa640 1 librados: calling monclient init 2026-02-24T19:23:53.911 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.901+0000 7fc6f3ffa640 10 monclient: init 2026-02-24T19:23:53.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.902+0000 7fc6f3ffa640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:53.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.902+0000 7fc6f3ffa640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:23:53.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.902+0000 7fc6f3ffa640 10 monclient(hunting): picked mon.noname-c con 0x7fc6ec0585e0 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:53.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.902+0000 7fc6f3ffa640 10 monclient(hunting): picked mon.noname-b con 0x7fc6ec0b9f80 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:53.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.902+0000 7fc6f3ffa640 10 monclient(hunting): picked mon.noname-a con 0x7fc6ec0ba350 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:53.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.902+0000 7fc6f3ffa640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6ec0b4ea0 con 0x7fc6ec0ba350 2026-02-24T19:23:53.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.902+0000 7fc6f3ffa640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6ec0b23b0 con 0x7fc6ec0b9f80 2026-02-24T19:23:53.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.902+0000 7fc6f3ffa640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6ec0b2690 con 0x7fc6ec0585e0 2026-02-24T19:23:53.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.902+0000 7fc6f3ffa640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:53.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.902+0000 7fc6f3ffa640 10 monclient(hunting): authenticate will time out at 4008.583370s 2026-02-24T19:23:53.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.902+0000 7fc6f2570640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7fc6ec0ba350 0x7fc6ec1fe480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:51098/0 (socket says 10.20.193.14:51098) 2026-02-24T19:23:53.912 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.902+0000 7fc6f2570640 1 -- 10.20.193.14:0/2153020547 learned_addr learned my addr 10.20.193.14:0/2153020547 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:53.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.902+0000 7fc6da7fc640 10 client.?.objecter ms_handle_connect 0x7fc6ec0ba350 2026-02-24T19:23:53.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.902+0000 7fc6da7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:53.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.902+0000 7fc6da7fc640 10 client.?.objecter ms_handle_connect 0x7fc6ec0b9f80 2026-02-24T19:23:53.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.902+0000 7fc6da7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:53.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.903+0000 7fc6da7fc640 10 client.?.objecter ms_handle_connect 0x7fc6ec0585e0 2026-02-24T19:23:53.913 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.903+0000 7fc6da7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:53.916 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.903+0000 7fc6da7fc640 1 -- 10.20.193.14:0/2153020547 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1532101655 0 0) 0x7fc6ec0b4ea0 con 0x7fc6ec0ba350 2026-02-24T19:23:53.917 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.903+0000 7fc6da7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:23:53.917 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.903+0000 7fc6da7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:53.917 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.903+0000 7fc6da7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:53.917 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.903+0000 7fc6da7fc640 10 monclient(hunting): my global_id is 30891 2026-02-24T19:23:53.917 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.903+0000 7fc6da7fc640 1 -- 10.20.193.14:0/2153020547 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6bc003610 con 0x7fc6ec0ba350 2026-02-24T19:23:53.917 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.903+0000 7fc6da7fc640 1 -- 10.20.193.14:0/2153020547 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2959039968 0 0) 0x7fc6ec0b23b0 con 0x7fc6ec0b9f80 2026-02-24T19:23:53.917 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.903+0000 7fc6da7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:23:53.917 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.903+0000 7fc6da7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:53.917 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.903+0000 7fc6da7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:53.917 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.903+0000 7fc6da7fc640 10 monclient(hunting): my global_id is 29206 2026-02-24T19:23:53.917 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.903+0000 7fc6da7fc640 1 -- 10.20.193.14:0/2153020547 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6ec0b4ea0 con 0x7fc6ec0b9f80 2026-02-24T19:23:53.917 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.904+0000 7fc6da7fc640 1 -- 10.20.193.14:0/2153020547 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1982152714 0 0) 0x7fc6ec0b2690 con 0x7fc6ec0585e0 2026-02-24T19:23:53.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.904+0000 7fc6da7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:23:53.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.904+0000 7fc6da7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:53.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.904+0000 7fc6da7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:53.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.904+0000 7fc6da7fc640 10 monclient(hunting): my global_id is 28844 2026-02-24T19:23:53.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.904+0000 7fc6da7fc640 1 -- 10.20.193.14:0/2153020547 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6ec0b23b0 con 0x7fc6ec0585e0 2026-02-24T19:23:53.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.906+0000 7fc6da7fc640 1 -- 10.20.193.14:0/2153020547 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3232638079 0 0) 0x7fc6bc003610 con 0x7fc6ec0ba350 2026-02-24T19:23:53.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.906+0000 7fc6da7fc640 1 -- 10.20.193.14:0/2153020547 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc6ec0b2690 con 0x7fc6ec0ba350 2026-02-24T19:23:53.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.906+0000 7fc6da7fc640 1 -- 10.20.193.14:0/2153020547 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc6e8003420 con 0x7fc6ec0ba350 2026-02-24T19:23:53.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.906+0000 7fc6da7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:53.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.906+0000 7fc6da7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:23:53.918 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.906+0000 7fc6da7fc640 10 monclient(hunting): dump: 2026-02-24T19:23:53.918 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:53.918 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:53.919 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.919 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.919 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:53.919 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:53.919 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:53.919 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:53.919 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:53.919 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.919 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.906+0000 7fc6da7fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:23:53.919 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.906+0000 7fc6da7fc640 1 -- 10.20.193.14:0/2153020547 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 586451823 0 0) 0x7fc6ec0b4ea0 con 0x7fc6ec0b9f80 2026-02-24T19:23:53.919 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.906+0000 7fc6da7fc640 1 -- 10.20.193.14:0/2153020547 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc6bc003610 con 0x7fc6ec0b9f80 2026-02-24T19:23:53.919 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.906+0000 7fc6da7fc640 1 -- 10.20.193.14:0/2153020547 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc6e0003310 con 0x7fc6ec0b9f80 2026-02-24T19:23:53.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.906+0000 7fc6da7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:53.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.906+0000 7fc6da7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:53.920 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.906+0000 7fc6da7fc640 10 monclient(hunting): dump: 2026-02-24T19:23:53.920 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:53.920 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:53.920 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.920 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.920 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:53.920 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:53.920 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:53.920 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:53.920 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:53.921 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.921 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.907+0000 7fc6da7fc640 1 -- 10.20.193.14:0/2153020547 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2821998511 0 0) 0x7fc6ec0b23b0 con 0x7fc6ec0585e0 2026-02-24T19:23:53.921 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.907+0000 7fc6da7fc640 1 -- 10.20.193.14:0/2153020547 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc6ec0b4ea0 con 0x7fc6ec0585e0 2026-02-24T19:23:53.921 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.907+0000 7fc6da7fc640 1 -- 10.20.193.14:0/2153020547 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc6dc003280 con 0x7fc6ec0585e0 2026-02-24T19:23:53.921 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.907+0000 7fc6da7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:53.921 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.907+0000 7fc6da7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:53.921 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.907+0000 7fc6da7fc640 10 monclient(hunting): dump: 2026-02-24T19:23:53.921 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:53.921 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:53.921 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.921 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.921 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:53.921 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:53.922 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:53.922 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:53.922 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:53.922 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.922 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.907+0000 7fc6da7fc640 1 -- 10.20.193.14:0/2153020547 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1647725912 0 0) 0x7fc6ec0b2690 con 0x7fc6ec0ba350 2026-02-24T19:23:53.922 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.907+0000 7fc6da7fc640 1 -- 10.20.193.14:0/2153020547 >> v1:10.20.193.170:6789/0 conn(0x7fc6ec0585e0 legacy=0x7fc6ec0b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:53.922 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.907+0000 7fc6da7fc640 1 -- 10.20.193.14:0/2153020547 >> v1:10.20.193.44:6789/0 conn(0x7fc6ec0b9f80 legacy=0x7fc6ec1fc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:53.922 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.907+0000 7fc6da7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:23:53.922 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.907+0000 7fc6da7fc640 1 monclient: found mon.a 2026-02-24T19:23:53.922 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.907+0000 7fc6da7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:53.922 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.907+0000 7fc6da7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:53.922 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.907+0000 7fc6da7fc640 1 -- 10.20.193.14:0/2153020547 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6ec0b2970 con 0x7fc6ec0ba350 2026-02-24T19:23:53.922 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.907+0000 7fc6da7fc640 10 monclient: _finish_auth 0 2026-02-24T19:23:53.923 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.907+0000 7fc6da7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:23:53.923 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.907+0000 7fc6da7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:53.923 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.907+0000 7fc6f3ffa640 5 monclient: authenticate success, global_id 30891 2026-02-24T19:23:53.923 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.907+0000 7fc6f3ffa640 10 monclient: _renew_subs 2026-02-24T19:23:53.923 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.907+0000 7fc6f3ffa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:53.923 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.907+0000 7fc6f3ffa640 1 -- 10.20.193.14:0/2153020547 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc6ec0b2c50 con 0x7fc6ec0ba350 2026-02-24T19:23:53.923 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.907+0000 7fc6f3ffa640 10 client.30891.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:53.923 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.907+0000 7fc6f3ffa640 10 monclient: _renew_subs 2026-02-24T19:23:53.923 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.907+0000 7fc6f3ffa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:53.923 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.907+0000 7fc6f3ffa640 1 -- 10.20.193.14:0/2153020547 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc6ec0b3210 con 0x7fc6ec0ba350 2026-02-24T19:23:53.923 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.907+0000 7fc6f3ffa640 1 librados: init done 2026-02-24T19:23:53.923 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.908+0000 7fc6f3ffa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:53.923 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.908+0000 7fc6f3ffa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:53.924 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.908+0000 7fc6f3ffa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:53.924 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.908+0000 7fc6f3ffa640 1 -- 10.20.193.14:0/2153020547 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6ec0b64c0 con 0x7fc6ec0ba350 2026-02-24T19:23:53.925 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.916+0000 7fc6da7fc640 1 -- 10.20.193.14:0/2153020547 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc6e80035c0 con 0x7fc6ec0ba350 2026-02-24T19:23:53.925 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.916+0000 7fc6da7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:53.925 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.916+0000 7fc6da7fc640 1 -- 10.20.193.14:0/2153020547 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fc6e8003ca0 con 0x7fc6ec0ba350 2026-02-24T19:23:53.925 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.916+0000 7fc6da7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:53.925 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.916+0000 7fc6da7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:53.925 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.916+0000 7fc6dbfff640 4 set_mon_vals no callback set 2026-02-24T19:23:53.925 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.916+0000 7fc6da7fc640 10 monclient: dump: 2026-02-24T19:23:53.925 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:53.925 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:53.925 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.925 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:53.926 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:53.926 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:53.926 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:53.926 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:53.926 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:53.926 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:53.926 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.916+0000 7fc6da7fc640 1 -- 10.20.193.14:0/2153020547 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7fc6e8003e80 con 0x7fc6ec0ba350 2026-02-24T19:23:53.926 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.917+0000 7fc6f1d6f640 10 monclient: get_auth_request con 0x7fc6bc077e70 auth_method 0 2026-02-24T19:23:53.926 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:53.917+0000 7fc6da7fc640 10 client.30891.objecter ms_handle_connect 0x7fc6bc077e70 2026-02-24T19:23:54.006 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.004+0000 7fc6da7fc640 1 -- 10.20.193.14:0/2153020547 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7fc6e8093560 con 0x7fc6ec0ba350 2026-02-24T19:23:54.006 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.004+0000 7fc6da7fc640 10 client.30891.objecter ms_dispatch2 0x7fc6ec000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:23:54.006 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.004+0000 7fc6da7fc640 3 client.30891.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:23:54.006 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.004+0000 7fc6da7fc640 3 client.30891.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:23:54.006 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.004+0000 7fc6da7fc640 20 client.30891.objecter dump_active .. 0 homeless 2026-02-24T19:23:54.006 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.004+0000 7fc6da7fc640 1 -- 10.20.193.14:0/2153020547 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fc6e805df90 con 0x7fc6ec0ba350 2026-02-24T19:23:54.006 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.004+0000 7fc6da7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:54.007 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.004+0000 7fc6da7fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:23:54.111 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.109+0000 7fc6f3ffa640 1 -- 10.20.193.14:0/2153020547 --> v1:10.20.193.14:6800/4014096310 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fc6ec0b94f0 con 0x7fc6bc077e70 2026-02-24T19:23:54.111 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.110+0000 7fc6da7fc640 1 -- 10.20.193.14:0/2153020547 <== mgr.4110 v1:10.20.193.14:6800/4014096310 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (unknown 1239724482 0 0) 0x7fc6ec0b94f0 con 0x7fc6bc077e70 2026-02-24T19:23:54.111 INFO:teuthology.orchestra.run.trial014.stderr:instructed osd(s) 7 to deep-scrub 2026-02-24T19:23:54.113 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.110+0000 7fc6f3ffa640 10 librados: watch_flush enter 2026-02-24T19:23:54.113 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.110+0000 7fc6f3ffa640 10 librados: watch_flush exit 2026-02-24T19:23:54.113 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.110+0000 7fc6f3ffa640 20 client.30891.objecter shutdown clearing up homeless session... 2026-02-24T19:23:54.113 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.110+0000 7fc6f3ffa640 10 client.30891.objecter successfully canceled tick 2026-02-24T19:23:54.113 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.110+0000 7fc6f3ffa640 1 -- 10.20.193.14:0/2153020547 >> v1:10.20.193.14:6800/4014096310 conn(0x7fc6bc077e70 legacy=0x7fc6bc098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:54.113 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.110+0000 7fc6f3ffa640 10 monclient: shutdown 2026-02-24T19:23:54.113 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.110+0000 7fc6f3ffa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:54.113 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.110+0000 7fc6f3ffa640 1 -- 10.20.193.14:0/2153020547 >> v1:10.20.193.14:6789/0 conn(0x7fc6ec0ba350 legacy=0x7fc6ec1fe480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:54.113 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.110+0000 7fc6f3ffa640 1 -- 10.20.193.14:0/2153020547 shutdown_connections 2026-02-24T19:23:54.113 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.110+0000 7fc6f3ffa640 1 -- 10.20.193.14:0/2153020547 >> 10.20.193.14:0/2153020547 conn(0x7fc6ec0b7990 msgr2=0x7fc6ec0b66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:54.113 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.111+0000 7fc6f3ffa640 1 -- 10.20.193.14:0/2153020547 shutdown_connections 2026-02-24T19:23:54.114 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.111+0000 7fc6f3ffa640 1 -- 10.20.193.14:0/2153020547 wait complete. 2026-02-24T19:23:54.114 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.111+0000 7fc6f3ffa640 1 librados: shutdown 2026-02-24T19:23:54.120 INFO:tasks.ceph:Scrubbing osd.11 2026-02-24T19:23:54.121 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:23:54.191 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.190+0000 7f138344d640 10 monclient: get_monmap_and_config 2026-02-24T19:23:54.192 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.190+0000 7f138344d640 10 monclient: build_initial_monmap 2026-02-24T19:23:54.192 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.190+0000 7f138344d640 10 monclient: monmap: 2026-02-24T19:23:54.192 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:54.192 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:54.192 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:23:54.190946+0000 2026-02-24T19:23:54.192 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:23:54.190946+0000 2026-02-24T19:23:54.192 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:54.192 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:54.192 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:54.192 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:54.193 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:54.193 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:54.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.190+0000 7f138344d640 1 Processor -- start 2026-02-24T19:23:54.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.190+0000 7f138344d640 1 -- start start 2026-02-24T19:23:54.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.190+0000 7f138344d640 10 monclient: init 2026-02-24T19:23:54.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.191+0000 7f138344d640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:54.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.191+0000 7f138344d640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:23:54.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.191+0000 7f138344d640 10 monclient(hunting): picked mon.noname-c con 0x7f137c1599b0 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:54.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.191+0000 7f138344d640 10 monclient(hunting): picked mon.noname-b con 0x7f137c159d80 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:54.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.191+0000 7f138344d640 10 monclient(hunting): picked mon.noname-a con 0x7f137c166f10 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:54.194 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.191+0000 7f138344d640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f137c05dc40 con 0x7f137c166f10 2026-02-24T19:23:54.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.191+0000 7f138344d640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f137c05ab90 con 0x7f137c159d80 2026-02-24T19:23:54.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.191+0000 7f138344d640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f137c057970 con 0x7f137c1599b0 2026-02-24T19:23:54.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.191+0000 7f138344d640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:54.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.191+0000 7f138344d640 10 monclient(hunting): authenticate will time out at 4008.872490s 2026-02-24T19:23:54.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.191+0000 7f13819c3640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f137c166f10 0x7f137c1c8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:51100/0 (socket says 10.20.193.14:51100) 2026-02-24T19:23:54.195 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.191+0000 7f13819c3640 1 -- 10.20.193.14:0/1210281037 learned_addr learned my addr 10.20.193.14:0/1210281037 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:54.199 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.193+0000 7f136bfff640 1 -- 10.20.193.14:0/1210281037 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3379486832 0 0) 0x7f137c05dc40 con 0x7f137c166f10 2026-02-24T19:23:54.199 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.193+0000 7f136bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:23:54.199 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.193+0000 7f136bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:54.200 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.193+0000 7f136bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:54.200 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.193+0000 7f136bfff640 10 monclient(hunting): my global_id is 30894 2026-02-24T19:23:54.200 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.193+0000 7f136bfff640 1 -- 10.20.193.14:0/1210281037 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1364003610 con 0x7f137c166f10 2026-02-24T19:23:54.200 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.193+0000 7f136bfff640 1 -- 10.20.193.14:0/1210281037 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3517262258 0 0) 0x7f137c057970 con 0x7f137c1599b0 2026-02-24T19:23:54.200 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.193+0000 7f136bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:23:54.200 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.193+0000 7f136bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:54.200 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.193+0000 7f136bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:54.200 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.193+0000 7f136bfff640 10 monclient(hunting): my global_id is 28847 2026-02-24T19:23:54.200 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.193+0000 7f136bfff640 1 -- 10.20.193.14:0/1210281037 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f137c05dc40 con 0x7f137c1599b0 2026-02-24T19:23:54.200 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.193+0000 7f136bfff640 1 -- 10.20.193.14:0/1210281037 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2889673613 0 0) 0x7f137c05ab90 con 0x7f137c159d80 2026-02-24T19:23:54.200 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.193+0000 7f136bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:23:54.200 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.193+0000 7f136bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:54.201 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.193+0000 7f136bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:54.201 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.193+0000 7f136bfff640 10 monclient(hunting): my global_id is 29209 2026-02-24T19:23:54.201 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.193+0000 7f136bfff640 1 -- 10.20.193.14:0/1210281037 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f137c057970 con 0x7f137c159d80 2026-02-24T19:23:54.201 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.194+0000 7f136bfff640 1 -- 10.20.193.14:0/1210281037 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2990080880 0 0) 0x7f1364003610 con 0x7f137c166f10 2026-02-24T19:23:54.201 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.194+0000 7f136bfff640 1 -- 10.20.193.14:0/1210281037 >> v1:10.20.193.170:6789/0 conn(0x7f137c1599b0 legacy=0x7f137c0b3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:54.201 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.194+0000 7f136bfff640 1 -- 10.20.193.14:0/1210281037 >> v1:10.20.193.44:6789/0 conn(0x7f137c159d80 legacy=0x7f137c166800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:54.201 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.194+0000 7f136bfff640 10 monclient: _finish_hunting 0 2026-02-24T19:23:54.201 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.194+0000 7f136bfff640 1 monclient: found mon.noname-a 2026-02-24T19:23:54.201 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.194+0000 7f136bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:54.201 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.194+0000 7f136bfff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:23:54.201 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.194+0000 7f136bfff640 1 -- 10.20.193.14:0/1210281037 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f137c057c50 con 0x7f137c166f10 2026-02-24T19:23:54.201 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.194+0000 7f136bfff640 10 monclient: _finish_auth 0 2026-02-24T19:23:54.201 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.194+0000 7f136bfff640 10 monclient: _check_auth_tickets 2026-02-24T19:23:54.202 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.194+0000 7f136bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:54.202 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.194+0000 7f136bfff640 1 -- 10.20.193.14:0/1210281037 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f1378003170 con 0x7f137c166f10 2026-02-24T19:23:54.202 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.194+0000 7f136bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:54.202 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.194+0000 7f136bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:23:54.202 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.194+0000 7f136bfff640 10 monclient: dump: 2026-02-24T19:23:54.202 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:54.202 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:54.202 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.202 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.202 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:54.202 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:54.202 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:54.202 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:54.203 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:54.203 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:54.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.194+0000 7f138344d640 5 monclient: authenticate success, global_id 30894 2026-02-24T19:23:54.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.194+0000 7f138344d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:54.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.195+0000 7f136bfff640 1 -- 10.20.193.14:0/1210281037 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1378003340 con 0x7f137c166f10 2026-02-24T19:23:54.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.195+0000 7f136bfff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:54.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.195+0000 7f136bfff640 1 -- 10.20.193.14:0/1210281037 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f1378003780 con 0x7f137c166f10 2026-02-24T19:23:54.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.195+0000 7f136bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:54.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.195+0000 7f136bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:54.203 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.195+0000 7f136bfff640 10 monclient: dump: 2026-02-24T19:23:54.203 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:54.203 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:54.203 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.204 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.204 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:54.204 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:54.204 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:54.204 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:54.204 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:54.204 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:54.204 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.195+0000 7f138344d640 10 monclient: get_monmap_and_config success 2026-02-24T19:23:54.204 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.195+0000 7f138344d640 4 set_mon_vals no callback set 2026-02-24T19:23:54.204 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.196+0000 7f138344d640 10 monclient: shutdown 2026-02-24T19:23:54.204 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.196+0000 7f138344d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:54.204 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.196+0000 7f138344d640 1 -- 10.20.193.14:0/1210281037 >> v1:10.20.193.14:6789/0 conn(0x7f137c166f10 legacy=0x7f137c1c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:54.204 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.196+0000 7f138344d640 1 -- 10.20.193.14:0/1210281037 shutdown_connections 2026-02-24T19:23:54.205 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.196+0000 7f138344d640 1 -- 10.20.193.14:0/1210281037 >> 10.20.193.14:0/1210281037 conn(0x7f137c0b5200 msgr2=0x7f137c0b5600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:54.205 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.196+0000 7f138344d640 1 -- 10.20.193.14:0/1210281037 shutdown_connections 2026-02-24T19:23:54.205 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.196+0000 7f138344d640 1 -- 10.20.193.14:0/1210281037 wait complete. 2026-02-24T19:23:54.205 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.196+0000 7f138344d640 10 monclient: build_initial_monmap 2026-02-24T19:23:54.205 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.196+0000 7f138344d640 10 monclient: monmap: 2026-02-24T19:23:54.205 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:54.205 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:23:54.205 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:23:54.205 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:23:54.205 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:54.205 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:23:54.205 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:54.206 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:54.206 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:54.206 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:54.206 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.196+0000 7f138344d640 1 librados: starting msgr at 2026-02-24T19:23:54.206 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.196+0000 7f138344d640 1 librados: starting objecter 2026-02-24T19:23:54.206 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.196+0000 7f138344d640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:23:54.206 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.196+0000 7f138344d640 1 Processor -- start 2026-02-24T19:23:54.206 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.196+0000 7f138344d640 1 -- start start 2026-02-24T19:23:54.206 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.196+0000 7f138344d640 1 librados: setting wanted keys 2026-02-24T19:23:54.206 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.196+0000 7f138344d640 1 librados: calling monclient init 2026-02-24T19:23:54.206 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.196+0000 7f138344d640 10 monclient: init 2026-02-24T19:23:54.206 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.197+0000 7f138344d640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:54.206 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.197+0000 7f138344d640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:23:54.206 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.197+0000 7f138344d640 10 monclient(hunting): picked mon.noname-b con 0x7f137c1599b0 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:54.207 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.197+0000 7f138344d640 10 monclient(hunting): picked mon.noname-c con 0x7f137c159d80 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:54.207 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.197+0000 7f138344d640 10 monclient(hunting): picked mon.noname-a con 0x7f137c166f10 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:54.207 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.197+0000 7f138344d640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f137c154df0 con 0x7f137c166f10 2026-02-24T19:23:54.207 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.197+0000 7f138344d640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f137c13abc0 con 0x7f137c1599b0 2026-02-24T19:23:54.207 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.197+0000 7f138344d640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f137c1fc730 con 0x7f137c159d80 2026-02-24T19:23:54.207 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.197+0000 7f138344d640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:54.207 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.197+0000 7f138344d640 10 monclient(hunting): authenticate will time out at 4008.878279s 2026-02-24T19:23:54.207 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.197+0000 7f13819c3640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f137c166f10 0x7f137c0592b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:51110/0 (socket says 10.20.193.14:51110) 2026-02-24T19:23:54.207 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.197+0000 7f13819c3640 1 -- 10.20.193.14:0/1674865934 learned_addr learned my addr 10.20.193.14:0/1674865934 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:54.207 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.197+0000 7f1369ffb640 10 client.?.objecter ms_handle_connect 0x7f137c166f10 2026-02-24T19:23:54.207 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.197+0000 7f1369ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:54.207 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.197+0000 7f1369ffb640 10 client.?.objecter ms_handle_connect 0x7f137c1599b0 2026-02-24T19:23:54.207 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.197+0000 7f1369ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:54.208 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.198+0000 7f1369ffb640 10 client.?.objecter ms_handle_connect 0x7f137c159d80 2026-02-24T19:23:54.208 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.198+0000 7f1369ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:54.211 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.198+0000 7f1369ffb640 1 -- 10.20.193.14:0/1674865934 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1852880373 0 0) 0x7f137c057c50 con 0x7f137c166f10 2026-02-24T19:23:54.211 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.198+0000 7f1369ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:23:54.211 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.198+0000 7f1369ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:54.211 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.198+0000 7f1369ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:54.211 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.198+0000 7f1369ffb640 10 monclient(hunting): my global_id is 30897 2026-02-24T19:23:54.211 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.198+0000 7f1369ffb640 1 -- 10.20.193.14:0/1674865934 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f134c003610 con 0x7f137c166f10 2026-02-24T19:23:54.211 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.199+0000 7f1369ffb640 1 -- 10.20.193.14:0/1674865934 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4217580899 0 0) 0x7f137c13abc0 con 0x7f137c1599b0 2026-02-24T19:23:54.212 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.199+0000 7f1369ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:23:54.212 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.199+0000 7f1369ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:54.212 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.199+0000 7f1369ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:54.212 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.199+0000 7f1369ffb640 10 monclient(hunting): my global_id is 29212 2026-02-24T19:23:54.212 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.199+0000 7f1369ffb640 1 -- 10.20.193.14:0/1674865934 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f137c057c50 con 0x7f137c1599b0 2026-02-24T19:23:54.212 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.199+0000 7f1369ffb640 1 -- 10.20.193.14:0/1674865934 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4041523538 0 0) 0x7f137c1fc730 con 0x7f137c159d80 2026-02-24T19:23:54.212 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.199+0000 7f1369ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:23:54.212 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.199+0000 7f1369ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:54.212 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.199+0000 7f1369ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:54.212 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.199+0000 7f1369ffb640 10 monclient(hunting): my global_id is 28850 2026-02-24T19:23:54.212 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.199+0000 7f1369ffb640 1 -- 10.20.193.14:0/1674865934 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f137c13abc0 con 0x7f137c159d80 2026-02-24T19:23:54.212 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.201+0000 7f1369ffb640 1 -- 10.20.193.14:0/1674865934 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 156669412 0 0) 0x7f134c003610 con 0x7f137c166f10 2026-02-24T19:23:54.212 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.201+0000 7f1369ffb640 1 -- 10.20.193.14:0/1674865934 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f137c1fc730 con 0x7f137c166f10 2026-02-24T19:23:54.213 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.201+0000 7f1369ffb640 1 -- 10.20.193.14:0/1674865934 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f1378003690 con 0x7f137c166f10 2026-02-24T19:23:54.213 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.201+0000 7f1369ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:54.213 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.201+0000 7f1369ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:23:54.213 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.201+0000 7f1369ffb640 10 monclient(hunting): dump: 2026-02-24T19:23:54.213 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:54.213 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:54.213 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.213 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.213 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:54.213 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:54.213 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:54.213 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:54.213 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:54.214 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:54.214 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.201+0000 7f1369ffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:23:54.214 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.201+0000 7f1369ffb640 1 -- 10.20.193.14:0/1674865934 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 539849463 0 0) 0x7f137c057c50 con 0x7f137c1599b0 2026-02-24T19:23:54.214 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.201+0000 7f1369ffb640 1 -- 10.20.193.14:0/1674865934 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f134c003610 con 0x7f137c1599b0 2026-02-24T19:23:54.214 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.201+0000 7f1369ffb640 1 -- 10.20.193.14:0/1674865934 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f136c003070 con 0x7f137c1599b0 2026-02-24T19:23:54.214 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.201+0000 7f1369ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:54.214 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.201+0000 7f1369ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:54.214 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.201+0000 7f1369ffb640 10 monclient(hunting): dump: 2026-02-24T19:23:54.214 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:54.214 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:54.214 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.214 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.215 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:54.215 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:54.215 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:54.215 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:54.215 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:54.215 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:54.215 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.201+0000 7f1369ffb640 1 -- 10.20.193.14:0/1674865934 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2524431480 0 0) 0x7f137c13abc0 con 0x7f137c159d80 2026-02-24T19:23:54.215 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.201+0000 7f1369ffb640 1 -- 10.20.193.14:0/1674865934 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f137c057c50 con 0x7f137c159d80 2026-02-24T19:23:54.215 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.201+0000 7f1369ffb640 1 -- 10.20.193.14:0/1674865934 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f13700031a0 con 0x7f137c159d80 2026-02-24T19:23:54.215 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.201+0000 7f1369ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:54.215 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.201+0000 7f1369ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:54.215 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.201+0000 7f1369ffb640 10 monclient(hunting): dump: 2026-02-24T19:23:54.215 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:54.216 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:54.216 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.216 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.216 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:54.216 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:54.216 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:54.216 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:54.216 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:54.216 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:54.216 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.203+0000 7f1369ffb640 1 -- 10.20.193.14:0/1674865934 <== mon.1 v1:10.20.193.44:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2312217828 0 0) 0x7f134c003610 con 0x7f137c1599b0 2026-02-24T19:23:54.216 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.203+0000 7f1369ffb640 1 -- 10.20.193.14:0/1674865934 >> v1:10.20.193.170:6789/0 conn(0x7f137c159d80 legacy=0x7f137c1fd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:54.216 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.203+0000 7f1369ffb640 1 -- 10.20.193.14:0/1674865934 >> v1:10.20.193.14:6789/0 conn(0x7f137c166f10 legacy=0x7f137c0592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:54.217 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.203+0000 7f1369ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:23:54.217 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.203+0000 7f1369ffb640 1 monclient: found mon.b 2026-02-24T19:23:54.217 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.203+0000 7f1369ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:54.217 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.203+0000 7f1369ffb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:23:54.217 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.203+0000 7f1369ffb640 1 -- 10.20.193.14:0/1674865934 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f137c1fca10 con 0x7f137c1599b0 2026-02-24T19:23:54.217 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.203+0000 7f1369ffb640 10 monclient: _finish_auth 0 2026-02-24T19:23:54.217 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.203+0000 7f1369ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:23:54.217 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.203+0000 7f1369ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:54.217 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.203+0000 7f138344d640 5 monclient: authenticate success, global_id 29212 2026-02-24T19:23:54.217 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.203+0000 7f138344d640 10 monclient: _renew_subs 2026-02-24T19:23:54.217 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.203+0000 7f138344d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:23:54.217 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.203+0000 7f138344d640 1 -- 10.20.193.14:0/1674865934 --> v1:10.20.193.44:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f137c1fccf0 con 0x7f137c1599b0 2026-02-24T19:23:54.217 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.203+0000 7f138344d640 10 client.29212.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:54.218 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.203+0000 7f138344d640 10 monclient: _renew_subs 2026-02-24T19:23:54.218 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.203+0000 7f138344d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:23:54.218 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.203+0000 7f138344d640 1 -- 10.20.193.14:0/1674865934 --> v1:10.20.193.44:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f137c0b4750 con 0x7f137c1599b0 2026-02-24T19:23:54.218 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.203+0000 7f138344d640 1 librados: init done 2026-02-24T19:23:54.218 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.203+0000 7f138344d640 10 client.29212.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:54.218 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.203+0000 7f138344d640 15 client.29212.objecter _session_command_op_assign -1 1 2026-02-24T19:23:54.218 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.203+0000 7f138344d640 20 client.29212.objecter _get_session osd=-1 returning homeless 2026-02-24T19:23:54.218 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.203+0000 7f138344d640 10 client.29212.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:54.218 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.203+0000 7f138344d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:23:54.218 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.203+0000 7f138344d640 1 -- 10.20.193.14:0/1674865934 --> v1:10.20.193.44:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f137c1fc4e0 con 0x7f137c1599b0 2026-02-24T19:23:54.220 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.211+0000 7f1369ffb640 1 -- 10.20.193.14:0/1674865934 <== mon.1 v1:10.20.193.44:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f137c1fc4e0 con 0x7f137c1599b0 2026-02-24T19:23:54.220 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.211+0000 7f1369ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:54.220 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.211+0000 7f1369ffb640 1 -- 10.20.193.14:0/1674865934 <== mon.1 v1:10.20.193.44:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f136c0038a0 con 0x7f137c1599b0 2026-02-24T19:23:54.220 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.211+0000 7f1369ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:54.221 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.211+0000 7f1369ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:54.221 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.211+0000 7f1369ffb640 10 monclient: dump: 2026-02-24T19:23:54.221 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:54.221 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:54.221 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.221 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.221 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:54.221 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:54.221 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:54.221 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:54.221 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:54.221 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:54.222 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.211+0000 7f136b7fe640 4 set_mon_vals no callback set 2026-02-24T19:23:54.222 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.212+0000 7f1369ffb640 1 -- 10.20.193.14:0/1674865934 <== mon.1 v1:10.20.193.44:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f136c01c710 con 0x7f137c1599b0 2026-02-24T19:23:54.222 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.212+0000 7f13809c1640 10 monclient: get_auth_request con 0x7f134c077ea0 auth_method 0 2026-02-24T19:23:54.222 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.212+0000 7f1369ffb640 10 client.29212.objecter ms_handle_connect 0x7f134c077ea0 2026-02-24T19:23:54.222 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.212+0000 7f1369ffb640 1 -- 10.20.193.14:0/1674865934 <== mon.1 v1:10.20.193.44:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7f136c091db0 con 0x7f137c1599b0 2026-02-24T19:23:54.222 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.212+0000 7f1369ffb640 10 client.29212.objecter ms_dispatch2 0x7f137c000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:23:54.222 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.213+0000 7f1369ffb640 3 client.29212.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:23:54.222 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.213+0000 7f1369ffb640 3 client.29212.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:23:54.222 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.213+0000 7f1369ffb640 10 client.29212.objecter checking command 1 2026-02-24T19:23:54.222 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.213+0000 7f1369ffb640 20 client.29212.objecter _get_session s=0x7f134c0a2160 osd=11 3 2026-02-24T19:23:54.222 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.213+0000 7f1369ffb640 20 client.29212.objecter put_session s=0x7f134c0a2160 osd=11 3 2026-02-24T19:23:54.222 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.213+0000 7f1369ffb640 15 client.29212.objecter _session_command_op_remove -1 1 2026-02-24T19:23:54.222 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.213+0000 7f1369ffb640 20 client.29212.objecter _get_session s=0x7f134c0a2160 osd=11 3 2026-02-24T19:23:54.223 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.213+0000 7f1369ffb640 20 client.29212.objecter get_session s=0x7f134c0a2160 osd=11 3 2026-02-24T19:23:54.223 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.213+0000 7f1369ffb640 15 client.29212.objecter _session_command_op_assign 11 1 2026-02-24T19:23:54.223 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.213+0000 7f1369ffb640 20 client.29212.objecter put_session s=0x7f134c0a2160 osd=11 4 2026-02-24T19:23:54.223 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.213+0000 7f1369ffb640 10 client.29212.objecter _send_command 1 2026-02-24T19:23:54.223 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.213+0000 7f1369ffb640 1 -- 10.20.193.14:0/1674865934 --> v1:10.20.193.195:6804/2798179318 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f134c0c4470 con 0x7f134c0a2810 2026-02-24T19:23:54.223 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.213+0000 7f1369ffb640 20 client.29212.objecter dump_active .. 0 homeless 2026-02-24T19:23:54.223 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.213+0000 7f13819c3640 10 monclient: get_auth_request con 0x7f134c0a2810 auth_method 0 2026-02-24T19:23:54.223 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.213+0000 7f1369ffb640 1 -- 10.20.193.14:0/1674865934 <== mon.1 v1:10.20.193.44:6789/0 9 ==== mon_get_version_reply(handle=1 version=354) ==== 24+0+0 (unknown 31317031 0 0) 0x7f136c058450 con 0x7f137c1599b0 2026-02-24T19:23:54.223 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.213+0000 7f1369ffb640 10 monclient: handle_get_version_reply finishing 1 version 354 2026-02-24T19:23:54.223 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.214+0000 7f1369ffb640 10 client.29212.objecter ms_handle_connect 0x7f134c0a2810 2026-02-24T19:23:54.225 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.223+0000 7f1369ffb640 1 -- 10.20.193.14:0/1674865934 <== osd.11 v1:10.20.193.195:6804/2798179318 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f134c0c4470 con 0x7f134c0a2810 2026-02-24T19:23:54.225 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.223+0000 7f1369ffb640 10 client.29212.objecter ms_dispatch2 0x7f137c000b90 command_reply(tid 1: 0 ) 2026-02-24T19:23:54.225 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.223+0000 7f1369ffb640 10 client.29212.objecter _finish_command 1 = system:0 2026-02-24T19:23:54.225 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.223+0000 7f1369ffb640 20 client.29212.objecter put_session s=0x7f134c0a2160 osd=11 4 2026-02-24T19:23:54.225 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.223+0000 7f1369ffb640 15 client.29212.objecter _session_command_op_remove 11 1 2026-02-24T19:23:54.232 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.231+0000 7f138344d640 10 client.29212.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:23:54.233 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.231+0000 7f138344d640 15 client.29212.objecter _session_command_op_assign -1 2 2026-02-24T19:23:54.233 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.231+0000 7f138344d640 20 client.29212.objecter _get_session s=0x7f134c0a2160 osd=11 3 2026-02-24T19:23:54.233 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.231+0000 7f138344d640 20 client.29212.objecter put_session s=0x7f134c0a2160 osd=11 3 2026-02-24T19:23:54.233 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.231+0000 7f138344d640 20 client.29212.objecter _get_session s=0x7f134c0a2160 osd=11 3 2026-02-24T19:23:54.233 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.231+0000 7f138344d640 15 client.29212.objecter _session_command_op_remove -1 2 2026-02-24T19:23:54.233 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.231+0000 7f138344d640 20 client.29212.objecter get_session s=0x7f134c0a2160 osd=11 3 2026-02-24T19:23:54.233 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.231+0000 7f138344d640 15 client.29212.objecter _session_command_op_assign 11 2 2026-02-24T19:23:54.233 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.231+0000 7f138344d640 20 client.29212.objecter put_session s=0x7f134c0a2160 osd=11 4 2026-02-24T19:23:54.233 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.231+0000 7f138344d640 10 client.29212.objecter _send_command 2 2026-02-24T19:23:54.233 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.231+0000 7f138344d640 1 -- 10.20.193.14:0/1674865934 --> v1:10.20.193.195:6804/2798179318 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f137c056530 con 0x7f134c0a2810 2026-02-24T19:23:54.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.238+0000 7f1369ffb640 1 -- 10.20.193.14:0/1674865934 <== osd.11 v1:10.20.193.195:6804/2798179318 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f137c056530 con 0x7f134c0a2810 2026-02-24T19:23:54.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.238+0000 7f1369ffb640 10 client.29212.objecter ms_dispatch2 0x7f137c000b90 command_reply(tid 2: 0 ) 2026-02-24T19:23:54.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.238+0000 7f1369ffb640 10 client.29212.objecter _finish_command 2 = system:0 2026-02-24T19:23:54.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.238+0000 7f1369ffb640 20 client.29212.objecter put_session s=0x7f134c0a2160 osd=11 4 2026-02-24T19:23:54.240 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.238+0000 7f1369ffb640 15 client.29212.objecter _session_command_op_remove 11 2 2026-02-24T19:23:54.241 INFO:teuthology.orchestra.run.trial014.stdout:{ 2026-02-24T19:23:54.241 INFO:teuthology.orchestra.run.trial014.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:23:54.241 INFO:teuthology.orchestra.run.trial014.stdout:} 2026-02-24T19:23:54.242 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.239+0000 7f138344d640 10 librados: watch_flush enter 2026-02-24T19:23:54.242 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.239+0000 7f138344d640 10 librados: watch_flush exit 2026-02-24T19:23:54.242 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.239+0000 7f138344d640 10 client.29212.objecter close_session for osd.11 2026-02-24T19:23:54.243 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.239+0000 7f138344d640 1 -- 10.20.193.14:0/1674865934 >> v1:10.20.193.195:6804/2798179318 conn(0x7f134c0a2810 legacy=0x7f134c0c2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:54.243 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.239+0000 7f138344d640 20 client.29212.objecter put_session s=0x7f134c0a2160 osd=11 1 2026-02-24T19:23:54.243 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.239+0000 7f138344d640 20 client.29212.objecter shutdown clearing up homeless session... 2026-02-24T19:23:54.243 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.239+0000 7f138344d640 10 client.29212.objecter successfully canceled tick 2026-02-24T19:23:54.243 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.239+0000 7f138344d640 1 -- 10.20.193.14:0/1674865934 >> v1:10.20.193.14:6800/4014096310 conn(0x7f134c077ea0 legacy=0x7f134c098350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:54.243 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.239+0000 7f138344d640 10 monclient: shutdown 2026-02-24T19:23:54.243 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.239+0000 7f138344d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:54.243 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.239+0000 7f138344d640 1 -- 10.20.193.14:0/1674865934 >> v1:10.20.193.44:6789/0 conn(0x7f137c1599b0 legacy=0x7f137c1546e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:54.243 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.239+0000 7f13819c3640 1 -- 10.20.193.14:0/1674865934 reap_dead start 2026-02-24T19:23:54.243 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.239+0000 7f138344d640 1 -- 10.20.193.14:0/1674865934 shutdown_connections 2026-02-24T19:23:54.243 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.239+0000 7f138344d640 1 -- 10.20.193.14:0/1674865934 >> 10.20.193.14:0/1674865934 conn(0x7f137c0b5200 msgr2=0x7f137c158ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:54.243 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.239+0000 7f138344d640 1 -- 10.20.193.14:0/1674865934 shutdown_connections 2026-02-24T19:23:54.244 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.239+0000 7f138344d640 1 -- 10.20.193.14:0/1674865934 wait complete. 2026-02-24T19:23:54.244 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.239+0000 7f138344d640 1 librados: shutdown 2026-02-24T19:23:54.248 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 11 2026-02-24T19:23:54.315 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.313+0000 7f6f9af98640 10 monclient: get_monmap_and_config 2026-02-24T19:23:54.315 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.313+0000 7f6f9af98640 10 monclient: build_initial_monmap 2026-02-24T19:23:54.315 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.313+0000 7f6f9af98640 10 monclient: monmap: 2026-02-24T19:23:54.315 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:54.315 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:54.315 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:23:54.314246+0000 2026-02-24T19:23:54.315 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:23:54.314246+0000 2026-02-24T19:23:54.316 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:54.316 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:54.316 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:54.316 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:54.316 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:54.316 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:54.318 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.314+0000 7f6f9af98640 1 Processor -- start 2026-02-24T19:23:54.318 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.314+0000 7f6f9af98640 1 -- start start 2026-02-24T19:23:54.318 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.314+0000 7f6f9af98640 10 monclient: init 2026-02-24T19:23:54.318 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.314+0000 7f6f9af98640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:54.319 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.314+0000 7f6f9af98640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:23:54.319 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.314+0000 7f6f9af98640 10 monclient(hunting): picked mon.noname-c con 0x7f6f94157780 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:54.319 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.314+0000 7f6f9af98640 10 monclient(hunting): picked mon.noname-b con 0x7f6f94157b50 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:54.319 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.314+0000 7f6f9af98640 10 monclient(hunting): picked mon.noname-a con 0x7f6f94164d00 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:54.319 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.314+0000 7f6f9af98640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f9405de70 con 0x7f6f94164d00 2026-02-24T19:23:54.319 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.314+0000 7f6f9af98640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f94055b20 con 0x7f6f94157b50 2026-02-24T19:23:54.319 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.314+0000 7f6f9af98640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f94055e00 con 0x7f6f94157780 2026-02-24T19:23:54.319 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.314+0000 7f6f9af98640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:54.319 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.314+0000 7f6f9af98640 10 monclient(hunting): authenticate will time out at 4008.995740s 2026-02-24T19:23:54.319 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.315+0000 7f6f9950e640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f6f94164d00 0x7f6f941c5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:51126/0 (socket says 10.20.193.14:51126) 2026-02-24T19:23:54.319 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.315+0000 7f6f9950e640 1 -- 10.20.193.14:0/3007831240 learned_addr learned my addr 10.20.193.14:0/3007831240 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:54.319 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.316+0000 7f6f8b7fe640 1 -- 10.20.193.14:0/3007831240 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3579390880 0 0) 0x7f6f94055b20 con 0x7f6f94157b50 2026-02-24T19:23:54.320 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.316+0000 7f6f8b7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:23:54.320 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.316+0000 7f6f8b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:54.320 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.316+0000 7f6f8b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:54.320 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.316+0000 7f6f8b7fe640 10 monclient(hunting): my global_id is 29215 2026-02-24T19:23:54.320 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.316+0000 7f6f8b7fe640 1 -- 10.20.193.14:0/3007831240 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f80003610 con 0x7f6f94157b50 2026-02-24T19:23:54.320 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.316+0000 7f6f8b7fe640 1 -- 10.20.193.14:0/3007831240 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 598548718 0 0) 0x7f6f9405de70 con 0x7f6f94164d00 2026-02-24T19:23:54.320 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.316+0000 7f6f8b7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:23:54.320 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.316+0000 7f6f8b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:54.320 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.316+0000 7f6f8b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:54.320 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.316+0000 7f6f8b7fe640 10 monclient(hunting): my global_id is 30900 2026-02-24T19:23:54.320 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.316+0000 7f6f8b7fe640 1 -- 10.20.193.14:0/3007831240 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f94055b20 con 0x7f6f94164d00 2026-02-24T19:23:54.320 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.316+0000 7f6f8b7fe640 1 -- 10.20.193.14:0/3007831240 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1079247887 0 0) 0x7f6f94055e00 con 0x7f6f94157780 2026-02-24T19:23:54.321 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.316+0000 7f6f8b7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:23:54.321 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.316+0000 7f6f8b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:54.321 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.316+0000 7f6f8b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:54.321 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.316+0000 7f6f8b7fe640 10 monclient(hunting): my global_id is 28853 2026-02-24T19:23:54.321 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.316+0000 7f6f8b7fe640 1 -- 10.20.193.14:0/3007831240 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f9405de70 con 0x7f6f94157780 2026-02-24T19:23:54.325 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.317+0000 7f6f8b7fe640 1 -- 10.20.193.14:0/3007831240 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 946731380 0 0) 0x7f6f80003610 con 0x7f6f94157b50 2026-02-24T19:23:54.325 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.318+0000 7f6f8b7fe640 1 -- 10.20.193.14:0/3007831240 >> v1:10.20.193.170:6789/0 conn(0x7f6f94157780 legacy=0x7f6f94056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:54.325 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.318+0000 7f6f8b7fe640 1 -- 10.20.193.14:0/3007831240 >> v1:10.20.193.14:6789/0 conn(0x7f6f94164d00 legacy=0x7f6f941c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:54.325 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.318+0000 7f6f8b7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:23:54.325 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.318+0000 7f6f8b7fe640 1 monclient: found mon.noname-b 2026-02-24T19:23:54.325 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.318+0000 7f6f8b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:54.325 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.318+0000 7f6f8b7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.44:6789/0 2026-02-24T19:23:54.326 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.318+0000 7f6f8b7fe640 1 -- 10.20.193.14:0/3007831240 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f940560e0 con 0x7f6f94157b50 2026-02-24T19:23:54.326 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.318+0000 7f6f8b7fe640 10 monclient: _finish_auth 0 2026-02-24T19:23:54.326 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.318+0000 7f6f8b7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:23:54.326 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.318+0000 7f6f8b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:54.326 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.318+0000 7f6f8b7fe640 1 -- 10.20.193.14:0/3007831240 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f6f7c002df0 con 0x7f6f94157b50 2026-02-24T19:23:54.326 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.318+0000 7f6f8b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:54.326 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.318+0000 7f6f8b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:23:54.326 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.318+0000 7f6f8b7fe640 10 monclient: dump: 2026-02-24T19:23:54.326 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:54.326 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:54.326 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.326 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.326 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:54.327 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:54.327 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:54.327 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:54.327 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:54.327 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:54.327 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.318+0000 7f6f9af98640 5 monclient: authenticate success, global_id 29215 2026-02-24T19:23:54.327 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.318+0000 7f6f9af98640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:54.327 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.318+0000 7f6f8b7fe640 1 -- 10.20.193.14:0/3007831240 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6f7c002fc0 con 0x7f6f94157b50 2026-02-24T19:23:54.327 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.318+0000 7f6f8b7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:54.327 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.318+0000 7f6f8b7fe640 1 -- 10.20.193.14:0/3007831240 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f6f7c003400 con 0x7f6f94157b50 2026-02-24T19:23:54.327 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.318+0000 7f6f9af98640 10 monclient: get_monmap_and_config success 2026-02-24T19:23:54.327 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.318+0000 7f6f9af98640 4 set_mon_vals no callback set 2026-02-24T19:23:54.328 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.318+0000 7f6f8b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:54.328 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.318+0000 7f6f8b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:54.328 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.318+0000 7f6f8b7fe640 10 monclient: dump: 2026-02-24T19:23:54.328 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:54.328 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:54.328 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.328 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.328 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:54.328 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:54.328 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:54.328 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:54.328 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:54.329 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:54.329 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.319+0000 7f6f9af98640 10 monclient: shutdown 2026-02-24T19:23:54.329 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.319+0000 7f6f9af98640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:54.329 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.319+0000 7f6f9af98640 1 -- 10.20.193.14:0/3007831240 >> v1:10.20.193.44:6789/0 conn(0x7f6f94157b50 legacy=0x7f6f941645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:54.329 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.319+0000 7f6f9af98640 1 -- 10.20.193.14:0/3007831240 shutdown_connections 2026-02-24T19:23:54.329 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.319+0000 7f6f9af98640 1 -- 10.20.193.14:0/3007831240 >> 10.20.193.14:0/3007831240 conn(0x7f6f940b2ef0 msgr2=0x7f6f940b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:54.329 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.319+0000 7f6f9af98640 1 -- 10.20.193.14:0/3007831240 shutdown_connections 2026-02-24T19:23:54.329 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.319+0000 7f6f9af98640 1 -- 10.20.193.14:0/3007831240 wait complete. 2026-02-24T19:23:54.329 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.319+0000 7f6f9af98640 10 monclient: build_initial_monmap 2026-02-24T19:23:54.329 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.319+0000 7f6f9af98640 10 monclient: monmap: 2026-02-24T19:23:54.329 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:54.329 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:23:54.329 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:23:54.330 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:23:54.330 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:54.330 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:23:54.330 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:54.330 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:54.330 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:54.330 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:54.330 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.319+0000 7f6f9af98640 1 librados: starting msgr at 2026-02-24T19:23:54.330 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.319+0000 7f6f9af98640 1 librados: starting objecter 2026-02-24T19:23:54.330 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.319+0000 7f6f9af98640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:23:54.330 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.319+0000 7f6f9af98640 1 Processor -- start 2026-02-24T19:23:54.330 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.320+0000 7f6f9af98640 1 -- start start 2026-02-24T19:23:54.330 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.320+0000 7f6f9af98640 1 librados: setting wanted keys 2026-02-24T19:23:54.331 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.320+0000 7f6f9af98640 1 librados: calling monclient init 2026-02-24T19:23:54.331 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.320+0000 7f6f9af98640 10 monclient: init 2026-02-24T19:23:54.331 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.320+0000 7f6f9af98640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:54.331 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.320+0000 7f6f9af98640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:23:54.331 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.320+0000 7f6f9af98640 10 monclient(hunting): picked mon.noname-c con 0x7f6f94157780 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:54.331 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.320+0000 7f6f9af98640 10 monclient(hunting): picked mon.noname-a con 0x7f6f94157b50 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:54.331 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.320+0000 7f6f9af98640 10 monclient(hunting): picked mon.noname-b con 0x7f6f94164d00 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:54.331 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.320+0000 7f6f9af98640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f9413abb0 con 0x7f6f94157b50 2026-02-24T19:23:54.331 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.320+0000 7f6f9af98640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f94147900 con 0x7f6f94164d00 2026-02-24T19:23:54.331 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.320+0000 7f6f9af98640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f94147be0 con 0x7f6f94157780 2026-02-24T19:23:54.331 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.320+0000 7f6f9af98640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:54.331 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.320+0000 7f6f9af98640 10 monclient(hunting): authenticate will time out at 4009.001405s 2026-02-24T19:23:54.331 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.320+0000 7f6f8bfff640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f6f94157b50 0x7f6f941489a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:51140/0 (socket says 10.20.193.14:51140) 2026-02-24T19:23:54.332 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.320+0000 7f6f8bfff640 1 -- 10.20.193.14:0/3500423698 learned_addr learned my addr 10.20.193.14:0/3500423698 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:54.332 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.320+0000 7f6f897fa640 10 client.?.objecter ms_handle_connect 0x7f6f94164d00 2026-02-24T19:23:54.332 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.320+0000 7f6f897fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:54.332 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.321+0000 7f6f897fa640 10 client.?.objecter ms_handle_connect 0x7f6f94157780 2026-02-24T19:23:54.332 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.321+0000 7f6f897fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:54.332 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.321+0000 7f6f897fa640 10 client.?.objecter ms_handle_connect 0x7f6f94157b50 2026-02-24T19:23:54.332 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.321+0000 7f6f897fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:54.332 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.322+0000 7f6f897fa640 1 -- 10.20.193.14:0/3500423698 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4024198844 0 0) 0x7f6f94147900 con 0x7f6f94164d00 2026-02-24T19:23:54.332 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.322+0000 7f6f897fa640 10 monclient(hunting): _negotiate 2026-02-24T19:23:54.332 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.322+0000 7f6f897fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:54.332 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.322+0000 7f6f897fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:54.332 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.322+0000 7f6f897fa640 10 monclient(hunting): my global_id is 29218 2026-02-24T19:23:54.333 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.322+0000 7f6f897fa640 1 -- 10.20.193.14:0/3500423698 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f64003610 con 0x7f6f94164d00 2026-02-24T19:23:54.333 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.322+0000 7f6f897fa640 1 -- 10.20.193.14:0/3500423698 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2494955352 0 0) 0x7f6f9413abb0 con 0x7f6f94157b50 2026-02-24T19:23:54.333 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.322+0000 7f6f897fa640 10 monclient(hunting): _negotiate 2026-02-24T19:23:54.333 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.322+0000 7f6f897fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:54.333 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.322+0000 7f6f897fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:54.333 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.322+0000 7f6f897fa640 10 monclient(hunting): my global_id is 30903 2026-02-24T19:23:54.333 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.322+0000 7f6f897fa640 1 -- 10.20.193.14:0/3500423698 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f94147900 con 0x7f6f94157b50 2026-02-24T19:23:54.333 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.322+0000 7f6f897fa640 1 -- 10.20.193.14:0/3500423698 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2078384322 0 0) 0x7f6f94147be0 con 0x7f6f94157780 2026-02-24T19:23:54.333 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.322+0000 7f6f897fa640 10 monclient(hunting): _negotiate 2026-02-24T19:23:54.333 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.322+0000 7f6f897fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:54.333 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.322+0000 7f6f897fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:54.333 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.322+0000 7f6f897fa640 10 monclient(hunting): my global_id is 28856 2026-02-24T19:23:54.333 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.322+0000 7f6f897fa640 1 -- 10.20.193.14:0/3500423698 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f9413abb0 con 0x7f6f94157780 2026-02-24T19:23:54.336 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.324+0000 7f6f897fa640 1 -- 10.20.193.14:0/3500423698 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 438495797 0 0) 0x7f6f64003610 con 0x7f6f94164d00 2026-02-24T19:23:54.336 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.324+0000 7f6f897fa640 1 -- 10.20.193.14:0/3500423698 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f94147be0 con 0x7f6f94164d00 2026-02-24T19:23:54.336 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.324+0000 7f6f897fa640 1 -- 10.20.193.14:0/3500423698 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f6f90003370 con 0x7f6f94164d00 2026-02-24T19:23:54.336 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.324+0000 7f6f897fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:54.336 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.324+0000 7f6f897fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:23:54.336 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.324+0000 7f6f897fa640 10 monclient(hunting): dump: 2026-02-24T19:23:54.337 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:54.337 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:54.337 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.337 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.337 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:54.337 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:54.337 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:54.337 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:54.337 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:54.337 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:54.337 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.324+0000 7f6f897fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:23:54.337 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.324+0000 7f6f897fa640 1 -- 10.20.193.14:0/3500423698 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 886842214 0 0) 0x7f6f94147900 con 0x7f6f94157b50 2026-02-24T19:23:54.338 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.324+0000 7f6f897fa640 1 -- 10.20.193.14:0/3500423698 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f64003610 con 0x7f6f94157b50 2026-02-24T19:23:54.338 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.324+0000 7f6f897fa640 1 -- 10.20.193.14:0/3500423698 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f6f7c003310 con 0x7f6f94157b50 2026-02-24T19:23:54.338 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.324+0000 7f6f897fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:54.338 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.324+0000 7f6f897fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:54.338 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.324+0000 7f6f897fa640 10 monclient(hunting): dump: 2026-02-24T19:23:54.338 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:54.338 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:54.338 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.338 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.338 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:54.338 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:54.338 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:54.338 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:54.339 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:54.339 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:54.339 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.325+0000 7f6f897fa640 1 -- 10.20.193.14:0/3500423698 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 936854302 0 0) 0x7f6f9413abb0 con 0x7f6f94157780 2026-02-24T19:23:54.339 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.325+0000 7f6f897fa640 1 -- 10.20.193.14:0/3500423698 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f94147900 con 0x7f6f94157780 2026-02-24T19:23:54.339 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.325+0000 7f6f897fa640 1 -- 10.20.193.14:0/3500423698 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f6f84003060 con 0x7f6f94157780 2026-02-24T19:23:54.339 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.325+0000 7f6f897fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:54.339 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.325+0000 7f6f897fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:54.339 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.325+0000 7f6f897fa640 10 monclient(hunting): dump: 2026-02-24T19:23:54.339 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:54.339 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:54.339 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.339 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.340 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:54.340 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:54.340 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:54.340 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:54.340 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:54.340 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:54.340 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.326+0000 7f6f897fa640 1 -- 10.20.193.14:0/3500423698 <== mon.1 v1:10.20.193.44:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4179960200 0 0) 0x7f6f94147be0 con 0x7f6f94164d00 2026-02-24T19:23:54.340 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.326+0000 7f6f897fa640 1 -- 10.20.193.14:0/3500423698 >> v1:10.20.193.170:6789/0 conn(0x7f6f94157780 legacy=0x7f6f9413a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:54.340 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.326+0000 7f6f897fa640 1 -- 10.20.193.14:0/3500423698 >> v1:10.20.193.14:6789/0 conn(0x7f6f94157b50 legacy=0x7f6f941489a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:54.340 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.326+0000 7f6f897fa640 10 monclient: _finish_hunting 0 2026-02-24T19:23:54.340 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.326+0000 7f6f897fa640 1 monclient: found mon.b 2026-02-24T19:23:54.340 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.326+0000 7f6f897fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:54.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.326+0000 7f6f897fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:23:54.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.326+0000 7f6f897fa640 1 -- 10.20.193.14:0/3500423698 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f94147ec0 con 0x7f6f94164d00 2026-02-24T19:23:54.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.326+0000 7f6f897fa640 10 monclient: _finish_auth 0 2026-02-24T19:23:54.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.326+0000 7f6f897fa640 10 monclient: _check_auth_tickets 2026-02-24T19:23:54.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.326+0000 7f6f897fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:54.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.326+0000 7f6f9af98640 5 monclient: authenticate success, global_id 29218 2026-02-24T19:23:54.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.326+0000 7f6f9af98640 10 monclient: _renew_subs 2026-02-24T19:23:54.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.326+0000 7f6f9af98640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:23:54.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.326+0000 7f6f9af98640 1 -- 10.20.193.14:0/3500423698 --> v1:10.20.193.44:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6f941481a0 con 0x7f6f94164d00 2026-02-24T19:23:54.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.326+0000 7f6f9af98640 10 client.29218.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:54.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.326+0000 7f6f9af98640 10 monclient: _renew_subs 2026-02-24T19:23:54.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.326+0000 7f6f9af98640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:23:54.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.326+0000 7f6f9af98640 1 -- 10.20.193.14:0/3500423698 --> v1:10.20.193.44:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6f941490b0 con 0x7f6f94164d00 2026-02-24T19:23:54.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.326+0000 7f6f9af98640 1 librados: init done 2026-02-24T19:23:54.342 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.326+0000 7f6f9af98640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:54.342 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.326+0000 7f6f9af98640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:54.342 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.326+0000 7f6f9af98640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:23:54.342 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.326+0000 7f6f9af98640 1 -- 10.20.193.14:0/3500423698 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f94165140 con 0x7f6f94164d00 2026-02-24T19:23:54.418 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.416+0000 7f6f897fa640 1 -- 10.20.193.14:0/3500423698 <== mon.1 v1:10.20.193.44:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6f900038b0 con 0x7f6f94164d00 2026-02-24T19:23:54.418 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.416+0000 7f6f897fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:54.418 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.416+0000 7f6f897fa640 1 -- 10.20.193.14:0/3500423698 <== mon.1 v1:10.20.193.44:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f6f90004df0 con 0x7f6f94164d00 2026-02-24T19:23:54.418 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.416+0000 7f6f897fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:54.418 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.416+0000 7f6f897fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:54.418 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.416+0000 7f6f897fa640 10 monclient: dump: 2026-02-24T19:23:54.419 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:54.419 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:54.419 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.419 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.419 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:54.419 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:54.419 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:54.419 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:54.419 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:54.419 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:54.419 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.416+0000 7f6f8affd640 4 set_mon_vals no callback set 2026-02-24T19:23:54.420 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.417+0000 7f6f897fa640 1 -- 10.20.193.14:0/3500423698 <== mon.1 v1:10.20.193.44:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f6f9001dc60 con 0x7f6f94164d00 2026-02-24T19:23:54.420 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.417+0000 7f6f98d0d640 10 monclient: get_auth_request con 0x7f6f64077dd0 auth_method 0 2026-02-24T19:23:54.421 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.417+0000 7f6f897fa640 10 client.29218.objecter ms_handle_connect 0x7f6f64077dd0 2026-02-24T19:23:54.421 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.418+0000 7f6f897fa640 1 -- 10.20.193.14:0/3500423698 <== mon.1 v1:10.20.193.44:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7f6f90093490 con 0x7f6f94164d00 2026-02-24T19:23:54.421 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.418+0000 7f6f897fa640 10 client.29218.objecter ms_dispatch2 0x7f6f94000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:23:54.421 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.418+0000 7f6f897fa640 3 client.29218.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:23:54.421 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.418+0000 7f6f897fa640 3 client.29218.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:23:54.421 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.419+0000 7f6f897fa640 20 client.29218.objecter dump_active .. 0 homeless 2026-02-24T19:23:54.421 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.420+0000 7f6f897fa640 1 -- 10.20.193.14:0/3500423698 <== mon.1 v1:10.20.193.44:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f6f94165140 con 0x7f6f94164d00 2026-02-24T19:23:54.421 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.420+0000 7f6f897fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:54.422 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.420+0000 7f6f897fa640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:23:54.528 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.526+0000 7f6f9af98640 1 -- 10.20.193.14:0/3500423698 --> v1:10.20.193.14:6800/4014096310 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "11", "target": ["mon-mgr", ""]}) -- 0x7f6f9414a7b0 con 0x7f6f64077dd0 2026-02-24T19:23:54.528 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.526+0000 7f6f897fa640 1 -- 10.20.193.14:0/3500423698 <== mgr.4110 v1:10.20.193.14:6800/4014096310 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 11 to deep-scrub) ==== 42+0+0 (unknown 2412662492 0 0) 0x7f6f9414a7b0 con 0x7f6f64077dd0 2026-02-24T19:23:54.528 INFO:teuthology.orchestra.run.trial014.stderr:instructed osd(s) 11 to deep-scrub 2026-02-24T19:23:54.529 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.527+0000 7f6f9af98640 10 librados: watch_flush enter 2026-02-24T19:23:54.530 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.527+0000 7f6f9af98640 10 librados: watch_flush exit 2026-02-24T19:23:54.530 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.527+0000 7f6f9af98640 20 client.29218.objecter shutdown clearing up homeless session... 2026-02-24T19:23:54.530 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.527+0000 7f6f9af98640 10 client.29218.objecter successfully canceled tick 2026-02-24T19:23:54.530 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.527+0000 7f6f9af98640 1 -- 10.20.193.14:0/3500423698 >> v1:10.20.193.14:6800/4014096310 conn(0x7f6f64077dd0 legacy=0x7f6f64098280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:54.530 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.527+0000 7f6f9af98640 10 monclient: shutdown 2026-02-24T19:23:54.530 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.527+0000 7f6f9af98640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:54.530 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.527+0000 7f6f9af98640 1 -- 10.20.193.14:0/3500423698 >> v1:10.20.193.44:6789/0 conn(0x7f6f94164d00 legacy=0x7f6f94149880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:54.530 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.527+0000 7f6f9af98640 1 -- 10.20.193.14:0/3500423698 shutdown_connections 2026-02-24T19:23:54.530 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.527+0000 7f6f9af98640 1 -- 10.20.193.14:0/3500423698 >> 10.20.193.14:0/3500423698 conn(0x7f6f940b2ef0 msgr2=0x7f6f940b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:54.530 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.527+0000 7f6f9af98640 1 -- 10.20.193.14:0/3500423698 shutdown_connections 2026-02-24T19:23:54.530 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.527+0000 7f6f9af98640 1 -- 10.20.193.14:0/3500423698 wait complete. 2026-02-24T19:23:54.530 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.527+0000 7f6f9af98640 1 librados: shutdown 2026-02-24T19:23:54.537 INFO:tasks.ceph:Scrubbing osd.15 2026-02-24T19:23:54.538 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:23:54.605 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.604+0000 7faf1ca5b640 10 monclient: get_monmap_and_config 2026-02-24T19:23:54.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.604+0000 7faf1ca5b640 10 monclient: build_initial_monmap 2026-02-24T19:23:54.606 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.604+0000 7faf1ca5b640 10 monclient: monmap: 2026-02-24T19:23:54.606 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:54.606 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:54.606 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:23:54.604800+0000 2026-02-24T19:23:54.606 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:23:54.604800+0000 2026-02-24T19:23:54.606 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:54.606 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:54.606 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:54.606 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:54.606 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:54.607 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:54.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.604+0000 7faf1ca5b640 1 Processor -- start 2026-02-24T19:23:54.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.604+0000 7faf1ca5b640 1 -- start start 2026-02-24T19:23:54.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.604+0000 7faf1ca5b640 10 monclient: init 2026-02-24T19:23:54.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.605+0000 7faf1ca5b640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:54.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.605+0000 7faf1ca5b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:23:54.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.605+0000 7faf1ca5b640 10 monclient(hunting): picked mon.noname-a con 0x7faf1815e2a0 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:54.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.605+0000 7faf1ca5b640 10 monclient(hunting): picked mon.noname-b con 0x7faf18059e10 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:54.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.605+0000 7faf1ca5b640 10 monclient(hunting): picked mon.noname-c con 0x7faf181a5660 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:54.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.605+0000 7faf1ca5b640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf18162df0 con 0x7faf1815e2a0 2026-02-24T19:23:54.609 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.605+0000 7faf1ca5b640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf181630d0 con 0x7faf18059e10 2026-02-24T19:23:54.610 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.605+0000 7faf1ca5b640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf181633b0 con 0x7faf181a5660 2026-02-24T19:23:54.610 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.605+0000 7faf1ca5b640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:54.610 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.605+0000 7faf1ca5b640 10 monclient(hunting): authenticate will time out at 4009.286231s 2026-02-24T19:23:54.610 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.605+0000 7faf16575640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7faf1815e2a0 0x7faf1805da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:51154/0 (socket says 10.20.193.14:51154) 2026-02-24T19:23:54.610 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.605+0000 7faf16575640 1 -- 10.20.193.14:0/2192333156 learned_addr learned my addr 10.20.193.14:0/2192333156 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:54.610 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.606+0000 7faf15573640 1 -- 10.20.193.14:0/2192333156 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3895462326 0 0) 0x7faf18162df0 con 0x7faf1815e2a0 2026-02-24T19:23:54.610 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.606+0000 7faf15573640 10 monclient(hunting): _negotiate 2026-02-24T19:23:54.610 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.606+0000 7faf15573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:54.610 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.606+0000 7faf15573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:54.610 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.606+0000 7faf15573640 10 monclient(hunting): my global_id is 30906 2026-02-24T19:23:54.610 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.606+0000 7faf15573640 1 -- 10.20.193.14:0/2192333156 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf04003610 con 0x7faf1815e2a0 2026-02-24T19:23:54.610 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.607+0000 7faf15573640 1 -- 10.20.193.14:0/2192333156 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2582217161 0 0) 0x7faf181630d0 con 0x7faf18059e10 2026-02-24T19:23:54.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.607+0000 7faf15573640 10 monclient(hunting): _negotiate 2026-02-24T19:23:54.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.607+0000 7faf15573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:54.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.607+0000 7faf15573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:54.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.607+0000 7faf15573640 10 monclient(hunting): my global_id is 29221 2026-02-24T19:23:54.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.607+0000 7faf15573640 1 -- 10.20.193.14:0/2192333156 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf18162df0 con 0x7faf18059e10 2026-02-24T19:23:54.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.607+0000 7faf15573640 1 -- 10.20.193.14:0/2192333156 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3296952719 0 0) 0x7faf181633b0 con 0x7faf181a5660 2026-02-24T19:23:54.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.607+0000 7faf15573640 10 monclient(hunting): _negotiate 2026-02-24T19:23:54.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.607+0000 7faf15573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:54.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.607+0000 7faf15573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:54.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.607+0000 7faf15573640 10 monclient(hunting): my global_id is 28859 2026-02-24T19:23:54.611 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.607+0000 7faf15573640 1 -- 10.20.193.14:0/2192333156 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf181630d0 con 0x7faf181a5660 2026-02-24T19:23:54.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.608+0000 7faf15573640 1 -- 10.20.193.14:0/2192333156 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3045361552 0 0) 0x7faf04003610 con 0x7faf1815e2a0 2026-02-24T19:23:54.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.608+0000 7faf15573640 1 -- 10.20.193.14:0/2192333156 >> v1:10.20.193.170:6789/0 conn(0x7faf181a5660 legacy=0x7faf181c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:54.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.608+0000 7faf15573640 1 -- 10.20.193.14:0/2192333156 >> v1:10.20.193.44:6789/0 conn(0x7faf18059e10 legacy=0x7faf1815ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:54.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.608+0000 7faf15573640 10 monclient: _finish_hunting 0 2026-02-24T19:23:54.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.608+0000 7faf15573640 1 monclient: found mon.noname-a 2026-02-24T19:23:54.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.608+0000 7faf15573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:54.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.608+0000 7faf15573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:23:54.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.608+0000 7faf15573640 1 -- 10.20.193.14:0/2192333156 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf18163690 con 0x7faf1815e2a0 2026-02-24T19:23:54.617 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.608+0000 7faf15573640 10 monclient: _finish_auth 0 2026-02-24T19:23:54.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.608+0000 7faf15573640 10 monclient: _check_auth_tickets 2026-02-24T19:23:54.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.608+0000 7faf15573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:54.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.608+0000 7faf15573640 1 -- 10.20.193.14:0/2192333156 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7faf0c002df0 con 0x7faf1815e2a0 2026-02-24T19:23:54.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.608+0000 7faf1ca5b640 5 monclient: authenticate success, global_id 30906 2026-02-24T19:23:54.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.608+0000 7faf1ca5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:54.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.608+0000 7faf15573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:54.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.608+0000 7faf15573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:23:54.618 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.608+0000 7faf15573640 10 monclient: dump: 2026-02-24T19:23:54.618 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:54.618 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:54.618 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.618 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.619 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:54.619 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:54.619 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:54.619 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:54.619 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:54.619 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:54.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.608+0000 7faf1ca5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:54.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.609+0000 7faf15573640 1 -- 10.20.193.14:0/2192333156 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faf0c002fc0 con 0x7faf1815e2a0 2026-02-24T19:23:54.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.609+0000 7faf15573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:54.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.609+0000 7faf15573640 1 -- 10.20.193.14:0/2192333156 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7faf0c003400 con 0x7faf1815e2a0 2026-02-24T19:23:54.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.609+0000 7faf15573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:54.619 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.609+0000 7faf15573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:54.620 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.609+0000 7faf15573640 10 monclient: dump: 2026-02-24T19:23:54.620 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:54.620 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:54.620 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.620 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.620 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:54.620 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:54.620 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:54.620 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:54.620 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:54.620 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:54.620 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.609+0000 7faf1ca5b640 10 monclient: get_monmap_and_config success 2026-02-24T19:23:54.620 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.609+0000 7faf1ca5b640 4 set_mon_vals no callback set 2026-02-24T19:23:54.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.609+0000 7faf1ca5b640 10 monclient: shutdown 2026-02-24T19:23:54.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.609+0000 7faf1ca5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:54.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.609+0000 7faf1ca5b640 1 -- 10.20.193.14:0/2192333156 >> v1:10.20.193.14:6789/0 conn(0x7faf1815e2a0 legacy=0x7faf1805da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:54.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.609+0000 7faf1ca5b640 1 -- 10.20.193.14:0/2192333156 shutdown_connections 2026-02-24T19:23:54.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.609+0000 7faf1ca5b640 1 -- 10.20.193.14:0/2192333156 >> 10.20.193.14:0/2192333156 conn(0x7faf180b2f60 msgr2=0x7faf180b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:54.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.609+0000 7faf1ca5b640 1 -- 10.20.193.14:0/2192333156 shutdown_connections 2026-02-24T19:23:54.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.609+0000 7faf1ca5b640 1 -- 10.20.193.14:0/2192333156 wait complete. 2026-02-24T19:23:54.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.610+0000 7faf1ca5b640 10 monclient: build_initial_monmap 2026-02-24T19:23:54.621 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.610+0000 7faf1ca5b640 10 monclient: monmap: 2026-02-24T19:23:54.621 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:54.621 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:23:54.621 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:23:54.622 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:23:54.622 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:54.622 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:23:54.622 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:54.622 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:54.622 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:54.622 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:54.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.610+0000 7faf1ca5b640 1 librados: starting msgr at 2026-02-24T19:23:54.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.610+0000 7faf1ca5b640 1 librados: starting objecter 2026-02-24T19:23:54.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.610+0000 7faf1ca5b640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:23:54.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.610+0000 7faf1ca5b640 1 Processor -- start 2026-02-24T19:23:54.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.610+0000 7faf1ca5b640 1 -- start start 2026-02-24T19:23:54.622 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.610+0000 7faf1ca5b640 1 librados: setting wanted keys 2026-02-24T19:23:54.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.610+0000 7faf1ca5b640 1 librados: calling monclient init 2026-02-24T19:23:54.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.610+0000 7faf1ca5b640 10 monclient: init 2026-02-24T19:23:54.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.611+0000 7faf1ca5b640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:54.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.611+0000 7faf1ca5b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:23:54.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.611+0000 7faf1ca5b640 10 monclient(hunting): picked mon.noname-c con 0x7faf18059e10 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:54.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.611+0000 7faf1ca5b640 10 monclient(hunting): picked mon.noname-a con 0x7faf1815e2a0 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:54.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.611+0000 7faf1ca5b640 10 monclient(hunting): picked mon.noname-b con 0x7faf181a5660 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:54.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.611+0000 7faf1ca5b640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf18193d00 con 0x7faf1815e2a0 2026-02-24T19:23:54.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.611+0000 7faf1ca5b640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf18193f70 con 0x7faf181a5660 2026-02-24T19:23:54.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.611+0000 7faf1ca5b640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf18194250 con 0x7faf18059e10 2026-02-24T19:23:54.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.611+0000 7faf1ca5b640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:54.623 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.611+0000 7faf1ca5b640 10 monclient(hunting): authenticate will time out at 4009.292099s 2026-02-24T19:23:54.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.611+0000 7faf15d74640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7faf1815e2a0 0x7faf1811e800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:51166/0 (socket says 10.20.193.14:51166) 2026-02-24T19:23:54.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.611+0000 7faf15d74640 1 -- 10.20.193.14:0/3455302974 learned_addr learned my addr 10.20.193.14:0/3455302974 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:54.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.611+0000 7faefeffd640 10 client.?.objecter ms_handle_connect 0x7faf1815e2a0 2026-02-24T19:23:54.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.611+0000 7faefeffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:54.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.611+0000 7faefeffd640 10 client.?.objecter ms_handle_connect 0x7faf18059e10 2026-02-24T19:23:54.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.611+0000 7faefeffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:54.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.611+0000 7faefeffd640 10 client.?.objecter ms_handle_connect 0x7faf181a5660 2026-02-24T19:23:54.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.611+0000 7faefeffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:54.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.612+0000 7faefeffd640 1 -- 10.20.193.14:0/3455302974 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3058450520 0 0) 0x7faf18193d00 con 0x7faf1815e2a0 2026-02-24T19:23:54.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.612+0000 7faefeffd640 10 monclient(hunting): _negotiate 2026-02-24T19:23:54.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.612+0000 7faefeffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:54.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.612+0000 7faefeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:54.624 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.612+0000 7faefeffd640 10 monclient(hunting): my global_id is 30909 2026-02-24T19:23:54.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.612+0000 7faefeffd640 1 -- 10.20.193.14:0/3455302974 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faee4003610 con 0x7faf1815e2a0 2026-02-24T19:23:54.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.612+0000 7faefeffd640 1 -- 10.20.193.14:0/3455302974 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1946106826 0 0) 0x7faf18194250 con 0x7faf18059e10 2026-02-24T19:23:54.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.612+0000 7faefeffd640 10 monclient(hunting): _negotiate 2026-02-24T19:23:54.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.612+0000 7faefeffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:54.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.612+0000 7faefeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:54.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.612+0000 7faefeffd640 10 monclient(hunting): my global_id is 28862 2026-02-24T19:23:54.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.612+0000 7faefeffd640 1 -- 10.20.193.14:0/3455302974 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf18193d00 con 0x7faf18059e10 2026-02-24T19:23:54.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.612+0000 7faefeffd640 1 -- 10.20.193.14:0/3455302974 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1557492447 0 0) 0x7faf18193f70 con 0x7faf181a5660 2026-02-24T19:23:54.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.612+0000 7faefeffd640 10 monclient(hunting): _negotiate 2026-02-24T19:23:54.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.612+0000 7faefeffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:54.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.612+0000 7faefeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:54.625 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.612+0000 7faefeffd640 10 monclient(hunting): my global_id is 29224 2026-02-24T19:23:54.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.612+0000 7faefeffd640 1 -- 10.20.193.14:0/3455302974 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf18194250 con 0x7faf181a5660 2026-02-24T19:23:54.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.614+0000 7faefeffd640 1 -- 10.20.193.14:0/3455302974 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3806055905 0 0) 0x7faee4003610 con 0x7faf1815e2a0 2026-02-24T19:23:54.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.614+0000 7faefeffd640 1 -- 10.20.193.14:0/3455302974 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faf18193f70 con 0x7faf1815e2a0 2026-02-24T19:23:54.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.614+0000 7faefeffd640 1 -- 10.20.193.14:0/3455302974 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7faf000030f0 con 0x7faf1815e2a0 2026-02-24T19:23:54.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.614+0000 7faefeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:54.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.614+0000 7faefeffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:23:54.626 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.614+0000 7faefeffd640 10 monclient(hunting): dump: 2026-02-24T19:23:54.626 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:54.626 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:54.626 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.626 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.626 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:54.626 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:54.627 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:54.627 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:54.627 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:54.627 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:54.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.614+0000 7faefeffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:23:54.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.614+0000 7faefeffd640 1 -- 10.20.193.14:0/3455302974 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3322144975 0 0) 0x7faf18193d00 con 0x7faf18059e10 2026-02-24T19:23:54.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.615+0000 7faefeffd640 1 -- 10.20.193.14:0/3455302974 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faee4003610 con 0x7faf18059e10 2026-02-24T19:23:54.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.615+0000 7faefeffd640 1 -- 10.20.193.14:0/3455302974 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7faf0c003310 con 0x7faf18059e10 2026-02-24T19:23:54.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.615+0000 7faefeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:54.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.615+0000 7faefeffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:54.627 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.615+0000 7faefeffd640 10 monclient(hunting): dump: 2026-02-24T19:23:54.627 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:54.627 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:54.628 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.628 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.628 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:54.628 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:54.628 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:54.628 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:54.628 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:54.628 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:54.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.615+0000 7faefeffd640 1 -- 10.20.193.14:0/3455302974 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2600411618 0 0) 0x7faf18194250 con 0x7faf181a5660 2026-02-24T19:23:54.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.615+0000 7faefeffd640 1 -- 10.20.193.14:0/3455302974 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faf18193d00 con 0x7faf181a5660 2026-02-24T19:23:54.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.615+0000 7faefeffd640 1 -- 10.20.193.14:0/3455302974 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7faf08003410 con 0x7faf181a5660 2026-02-24T19:23:54.628 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.615+0000 7faefeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:54.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.615+0000 7faefeffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:54.629 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.615+0000 7faefeffd640 10 monclient(hunting): dump: 2026-02-24T19:23:54.629 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:54.629 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:54.629 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.629 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.629 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:54.629 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:54.629 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:54.629 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:54.629 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:54.629 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:54.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.616+0000 7faefeffd640 1 -- 10.20.193.14:0/3455302974 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4111423313 0 0) 0x7faf18193f70 con 0x7faf1815e2a0 2026-02-24T19:23:54.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.616+0000 7faefeffd640 1 -- 10.20.193.14:0/3455302974 >> v1:10.20.193.170:6789/0 conn(0x7faf18059e10 legacy=0x7faf1818fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:54.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.616+0000 7faefeffd640 1 -- 10.20.193.14:0/3455302974 >> v1:10.20.193.44:6789/0 conn(0x7faf181a5660 legacy=0x7faf18164070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:54.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.616+0000 7faefeffd640 10 monclient: _finish_hunting 0 2026-02-24T19:23:54.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.616+0000 7faefeffd640 1 monclient: found mon.a 2026-02-24T19:23:54.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.616+0000 7faefeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:54.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.616+0000 7faefeffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:54.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.616+0000 7faefeffd640 1 -- 10.20.193.14:0/3455302974 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf18194530 con 0x7faf1815e2a0 2026-02-24T19:23:54.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.616+0000 7faefeffd640 10 monclient: _finish_auth 0 2026-02-24T19:23:54.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.616+0000 7faefeffd640 10 monclient: _check_auth_tickets 2026-02-24T19:23:54.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.616+0000 7faefeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:54.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.616+0000 7faf1ca5b640 5 monclient: authenticate success, global_id 30909 2026-02-24T19:23:54.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.616+0000 7faf1ca5b640 10 monclient: _renew_subs 2026-02-24T19:23:54.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.616+0000 7faf1ca5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:54.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.616+0000 7faf1ca5b640 1 -- 10.20.193.14:0/3455302974 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7faf18194810 con 0x7faf1815e2a0 2026-02-24T19:23:54.633 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.616+0000 7faf1ca5b640 10 client.30909.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:54.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.616+0000 7faf1ca5b640 10 monclient: _renew_subs 2026-02-24T19:23:54.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.616+0000 7faf1ca5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:54.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.616+0000 7faf1ca5b640 1 -- 10.20.193.14:0/3455302974 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7faf18195010 con 0x7faf1815e2a0 2026-02-24T19:23:54.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.616+0000 7faf1ca5b640 1 librados: init done 2026-02-24T19:23:54.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.616+0000 7faf1ca5b640 10 client.30909.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:54.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.616+0000 7faf1ca5b640 15 client.30909.objecter _session_command_op_assign -1 1 2026-02-24T19:23:54.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.616+0000 7faf1ca5b640 20 client.30909.objecter _get_session osd=-1 returning homeless 2026-02-24T19:23:54.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.616+0000 7faf1ca5b640 10 client.30909.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:54.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.616+0000 7faf1ca5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:54.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.616+0000 7faf1ca5b640 1 -- 10.20.193.14:0/3455302974 --> v1:10.20.193.14:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7faf181952a0 con 0x7faf1815e2a0 2026-02-24T19:23:54.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.624+0000 7faefeffd640 1 -- 10.20.193.14:0/3455302974 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faf181952a0 con 0x7faf1815e2a0 2026-02-24T19:23:54.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.624+0000 7faefeffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:54.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.624+0000 7faefeffd640 1 -- 10.20.193.14:0/3455302974 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7faf000039b0 con 0x7faf1815e2a0 2026-02-24T19:23:54.634 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.624+0000 7faefeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:54.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.624+0000 7faefeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:54.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.624+0000 7faefeffd640 10 monclient: dump: 2026-02-24T19:23:54.635 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:54.635 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:54.635 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.635 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.635 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:54.635 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:54.635 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:54.635 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:54.635 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:54.635 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:54.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.624+0000 7faf14d72640 4 set_mon_vals no callback set 2026-02-24T19:23:54.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.625+0000 7faefeffd640 1 -- 10.20.193.14:0/3455302974 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7faf00003bc0 con 0x7faf1815e2a0 2026-02-24T19:23:54.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.625+0000 7faf16575640 10 monclient: get_auth_request con 0x7faee4077e20 auth_method 0 2026-02-24T19:23:54.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.626+0000 7faefeffd640 10 client.30909.objecter ms_handle_connect 0x7faee4077e20 2026-02-24T19:23:54.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.627+0000 7faefeffd640 1 -- 10.20.193.14:0/3455302974 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7faf000039b0 con 0x7faf1815e2a0 2026-02-24T19:23:54.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.627+0000 7faefeffd640 10 client.30909.objecter ms_dispatch2 0x7faf18000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:23:54.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.627+0000 7faefeffd640 3 client.30909.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:23:54.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.627+0000 7faefeffd640 3 client.30909.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:23:54.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.627+0000 7faefeffd640 10 client.30909.objecter checking command 1 2026-02-24T19:23:54.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.627+0000 7faefeffd640 20 client.30909.objecter _get_session s=0x7faee40a20e0 osd=15 3 2026-02-24T19:23:54.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.627+0000 7faefeffd640 20 client.30909.objecter put_session s=0x7faee40a20e0 osd=15 3 2026-02-24T19:23:54.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.627+0000 7faefeffd640 15 client.30909.objecter _session_command_op_remove -1 1 2026-02-24T19:23:54.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.627+0000 7faefeffd640 20 client.30909.objecter _get_session s=0x7faee40a20e0 osd=15 3 2026-02-24T19:23:54.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.627+0000 7faefeffd640 20 client.30909.objecter get_session s=0x7faee40a20e0 osd=15 3 2026-02-24T19:23:54.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.627+0000 7faefeffd640 15 client.30909.objecter _session_command_op_assign 15 1 2026-02-24T19:23:54.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.627+0000 7faefeffd640 20 client.30909.objecter put_session s=0x7faee40a20e0 osd=15 4 2026-02-24T19:23:54.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.627+0000 7faefeffd640 10 client.30909.objecter _send_command 1 2026-02-24T19:23:54.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.627+0000 7faefeffd640 1 -- 10.20.193.14:0/3455302974 --> v1:10.20.193.195:6809/3316970219 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faee40c43f0 con 0x7faee40a2790 2026-02-24T19:23:54.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.627+0000 7faefeffd640 20 client.30909.objecter dump_active .. 0 homeless 2026-02-24T19:23:54.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.627+0000 7faefeffd640 1 -- 10.20.193.14:0/3455302974 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_get_version_reply(handle=1 version=354) ==== 24+0+0 (unknown 31317031 0 0) 0x7faf00059690 con 0x7faf1815e2a0 2026-02-24T19:23:54.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.627+0000 7faefeffd640 10 monclient: handle_get_version_reply finishing 1 version 354 2026-02-24T19:23:54.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.627+0000 7faf16d76640 10 monclient: get_auth_request con 0x7faee40a2790 auth_method 0 2026-02-24T19:23:54.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.629+0000 7faefeffd640 10 client.30909.objecter ms_handle_connect 0x7faee40a2790 2026-02-24T19:23:54.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.638+0000 7faefeffd640 1 -- 10.20.193.14:0/3455302974 <== osd.15 v1:10.20.193.195:6809/3316970219 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7faee40c43f0 con 0x7faee40a2790 2026-02-24T19:23:54.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.638+0000 7faefeffd640 10 client.30909.objecter ms_dispatch2 0x7faf18000b90 command_reply(tid 1: 0 ) 2026-02-24T19:23:54.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.638+0000 7faefeffd640 10 client.30909.objecter _finish_command 1 = system:0 2026-02-24T19:23:54.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.638+0000 7faefeffd640 20 client.30909.objecter put_session s=0x7faee40a20e0 osd=15 4 2026-02-24T19:23:54.640 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.638+0000 7faefeffd640 15 client.30909.objecter _session_command_op_remove 15 1 2026-02-24T19:23:54.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.645+0000 7faf1ca5b640 10 client.30909.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:23:54.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.645+0000 7faf1ca5b640 15 client.30909.objecter _session_command_op_assign -1 2 2026-02-24T19:23:54.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.645+0000 7faf1ca5b640 20 client.30909.objecter _get_session s=0x7faee40a20e0 osd=15 3 2026-02-24T19:23:54.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.645+0000 7faf1ca5b640 20 client.30909.objecter put_session s=0x7faee40a20e0 osd=15 3 2026-02-24T19:23:54.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.645+0000 7faf1ca5b640 20 client.30909.objecter _get_session s=0x7faee40a20e0 osd=15 3 2026-02-24T19:23:54.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.645+0000 7faf1ca5b640 15 client.30909.objecter _session_command_op_remove -1 2 2026-02-24T19:23:54.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.645+0000 7faf1ca5b640 20 client.30909.objecter get_session s=0x7faee40a20e0 osd=15 3 2026-02-24T19:23:54.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.645+0000 7faf1ca5b640 15 client.30909.objecter _session_command_op_assign 15 2 2026-02-24T19:23:54.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.645+0000 7faf1ca5b640 20 client.30909.objecter put_session s=0x7faee40a20e0 osd=15 4 2026-02-24T19:23:54.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.645+0000 7faf1ca5b640 10 client.30909.objecter _send_command 2 2026-02-24T19:23:54.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.645+0000 7faf1ca5b640 1 -- 10.20.193.14:0/3455302974 --> v1:10.20.193.195:6809/3316970219 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7faf18195e10 con 0x7faee40a2790 2026-02-24T19:23:54.655 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.653+0000 7faefeffd640 1 -- 10.20.193.14:0/3455302974 <== osd.15 v1:10.20.193.195:6809/3316970219 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7faf18195e10 con 0x7faee40a2790 2026-02-24T19:23:54.655 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.653+0000 7faefeffd640 10 client.30909.objecter ms_dispatch2 0x7faf18000b90 command_reply(tid 2: 0 ) 2026-02-24T19:23:54.655 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.653+0000 7faefeffd640 10 client.30909.objecter _finish_command 2 = system:0 2026-02-24T19:23:54.655 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.653+0000 7faefeffd640 20 client.30909.objecter put_session s=0x7faee40a20e0 osd=15 4 2026-02-24T19:23:54.655 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.653+0000 7faefeffd640 15 client.30909.objecter _session_command_op_remove 15 2 2026-02-24T19:23:54.656 INFO:teuthology.orchestra.run.trial014.stdout:{ 2026-02-24T19:23:54.656 INFO:teuthology.orchestra.run.trial014.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:23:54.656 INFO:teuthology.orchestra.run.trial014.stdout:} 2026-02-24T19:23:54.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.654+0000 7faf1ca5b640 10 librados: watch_flush enter 2026-02-24T19:23:54.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.654+0000 7faf1ca5b640 10 librados: watch_flush exit 2026-02-24T19:23:54.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.654+0000 7faf1ca5b640 10 client.30909.objecter close_session for osd.15 2026-02-24T19:23:54.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.654+0000 7faf1ca5b640 1 -- 10.20.193.14:0/3455302974 >> v1:10.20.193.195:6809/3316970219 conn(0x7faee40a2790 legacy=0x7faee40c2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:54.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.654+0000 7faf1ca5b640 20 client.30909.objecter put_session s=0x7faee40a20e0 osd=15 1 2026-02-24T19:23:54.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.654+0000 7faf1ca5b640 20 client.30909.objecter shutdown clearing up homeless session... 2026-02-24T19:23:54.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.654+0000 7faf1ca5b640 10 client.30909.objecter successfully canceled tick 2026-02-24T19:23:54.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.654+0000 7faf1ca5b640 1 -- 10.20.193.14:0/3455302974 >> v1:10.20.193.14:6800/4014096310 conn(0x7faee4077e20 legacy=0x7faee40982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:54.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.654+0000 7faf1ca5b640 10 monclient: shutdown 2026-02-24T19:23:54.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.654+0000 7faf1ca5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:54.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.654+0000 7faf1ca5b640 1 -- 10.20.193.14:0/3455302974 >> v1:10.20.193.14:6789/0 conn(0x7faf1815e2a0 legacy=0x7faf1811e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:54.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.654+0000 7faf16d76640 1 -- 10.20.193.14:0/3455302974 reap_dead start 2026-02-24T19:23:54.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.654+0000 7faf1ca5b640 1 -- 10.20.193.14:0/3455302974 shutdown_connections 2026-02-24T19:23:54.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.654+0000 7faf1ca5b640 1 -- 10.20.193.14:0/3455302974 >> 10.20.193.14:0/3455302974 conn(0x7faf180b2f60 msgr2=0x7faf181a4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:54.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.654+0000 7faf1ca5b640 1 -- 10.20.193.14:0/3455302974 shutdown_connections 2026-02-24T19:23:54.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.654+0000 7faf1ca5b640 1 -- 10.20.193.14:0/3455302974 wait complete. 2026-02-24T19:23:54.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.654+0000 7faf1ca5b640 1 librados: shutdown 2026-02-24T19:23:54.664 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 15 2026-02-24T19:23:54.730 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.728+0000 7f8132dfa640 10 monclient: get_monmap_and_config 2026-02-24T19:23:54.730 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.728+0000 7f8132dfa640 10 monclient: build_initial_monmap 2026-02-24T19:23:54.730 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.728+0000 7f8132dfa640 10 monclient: monmap: 2026-02-24T19:23:54.730 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:54.730 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:54.731 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:23:54.729398+0000 2026-02-24T19:23:54.731 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:23:54.729398+0000 2026-02-24T19:23:54.731 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:54.731 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:54.731 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:54.731 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:54.731 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:54.731 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:54.732 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.729+0000 7f8132dfa640 1 Processor -- start 2026-02-24T19:23:54.733 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.729+0000 7f8132dfa640 1 -- start start 2026-02-24T19:23:54.733 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.729+0000 7f8132dfa640 10 monclient: init 2026-02-24T19:23:54.733 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.729+0000 7f8132dfa640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:54.733 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.729+0000 7f8132dfa640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:23:54.733 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.729+0000 7f8132dfa640 10 monclient(hunting): picked mon.noname-c con 0x7f812c157780 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:54.733 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.729+0000 7f8132dfa640 10 monclient(hunting): picked mon.noname-a con 0x7f812c157b50 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:54.733 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.729+0000 7f8132dfa640 10 monclient(hunting): picked mon.noname-b con 0x7f812c164d00 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:54.733 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.729+0000 7f8132dfa640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f812c05de70 con 0x7f812c157b50 2026-02-24T19:23:54.733 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.729+0000 7f8132dfa640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f812c055b20 con 0x7f812c164d00 2026-02-24T19:23:54.733 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.729+0000 7f8132dfa640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f812c055e00 con 0x7f812c157780 2026-02-24T19:23:54.733 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.729+0000 7f8132dfa640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:54.734 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.729+0000 7f8132dfa640 10 monclient(hunting): authenticate will time out at 4009.410818s 2026-02-24T19:23:54.734 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.730+0000 7f8123fff640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f812c157b50 0x7f812c1645f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:51182/0 (socket says 10.20.193.14:51182) 2026-02-24T19:23:54.734 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.730+0000 7f8123fff640 1 -- 10.20.193.14:0/75185798 learned_addr learned my addr 10.20.193.14:0/75185798 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:54.738 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.731+0000 7f81237fe640 1 -- 10.20.193.14:0/75185798 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 789376035 0 0) 0x7f812c05de70 con 0x7f812c157b50 2026-02-24T19:23:54.738 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.731+0000 7f81237fe640 10 monclient(hunting): _negotiate 2026-02-24T19:23:54.738 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.731+0000 7f81237fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:54.738 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.731+0000 7f81237fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:54.739 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.731+0000 7f81237fe640 10 monclient(hunting): my global_id is 30912 2026-02-24T19:23:54.739 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.731+0000 7f81237fe640 1 -- 10.20.193.14:0/75185798 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8118003610 con 0x7f812c157b50 2026-02-24T19:23:54.739 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.731+0000 7f81237fe640 1 -- 10.20.193.14:0/75185798 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 7749702 0 0) 0x7f812c055e00 con 0x7f812c157780 2026-02-24T19:23:54.739 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.731+0000 7f81237fe640 10 monclient(hunting): _negotiate 2026-02-24T19:23:54.739 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.731+0000 7f81237fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:54.739 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.731+0000 7f81237fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:54.739 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.731+0000 7f81237fe640 10 monclient(hunting): my global_id is 28865 2026-02-24T19:23:54.739 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.731+0000 7f81237fe640 1 -- 10.20.193.14:0/75185798 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f812c05de70 con 0x7f812c157780 2026-02-24T19:23:54.739 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.732+0000 7f81237fe640 1 -- 10.20.193.14:0/75185798 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 190814282 0 0) 0x7f812c055b20 con 0x7f812c164d00 2026-02-24T19:23:54.739 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.732+0000 7f81237fe640 10 monclient(hunting): _negotiate 2026-02-24T19:23:54.739 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.732+0000 7f81237fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:54.739 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.732+0000 7f81237fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:54.740 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.732+0000 7f81237fe640 10 monclient(hunting): my global_id is 29227 2026-02-24T19:23:54.740 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.732+0000 7f81237fe640 1 -- 10.20.193.14:0/75185798 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f812c055e00 con 0x7f812c164d00 2026-02-24T19:23:54.740 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.733+0000 7f81237fe640 1 -- 10.20.193.14:0/75185798 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1387011163 0 0) 0x7f8118003610 con 0x7f812c157b50 2026-02-24T19:23:54.740 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.733+0000 7f81237fe640 1 -- 10.20.193.14:0/75185798 >> v1:10.20.193.170:6789/0 conn(0x7f812c157780 legacy=0x7f812c056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:54.740 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.733+0000 7f81237fe640 1 -- 10.20.193.14:0/75185798 >> v1:10.20.193.44:6789/0 conn(0x7f812c164d00 legacy=0x7f812c1c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:54.740 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.733+0000 7f81237fe640 10 monclient: _finish_hunting 0 2026-02-24T19:23:54.740 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.733+0000 7f81237fe640 1 monclient: found mon.noname-a 2026-02-24T19:23:54.740 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.733+0000 7f81237fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:54.740 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.733+0000 7f81237fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.14:6789/0 2026-02-24T19:23:54.740 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.733+0000 7f81237fe640 1 -- 10.20.193.14:0/75185798 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f812c0560e0 con 0x7f812c157b50 2026-02-24T19:23:54.740 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.733+0000 7f81237fe640 10 monclient: _finish_auth 0 2026-02-24T19:23:54.740 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.733+0000 7f81237fe640 10 monclient: _check_auth_tickets 2026-02-24T19:23:54.740 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.733+0000 7f81237fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:54.741 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.733+0000 7f81237fe640 1 -- 10.20.193.14:0/75185798 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f8114002df0 con 0x7f812c157b50 2026-02-24T19:23:54.741 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.733+0000 7f81237fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:54.741 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.733+0000 7f81237fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:23:54.741 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.733+0000 7f81237fe640 10 monclient: dump: 2026-02-24T19:23:54.741 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:54.741 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:54.741 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.741 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.741 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:54.741 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:54.741 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:54.741 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:54.742 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:54.742 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:54.742 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.733+0000 7f8132dfa640 5 monclient: authenticate success, global_id 30912 2026-02-24T19:23:54.742 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.733+0000 7f8132dfa640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:54.742 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.734+0000 7f81237fe640 1 -- 10.20.193.14:0/75185798 <== mon.0 v1:10.20.193.14:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8114002fc0 con 0x7f812c157b50 2026-02-24T19:23:54.742 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.734+0000 7f81237fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:54.742 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.734+0000 7f81237fe640 1 -- 10.20.193.14:0/75185798 <== mon.0 v1:10.20.193.14:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f8114003400 con 0x7f812c157b50 2026-02-24T19:23:54.742 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.734+0000 7f81237fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:54.742 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.734+0000 7f81237fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:54.742 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.734+0000 7f81237fe640 10 monclient: dump: 2026-02-24T19:23:54.742 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:54.742 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:54.743 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.743 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.743 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:54.743 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:54.743 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:54.743 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:54.743 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:54.743 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:54.743 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.734+0000 7f8132dfa640 10 monclient: get_monmap_and_config success 2026-02-24T19:23:54.743 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.734+0000 7f8132dfa640 4 set_mon_vals no callback set 2026-02-24T19:23:54.743 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.735+0000 7f8132dfa640 10 monclient: shutdown 2026-02-24T19:23:54.743 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.735+0000 7f8132dfa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:54.744 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.735+0000 7f8132dfa640 1 -- 10.20.193.14:0/75185798 >> v1:10.20.193.14:6789/0 conn(0x7f812c157b50 legacy=0x7f812c1645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:54.744 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.735+0000 7f8132dfa640 1 -- 10.20.193.14:0/75185798 shutdown_connections 2026-02-24T19:23:54.744 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.735+0000 7f8132dfa640 1 -- 10.20.193.14:0/75185798 >> 10.20.193.14:0/75185798 conn(0x7f812c0b2ef0 msgr2=0x7f812c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:54.744 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.735+0000 7f8132dfa640 1 -- 10.20.193.14:0/75185798 shutdown_connections 2026-02-24T19:23:54.744 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.735+0000 7f8132dfa640 1 -- 10.20.193.14:0/75185798 wait complete. 2026-02-24T19:23:54.744 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.735+0000 7f8132dfa640 10 monclient: build_initial_monmap 2026-02-24T19:23:54.744 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.735+0000 7f8132dfa640 10 monclient: monmap: 2026-02-24T19:23:54.744 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:54.744 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:23:54.744 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:23:54.744 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:23:54.744 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:54.744 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:23:54.745 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:54.745 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:54.745 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:54.745 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:54.745 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.735+0000 7f8132dfa640 1 librados: starting msgr at 2026-02-24T19:23:54.745 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.735+0000 7f8132dfa640 1 librados: starting objecter 2026-02-24T19:23:54.745 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.735+0000 7f8132dfa640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:23:54.745 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.735+0000 7f8132dfa640 1 Processor -- start 2026-02-24T19:23:54.745 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.735+0000 7f8132dfa640 1 -- start start 2026-02-24T19:23:54.745 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.735+0000 7f8132dfa640 1 librados: setting wanted keys 2026-02-24T19:23:54.745 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.735+0000 7f8132dfa640 1 librados: calling monclient init 2026-02-24T19:23:54.745 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.735+0000 7f8132dfa640 10 monclient: init 2026-02-24T19:23:54.745 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.736+0000 7f8132dfa640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:54.746 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.736+0000 7f8132dfa640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:23:54.746 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.736+0000 7f8132dfa640 10 monclient(hunting): picked mon.noname-b con 0x7f812c157780 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:54.746 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.736+0000 7f8132dfa640 10 monclient(hunting): picked mon.noname-a con 0x7f812c157b50 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:54.746 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.736+0000 7f8132dfa640 10 monclient(hunting): picked mon.noname-c con 0x7f812c164d00 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:54.746 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.736+0000 7f8132dfa640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f812c161c80 con 0x7f812c157b50 2026-02-24T19:23:54.746 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.736+0000 7f8132dfa640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f812c13bf30 con 0x7f812c157780 2026-02-24T19:23:54.746 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.736+0000 7f8132dfa640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f812c0a71f0 con 0x7f812c164d00 2026-02-24T19:23:54.746 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.736+0000 7f8132dfa640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:54.746 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.736+0000 7f8132dfa640 10 monclient(hunting): authenticate will time out at 4009.417293s 2026-02-24T19:23:54.746 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.736+0000 7f8130b6f640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7f812c157780 0x7f812c1479f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:40446/0 (socket says 10.20.193.14:40446) 2026-02-24T19:23:54.746 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.736+0000 7f8130b6f640 1 -- 10.20.193.14:0/3411597229 learned_addr learned my addr 10.20.193.14:0/3411597229 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:54.746 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.736+0000 7f81217fa640 10 client.?.objecter ms_handle_connect 0x7f812c157b50 2026-02-24T19:23:54.747 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.736+0000 7f81217fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:54.747 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.736+0000 7f81217fa640 10 client.?.objecter ms_handle_connect 0x7f812c157780 2026-02-24T19:23:54.747 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.736+0000 7f81217fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:54.747 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.737+0000 7f81217fa640 10 client.?.objecter ms_handle_connect 0x7f812c164d00 2026-02-24T19:23:54.747 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.737+0000 7f81217fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:54.750 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.737+0000 7f81217fa640 1 -- 10.20.193.14:0/3411597229 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 618736269 0 0) 0x7f812c161c80 con 0x7f812c157b50 2026-02-24T19:23:54.750 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.737+0000 7f81217fa640 10 monclient(hunting): _negotiate 2026-02-24T19:23:54.750 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.737+0000 7f81217fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:54.750 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.737+0000 7f81217fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:54.750 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.737+0000 7f81217fa640 10 monclient(hunting): my global_id is 30915 2026-02-24T19:23:54.750 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.737+0000 7f81217fa640 1 -- 10.20.193.14:0/3411597229 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80fc003610 con 0x7f812c157b50 2026-02-24T19:23:54.750 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.738+0000 7f81217fa640 1 -- 10.20.193.14:0/3411597229 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3051952632 0 0) 0x7f812c13bf30 con 0x7f812c157780 2026-02-24T19:23:54.751 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.738+0000 7f81217fa640 10 monclient(hunting): _negotiate 2026-02-24T19:23:54.751 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.738+0000 7f81217fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:54.751 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.738+0000 7f81217fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:54.751 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.738+0000 7f81217fa640 10 monclient(hunting): my global_id is 29230 2026-02-24T19:23:54.751 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.738+0000 7f81217fa640 1 -- 10.20.193.14:0/3411597229 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f812c161c80 con 0x7f812c157780 2026-02-24T19:23:54.751 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.738+0000 7f81217fa640 1 -- 10.20.193.14:0/3411597229 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 138072841 0 0) 0x7f812c0a71f0 con 0x7f812c164d00 2026-02-24T19:23:54.751 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.738+0000 7f81217fa640 10 monclient(hunting): _negotiate 2026-02-24T19:23:54.751 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.738+0000 7f81217fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:54.751 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.738+0000 7f81217fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:54.751 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.738+0000 7f81217fa640 10 monclient(hunting): my global_id is 28868 2026-02-24T19:23:54.751 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.738+0000 7f81217fa640 1 -- 10.20.193.14:0/3411597229 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f812c13bf30 con 0x7f812c164d00 2026-02-24T19:23:54.751 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.740+0000 7f81217fa640 1 -- 10.20.193.14:0/3411597229 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2750992204 0 0) 0x7f80fc003610 con 0x7f812c157b50 2026-02-24T19:23:54.752 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.740+0000 7f81217fa640 1 -- 10.20.193.14:0/3411597229 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f812c0a71f0 con 0x7f812c157b50 2026-02-24T19:23:54.752 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.740+0000 7f81217fa640 1 -- 10.20.193.14:0/3411597229 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f8114003310 con 0x7f812c157b50 2026-02-24T19:23:54.752 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.740+0000 7f81217fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:54.752 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.740+0000 7f81217fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:23:54.752 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.740+0000 7f81217fa640 10 monclient(hunting): dump: 2026-02-24T19:23:54.752 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:54.752 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:54.752 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.752 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.752 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:54.752 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:54.752 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:54.752 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:54.753 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:54.753 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:54.753 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.740+0000 7f81217fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:23:54.753 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.740+0000 7f81217fa640 1 -- 10.20.193.14:0/3411597229 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1862062484 0 0) 0x7f812c161c80 con 0x7f812c157780 2026-02-24T19:23:54.753 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.740+0000 7f81217fa640 1 -- 10.20.193.14:0/3411597229 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f80fc003610 con 0x7f812c157780 2026-02-24T19:23:54.753 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.740+0000 7f81217fa640 1 -- 10.20.193.14:0/3411597229 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f811c003190 con 0x7f812c157780 2026-02-24T19:23:54.753 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.740+0000 7f81217fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:54.753 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.740+0000 7f81217fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:54.753 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.740+0000 7f81217fa640 10 monclient(hunting): dump: 2026-02-24T19:23:54.753 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:54.753 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:54.753 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.753 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.754 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:54.754 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:54.754 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:54.754 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:54.754 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:54.754 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:54.754 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.741+0000 7f81217fa640 1 -- 10.20.193.14:0/3411597229 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 372765970 0 0) 0x7f812c13bf30 con 0x7f812c164d00 2026-02-24T19:23:54.754 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.741+0000 7f81217fa640 1 -- 10.20.193.14:0/3411597229 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f812c161c80 con 0x7f812c164d00 2026-02-24T19:23:54.754 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.741+0000 7f81217fa640 1 -- 10.20.193.14:0/3411597229 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f8128003330 con 0x7f812c164d00 2026-02-24T19:23:54.754 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.741+0000 7f81217fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:54.754 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.741+0000 7f81217fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:54.754 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.741+0000 7f81217fa640 10 monclient(hunting): dump: 2026-02-24T19:23:54.754 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:54.755 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:54.755 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.755 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.755 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:54.755 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:54.755 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:54.755 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:54.755 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:54.755 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:54.755 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.741+0000 7f81217fa640 1 -- 10.20.193.14:0/3411597229 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1075760680 0 0) 0x7f812c0a71f0 con 0x7f812c157b50 2026-02-24T19:23:54.755 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.741+0000 7f81217fa640 1 -- 10.20.193.14:0/3411597229 >> v1:10.20.193.170:6789/0 conn(0x7f812c164d00 legacy=0x7f812c136b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:54.755 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.741+0000 7f81217fa640 1 -- 10.20.193.14:0/3411597229 >> v1:10.20.193.44:6789/0 conn(0x7f812c157780 legacy=0x7f812c1479f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:54.755 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.741+0000 7f81217fa640 10 monclient: _finish_hunting 0 2026-02-24T19:23:54.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.741+0000 7f81217fa640 1 monclient: found mon.a 2026-02-24T19:23:54.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.741+0000 7f81217fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:54.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.741+0000 7f81217fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:54.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.741+0000 7f81217fa640 1 -- 10.20.193.14:0/3411597229 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f812c0a74d0 con 0x7f812c157b50 2026-02-24T19:23:54.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.741+0000 7f81217fa640 10 monclient: _finish_auth 0 2026-02-24T19:23:54.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.741+0000 7f81217fa640 10 monclient: _check_auth_tickets 2026-02-24T19:23:54.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.741+0000 7f81217fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:54.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.741+0000 7f8132dfa640 5 monclient: authenticate success, global_id 30915 2026-02-24T19:23:54.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.741+0000 7f8132dfa640 10 monclient: _renew_subs 2026-02-24T19:23:54.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.741+0000 7f8132dfa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:54.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.741+0000 7f8132dfa640 1 -- 10.20.193.14:0/3411597229 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f812c0a77b0 con 0x7f812c157b50 2026-02-24T19:23:54.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.741+0000 7f8132dfa640 10 client.30915.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:54.756 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.741+0000 7f8132dfa640 10 monclient: _renew_subs 2026-02-24T19:23:54.757 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.741+0000 7f8132dfa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:54.757 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.741+0000 7f8132dfa640 1 -- 10.20.193.14:0/3411597229 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f812c1474d0 con 0x7f812c157b50 2026-02-24T19:23:54.757 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.741+0000 7f8132dfa640 1 librados: init done 2026-02-24T19:23:54.757 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.742+0000 7f8132dfa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:54.757 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.742+0000 7f8132dfa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:54.757 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.742+0000 7f8132dfa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:54.757 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.742+0000 7f8132dfa640 1 -- 10.20.193.14:0/3411597229 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f812c0b5750 con 0x7f812c157b50 2026-02-24T19:23:54.835 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.833+0000 7f81217fa640 1 -- 10.20.193.14:0/3411597229 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8114002fc0 con 0x7f812c157b50 2026-02-24T19:23:54.835 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.833+0000 7f81217fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:54.835 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.833+0000 7f81217fa640 1 -- 10.20.193.14:0/3411597229 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f8114004b80 con 0x7f812c157b50 2026-02-24T19:23:54.835 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.833+0000 7f81217fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:54.835 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.833+0000 7f81217fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:54.835 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.833+0000 7f81217fa640 10 monclient: dump: 2026-02-24T19:23:54.835 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:54.835 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:54.835 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.836 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:54.836 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:54.836 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:54.836 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:54.836 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:54.836 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:54.836 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:54.836 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.833+0000 7f8122ffd640 4 set_mon_vals no callback set 2026-02-24T19:23:54.837 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.833+0000 7f81217fa640 1 -- 10.20.193.14:0/3411597229 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f811401d9f0 con 0x7f812c157b50 2026-02-24T19:23:54.837 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.834+0000 7f8130b6f640 10 monclient: get_auth_request con 0x7f80fc077e70 auth_method 0 2026-02-24T19:23:54.837 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.834+0000 7f81217fa640 10 client.30915.objecter ms_handle_connect 0x7f80fc077e70 2026-02-24T19:23:54.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.836+0000 7f81217fa640 1 -- 10.20.193.14:0/3411597229 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7f81140930a0 con 0x7f812c157b50 2026-02-24T19:23:54.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.836+0000 7f81217fa640 10 client.30915.objecter ms_dispatch2 0x7f812c000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:23:54.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.836+0000 7f81217fa640 3 client.30915.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:23:54.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.836+0000 7f81217fa640 3 client.30915.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:23:54.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.836+0000 7f81217fa640 20 client.30915.objecter dump_active .. 0 homeless 2026-02-24T19:23:54.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.836+0000 7f81217fa640 1 -- 10.20.193.14:0/3411597229 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f811405dad0 con 0x7f812c157b50 2026-02-24T19:23:54.838 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.836+0000 7f81217fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:54.839 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.836+0000 7f81217fa640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:23:54.943 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.942+0000 7f8132dfa640 1 -- 10.20.193.14:0/3411597229 --> v1:10.20.193.14:6800/4014096310 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "15", "target": ["mon-mgr", ""]}) -- 0x7f812c0b5470 con 0x7f80fc077e70 2026-02-24T19:23:54.944 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.942+0000 7f81217fa640 1 -- 10.20.193.14:0/3411597229 <== mgr.4110 v1:10.20.193.14:6800/4014096310 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 15 to deep-scrub) ==== 42+0+0 (unknown 337234985 0 0) 0x7f812c0b5470 con 0x7f80fc077e70 2026-02-24T19:23:54.944 INFO:teuthology.orchestra.run.trial014.stderr:instructed osd(s) 15 to deep-scrub 2026-02-24T19:23:54.945 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.943+0000 7f8132dfa640 10 librados: watch_flush enter 2026-02-24T19:23:54.945 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.943+0000 7f8132dfa640 10 librados: watch_flush exit 2026-02-24T19:23:54.945 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.943+0000 7f8132dfa640 20 client.30915.objecter shutdown clearing up homeless session... 2026-02-24T19:23:54.945 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.943+0000 7f8132dfa640 10 client.30915.objecter successfully canceled tick 2026-02-24T19:23:54.946 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.943+0000 7f8132dfa640 1 -- 10.20.193.14:0/3411597229 >> v1:10.20.193.14:6800/4014096310 conn(0x7f80fc077e70 legacy=0x7f80fc098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:54.946 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.943+0000 7f8132dfa640 10 monclient: shutdown 2026-02-24T19:23:54.946 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.943+0000 7f8132dfa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:54.946 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.943+0000 7f8132dfa640 1 -- 10.20.193.14:0/3411597229 >> v1:10.20.193.14:6789/0 conn(0x7f812c157b50 legacy=0x7f812c13b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:54.946 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.943+0000 7f8132dfa640 1 -- 10.20.193.14:0/3411597229 shutdown_connections 2026-02-24T19:23:54.946 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.943+0000 7f8132dfa640 1 -- 10.20.193.14:0/3411597229 >> 10.20.193.14:0/3411597229 conn(0x7f812c0b2ef0 msgr2=0x7f812c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:54.946 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.943+0000 7f8132dfa640 1 -- 10.20.193.14:0/3411597229 shutdown_connections 2026-02-24T19:23:54.946 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.943+0000 7f8132dfa640 1 -- 10.20.193.14:0/3411597229 wait complete. 2026-02-24T19:23:54.946 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:54.943+0000 7f8132dfa640 1 librados: shutdown 2026-02-24T19:23:54.953 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T19:23:55.021 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.020+0000 7fec4144d640 10 monclient: get_monmap_and_config 2026-02-24T19:23:55.021 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.020+0000 7fec4144d640 10 monclient: build_initial_monmap 2026-02-24T19:23:55.021 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.020+0000 7fec4144d640 10 monclient: monmap: 2026-02-24T19:23:55.022 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:55.022 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:55.022 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:23:55.020630+0000 2026-02-24T19:23:55.022 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:23:55.020630+0000 2026-02-24T19:23:55.022 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:55.022 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:55.022 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:55.022 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:55.022 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:55.022 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:55.025 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.020+0000 7fec4144d640 1 Processor -- start 2026-02-24T19:23:55.025 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.020+0000 7fec4144d640 1 -- start start 2026-02-24T19:23:55.025 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.020+0000 7fec4144d640 10 monclient: init 2026-02-24T19:23:55.025 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.020+0000 7fec4144d640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:55.025 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.020+0000 7fec4144d640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:23:55.025 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.021+0000 7fec4144d640 10 monclient(hunting): picked mon.noname-b con 0x7fec3c058da0 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:55.025 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.021+0000 7fec4144d640 10 monclient(hunting): picked mon.noname-a con 0x7fec3c0b0410 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:55.025 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.021+0000 7fec4144d640 10 monclient(hunting): picked mon.noname-c con 0x7fec3c1626a0 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:55.025 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.021+0000 7fec4144d640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec3c1655c0 con 0x7fec3c0b0410 2026-02-24T19:23:55.026 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.021+0000 7fec4144d640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec3c0b12b0 con 0x7fec3c058da0 2026-02-24T19:23:55.026 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.021+0000 7fec4144d640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec3c0b1590 con 0x7fec3c1626a0 2026-02-24T19:23:55.026 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.021+0000 7fec4144d640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:55.026 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.021+0000 7fec4144d640 10 monclient(hunting): authenticate will time out at 4009.702076s 2026-02-24T19:23:55.026 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.021+0000 7fec3a7fc640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7fec3c0b0410 0x7fec3c164eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:51198/0 (socket says 10.20.193.14:51198) 2026-02-24T19:23:55.026 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.021+0000 7fec3a7fc640 1 -- 10.20.193.14:0/766344023 learned_addr learned my addr 10.20.193.14:0/766344023 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:55.026 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.022+0000 7fec39ffb640 1 -- 10.20.193.14:0/766344023 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 965917615 0 0) 0x7fec3c1655c0 con 0x7fec3c0b0410 2026-02-24T19:23:55.026 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.022+0000 7fec39ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:23:55.026 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.022+0000 7fec39ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:55.026 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.022+0000 7fec39ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:55.026 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.022+0000 7fec39ffb640 10 monclient(hunting): my global_id is 30918 2026-02-24T19:23:55.026 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.022+0000 7fec39ffb640 1 -- 10.20.193.14:0/766344023 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec28003610 con 0x7fec3c0b0410 2026-02-24T19:23:55.027 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.022+0000 7fec39ffb640 1 -- 10.20.193.14:0/766344023 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2040533932 0 0) 0x7fec3c0b1590 con 0x7fec3c1626a0 2026-02-24T19:23:55.027 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.022+0000 7fec39ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:23:55.027 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.022+0000 7fec39ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:55.027 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.022+0000 7fec39ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:55.027 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.022+0000 7fec39ffb640 10 monclient(hunting): my global_id is 28871 2026-02-24T19:23:55.027 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.022+0000 7fec39ffb640 1 -- 10.20.193.14:0/766344023 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec3c1655c0 con 0x7fec3c1626a0 2026-02-24T19:23:55.027 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.023+0000 7fec39ffb640 1 -- 10.20.193.14:0/766344023 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3553420870 0 0) 0x7fec3c0b12b0 con 0x7fec3c058da0 2026-02-24T19:23:55.027 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.023+0000 7fec39ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:23:55.027 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.023+0000 7fec39ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:55.027 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.023+0000 7fec39ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:55.027 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.023+0000 7fec39ffb640 10 monclient(hunting): my global_id is 29233 2026-02-24T19:23:55.027 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.023+0000 7fec39ffb640 1 -- 10.20.193.14:0/766344023 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec3c0b1590 con 0x7fec3c058da0 2026-02-24T19:23:55.032 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.024+0000 7fec39ffb640 1 -- 10.20.193.14:0/766344023 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 609351786 0 0) 0x7fec3c1655c0 con 0x7fec3c1626a0 2026-02-24T19:23:55.032 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.024+0000 7fec39ffb640 1 -- 10.20.193.14:0/766344023 >> v1:10.20.193.44:6789/0 conn(0x7fec3c058da0 legacy=0x7fec3c1647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:55.032 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.024+0000 7fec39ffb640 1 -- 10.20.193.14:0/766344023 >> v1:10.20.193.14:6789/0 conn(0x7fec3c0b0410 legacy=0x7fec3c164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:55.032 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.024+0000 7fec39ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:23:55.032 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.024+0000 7fec39ffb640 1 monclient: found mon.noname-c 2026-02-24T19:23:55.032 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.024+0000 7fec39ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:55.032 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.024+0000 7fec39ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.170:6789/0 2026-02-24T19:23:55.033 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.024+0000 7fec39ffb640 1 -- 10.20.193.14:0/766344023 --> v1:10.20.193.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec3c0b1870 con 0x7fec3c1626a0 2026-02-24T19:23:55.033 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.024+0000 7fec39ffb640 10 monclient: _finish_auth 0 2026-02-24T19:23:55.033 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.024+0000 7fec39ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:23:55.033 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.024+0000 7fec39ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:55.033 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.024+0000 7fec39ffb640 1 -- 10.20.193.14:0/766344023 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fec2c003170 con 0x7fec3c1626a0 2026-02-24T19:23:55.033 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.024+0000 7fec39ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:55.033 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.024+0000 7fec39ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:23:55.033 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.024+0000 7fec39ffb640 10 monclient: dump: 2026-02-24T19:23:55.033 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:55.033 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:55.033 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:55.033 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:55.034 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:55.034 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:55.034 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:55.034 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:55.034 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:55.034 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:55.034 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.024+0000 7fec4144d640 5 monclient: authenticate success, global_id 28871 2026-02-24T19:23:55.034 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.024+0000 7fec4144d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:23:55.034 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.025+0000 7fec39ffb640 1 -- 10.20.193.14:0/766344023 <== mon.2 v1:10.20.193.170:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fec2c003340 con 0x7fec3c1626a0 2026-02-24T19:23:55.034 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.025+0000 7fec39ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:55.034 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.025+0000 7fec39ffb640 1 -- 10.20.193.14:0/766344023 <== mon.2 v1:10.20.193.170:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fec2c003780 con 0x7fec3c1626a0 2026-02-24T19:23:55.034 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.025+0000 7fec39ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:55.035 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.025+0000 7fec39ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:55.035 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.025+0000 7fec39ffb640 10 monclient: dump: 2026-02-24T19:23:55.035 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:55.035 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:55.035 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:55.035 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:55.035 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:55.035 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:55.035 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:55.035 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:55.035 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:55.035 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:55.035 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.025+0000 7fec4144d640 10 monclient: get_monmap_and_config success 2026-02-24T19:23:55.036 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.025+0000 7fec4144d640 4 set_mon_vals no callback set 2026-02-24T19:23:55.036 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.025+0000 7fec4144d640 10 monclient: shutdown 2026-02-24T19:23:55.036 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.025+0000 7fec4144d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:55.036 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.025+0000 7fec4144d640 1 -- 10.20.193.14:0/766344023 >> v1:10.20.193.170:6789/0 conn(0x7fec3c1626a0 legacy=0x7fec3c1c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:55.036 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.025+0000 7fec4144d640 1 -- 10.20.193.14:0/766344023 shutdown_connections 2026-02-24T19:23:55.036 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.025+0000 7fec4144d640 1 -- 10.20.193.14:0/766344023 >> 10.20.193.14:0/766344023 conn(0x7fec3c0b65f0 msgr2=0x7fec3c0b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:55.036 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.025+0000 7fec4144d640 1 -- 10.20.193.14:0/766344023 shutdown_connections 2026-02-24T19:23:55.036 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.025+0000 7fec4144d640 1 -- 10.20.193.14:0/766344023 wait complete. 2026-02-24T19:23:55.036 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.026+0000 7fec4144d640 10 monclient: build_initial_monmap 2026-02-24T19:23:55.036 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.026+0000 7fec4144d640 10 monclient: monmap: 2026-02-24T19:23:55.036 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:23:55.036 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:23:55.036 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:23:55.037 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:23:55.037 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:23:55.037 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:23:55.037 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:23:55.037 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:23:55.037 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:23:55.037 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:55.037 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.026+0000 7fec4144d640 1 librados: starting msgr at 2026-02-24T19:23:55.037 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.026+0000 7fec4144d640 1 librados: starting objecter 2026-02-24T19:23:55.037 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.026+0000 7fec4144d640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:23:55.037 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.026+0000 7fec4144d640 1 Processor -- start 2026-02-24T19:23:55.037 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.026+0000 7fec4144d640 1 -- start start 2026-02-24T19:23:55.037 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.026+0000 7fec4144d640 1 librados: setting wanted keys 2026-02-24T19:23:55.038 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.026+0000 7fec4144d640 1 librados: calling monclient init 2026-02-24T19:23:55.038 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.026+0000 7fec4144d640 10 monclient: init 2026-02-24T19:23:55.038 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.026+0000 7fec4144d640 10 monclient: _reopen_session rank -1 2026-02-24T19:23:55.038 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.026+0000 7fec4144d640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:23:55.038 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.026+0000 7fec4144d640 10 monclient(hunting): picked mon.noname-c con 0x7fec3c058da0 addr v1:10.20.193.170:6789/0 2026-02-24T19:23:55.038 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.026+0000 7fec4144d640 10 monclient(hunting): picked mon.noname-b con 0x7fec3c0b0410 addr v1:10.20.193.44:6789/0 2026-02-24T19:23:55.038 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.026+0000 7fec4144d640 10 monclient(hunting): picked mon.noname-a con 0x7fec3c1626a0 addr v1:10.20.193.14:6789/0 2026-02-24T19:23:55.038 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.026+0000 7fec4144d640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec3c1fbd90 con 0x7fec3c1626a0 2026-02-24T19:23:55.038 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.026+0000 7fec4144d640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec3c1fb760 con 0x7fec3c0b0410 2026-02-24T19:23:55.038 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.026+0000 7fec4144d640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec3c139cb0 con 0x7fec3c058da0 2026-02-24T19:23:55.038 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.026+0000 7fec4144d640 10 monclient(hunting): _renew_subs 2026-02-24T19:23:55.038 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.026+0000 7fec4144d640 10 monclient(hunting): authenticate will time out at 4009.707972s 2026-02-24T19:23:55.038 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.027+0000 7fec3b7fe640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7fec3c1626a0 0x7fec3c0a7c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:51212/0 (socket says 10.20.193.14:51212) 2026-02-24T19:23:55.039 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.027+0000 7fec3b7fe640 1 -- 10.20.193.14:0/3555261478 learned_addr learned my addr 10.20.193.14:0/3555261478 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:23:55.039 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.027+0000 7fec1b7fe640 10 client.?.objecter ms_handle_connect 0x7fec3c1626a0 2026-02-24T19:23:55.039 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.027+0000 7fec1b7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:55.039 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.027+0000 7fec1b7fe640 10 client.?.objecter ms_handle_connect 0x7fec3c058da0 2026-02-24T19:23:55.039 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.027+0000 7fec1b7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:55.039 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.027+0000 7fec1b7fe640 10 client.?.objecter ms_handle_connect 0x7fec3c0b0410 2026-02-24T19:23:55.039 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.027+0000 7fec1b7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:23:55.039 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.028+0000 7fec1b7fe640 1 -- 10.20.193.14:0/3555261478 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1501314515 0 0) 0x7fec3c1fbd90 con 0x7fec3c1626a0 2026-02-24T19:23:55.039 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.028+0000 7fec1b7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:23:55.039 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.028+0000 7fec1b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:55.039 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.028+0000 7fec1b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:55.039 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.028+0000 7fec1b7fe640 10 monclient(hunting): my global_id is 30921 2026-02-24T19:23:55.040 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.028+0000 7fec1b7fe640 1 -- 10.20.193.14:0/3555261478 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec08003610 con 0x7fec3c1626a0 2026-02-24T19:23:55.040 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.028+0000 7fec1b7fe640 1 -- 10.20.193.14:0/3555261478 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2421879935 0 0) 0x7fec3c139cb0 con 0x7fec3c058da0 2026-02-24T19:23:55.040 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.028+0000 7fec1b7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:23:55.040 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.028+0000 7fec1b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:55.040 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.028+0000 7fec1b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:55.040 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.028+0000 7fec1b7fe640 10 monclient(hunting): my global_id is 28874 2026-02-24T19:23:55.040 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.028+0000 7fec1b7fe640 1 -- 10.20.193.14:0/3555261478 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec3c1fbd90 con 0x7fec3c058da0 2026-02-24T19:23:55.040 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.028+0000 7fec1b7fe640 1 -- 10.20.193.14:0/3555261478 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 163206568 0 0) 0x7fec3c1fb760 con 0x7fec3c0b0410 2026-02-24T19:23:55.040 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.028+0000 7fec1b7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:23:55.040 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.028+0000 7fec1b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:23:55.040 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.028+0000 7fec1b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:23:55.040 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.028+0000 7fec1b7fe640 10 monclient(hunting): my global_id is 29236 2026-02-24T19:23:55.040 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.028+0000 7fec1b7fe640 1 -- 10.20.193.14:0/3555261478 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec3c139cb0 con 0x7fec3c0b0410 2026-02-24T19:23:55.041 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.030+0000 7fec1b7fe640 1 -- 10.20.193.14:0/3555261478 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2731164583 0 0) 0x7fec08003610 con 0x7fec3c1626a0 2026-02-24T19:23:55.041 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.030+0000 7fec1b7fe640 1 -- 10.20.193.14:0/3555261478 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fec3c1fb760 con 0x7fec3c1626a0 2026-02-24T19:23:55.041 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.030+0000 7fec1b7fe640 1 -- 10.20.193.14:0/3555261478 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fec2c003690 con 0x7fec3c1626a0 2026-02-24T19:23:55.041 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.030+0000 7fec1b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:55.041 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.030+0000 7fec1b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:23:55.041 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.030+0000 7fec1b7fe640 10 monclient(hunting): dump: 2026-02-24T19:23:55.041 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:55.041 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:55.041 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:55.041 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:55.041 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:55.041 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:55.041 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:55.042 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:55.042 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:55.042 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:55.042 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.030+0000 7fec1b7fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:23:55.044 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.031+0000 7fec1b7fe640 1 -- 10.20.193.14:0/3555261478 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1750248237 0 0) 0x7fec3c1fbd90 con 0x7fec3c058da0 2026-02-24T19:23:55.044 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.031+0000 7fec1b7fe640 1 -- 10.20.193.14:0/3555261478 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fec08003610 con 0x7fec3c058da0 2026-02-24T19:23:55.044 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.031+0000 7fec1b7fe640 1 -- 10.20.193.14:0/3555261478 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fec30003060 con 0x7fec3c058da0 2026-02-24T19:23:55.044 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.031+0000 7fec1b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:55.044 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.031+0000 7fec1b7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:23:55.044 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.031+0000 7fec1b7fe640 10 monclient(hunting): dump: 2026-02-24T19:23:55.045 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:55.045 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:55.045 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:55.045 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:55.045 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:55.045 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:55.045 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:55.045 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:55.045 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:55.045 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:55.045 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.031+0000 7fec1b7fe640 1 -- 10.20.193.14:0/3555261478 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4029313642 0 0) 0x7fec3c139cb0 con 0x7fec3c0b0410 2026-02-24T19:23:55.045 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.031+0000 7fec1b7fe640 1 -- 10.20.193.14:0/3555261478 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fec3c1fbd90 con 0x7fec3c0b0410 2026-02-24T19:23:55.045 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.031+0000 7fec1b7fe640 1 -- 10.20.193.14:0/3555261478 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fec240030b0 con 0x7fec3c0b0410 2026-02-24T19:23:55.046 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.031+0000 7fec1b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:23:55.046 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.031+0000 7fec1b7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:23:55.046 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.031+0000 7fec1b7fe640 10 monclient(hunting): dump: 2026-02-24T19:23:55.046 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:55.046 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:55.046 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:55.046 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:55.046 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:55.046 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:55.046 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:55.046 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:55.046 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:55.047 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:55.047 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.032+0000 7fec1b7fe640 1 -- 10.20.193.14:0/3555261478 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1066957951 0 0) 0x7fec3c1fb760 con 0x7fec3c1626a0 2026-02-24T19:23:55.047 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.032+0000 7fec1b7fe640 1 -- 10.20.193.14:0/3555261478 >> v1:10.20.193.170:6789/0 conn(0x7fec3c058da0 legacy=0x7fec3c1fd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:55.047 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.032+0000 7fec1b7fe640 1 -- 10.20.193.14:0/3555261478 >> v1:10.20.193.44:6789/0 conn(0x7fec3c0b0410 legacy=0x7fec3c13ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:55.047 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.032+0000 7fec1b7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:23:55.047 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.032+0000 7fec1b7fe640 1 monclient: found mon.a 2026-02-24T19:23:55.047 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.032+0000 7fec1b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:23:55.047 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.032+0000 7fec1b7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:55.047 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.032+0000 7fec1b7fe640 1 -- 10.20.193.14:0/3555261478 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec3c139f90 con 0x7fec3c1626a0 2026-02-24T19:23:55.047 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.032+0000 7fec1b7fe640 10 monclient: _finish_auth 0 2026-02-24T19:23:55.047 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.032+0000 7fec1b7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:23:55.047 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.032+0000 7fec1b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:23:55.047 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.032+0000 7fec4144d640 5 monclient: authenticate success, global_id 30921 2026-02-24T19:23:55.048 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.032+0000 7fec4144d640 10 monclient: _renew_subs 2026-02-24T19:23:55.048 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.032+0000 7fec4144d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:55.048 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.032+0000 7fec4144d640 1 -- 10.20.193.14:0/3555261478 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fec3c13a270 con 0x7fec3c1626a0 2026-02-24T19:23:55.048 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.032+0000 7fec4144d640 10 client.30921.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:23:55.048 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.032+0000 7fec4144d640 10 monclient: _renew_subs 2026-02-24T19:23:55.048 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.032+0000 7fec4144d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:55.048 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.032+0000 7fec4144d640 1 -- 10.20.193.14:0/3555261478 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fec3c13b440 con 0x7fec3c1626a0 2026-02-24T19:23:55.048 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.032+0000 7fec4144d640 1 librados: init done 2026-02-24T19:23:55.048 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.032+0000 7fec4144d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:55.048 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.032+0000 7fec4144d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:55.048 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.032+0000 7fec4144d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:23:55.048 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.032+0000 7fec4144d640 1 -- 10.20.193.14:0/3555261478 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec3c0595e0 con 0x7fec3c1626a0 2026-02-24T19:23:55.125 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.123+0000 7fec1b7fe640 1 -- 10.20.193.14:0/3555261478 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fec2c0032f0 con 0x7fec3c1626a0 2026-02-24T19:23:55.125 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.123+0000 7fec1b7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:23:55.125 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.123+0000 7fec1b7fe640 1 -- 10.20.193.14:0/3555261478 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7fec2c003e70 con 0x7fec3c1626a0 2026-02-24T19:23:55.125 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.123+0000 7fec1b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:23:55.125 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.123+0000 7fec1b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:23:55.125 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.123+0000 7fec397fa640 4 set_mon_vals no callback set 2026-02-24T19:23:55.125 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.123+0000 7fec1b7fe640 10 monclient: dump: 2026-02-24T19:23:55.125 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:23:55.125 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:23:55.125 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:55.126 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:23:55.126 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:23:55.126 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:23:55.126 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:23:55.126 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:23:55.126 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:23:55.126 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:23:55.127 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.123+0000 7fec1b7fe640 1 -- 10.20.193.14:0/3555261478 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7fec2c004050 con 0x7fec3c1626a0 2026-02-24T19:23:55.127 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.124+0000 7fec3affd640 10 monclient: get_auth_request con 0x7fec08077e60 auth_method 0 2026-02-24T19:23:55.127 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.124+0000 7fec1b7fe640 10 client.30921.objecter ms_handle_connect 0x7fec08077e60 2026-02-24T19:23:55.129 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.127+0000 7fec1b7fe640 1 -- 10.20.193.14:0/3555261478 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7fec2c093410 con 0x7fec3c1626a0 2026-02-24T19:23:55.129 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.127+0000 7fec1b7fe640 10 client.30921.objecter ms_dispatch2 0x7fec3c000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:23:55.129 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.127+0000 7fec1b7fe640 3 client.30921.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:23:55.129 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.127+0000 7fec1b7fe640 3 client.30921.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:23:55.129 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.127+0000 7fec1b7fe640 20 client.30921.objecter dump_active .. 0 homeless 2026-02-24T19:23:55.129 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.127+0000 7fec1b7fe640 1 -- 10.20.193.14:0/3555261478 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fec2c003e70 con 0x7fec3c1626a0 2026-02-24T19:23:55.130 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.127+0000 7fec1b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:23:55.130 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.127+0000 7fec1b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:23:55.232 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.231+0000 7fec4144d640 1 -- 10.20.193.14:0/3555261478 --> v1:10.20.193.14:6800/4014096310 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fec3c0b6d00 con 0x7fec08077e60 2026-02-24T19:23:55.234 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.232+0000 7fec1b7fe640 1 -- 10.20.193.14:0/3555261478 <== mgr.4110 v1:10.20.193.14:6800/4014096310 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+125454 (unknown 2965378022 0 3424203634) 0x7fec3c0b6d00 con 0x7fec08077e60 2026-02-24T19:23:55.235 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:23:55.236 INFO:teuthology.orchestra.run.trial014.stderr:dumped all 2026-02-24T19:23:55.237 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.233+0000 7fec4144d640 10 librados: watch_flush enter 2026-02-24T19:23:55.237 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.233+0000 7fec4144d640 10 librados: watch_flush exit 2026-02-24T19:23:55.237 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.233+0000 7fec4144d640 20 client.30921.objecter shutdown clearing up homeless session... 2026-02-24T19:23:55.237 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.233+0000 7fec4144d640 10 client.30921.objecter successfully canceled tick 2026-02-24T19:23:55.238 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.234+0000 7fec4144d640 1 -- 10.20.193.14:0/3555261478 >> v1:10.20.193.14:6800/4014096310 conn(0x7fec08077e60 legacy=0x7fec08098310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:55.238 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.234+0000 7fec4144d640 10 monclient: shutdown 2026-02-24T19:23:55.238 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.234+0000 7fec4144d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:23:55.238 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.234+0000 7fec4144d640 1 -- 10.20.193.14:0/3555261478 >> v1:10.20.193.14:6789/0 conn(0x7fec3c1626a0 legacy=0x7fec3c0a7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:23:55.238 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.234+0000 7fec4144d640 1 -- 10.20.193.14:0/3555261478 shutdown_connections 2026-02-24T19:23:55.238 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.234+0000 7fec4144d640 1 -- 10.20.193.14:0/3555261478 >> 10.20.193.14:0/3555261478 conn(0x7fec3c0b65f0 msgr2=0x7fec3c055980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:23:55.238 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.234+0000 7fec4144d640 1 -- 10.20.193.14:0/3555261478 shutdown_connections 2026-02-24T19:23:55.238 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.234+0000 7fec4144d640 1 -- 10.20.193.14:0/3555261478 wait complete. 2026-02-24T19:23:55.238 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:23:55.234+0000 7fec4144d640 1 librados: shutdown 2026-02-24T19:23:55.244 INFO:teuthology.orchestra.run.trial014.stdout:{"pg_ready":true,"pg_map":{"version":557,"stamp":"2026-02-24T19:23:53.571032+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":56,"num_read_kb":47,"num_write":70,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":97,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":544480,"kb_used_data":113120,"kb_used_omap":25020,"kb_used_meta":406083,"kb_avail":1509404960,"statfs":{"total":1546188226560,"available":1545630679040,"internally_reserved":0,"allocated":115834880,"data_stored":73029024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25620621,"internal_metadata":415829875},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":136,"apply_latency_ms":136,"commit_latency_ns":136000000,"apply_latency_ns":136000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.284615"},"pg_stats":[{"pgid":"28.0","version":"0'0","reported_seq":649,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:46.168241+0000","last_change":"2026-02-24T19:18:04.433420+0000","last_active":"2026-02-24T19:23:46.168241+0000","last_peered":"2026-02-24T19:23:46.168241+0000","last_clean":"2026-02-24T19:23:46.168241+0000","last_became_active":"2026-02-24T19:18:04.430880+0000","last_became_peered":"2026-02-24T19:18:04.430880+0000","last_unstale":"2026-02-24T19:23:46.168241+0000","last_undegraded":"2026-02-24T19:23:46.168241+0000","last_fullsized":"2026-02-24T19:23:46.168241+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:12:09.744113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1","version":"36'11","reported_seq":674,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:45.865061+0000","last_change":"2026-02-24T19:18:04.578561+0000","last_active":"2026-02-24T19:23:45.865061+0000","last_peered":"2026-02-24T19:23:45.865061+0000","last_clean":"2026-02-24T19:23:45.865061+0000","last_became_active":"2026-02-24T19:18:04.576194+0000","last_became_peered":"2026-02-24T19:18:04.576194+0000","last_unstale":"2026-02-24T19:23:45.865061+0000","last_undegraded":"2026-02-24T19:23:45.865061+0000","last_fullsized":"2026-02-24T19:23:45.865061+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:49:29.287956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,4],"acting":[12,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":647,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:46.159568+0000","last_change":"2026-02-24T19:18:03.963505+0000","last_active":"2026-02-24T19:23:46.159568+0000","last_peered":"2026-02-24T19:23:46.159568+0000","last_clean":"2026-02-24T19:23:46.159568+0000","last_became_active":"2026-02-24T19:18:03.958691+0000","last_became_peered":"2026-02-24T19:18:03.958691+0000","last_unstale":"2026-02-24T19:23:46.159568+0000","last_undegraded":"2026-02-24T19:23:46.159568+0000","last_fullsized":"2026-02-24T19:23:46.159568+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:23:22.822755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":649,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:46.169291+0000","last_change":"2026-02-24T19:18:04.348647+0000","last_active":"2026-02-24T19:23:46.169291+0000","last_peered":"2026-02-24T19:23:46.169291+0000","last_clean":"2026-02-24T19:23:46.169291+0000","last_became_active":"2026-02-24T19:18:04.335655+0000","last_became_peered":"2026-02-24T19:18:04.335655+0000","last_unstale":"2026-02-24T19:23:46.169291+0000","last_undegraded":"2026-02-24T19:23:46.169291+0000","last_fullsized":"2026-02-24T19:23:46.169291+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:38:16.688089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,14],"acting":[5,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":651,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:46.174327+0000","last_change":"2026-02-24T19:18:05.017788+0000","last_active":"2026-02-24T19:23:46.174327+0000","last_peered":"2026-02-24T19:23:46.174327+0000","last_clean":"2026-02-24T19:23:46.174327+0000","last_became_active":"2026-02-24T19:18:05.015377+0000","last_became_peered":"2026-02-24T19:18:05.015377+0000","last_unstale":"2026-02-24T19:23:46.174327+0000","last_undegraded":"2026-02-24T19:23:46.174327+0000","last_fullsized":"2026-02-24T19:23:46.174327+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:40:20.318316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,10],"acting":[14,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":644,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:46.166102+0000","last_change":"2026-02-24T19:18:05.237620+0000","last_active":"2026-02-24T19:23:46.166102+0000","last_peered":"2026-02-24T19:23:46.166102+0000","last_clean":"2026-02-24T19:23:46.166102+0000","last_became_active":"2026-02-24T19:18:05.234574+0000","last_became_peered":"2026-02-24T19:18:05.234574+0000","last_unstale":"2026-02-24T19:23:46.166102+0000","last_undegraded":"2026-02-24T19:23:46.166102+0000","last_fullsized":"2026-02-24T19:23:46.166102+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:31:23.754288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":655,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:49.456626+0000","last_change":"2026-02-24T19:23:49.456626+0000","last_active":"2026-02-24T19:23:49.456626+0000","last_peered":"2026-02-24T19:23:49.456626+0000","last_clean":"2026-02-24T19:23:49.456626+0000","last_became_active":"2026-02-24T19:18:03.990285+0000","last_became_peered":"2026-02-24T19:18:03.990285+0000","last_unstale":"2026-02-24T19:23:49.456626+0000","last_undegraded":"2026-02-24T19:23:49.456626+0000","last_fullsized":"2026-02-24T19:23:49.456626+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:49.455047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:49.455047+0000","last_clean_scrub_stamp":"2026-02-24T19:23:49.455047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:30:10.157256+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":651,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:46.062667+0000","last_change":"2026-02-24T19:18:03.425674+0000","last_active":"2026-02-24T19:23:46.062667+0000","last_peered":"2026-02-24T19:23:46.062667+0000","last_clean":"2026-02-24T19:23:46.062667+0000","last_became_active":"2026-02-24T19:18:03.420675+0000","last_became_peered":"2026-02-24T19:18:03.420675+0000","last_unstale":"2026-02-24T19:23:46.062667+0000","last_undegraded":"2026-02-24T19:23:46.062667+0000","last_fullsized":"2026-02-24T19:23:46.062667+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:20:11.350436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,6],"acting":[15,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":647,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:45.875847+0000","last_change":"2026-02-24T19:18:03.255478+0000","last_active":"2026-02-24T19:23:45.875847+0000","last_peered":"2026-02-24T19:23:45.875847+0000","last_clean":"2026-02-24T19:23:45.875847+0000","last_became_active":"2026-02-24T19:18:03.252679+0000","last_became_peered":"2026-02-24T19:18:03.252679+0000","last_unstale":"2026-02-24T19:23:45.875847+0000","last_undegraded":"2026-02-24T19:23:45.875847+0000","last_fullsized":"2026-02-24T19:23:45.875847+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:16:26.096508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,13],"acting":[4,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":648,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:45.865886+0000","last_change":"2026-02-24T19:18:04.558252+0000","last_active":"2026-02-24T19:23:45.865886+0000","last_peered":"2026-02-24T19:23:45.865886+0000","last_clean":"2026-02-24T19:23:45.865886+0000","last_became_active":"2026-02-24T19:18:04.552851+0000","last_became_peered":"2026-02-24T19:18:04.552851+0000","last_unstale":"2026-02-24T19:23:45.865886+0000","last_undegraded":"2026-02-24T19:23:45.865886+0000","last_fullsized":"2026-02-24T19:23:45.865886+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:11:05.672582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,13],"acting":[12,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":647,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:47.165815+0000","last_change":"2026-02-24T19:18:03.509349+0000","last_active":"2026-02-24T19:23:47.165815+0000","last_peered":"2026-02-24T19:23:47.165815+0000","last_clean":"2026-02-24T19:23:47.165815+0000","last_became_active":"2026-02-24T19:18:03.507201+0000","last_became_peered":"2026-02-24T19:18:03.507201+0000","last_unstale":"2026-02-24T19:23:47.165815+0000","last_undegraded":"2026-02-24T19:23:47.165815+0000","last_fullsized":"2026-02-24T19:23:47.165815+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:24:43.636938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,13],"acting":[8,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":650,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:46.058298+0000","last_change":"2026-02-24T19:18:03.452428+0000","last_active":"2026-02-24T19:23:46.058298+0000","last_peered":"2026-02-24T19:23:46.058298+0000","last_clean":"2026-02-24T19:23:46.058298+0000","last_became_active":"2026-02-24T19:18:03.433618+0000","last_became_peered":"2026-02-24T19:18:03.433618+0000","last_unstale":"2026-02-24T19:23:46.058298+0000","last_undegraded":"2026-02-24T19:23:46.058298+0000","last_fullsized":"2026-02-24T19:23:46.058298+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:42:16.990633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":647,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:46.159859+0000","last_change":"2026-02-24T19:18:04.459024+0000","last_active":"2026-02-24T19:23:46.159859+0000","last_peered":"2026-02-24T19:23:46.159859+0000","last_clean":"2026-02-24T19:23:46.159859+0000","last_became_active":"2026-02-24T19:18:04.456892+0000","last_became_peered":"2026-02-24T19:18:04.456892+0000","last_unstale":"2026-02-24T19:23:46.159859+0000","last_undegraded":"2026-02-24T19:23:46.159859+0000","last_fullsized":"2026-02-24T19:23:46.159859+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:33:41.389587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":669,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:46.061798+0000","last_change":"2026-02-24T19:17:26.965063+0000","last_active":"2026-02-24T19:23:46.061798+0000","last_peered":"2026-02-24T19:23:46.061798+0000","last_clean":"2026-02-24T19:23:46.061798+0000","last_became_active":"2026-02-24T19:17:25.636961+0000","last_became_peered":"2026-02-24T19:17:25.636961+0000","last_unstale":"2026-02-24T19:23:46.061798+0000","last_undegraded":"2026-02-24T19:23:46.061798+0000","last_fullsized":"2026-02-24T19:23:46.061798+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:42:49.532270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.076701065999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,0],"acting":[15,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":649,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:46.042757+0000","last_change":"2026-02-24T19:18:04.060070+0000","last_active":"2026-02-24T19:23:46.042757+0000","last_peered":"2026-02-24T19:23:46.042757+0000","last_clean":"2026-02-24T19:23:46.042757+0000","last_became_active":"2026-02-24T19:18:04.057738+0000","last_became_peered":"2026-02-24T19:18:04.057738+0000","last_unstale":"2026-02-24T19:23:46.042757+0000","last_undegraded":"2026-02-24T19:23:46.042757+0000","last_fullsized":"2026-02-24T19:23:46.042757+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:30:15.992686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":669,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:46.175828+0000","last_change":"2026-02-24T19:17:27.096285+0000","last_active":"2026-02-24T19:23:46.175828+0000","last_peered":"2026-02-24T19:23:46.175828+0000","last_clean":"2026-02-24T19:23:46.175828+0000","last_became_active":"2026-02-24T19:17:24.847985+0000","last_became_peered":"2026-02-24T19:17:24.847985+0000","last_unstale":"2026-02-24T19:23:46.175828+0000","last_undegraded":"2026-02-24T19:23:46.175828+0000","last_fullsized":"2026-02-24T19:23:46.175828+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:50:14.116609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032556177999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,7],"acting":[14,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":648,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:45.866755+0000","last_change":"2026-02-24T19:18:04.733866+0000","last_active":"2026-02-24T19:23:45.866755+0000","last_peered":"2026-02-24T19:23:45.866755+0000","last_clean":"2026-02-24T19:23:45.866755+0000","last_became_active":"2026-02-24T19:18:04.731637+0000","last_became_peered":"2026-02-24T19:18:04.731637+0000","last_unstale":"2026-02-24T19:23:45.866755+0000","last_undegraded":"2026-02-24T19:23:45.866755+0000","last_fullsized":"2026-02-24T19:23:45.866755+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:06:08.078529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,14],"acting":[12,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":663,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:46.163519+0000","last_change":"2026-02-24T19:17:26.898110+0000","last_active":"2026-02-24T19:23:46.163519+0000","last_peered":"2026-02-24T19:23:46.163519+0000","last_clean":"2026-02-24T19:23:46.163519+0000","last_became_active":"2026-02-24T19:17:24.821876+0000","last_became_peered":"2026-02-24T19:17:24.821876+0000","last_unstale":"2026-02-24T19:23:46.163519+0000","last_undegraded":"2026-02-24T19:23:46.163519+0000","last_fullsized":"2026-02-24T19:23:46.163519+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:00:08.087971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.044624814999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":648,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:45.893054+0000","last_change":"2026-02-24T19:18:04.721916+0000","last_active":"2026-02-24T19:23:45.893054+0000","last_peered":"2026-02-24T19:23:45.893054+0000","last_clean":"2026-02-24T19:23:45.893054+0000","last_became_active":"2026-02-24T19:18:04.719330+0000","last_became_peered":"2026-02-24T19:18:04.719330+0000","last_unstale":"2026-02-24T19:23:45.893054+0000","last_undegraded":"2026-02-24T19:23:45.893054+0000","last_fullsized":"2026-02-24T19:23:45.893054+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:26:21.901912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,6],"acting":[10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":663,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:46.162212+0000","last_change":"2026-02-24T19:17:26.891122+0000","last_active":"2026-02-24T19:23:46.162212+0000","last_peered":"2026-02-24T19:23:46.162212+0000","last_clean":"2026-02-24T19:23:46.162212+0000","last_became_active":"2026-02-24T19:17:23.991081+0000","last_became_peered":"2026-02-24T19:17:23.991081+0000","last_unstale":"2026-02-24T19:23:46.162212+0000","last_undegraded":"2026-02-24T19:23:46.162212+0000","last_fullsized":"2026-02-24T19:23:46.162212+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:10:30.161691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.042145786999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":651,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:46.172993+0000","last_change":"2026-02-24T19:18:03.657924+0000","last_active":"2026-02-24T19:23:46.172993+0000","last_peered":"2026-02-24T19:23:46.172993+0000","last_clean":"2026-02-24T19:23:46.172993+0000","last_became_active":"2026-02-24T19:18:03.655492+0000","last_became_peered":"2026-02-24T19:18:03.655492+0000","last_unstale":"2026-02-24T19:23:46.172993+0000","last_undegraded":"2026-02-24T19:23:46.172993+0000","last_fullsized":"2026-02-24T19:23:46.172993+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:07:13.620976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,7],"acting":[14,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.2","version":"31'2","reported_seq":672,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:46.055818+0000","last_change":"2026-02-24T19:17:26.948217+0000","last_active":"2026-02-24T19:23:46.055818+0000","last_peered":"2026-02-24T19:23:46.055818+0000","last_clean":"2026-02-24T19:23:46.055818+0000","last_became_active":"2026-02-24T19:17:25.045520+0000","last_became_peered":"2026-02-24T19:17:25.045520+0000","last_unstale":"2026-02-24T19:23:46.055818+0000","last_undegraded":"2026-02-24T19:23:46.055818+0000","last_fullsized":"2026-02-24T19:23:46.055818+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:32:11.642822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.069045234999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,10],"acting":[15,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":647,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:45.888181+0000","last_change":"2026-02-24T19:18:03.350390+0000","last_active":"2026-02-24T19:23:45.888181+0000","last_peered":"2026-02-24T19:23:45.888181+0000","last_clean":"2026-02-24T19:23:45.888181+0000","last_became_active":"2026-02-24T19:18:03.348322+0000","last_became_peered":"2026-02-24T19:18:03.348322+0000","last_unstale":"2026-02-24T19:23:45.888181+0000","last_undegraded":"2026-02-24T19:23:45.888181+0000","last_fullsized":"2026-02-24T19:23:45.888181+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:36:08.115800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":669,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:46.043812+0000","last_change":"2026-02-24T19:17:27.119087+0000","last_active":"2026-02-24T19:23:46.043812+0000","last_peered":"2026-02-24T19:23:46.043812+0000","last_clean":"2026-02-24T19:23:46.043812+0000","last_became_active":"2026-02-24T19:17:24.834035+0000","last_became_peered":"2026-02-24T19:17:24.834035+0000","last_unstale":"2026-02-24T19:23:46.043812+0000","last_undegraded":"2026-02-24T19:23:46.043812+0000","last_fullsized":"2026-02-24T19:23:46.043812+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:29:27.582878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036343514,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":649,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:46.061592+0000","last_change":"2026-02-24T19:18:03.457431+0000","last_active":"2026-02-24T19:23:46.061592+0000","last_peered":"2026-02-24T19:23:46.061592+0000","last_clean":"2026-02-24T19:23:46.061592+0000","last_became_active":"2026-02-24T19:18:03.450995+0000","last_became_peered":"2026-02-24T19:18:03.450995+0000","last_unstale":"2026-02-24T19:23:46.061592+0000","last_undegraded":"2026-02-24T19:23:46.061592+0000","last_fullsized":"2026-02-24T19:23:46.061592+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:07:57.911949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,2],"acting":[13,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":669,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:46.056762+0000","last_change":"2026-02-24T19:17:27.099921+0000","last_active":"2026-02-24T19:23:46.056762+0000","last_peered":"2026-02-24T19:23:46.056762+0000","last_clean":"2026-02-24T19:23:46.056762+0000","last_became_active":"2026-02-24T19:17:24.560197+0000","last_became_peered":"2026-02-24T19:17:24.560197+0000","last_unstale":"2026-02-24T19:23:46.056762+0000","last_undegraded":"2026-02-24T19:23:46.056762+0000","last_fullsized":"2026-02-24T19:23:46.056762+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:28:40.195905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038521284000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":647,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:46.162580+0000","last_change":"2026-02-24T19:18:04.002274+0000","last_active":"2026-02-24T19:23:46.162580+0000","last_peered":"2026-02-24T19:23:46.162580+0000","last_clean":"2026-02-24T19:23:46.162580+0000","last_became_active":"2026-02-24T19:18:03.998754+0000","last_became_peered":"2026-02-24T19:18:03.998754+0000","last_unstale":"2026-02-24T19:23:46.162580+0000","last_undegraded":"2026-02-24T19:23:46.162580+0000","last_fullsized":"2026-02-24T19:23:46.162580+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:03:56.409494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"29'1","reported_seq":671,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:46.057437+0000","last_change":"2026-02-24T19:17:26.955767+0000","last_active":"2026-02-24T19:23:46.057437+0000","last_peered":"2026-02-24T19:23:46.057437+0000","last_clean":"2026-02-24T19:23:46.057437+0000","last_became_active":"2026-02-24T19:17:24.838239+0000","last_became_peered":"2026-02-24T19:17:24.838239+0000","last_unstale":"2026-02-24T19:23:46.057437+0000","last_undegraded":"2026-02-24T19:23:46.057437+0000","last_fullsized":"2026-02-24T19:23:46.057437+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:22.166798+0000","last_clean_scrub_stamp":"2026-02-24T19:17:22.166798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:54:28.324309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070474251000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"1.0","version":"29'32","reported_seq":710,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:46.160071+0000","last_change":"2026-02-24T19:17:18.365341+0000","last_active":"2026-02-24T19:23:46.160071+0000","last_peered":"2026-02-24T19:23:46.160071+0000","last_clean":"2026-02-24T19:23:46.160071+0000","last_became_active":"2026-02-24T19:17:18.351934+0000","last_became_peered":"2026-02-24T19:17:18.351934+0000","last_unstale":"2026-02-24T19:23:46.160071+0000","last_undegraded":"2026-02-24T19:23:46.160071+0000","last_fullsized":"2026-02-24T19:23:46.160071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:15.908436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:15.908436+0000","last_clean_scrub_stamp":"2026-02-24T19:17:15.908436+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:23:17.271649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":647,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:46.164683+0000","last_change":"2026-02-24T19:18:03.588627+0000","last_active":"2026-02-24T19:23:46.164683+0000","last_peered":"2026-02-24T19:23:46.164683+0000","last_clean":"2026-02-24T19:23:46.164683+0000","last_became_active":"2026-02-24T19:18:03.586391+0000","last_became_peered":"2026-02-24T19:18:03.586391+0000","last_unstale":"2026-02-24T19:23:46.164683+0000","last_undegraded":"2026-02-24T19:23:46.164683+0000","last_fullsized":"2026-02-24T19:23:46.164683+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:55:35.275201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":648,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:45.868734+0000","last_change":"2026-02-24T19:18:04.537088+0000","last_active":"2026-02-24T19:23:45.868734+0000","last_peered":"2026-02-24T19:23:45.868734+0000","last_clean":"2026-02-24T19:23:45.868734+0000","last_became_active":"2026-02-24T19:18:04.535003+0000","last_became_peered":"2026-02-24T19:18:04.535003+0000","last_unstale":"2026-02-24T19:23:45.868734+0000","last_undegraded":"2026-02-24T19:23:45.868734+0000","last_fullsized":"2026-02-24T19:23:45.868734+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T07:11:21.119347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,1],"acting":[12,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":655,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:49.325050+0000","last_change":"2026-02-24T19:23:49.325050+0000","last_active":"2026-02-24T19:23:49.325050+0000","last_peered":"2026-02-24T19:23:49.325050+0000","last_clean":"2026-02-24T19:23:49.325050+0000","last_became_active":"2026-02-24T19:18:03.813130+0000","last_became_peered":"2026-02-24T19:18:03.813130+0000","last_unstale":"2026-02-24T19:23:49.325050+0000","last_undegraded":"2026-02-24T19:23:49.325050+0000","last_fullsized":"2026-02-24T19:23:49.325050+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:49.323273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:49.323273+0000","last_clean_scrub_stamp":"2026-02-24T19:23:49.323273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:00:17.422922+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9],"acting":[0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":647,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:46.162078+0000","last_change":"2026-02-24T19:18:04.181930+0000","last_active":"2026-02-24T19:23:46.162078+0000","last_peered":"2026-02-24T19:23:46.162078+0000","last_clean":"2026-02-24T19:23:46.162078+0000","last_became_active":"2026-02-24T19:18:04.175135+0000","last_became_peered":"2026-02-24T19:18:04.175135+0000","last_unstale":"2026-02-24T19:23:46.162078+0000","last_undegraded":"2026-02-24T19:23:46.162078+0000","last_fullsized":"2026-02-24T19:23:46.162078+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:56:14.603348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":646,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:47.144792+0000","last_change":"2026-02-24T19:18:03.687215+0000","last_active":"2026-02-24T19:23:47.144792+0000","last_peered":"2026-02-24T19:23:47.144792+0000","last_clean":"2026-02-24T19:23:47.144792+0000","last_became_active":"2026-02-24T19:18:03.684548+0000","last_became_peered":"2026-02-24T19:18:03.684548+0000","last_unstale":"2026-02-24T19:23:47.144792+0000","last_undegraded":"2026-02-24T19:23:47.144792+0000","last_fullsized":"2026-02-24T19:23:47.144792+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:49:54.756086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,13],"acting":[7,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":646,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:47.146193+0000","last_change":"2026-02-24T19:18:03.881093+0000","last_active":"2026-02-24T19:23:47.146193+0000","last_peered":"2026-02-24T19:23:47.146193+0000","last_clean":"2026-02-24T19:23:47.146193+0000","last_became_active":"2026-02-24T19:18:03.879055+0000","last_became_peered":"2026-02-24T19:18:03.879055+0000","last_unstale":"2026-02-24T19:23:47.146193+0000","last_undegraded":"2026-02-24T19:23:47.146193+0000","last_fullsized":"2026-02-24T19:23:47.146193+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:01:48.589688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,12],"acting":[7,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":647,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:45.883395+0000","last_change":"2026-02-24T19:18:03.674911+0000","last_active":"2026-02-24T19:23:45.883395+0000","last_peered":"2026-02-24T19:23:45.883395+0000","last_clean":"2026-02-24T19:23:45.883395+0000","last_became_active":"2026-02-24T19:18:03.672857+0000","last_became_peered":"2026-02-24T19:18:03.672857+0000","last_unstale":"2026-02-24T19:23:45.883395+0000","last_undegraded":"2026-02-24T19:23:45.883395+0000","last_fullsized":"2026-02-24T19:23:45.883395+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:10:42.261455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":648,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:45.889112+0000","last_change":"2026-02-24T19:18:05.058931+0000","last_active":"2026-02-24T19:23:45.889112+0000","last_peered":"2026-02-24T19:23:45.889112+0000","last_clean":"2026-02-24T19:23:45.889112+0000","last_became_active":"2026-02-24T19:18:05.049751+0000","last_became_peered":"2026-02-24T19:18:05.049751+0000","last_unstale":"2026-02-24T19:23:45.889112+0000","last_undegraded":"2026-02-24T19:23:45.889112+0000","last_fullsized":"2026-02-24T19:23:45.889112+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:06:49.580678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":647,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:46.165864+0000","last_change":"2026-02-24T19:18:03.634334+0000","last_active":"2026-02-24T19:23:46.165864+0000","last_peered":"2026-02-24T19:23:46.165864+0000","last_clean":"2026-02-24T19:23:46.165864+0000","last_became_active":"2026-02-24T19:18:03.612739+0000","last_became_peered":"2026-02-24T19:18:03.612739+0000","last_unstale":"2026-02-24T19:23:46.165864+0000","last_undegraded":"2026-02-24T19:23:46.165864+0000","last_fullsized":"2026-02-24T19:23:46.165864+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:01:31.700321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":651,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:46.060057+0000","last_change":"2026-02-24T19:18:03.344644+0000","last_active":"2026-02-24T19:23:46.060057+0000","last_peered":"2026-02-24T19:23:46.060057+0000","last_clean":"2026-02-24T19:23:46.060057+0000","last_became_active":"2026-02-24T19:18:03.341693+0000","last_became_peered":"2026-02-24T19:18:03.341693+0000","last_unstale":"2026-02-24T19:23:46.060057+0000","last_undegraded":"2026-02-24T19:23:46.060057+0000","last_fullsized":"2026-02-24T19:23:46.060057+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:18:49.303930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,4],"acting":[15,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":646,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:47.148179+0000","last_change":"2026-02-24T19:18:03.403726+0000","last_active":"2026-02-24T19:23:47.148179+0000","last_peered":"2026-02-24T19:23:47.148179+0000","last_clean":"2026-02-24T19:23:47.148179+0000","last_became_active":"2026-02-24T19:18:03.401642+0000","last_became_peered":"2026-02-24T19:18:03.401642+0000","last_unstale":"2026-02-24T19:23:47.148179+0000","last_undegraded":"2026-02-24T19:23:47.148179+0000","last_fullsized":"2026-02-24T19:23:47.148179+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:18:07.075632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,15],"acting":[7,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":644,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:46.163793+0000","last_change":"2026-02-24T19:18:03.708894+0000","last_active":"2026-02-24T19:23:46.163793+0000","last_peered":"2026-02-24T19:23:46.163793+0000","last_clean":"2026-02-24T19:23:46.163793+0000","last_became_active":"2026-02-24T19:18:03.706699+0000","last_became_peered":"2026-02-24T19:18:03.706699+0000","last_unstale":"2026-02-24T19:23:46.163793+0000","last_undegraded":"2026-02-24T19:23:46.163793+0000","last_fullsized":"2026-02-24T19:23:46.163793+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:01.075697+0000","last_clean_scrub_stamp":"2026-02-24T19:18:01.075697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:17:30.885035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9],"acting":[2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":16}],"osd_stats":[{"osd":15,"up_from":21,"seq":90194313297,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33984,"kb_used_data":7024,"kb_used_omap":217,"kb_used_meta":26726,"kb_avail":94337856,"statfs":{"total":96636764160,"available":96601964544,"internally_reserved":0,"allocated":7192576,"data_stored":4514600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":222642,"internal_metadata":27368014},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":14,"up_from":21,"seq":90194313297,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33980,"kb_used_data":7020,"kb_used_omap":218,"kb_used_meta":26725,"kb_avail":94337860,"statfs":{"total":96636764160,"available":96601968640,"internally_reserved":0,"allocated":7188480,"data_stored":4514581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":223902,"internal_metadata":27366754},"hb_peers":[0,1,2,3,5,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313297,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33980,"kb_used_data":7020,"kb_used_omap":222,"kb_used_meta":26721,"kb_avail":94337860,"statfs":{"total":96636764160,"available":96601968640,"internally_reserved":0,"allocated":7188480,"data_stored":4514581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":227627,"internal_metadata":27363029},"hb_peers":[0,1,2,3,4,6,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313297,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33980,"kb_used_data":7020,"kb_used_omap":4988,"kb_used_meta":21955,"kb_avail":94337860,"statfs":{"total":96636764160,"available":96601968640,"internally_reserved":0,"allocated":7188480,"data_stored":4514581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5108141,"internal_metadata":22482515},"hb_peers":[1,2,3,4,6,7,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":1,"up_from":21,"seq":90194313297,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33980,"kb_used_data":7020,"kb_used_omap":215,"kb_used_meta":26728,"kb_avail":94337860,"statfs":{"total":96636764160,"available":96601968640,"internally_reserved":0,"allocated":7188480,"data_stored":4514581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":220720,"internal_metadata":27369936},"hb_peers":[0,2,3,4,5,6,7,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313297,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34372,"kb_used_data":7412,"kb_used_omap":216,"kb_used_meta":26727,"kb_avail":94337468,"statfs":{"total":96636764160,"available":96601567232,"internally_reserved":0,"allocated":7589888,"data_stored":4912421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":221639,"internal_metadata":27369017},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313298,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33980,"kb_used_data":7020,"kb_used_omap":3019,"kb_used_meta":23924,"kb_avail":94337860,"statfs":{"total":96636764160,"available":96601968640,"internally_reserved":0,"allocated":7188480,"data_stored":4514581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3091562,"internal_metadata":24499094},"hb_peers":[0,1,2,4,5,6,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313297,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33984,"kb_used_data":7024,"kb_used_omap":3009,"kb_used_meta":23934,"kb_avail":94337856,"statfs":{"total":96636764160,"available":96601964544,"internally_reserved":0,"allocated":7192576,"data_stored":4514586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3081227,"internal_metadata":24509429},"hb_peers":[0,1,2,3,5,6,7,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313297,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33980,"kb_used_data":7020,"kb_used_omap":216,"kb_used_meta":26727,"kb_avail":94337860,"statfs":{"total":96636764160,"available":96601968640,"internally_reserved":0,"allocated":7188480,"data_stored":4514581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":222036,"internal_metadata":27368620},"hb_peers":[0,1,2,3,4,6,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":21,"seq":90194313298,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33980,"kb_used_data":7020,"kb_used_omap":3010,"kb_used_meta":23933,"kb_avail":94337860,"statfs":{"total":96636764160,"available":96601968640,"internally_reserved":0,"allocated":7188480,"data_stored":4514581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3082635,"internal_metadata":24508021},"hb_peers":[0,1,2,3,4,5,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":7,"up_from":21,"seq":90194313298,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34372,"kb_used_data":7412,"kb_used_omap":216,"kb_used_meta":26727,"kb_avail":94337468,"statfs":{"total":96636764160,"available":96601567232,"internally_reserved":0,"allocated":7589888,"data_stored":4912421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":221714,"internal_metadata":27368942},"hb_peers":[0,1,2,3,5,6,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313297,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33980,"kb_used_data":7020,"kb_used_omap":3024,"kb_used_meta":23919,"kb_avail":94337860,"statfs":{"total":96636764160,"available":96601968640,"internally_reserved":0,"allocated":7188480,"data_stored":4514581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3097551,"internal_metadata":24493105},"hb_peers":[1,3,4,5,6,7,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313298,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33980,"kb_used_data":7020,"kb_used_omap":3024,"kb_used_meta":23919,"kb_avail":94337860,"statfs":{"total":96636764160,"available":96601968640,"internally_reserved":0,"allocated":7188480,"data_stored":4514581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3097174,"internal_metadata":24493482},"hb_peers":[0,1,2,3,4,5,6,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":10,"up_from":21,"seq":90194313297,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33984,"kb_used_data":7024,"kb_used_omap":175,"kb_used_meta":26768,"kb_avail":94337856,"statfs":{"total":96636764160,"available":96601964544,"internally_reserved":0,"allocated":7192576,"data_stored":4514600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179931,"internal_metadata":27410725},"hb_peers":[0,1,2,4,5,6,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313297,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33980,"kb_used_data":7020,"kb_used_omap":3026,"kb_used_meta":23917,"kb_avail":94337860,"statfs":{"total":96636764160,"available":96601968640,"internally_reserved":0,"allocated":7188480,"data_stored":4514581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3098761,"internal_metadata":24491895},"hb_peers":[0,1,2,3,4,5,6,7,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313297,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33984,"kb_used_data":7024,"kb_used_omap":218,"kb_used_meta":26725,"kb_avail":94337856,"statfs":{"total":96636764160,"available":96601964544,"internally_reserved":0,"allocated":7192576,"data_stored":4514586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":223359,"internal_metadata":27367297},"hb_peers":[0,1,2,3,4,5,6,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T19:23:55.253 INFO:tasks.ceph:pgid 28.0 last_scrub_stamp 2026-02-24T19:18:01.075697+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=1, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.253 INFO:tasks.ceph:pgid 28.1 last_scrub_stamp 2026-02-24T19:18:01.075697+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=1, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.253 INFO:tasks.ceph:pgid 28.2 last_scrub_stamp 2026-02-24T19:18:01.075697+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=1, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.253 INFO:tasks.ceph:pgid 28.3 last_scrub_stamp 2026-02-24T19:18:01.075697+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=1, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.253 INFO:tasks.ceph:pgid 28.4 last_scrub_stamp 2026-02-24T19:18:01.075697+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=1, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.254 INFO:tasks.ceph:pgid 28.5 last_scrub_stamp 2026-02-24T19:18:01.075697+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=1, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.254 INFO:tasks.ceph:pgid 28.7 last_scrub_stamp 2026-02-24T19:18:01.075697+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=1, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.254 INFO:tasks.ceph:pgid 28.8 last_scrub_stamp 2026-02-24T19:18:01.075697+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=1, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.254 INFO:tasks.ceph:pgid 28.9 last_scrub_stamp 2026-02-24T19:18:01.075697+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=1, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.254 INFO:tasks.ceph:pgid 28.a last_scrub_stamp 2026-02-24T19:18:01.075697+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=1, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.254 INFO:tasks.ceph:pgid 28.b last_scrub_stamp 2026-02-24T19:18:01.075697+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=1, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.255 INFO:tasks.ceph:pgid 28.19 last_scrub_stamp 2026-02-24T19:18:01.075697+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=1, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.255 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2026-02-24T19:17:22.166798+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=17, tm_sec=22, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.255 INFO:tasks.ceph:pgid 28.18 last_scrub_stamp 2026-02-24T19:18:01.075697+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=1, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.255 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2026-02-24T19:17:22.166798+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=17, tm_sec=22, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.255 INFO:tasks.ceph:pgid 28.1b last_scrub_stamp 2026-02-24T19:18:01.075697+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=1, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.255 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2026-02-24T19:17:22.166798+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=17, tm_sec=22, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.255 INFO:tasks.ceph:pgid 28.1a last_scrub_stamp 2026-02-24T19:18:01.075697+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=1, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.255 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2026-02-24T19:17:22.166798+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=17, tm_sec=22, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.256 INFO:tasks.ceph:pgid 28.1c last_scrub_stamp 2026-02-24T19:18:01.075697+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=1, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.256 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2026-02-24T19:17:22.166798+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=17, tm_sec=22, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.256 INFO:tasks.ceph:pgid 28.1f last_scrub_stamp 2026-02-24T19:18:01.075697+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=1, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.256 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2026-02-24T19:17:22.166798+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=17, tm_sec=22, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.256 INFO:tasks.ceph:pgid 28.1e last_scrub_stamp 2026-02-24T19:18:01.075697+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=1, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.256 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-24T19:17:22.166798+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=17, tm_sec=22, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.256 INFO:tasks.ceph:pgid 28.1d last_scrub_stamp 2026-02-24T19:18:01.075697+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=1, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.257 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2026-02-24T19:17:22.166798+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=17, tm_sec=22, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.257 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-24T19:17:15.908436+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=17, tm_sec=15, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.257 INFO:tasks.ceph:pgid 28.17 last_scrub_stamp 2026-02-24T19:18:01.075697+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=1, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.257 INFO:tasks.ceph:pgid 28.16 last_scrub_stamp 2026-02-24T19:18:01.075697+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=1, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.257 INFO:tasks.ceph:pgid 28.14 last_scrub_stamp 2026-02-24T19:18:01.075697+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=1, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.257 INFO:tasks.ceph:pgid 28.13 last_scrub_stamp 2026-02-24T19:18:01.075697+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=1, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.258 INFO:tasks.ceph:pgid 28.12 last_scrub_stamp 2026-02-24T19:18:01.075697+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=1, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.258 INFO:tasks.ceph:pgid 28.11 last_scrub_stamp 2026-02-24T19:18:01.075697+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=1, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.258 INFO:tasks.ceph:pgid 28.10 last_scrub_stamp 2026-02-24T19:18:01.075697+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=1, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.258 INFO:tasks.ceph:pgid 28.f last_scrub_stamp 2026-02-24T19:18:01.075697+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=1, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.258 INFO:tasks.ceph:pgid 28.e last_scrub_stamp 2026-02-24T19:18:01.075697+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=1, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.258 INFO:tasks.ceph:pgid 28.d last_scrub_stamp 2026-02-24T19:18:01.075697+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=1, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.258 INFO:tasks.ceph:pgid 28.c last_scrub_stamp 2026-02-24T19:18:01.075697+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=1, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=23, tm_sec=47, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:23:55.258 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-24T19:24:15.260 DEBUG:teuthology.orchestra.run.trial014:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T19:24:15.330 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.327+0000 7f4d98ab1640 10 monclient: get_monmap_and_config 2026-02-24T19:24:15.330 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.327+0000 7f4d98ab1640 10 monclient: build_initial_monmap 2026-02-24T19:24:15.330 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.327+0000 7f4d98ab1640 10 monclient: monmap: 2026-02-24T19:24:15.330 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:24:15.330 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:24:15.330 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:24:15.329035+0000 2026-02-24T19:24:15.330 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:24:15.329035+0000 2026-02-24T19:24:15.330 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:15.331 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:24:15.331 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:24:15.331 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:24:15.331 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:24:15.331 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:24:15.333 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.327+0000 7f4d98ab1640 1 Processor -- start 2026-02-24T19:24:15.333 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.328+0000 7f4d98ab1640 1 -- start start 2026-02-24T19:24:15.334 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.328+0000 7f4d98ab1640 10 monclient: init 2026-02-24T19:24:15.334 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.328+0000 7f4d98ab1640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:15.334 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.328+0000 7f4d98ab1640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:24:15.334 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.328+0000 7f4d98ab1640 10 monclient(hunting): picked mon.noname-a con 0x7f4d94058da0 addr v1:10.20.193.14:6789/0 2026-02-24T19:24:15.334 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.328+0000 7f4d98ab1640 10 monclient(hunting): picked mon.noname-c con 0x7f4d940b0410 addr v1:10.20.193.170:6789/0 2026-02-24T19:24:15.334 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.328+0000 7f4d98ab1640 10 monclient(hunting): picked mon.noname-b con 0x7f4d941626a0 addr v1:10.20.193.44:6789/0 2026-02-24T19:24:15.334 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.328+0000 7f4d98ab1640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d941655c0 con 0x7f4d94058da0 2026-02-24T19:24:15.334 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.328+0000 7f4d98ab1640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d940b12b0 con 0x7f4d941626a0 2026-02-24T19:24:15.334 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.328+0000 7f4d98ab1640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d940b1590 con 0x7f4d940b0410 2026-02-24T19:24:15.334 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.328+0000 7f4d98ab1640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:15.334 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.328+0000 7f4d98ab1640 10 monclient(hunting): authenticate will time out at 4030.010743s 2026-02-24T19:24:15.334 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.329+0000 7f4d92575640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f4d94058da0 0x7f4d941647a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:55172/0 (socket says 10.20.193.14:55172) 2026-02-24T19:24:15.335 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.329+0000 7f4d92575640 1 -- 10.20.193.14:0/1758587485 learned_addr learned my addr 10.20.193.14:0/1758587485 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:24:15.335 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.330+0000 7f4d91573640 1 -- 10.20.193.14:0/1758587485 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 51678772 0 0) 0x7f4d940b12b0 con 0x7f4d941626a0 2026-02-24T19:24:15.335 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.330+0000 7f4d91573640 10 monclient(hunting): _negotiate 2026-02-24T19:24:15.335 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.330+0000 7f4d91573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:15.335 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.330+0000 7f4d91573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:15.335 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.330+0000 7f4d91573640 10 monclient(hunting): my global_id is 29239 2026-02-24T19:24:15.335 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.330+0000 7f4d91573640 1 -- 10.20.193.14:0/1758587485 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d80003610 con 0x7f4d941626a0 2026-02-24T19:24:15.335 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.330+0000 7f4d91573640 1 -- 10.20.193.14:0/1758587485 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3629526386 0 0) 0x7f4d940b1590 con 0x7f4d940b0410 2026-02-24T19:24:15.335 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.330+0000 7f4d91573640 10 monclient(hunting): _negotiate 2026-02-24T19:24:15.335 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.330+0000 7f4d91573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:15.335 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.330+0000 7f4d91573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:15.335 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.330+0000 7f4d91573640 10 monclient(hunting): my global_id is 28877 2026-02-24T19:24:15.335 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.330+0000 7f4d91573640 1 -- 10.20.193.14:0/1758587485 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d940b12b0 con 0x7f4d940b0410 2026-02-24T19:24:15.336 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.330+0000 7f4d91573640 1 -- 10.20.193.14:0/1758587485 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 965688812 0 0) 0x7f4d941655c0 con 0x7f4d94058da0 2026-02-24T19:24:15.336 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.330+0000 7f4d91573640 10 monclient(hunting): _negotiate 2026-02-24T19:24:15.336 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.330+0000 7f4d91573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:15.336 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.330+0000 7f4d91573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:15.336 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.330+0000 7f4d91573640 10 monclient(hunting): my global_id is 30924 2026-02-24T19:24:15.336 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.330+0000 7f4d91573640 1 -- 10.20.193.14:0/1758587485 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d940b1590 con 0x7f4d94058da0 2026-02-24T19:24:15.340 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.332+0000 7f4d91573640 1 -- 10.20.193.14:0/1758587485 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3879878138 0 0) 0x7f4d80003610 con 0x7f4d941626a0 2026-02-24T19:24:15.340 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.332+0000 7f4d91573640 1 -- 10.20.193.14:0/1758587485 >> v1:10.20.193.170:6789/0 conn(0x7f4d940b0410 legacy=0x7f4d94164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:15.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.332+0000 7f4d91573640 1 -- 10.20.193.14:0/1758587485 >> v1:10.20.193.14:6789/0 conn(0x7f4d94058da0 legacy=0x7f4d941647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:15.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.332+0000 7f4d91573640 10 monclient: _finish_hunting 0 2026-02-24T19:24:15.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.332+0000 7f4d91573640 1 monclient: found mon.noname-b 2026-02-24T19:24:15.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.332+0000 7f4d91573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:15.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.332+0000 7f4d91573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.44:6789/0 2026-02-24T19:24:15.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.332+0000 7f4d91573640 1 -- 10.20.193.14:0/1758587485 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d940b1870 con 0x7f4d941626a0 2026-02-24T19:24:15.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.332+0000 7f4d91573640 10 monclient: _finish_auth 0 2026-02-24T19:24:15.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.332+0000 7f4d91573640 10 monclient: _check_auth_tickets 2026-02-24T19:24:15.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.332+0000 7f4d91573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:15.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.332+0000 7f4d91573640 1 -- 10.20.193.14:0/1758587485 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4d84003170 con 0x7f4d941626a0 2026-02-24T19:24:15.341 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.332+0000 7f4d98ab1640 5 monclient: authenticate success, global_id 29239 2026-02-24T19:24:15.342 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.332+0000 7f4d98ab1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:15.342 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.332+0000 7f4d91573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:15.342 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.332+0000 7f4d91573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:15.342 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.332+0000 7f4d91573640 10 monclient: dump: 2026-02-24T19:24:15.342 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:24:15.342 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:24:15.342 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:24:15.342 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:24:15.342 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:15.342 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:24:15.342 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:24:15.342 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:24:15.343 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:24:15.343 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:24:15.343 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.332+0000 7f4d98ab1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:15.343 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.333+0000 7f4d91573640 1 -- 10.20.193.14:0/1758587485 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4d84003340 con 0x7f4d941626a0 2026-02-24T19:24:15.343 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.333+0000 7f4d91573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:15.343 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.333+0000 7f4d91573640 1 -- 10.20.193.14:0/1758587485 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4d84003780 con 0x7f4d941626a0 2026-02-24T19:24:15.343 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.333+0000 7f4d91573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:15.343 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.333+0000 7f4d91573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:15.343 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.333+0000 7f4d91573640 10 monclient: dump: 2026-02-24T19:24:15.343 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:24:15.343 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:24:15.343 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:24:15.344 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:24:15.344 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:15.344 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:24:15.344 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:24:15.344 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:24:15.344 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:24:15.344 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:24:15.344 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.333+0000 7f4d98ab1640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:15.344 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.333+0000 7f4d98ab1640 4 set_mon_vals no callback set 2026-02-24T19:24:15.344 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.333+0000 7f4d98ab1640 10 monclient: shutdown 2026-02-24T19:24:15.344 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.333+0000 7f4d98ab1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:15.344 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.333+0000 7f4d98ab1640 1 -- 10.20.193.14:0/1758587485 >> v1:10.20.193.44:6789/0 conn(0x7f4d941626a0 legacy=0x7f4d941c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:15.344 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.333+0000 7f4d98ab1640 1 -- 10.20.193.14:0/1758587485 shutdown_connections 2026-02-24T19:24:15.345 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.333+0000 7f4d98ab1640 1 -- 10.20.193.14:0/1758587485 >> 10.20.193.14:0/1758587485 conn(0x7f4d940b65f0 msgr2=0x7f4d940b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:15.345 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.333+0000 7f4d98ab1640 1 -- 10.20.193.14:0/1758587485 shutdown_connections 2026-02-24T19:24:15.345 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.333+0000 7f4d98ab1640 1 -- 10.20.193.14:0/1758587485 wait complete. 2026-02-24T19:24:15.345 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.334+0000 7f4d98ab1640 10 monclient: build_initial_monmap 2026-02-24T19:24:15.345 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.334+0000 7f4d98ab1640 10 monclient: monmap: 2026-02-24T19:24:15.345 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:24:15.345 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:15.345 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:24:15.345 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:24:15.345 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:15.345 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:24:15.345 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:24:15.345 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:24:15.346 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:24:15.346 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:24:15.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.334+0000 7f4d98ab1640 1 librados: starting msgr at 2026-02-24T19:24:15.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.334+0000 7f4d98ab1640 1 librados: starting objecter 2026-02-24T19:24:15.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.334+0000 7f4d98ab1640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:15.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.334+0000 7f4d98ab1640 1 Processor -- start 2026-02-24T19:24:15.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.334+0000 7f4d98ab1640 1 -- start start 2026-02-24T19:24:15.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.334+0000 7f4d98ab1640 1 librados: setting wanted keys 2026-02-24T19:24:15.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.334+0000 7f4d98ab1640 1 librados: calling monclient init 2026-02-24T19:24:15.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.334+0000 7f4d98ab1640 10 monclient: init 2026-02-24T19:24:15.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.334+0000 7f4d98ab1640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:15.346 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.334+0000 7f4d98ab1640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:24:15.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.334+0000 7f4d98ab1640 10 monclient(hunting): picked mon.noname-a con 0x7f4d94058da0 addr v1:10.20.193.14:6789/0 2026-02-24T19:24:15.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.334+0000 7f4d98ab1640 10 monclient(hunting): picked mon.noname-c con 0x7f4d940b0410 addr v1:10.20.193.170:6789/0 2026-02-24T19:24:15.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.334+0000 7f4d98ab1640 10 monclient(hunting): picked mon.noname-b con 0x7f4d941626a0 addr v1:10.20.193.44:6789/0 2026-02-24T19:24:15.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.334+0000 7f4d98ab1640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d941ff010 con 0x7f4d94058da0 2026-02-24T19:24:15.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.334+0000 7f4d98ab1640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d9413fa80 con 0x7f4d941626a0 2026-02-24T19:24:15.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.334+0000 7f4d98ab1640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d9413fd60 con 0x7f4d940b0410 2026-02-24T19:24:15.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.334+0000 7f4d98ab1640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:15.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.334+0000 7f4d98ab1640 10 monclient(hunting): authenticate will time out at 4030.016948s 2026-02-24T19:24:15.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.335+0000 7f4d92575640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f4d94058da0 0x7f4d941fb510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:55182/0 (socket says 10.20.193.14:55182) 2026-02-24T19:24:15.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.335+0000 7f4d92575640 1 -- 10.20.193.14:0/3872755283 learned_addr learned my addr 10.20.193.14:0/3872755283 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:24:15.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.335+0000 7f4d7affd640 10 client.?.objecter ms_handle_connect 0x7f4d94058da0 2026-02-24T19:24:15.347 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.335+0000 7f4d7affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:15.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.335+0000 7f4d7affd640 10 client.?.objecter ms_handle_connect 0x7f4d940b0410 2026-02-24T19:24:15.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.335+0000 7f4d7affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:15.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.335+0000 7f4d7affd640 10 client.?.objecter ms_handle_connect 0x7f4d941626a0 2026-02-24T19:24:15.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.335+0000 7f4d7affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:15.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.336+0000 7f4d7affd640 1 -- 10.20.193.14:0/3872755283 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 434734396 0 0) 0x7f4d941ff010 con 0x7f4d94058da0 2026-02-24T19:24:15.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.336+0000 7f4d7affd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:15.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.336+0000 7f4d7affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:15.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.336+0000 7f4d7affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:15.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.336+0000 7f4d7affd640 10 monclient(hunting): my global_id is 30927 2026-02-24T19:24:15.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.336+0000 7f4d7affd640 1 -- 10.20.193.14:0/3872755283 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d60003610 con 0x7f4d94058da0 2026-02-24T19:24:15.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.336+0000 7f4d7affd640 1 -- 10.20.193.14:0/3872755283 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3498513904 0 0) 0x7f4d9413fd60 con 0x7f4d940b0410 2026-02-24T19:24:15.348 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.336+0000 7f4d7affd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:15.349 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.336+0000 7f4d7affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:15.349 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.336+0000 7f4d7affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:15.349 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.336+0000 7f4d7affd640 10 monclient(hunting): my global_id is 28880 2026-02-24T19:24:15.349 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.336+0000 7f4d7affd640 1 -- 10.20.193.14:0/3872755283 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d941ff010 con 0x7f4d940b0410 2026-02-24T19:24:15.349 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.337+0000 7f4d7affd640 1 -- 10.20.193.14:0/3872755283 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2700347595 0 0) 0x7f4d9413fa80 con 0x7f4d941626a0 2026-02-24T19:24:15.349 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.337+0000 7f4d7affd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:15.349 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.337+0000 7f4d7affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:15.349 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.337+0000 7f4d7affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:15.349 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.337+0000 7f4d7affd640 10 monclient(hunting): my global_id is 29242 2026-02-24T19:24:15.349 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.337+0000 7f4d7affd640 1 -- 10.20.193.14:0/3872755283 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d9413fd60 con 0x7f4d941626a0 2026-02-24T19:24:15.352 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.339+0000 7f4d7affd640 1 -- 10.20.193.14:0/3872755283 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1660509346 0 0) 0x7f4d60003610 con 0x7f4d94058da0 2026-02-24T19:24:15.352 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.339+0000 7f4d7affd640 1 -- 10.20.193.14:0/3872755283 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4d9413fa80 con 0x7f4d94058da0 2026-02-24T19:24:15.352 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.339+0000 7f4d7affd640 1 -- 10.20.193.14:0/3872755283 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4d88002fe0 con 0x7f4d94058da0 2026-02-24T19:24:15.352 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.339+0000 7f4d7affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:15.352 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.339+0000 7f4d7affd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:15.352 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.339+0000 7f4d7affd640 10 monclient(hunting): dump: 2026-02-24T19:24:15.353 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:24:15.353 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:24:15.353 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:24:15.353 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:24:15.353 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:15.353 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:24:15.353 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:24:15.353 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:24:15.353 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:24:15.353 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:24:15.353 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.339+0000 7f4d7affd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:15.353 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.339+0000 7f4d7affd640 1 -- 10.20.193.14:0/3872755283 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1666649573 0 0) 0x7f4d941ff010 con 0x7f4d940b0410 2026-02-24T19:24:15.354 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.339+0000 7f4d7affd640 1 -- 10.20.193.14:0/3872755283 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4d60003610 con 0x7f4d940b0410 2026-02-24T19:24:15.354 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.339+0000 7f4d7affd640 1 -- 10.20.193.14:0/3872755283 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4d7c003070 con 0x7f4d940b0410 2026-02-24T19:24:15.354 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.339+0000 7f4d7affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:15.354 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.339+0000 7f4d7affd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:15.354 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.339+0000 7f4d7affd640 10 monclient(hunting): dump: 2026-02-24T19:24:15.354 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:24:15.354 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:24:15.354 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:24:15.354 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:24:15.354 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:15.354 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:24:15.354 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:24:15.355 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:24:15.355 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:24:15.355 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:24:15.355 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.339+0000 7f4d7affd640 1 -- 10.20.193.14:0/3872755283 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 473661573 0 0) 0x7f4d9413fd60 con 0x7f4d941626a0 2026-02-24T19:24:15.355 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.339+0000 7f4d7affd640 1 -- 10.20.193.14:0/3872755283 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4d941ff010 con 0x7f4d941626a0 2026-02-24T19:24:15.355 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.339+0000 7f4d7affd640 1 -- 10.20.193.14:0/3872755283 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4d84003690 con 0x7f4d941626a0 2026-02-24T19:24:15.355 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.339+0000 7f4d7affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:15.355 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.339+0000 7f4d7affd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:15.355 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.339+0000 7f4d7affd640 10 monclient(hunting): dump: 2026-02-24T19:24:15.355 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:24:15.355 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:24:15.355 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:24:15.355 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:24:15.356 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:15.356 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:24:15.356 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:24:15.356 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:24:15.356 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:24:15.356 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:24:15.356 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.341+0000 7f4d7affd640 1 -- 10.20.193.14:0/3872755283 <== mon.0 v1:10.20.193.14:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2685139706 0 0) 0x7f4d9413fa80 con 0x7f4d94058da0 2026-02-24T19:24:15.356 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.341+0000 7f4d7affd640 1 -- 10.20.193.14:0/3872755283 >> v1:10.20.193.170:6789/0 conn(0x7f4d940b0410 legacy=0x7f4d941fe900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:15.356 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.341+0000 7f4d7affd640 1 -- 10.20.193.14:0/3872755283 >> v1:10.20.193.44:6789/0 conn(0x7f4d941626a0 legacy=0x7f4d9413d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:15.356 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.341+0000 7f4d7affd640 10 monclient: _finish_hunting 0 2026-02-24T19:24:15.356 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.341+0000 7f4d7affd640 1 monclient: found mon.a 2026-02-24T19:24:15.356 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.341+0000 7f4d7affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:15.357 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.341+0000 7f4d7affd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:24:15.357 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.341+0000 7f4d7affd640 1 -- 10.20.193.14:0/3872755283 --> v1:10.20.193.14:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d94140040 con 0x7f4d94058da0 2026-02-24T19:24:15.357 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.341+0000 7f4d7affd640 10 monclient: _finish_auth 0 2026-02-24T19:24:15.357 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.341+0000 7f4d7affd640 10 monclient: _check_auth_tickets 2026-02-24T19:24:15.357 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.341+0000 7f4d7affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:15.357 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.341+0000 7f4d98ab1640 5 monclient: authenticate success, global_id 30927 2026-02-24T19:24:15.357 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.341+0000 7f4d98ab1640 10 monclient: _renew_subs 2026-02-24T19:24:15.357 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.341+0000 7f4d98ab1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:24:15.357 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.341+0000 7f4d98ab1640 1 -- 10.20.193.14:0/3872755283 --> v1:10.20.193.14:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4d94140320 con 0x7f4d94058da0 2026-02-24T19:24:15.357 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.341+0000 7f4d98ab1640 10 client.30927.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:15.357 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.341+0000 7f4d98ab1640 10 monclient: _renew_subs 2026-02-24T19:24:15.357 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.341+0000 7f4d98ab1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:24:15.357 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.341+0000 7f4d98ab1640 1 -- 10.20.193.14:0/3872755283 --> v1:10.20.193.14:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4d941fab80 con 0x7f4d94058da0 2026-02-24T19:24:15.358 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.341+0000 7f4d98ab1640 1 librados: init done 2026-02-24T19:24:15.358 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.341+0000 7f4d98ab1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:15.358 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.341+0000 7f4d98ab1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:15.358 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.341+0000 7f4d98ab1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.14:6789/0 2026-02-24T19:24:15.358 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.341+0000 7f4d98ab1640 1 -- 10.20.193.14:0/3872755283 --> v1:10.20.193.14:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d9413f130 con 0x7f4d94058da0 2026-02-24T19:24:15.436 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.433+0000 7f4d7affd640 1 -- 10.20.193.14:0/3872755283 <== mon.0 v1:10.20.193.14:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4d88003180 con 0x7f4d94058da0 2026-02-24T19:24:15.437 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.433+0000 7f4d7affd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:15.437 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.433+0000 7f4d7affd640 1 -- 10.20.193.14:0/3872755283 <== mon.0 v1:10.20.193.14:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4d88004a70 con 0x7f4d94058da0 2026-02-24T19:24:15.437 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.433+0000 7f4d7affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:15.437 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.433+0000 7f4d7affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:15.437 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.433+0000 7f4d7affd640 10 monclient: dump: 2026-02-24T19:24:15.437 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:24:15.437 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:24:15.437 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:24:15.437 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:24:15.437 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:15.438 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:24:15.438 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:24:15.438 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:24:15.438 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:24:15.438 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:24:15.438 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.433+0000 7f4d90d72640 4 set_mon_vals no callback set 2026-02-24T19:24:15.439 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.434+0000 7f4d7affd640 1 -- 10.20.193.14:0/3872755283 <== mon.0 v1:10.20.193.14:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f4d88004a70 con 0x7f4d94058da0 2026-02-24T19:24:15.439 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.435+0000 7f4d91d74640 10 monclient: get_auth_request con 0x7f4d60077e60 auth_method 0 2026-02-24T19:24:15.439 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.435+0000 7f4d7affd640 10 client.30927.objecter ms_handle_connect 0x7f4d60077e60 2026-02-24T19:24:15.441 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.438+0000 7f4d7affd640 1 -- 10.20.193.14:0/3872755283 <== mon.0 v1:10.20.193.14:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7f4d88093170 con 0x7f4d94058da0 2026-02-24T19:24:15.441 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.438+0000 7f4d7affd640 10 client.30927.objecter ms_dispatch2 0x7f4d94000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:24:15.441 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.438+0000 7f4d7affd640 3 client.30927.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:24:15.441 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.438+0000 7f4d7affd640 3 client.30927.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:24:15.441 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.438+0000 7f4d7affd640 20 client.30927.objecter dump_active .. 0 homeless 2026-02-24T19:24:15.441 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.438+0000 7f4d7affd640 1 -- 10.20.193.14:0/3872755283 <== mon.0 v1:10.20.193.14:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f4d8805dba0 con 0x7f4d94058da0 2026-02-24T19:24:15.441 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.438+0000 7f4d7affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:15.441 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.438+0000 7f4d7affd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:15.548 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.545+0000 7f4d98ab1640 1 -- 10.20.193.14:0/3872755283 --> v1:10.20.193.14:6800/4014096310 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4d9413ee50 con 0x7f4d60077e60 2026-02-24T19:24:15.549 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.547+0000 7f4d7affd640 1 -- 10.20.193.14:0/3872755283 <== mgr.4110 v1:10.20.193.14:6800/4014096310 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+125281 (unknown 2965378022 0 1845551278) 0x7f4d9413ee50 con 0x7f4d60077e60 2026-02-24T19:24:15.550 INFO:teuthology.orchestra.run.trial014.stdout: 2026-02-24T19:24:15.551 INFO:teuthology.orchestra.run.trial014.stderr:dumped all 2026-02-24T19:24:15.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.548+0000 7f4d98ab1640 10 librados: watch_flush enter 2026-02-24T19:24:15.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.548+0000 7f4d98ab1640 10 librados: watch_flush exit 2026-02-24T19:24:15.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.548+0000 7f4d98ab1640 20 client.30927.objecter shutdown clearing up homeless session... 2026-02-24T19:24:15.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.548+0000 7f4d98ab1640 10 client.30927.objecter successfully canceled tick 2026-02-24T19:24:15.553 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.548+0000 7f4d98ab1640 1 -- 10.20.193.14:0/3872755283 >> v1:10.20.193.14:6800/4014096310 conn(0x7f4d60077e60 legacy=0x7f4d60098310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:15.554 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.548+0000 7f4d98ab1640 10 monclient: shutdown 2026-02-24T19:24:15.554 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.548+0000 7f4d98ab1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:15.554 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.548+0000 7f4d98ab1640 1 -- 10.20.193.14:0/3872755283 >> v1:10.20.193.14:6789/0 conn(0x7f4d94058da0 legacy=0x7f4d941fb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:15.554 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.548+0000 7f4d98ab1640 1 -- 10.20.193.14:0/3872755283 shutdown_connections 2026-02-24T19:24:15.554 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.548+0000 7f4d98ab1640 1 -- 10.20.193.14:0/3872755283 >> 10.20.193.14:0/3872755283 conn(0x7f4d940b65f0 msgr2=0x7f4d9405cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:15.554 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.549+0000 7f4d98ab1640 1 -- 10.20.193.14:0/3872755283 shutdown_connections 2026-02-24T19:24:15.554 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.549+0000 7f4d98ab1640 1 -- 10.20.193.14:0/3872755283 wait complete. 2026-02-24T19:24:15.554 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.549+0000 7f4d98ab1640 1 librados: shutdown 2026-02-24T19:24:15.560 INFO:teuthology.orchestra.run.trial014.stdout:{"pg_ready":true,"pg_map":{"version":567,"stamp":"2026-02-24T19:24:13.574089+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":56,"num_read_kb":47,"num_write":70,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":544480,"kb_used_data":113120,"kb_used_omap":25020,"kb_used_meta":406083,"kb_avail":1509404960,"statfs":{"total":1546188226560,"available":1545630679040,"internally_reserved":0,"allocated":115834880,"data_stored":73029024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25620621,"internal_metadata":415829875},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001859"},"pg_stats":[{"pgid":"28.0","version":"0'0","reported_seq":658,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:51.177634+0000","last_change":"2026-02-24T19:23:51.176844+0000","last_active":"2026-02-24T19:23:51.177634+0000","last_peered":"2026-02-24T19:23:51.177634+0000","last_clean":"2026-02-24T19:23:51.177634+0000","last_became_active":"2026-02-24T19:18:04.430880+0000","last_became_peered":"2026-02-24T19:18:04.430880+0000","last_unstale":"2026-02-24T19:23:51.177634+0000","last_undegraded":"2026-02-24T19:23:51.177634+0000","last_fullsized":"2026-02-24T19:23:51.177634+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:51.175047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:51.175047+0000","last_clean_scrub_stamp":"2026-02-24T19:23:51.175047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:48:49.117345+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1","version":"354'12","reported_seq":683,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:50.047593+0000","last_change":"2026-02-24T19:23:50.047593+0000","last_active":"2026-02-24T19:23:50.047593+0000","last_peered":"2026-02-24T19:23:50.047593+0000","last_clean":"2026-02-24T19:23:50.047593+0000","last_became_active":"2026-02-24T19:18:04.576194+0000","last_became_peered":"2026-02-24T19:18:04.576194+0000","last_unstale":"2026-02-24T19:23:50.047593+0000","last_undegraded":"2026-02-24T19:23:50.047593+0000","last_fullsized":"2026-02-24T19:23:50.047593+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"354'12","last_scrub_stamp":"2026-02-24T19:23:50.046522+0000","last_deep_scrub":"354'12","last_deep_scrub_stamp":"2026-02-24T19:23:50.046522+0000","last_clean_scrub_stamp":"2026-02-24T19:23:50.046522+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:03:49.829180+0000","scrub_duration":115,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,4],"acting":[12,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":655,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:50.325961+0000","last_change":"2026-02-24T19:23:50.325961+0000","last_active":"2026-02-24T19:23:50.325961+0000","last_peered":"2026-02-24T19:23:50.325961+0000","last_clean":"2026-02-24T19:23:50.325961+0000","last_became_active":"2026-02-24T19:18:03.958691+0000","last_became_peered":"2026-02-24T19:18:03.958691+0000","last_unstale":"2026-02-24T19:23:50.325961+0000","last_undegraded":"2026-02-24T19:23:50.325961+0000","last_fullsized":"2026-02-24T19:23:50.325961+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:50.325183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:50.325183+0000","last_clean_scrub_stamp":"2026-02-24T19:23:50.325183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:47:09.737576+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":657,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:52.232240+0000","last_change":"2026-02-24T19:23:52.232240+0000","last_active":"2026-02-24T19:23:52.232240+0000","last_peered":"2026-02-24T19:23:52.232240+0000","last_clean":"2026-02-24T19:23:52.232240+0000","last_became_active":"2026-02-24T19:18:04.335655+0000","last_became_peered":"2026-02-24T19:18:04.335655+0000","last_unstale":"2026-02-24T19:23:52.232240+0000","last_undegraded":"2026-02-24T19:23:52.232240+0000","last_fullsized":"2026-02-24T19:23:52.232240+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:52.230268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:52.230268+0000","last_clean_scrub_stamp":"2026-02-24T19:23:52.230268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:19:32.573930+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,14],"acting":[5,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":659,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:54.706499+0000","last_change":"2026-02-24T19:23:54.706499+0000","last_active":"2026-02-24T19:23:54.706499+0000","last_peered":"2026-02-24T19:23:54.706499+0000","last_clean":"2026-02-24T19:23:54.706499+0000","last_became_active":"2026-02-24T19:18:05.015377+0000","last_became_peered":"2026-02-24T19:18:05.015377+0000","last_unstale":"2026-02-24T19:23:54.706499+0000","last_undegraded":"2026-02-24T19:23:54.706499+0000","last_fullsized":"2026-02-24T19:23:54.706499+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:54.704778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:54.704778+0000","last_clean_scrub_stamp":"2026-02-24T19:23:54.704778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:13:23.611723+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,10],"acting":[14,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":652,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:53.353257+0000","last_change":"2026-02-24T19:23:53.353257+0000","last_active":"2026-02-24T19:23:53.353257+0000","last_peered":"2026-02-24T19:23:53.353257+0000","last_clean":"2026-02-24T19:23:53.353257+0000","last_became_active":"2026-02-24T19:18:05.234574+0000","last_became_peered":"2026-02-24T19:18:05.234574+0000","last_unstale":"2026-02-24T19:23:53.353257+0000","last_undegraded":"2026-02-24T19:23:53.353257+0000","last_fullsized":"2026-02-24T19:23:53.353257+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:53.351545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:53.351545+0000","last_clean_scrub_stamp":"2026-02-24T19:23:53.351545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:47:20.946591+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":655,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:49.456626+0000","last_change":"2026-02-24T19:23:49.456626+0000","last_active":"2026-02-24T19:23:49.456626+0000","last_peered":"2026-02-24T19:23:49.456626+0000","last_clean":"2026-02-24T19:23:49.456626+0000","last_became_active":"2026-02-24T19:18:03.990285+0000","last_became_peered":"2026-02-24T19:18:03.990285+0000","last_unstale":"2026-02-24T19:23:49.456626+0000","last_undegraded":"2026-02-24T19:23:49.456626+0000","last_fullsized":"2026-02-24T19:23:49.456626+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:49.455047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:49.455047+0000","last_clean_scrub_stamp":"2026-02-24T19:23:49.455047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:30:10.157256+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":659,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.041044+0000","last_change":"2026-02-24T19:23:58.041044+0000","last_active":"2026-02-24T19:23:58.041044+0000","last_peered":"2026-02-24T19:23:58.041044+0000","last_clean":"2026-02-24T19:23:58.041044+0000","last_became_active":"2026-02-24T19:18:03.420675+0000","last_became_peered":"2026-02-24T19:18:03.420675+0000","last_unstale":"2026-02-24T19:23:58.041044+0000","last_undegraded":"2026-02-24T19:23:58.041044+0000","last_fullsized":"2026-02-24T19:23:58.041044+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:58.040308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:58.040308+0000","last_clean_scrub_stamp":"2026-02-24T19:23:58.040308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:12:13.184089+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,6],"acting":[15,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":655,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:50.453207+0000","last_change":"2026-02-24T19:23:50.453207+0000","last_active":"2026-02-24T19:23:50.453207+0000","last_peered":"2026-02-24T19:23:50.453207+0000","last_clean":"2026-02-24T19:23:50.453207+0000","last_became_active":"2026-02-24T19:18:03.252679+0000","last_became_peered":"2026-02-24T19:18:03.252679+0000","last_unstale":"2026-02-24T19:23:50.453207+0000","last_undegraded":"2026-02-24T19:23:50.453207+0000","last_fullsized":"2026-02-24T19:23:50.453207+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:50.452324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:50.452324+0000","last_clean_scrub_stamp":"2026-02-24T19:23:50.452324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:06:52.442325+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,13],"acting":[4,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":656,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:50.978104+0000","last_change":"2026-02-24T19:23:50.978104+0000","last_active":"2026-02-24T19:23:50.978104+0000","last_peered":"2026-02-24T19:23:50.978104+0000","last_clean":"2026-02-24T19:23:50.978104+0000","last_became_active":"2026-02-24T19:18:04.552851+0000","last_became_peered":"2026-02-24T19:18:04.552851+0000","last_unstale":"2026-02-24T19:23:50.978104+0000","last_undegraded":"2026-02-24T19:23:50.978104+0000","last_fullsized":"2026-02-24T19:23:50.978104+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:50.976401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:50.976401+0000","last_clean_scrub_stamp":"2026-02-24T19:23:50.976401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:12:09.136814+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,13],"acting":[12,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":655,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:49.871362+0000","last_change":"2026-02-24T19:23:49.871362+0000","last_active":"2026-02-24T19:23:49.871362+0000","last_peered":"2026-02-24T19:23:49.871362+0000","last_clean":"2026-02-24T19:23:49.871362+0000","last_became_active":"2026-02-24T19:18:03.507201+0000","last_became_peered":"2026-02-24T19:18:03.507201+0000","last_unstale":"2026-02-24T19:23:49.871362+0000","last_undegraded":"2026-02-24T19:23:49.871362+0000","last_fullsized":"2026-02-24T19:23:49.871362+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:49.867529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:49.867529+0000","last_clean_scrub_stamp":"2026-02-24T19:23:49.867529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:54:39.940147+0000","scrub_duration":126,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,13],"acting":[8,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":658,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:54.663389+0000","last_change":"2026-02-24T19:23:54.663389+0000","last_active":"2026-02-24T19:23:54.663389+0000","last_peered":"2026-02-24T19:23:54.663389+0000","last_clean":"2026-02-24T19:23:54.663389+0000","last_became_active":"2026-02-24T19:18:03.433618+0000","last_became_peered":"2026-02-24T19:18:03.433618+0000","last_unstale":"2026-02-24T19:23:54.663389+0000","last_undegraded":"2026-02-24T19:23:54.663389+0000","last_fullsized":"2026-02-24T19:23:54.663389+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:54.661811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:54.661811+0000","last_clean_scrub_stamp":"2026-02-24T19:23:54.661811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:53:44.424719+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,7],"acting":[11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":655,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:56.126657+0000","last_change":"2026-02-24T19:23:56.126657+0000","last_active":"2026-02-24T19:23:56.126657+0000","last_peered":"2026-02-24T19:23:56.126657+0000","last_clean":"2026-02-24T19:23:56.126657+0000","last_became_active":"2026-02-24T19:18:04.456892+0000","last_became_peered":"2026-02-24T19:18:04.456892+0000","last_unstale":"2026-02-24T19:23:56.126657+0000","last_undegraded":"2026-02-24T19:23:56.126657+0000","last_fullsized":"2026-02-24T19:23:56.126657+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:56.124950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:56.124950+0000","last_clean_scrub_stamp":"2026-02-24T19:23:56.124950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:56:05.793207+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":678,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:57.060175+0000","last_change":"2026-02-24T19:23:57.060175+0000","last_active":"2026-02-24T19:23:57.060175+0000","last_peered":"2026-02-24T19:23:57.060175+0000","last_clean":"2026-02-24T19:23:57.060175+0000","last_became_active":"2026-02-24T19:17:25.636961+0000","last_became_peered":"2026-02-24T19:17:25.636961+0000","last_unstale":"2026-02-24T19:23:57.060175+0000","last_undegraded":"2026-02-24T19:23:57.060175+0000","last_fullsized":"2026-02-24T19:23:57.060175+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:57.059411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:57.059411+0000","last_clean_scrub_stamp":"2026-02-24T19:23:57.059411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:34:05.332187+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0.076701065999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,0],"acting":[15,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":657,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:52.942398+0000","last_change":"2026-02-24T19:23:52.942398+0000","last_active":"2026-02-24T19:23:52.942398+0000","last_peered":"2026-02-24T19:23:52.942398+0000","last_clean":"2026-02-24T19:23:52.942398+0000","last_became_active":"2026-02-24T19:18:04.057738+0000","last_became_peered":"2026-02-24T19:18:04.057738+0000","last_unstale":"2026-02-24T19:23:52.942398+0000","last_undegraded":"2026-02-24T19:23:52.942398+0000","last_fullsized":"2026-02-24T19:23:52.942398+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:52.940604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:52.940604+0000","last_clean_scrub_stamp":"2026-02-24T19:23:52.940604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:00:01.782714+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":678,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:53.784159+0000","last_change":"2026-02-24T19:23:53.783281+0000","last_active":"2026-02-24T19:23:53.784159+0000","last_peered":"2026-02-24T19:23:53.784159+0000","last_clean":"2026-02-24T19:23:53.784159+0000","last_became_active":"2026-02-24T19:17:24.847985+0000","last_became_peered":"2026-02-24T19:17:24.847985+0000","last_unstale":"2026-02-24T19:23:53.784159+0000","last_undegraded":"2026-02-24T19:23:53.784159+0000","last_fullsized":"2026-02-24T19:23:53.784159+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:53.778125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:53.778125+0000","last_clean_scrub_stamp":"2026-02-24T19:23:53.778125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:41:30.899190+0000","scrub_duration":90,"objects_trimmed":0,"snaptrim_duration":0.032556177999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,7],"acting":[14,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":656,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:52.951663+0000","last_change":"2026-02-24T19:23:52.951663+0000","last_active":"2026-02-24T19:23:52.951663+0000","last_peered":"2026-02-24T19:23:52.951663+0000","last_clean":"2026-02-24T19:23:52.951663+0000","last_became_active":"2026-02-24T19:18:04.731637+0000","last_became_peered":"2026-02-24T19:18:04.731637+0000","last_unstale":"2026-02-24T19:23:52.951663+0000","last_undegraded":"2026-02-24T19:23:52.951663+0000","last_fullsized":"2026-02-24T19:23:52.951663+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:52.950040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:52.950040+0000","last_clean_scrub_stamp":"2026-02-24T19:23:52.950040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:25:28.452211+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,14],"acting":[12,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":671,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:55.689580+0000","last_change":"2026-02-24T19:23:55.689580+0000","last_active":"2026-02-24T19:23:55.689580+0000","last_peered":"2026-02-24T19:23:55.689580+0000","last_clean":"2026-02-24T19:23:55.689580+0000","last_became_active":"2026-02-24T19:17:24.821876+0000","last_became_peered":"2026-02-24T19:17:24.821876+0000","last_unstale":"2026-02-24T19:23:55.689580+0000","last_undegraded":"2026-02-24T19:23:55.689580+0000","last_fullsized":"2026-02-24T19:23:55.689580+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:55.687779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:55.687779+0000","last_clean_scrub_stamp":"2026-02-24T19:23:55.687779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:30:08.144746+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0.044624814999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":656,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:54.565623+0000","last_change":"2026-02-24T19:23:54.565623+0000","last_active":"2026-02-24T19:23:54.565623+0000","last_peered":"2026-02-24T19:23:54.565623+0000","last_clean":"2026-02-24T19:23:54.565623+0000","last_became_active":"2026-02-24T19:18:04.719330+0000","last_became_peered":"2026-02-24T19:18:04.719330+0000","last_unstale":"2026-02-24T19:23:54.565623+0000","last_undegraded":"2026-02-24T19:23:54.565623+0000","last_fullsized":"2026-02-24T19:23:54.565623+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:54.563874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:54.563874+0000","last_clean_scrub_stamp":"2026-02-24T19:23:54.563874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:04:09.484914+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,6],"acting":[10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":671,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:54.800012+0000","last_change":"2026-02-24T19:23:54.800012+0000","last_active":"2026-02-24T19:23:54.800012+0000","last_peered":"2026-02-24T19:23:54.800012+0000","last_clean":"2026-02-24T19:23:54.800012+0000","last_became_active":"2026-02-24T19:17:23.991081+0000","last_became_peered":"2026-02-24T19:17:23.991081+0000","last_unstale":"2026-02-24T19:23:54.800012+0000","last_undegraded":"2026-02-24T19:23:54.800012+0000","last_fullsized":"2026-02-24T19:23:54.800012+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:54.794994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:54.794994+0000","last_clean_scrub_stamp":"2026-02-24T19:23:54.794994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:46:15.953883+0000","scrub_duration":118,"objects_trimmed":0,"snaptrim_duration":0.042145786999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":659,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:55.741419+0000","last_change":"2026-02-24T19:23:55.741419+0000","last_active":"2026-02-24T19:23:55.741419+0000","last_peered":"2026-02-24T19:23:55.741419+0000","last_clean":"2026-02-24T19:23:55.741419+0000","last_became_active":"2026-02-24T19:18:03.655492+0000","last_became_peered":"2026-02-24T19:18:03.655492+0000","last_unstale":"2026-02-24T19:23:55.741419+0000","last_undegraded":"2026-02-24T19:23:55.741419+0000","last_fullsized":"2026-02-24T19:23:55.741419+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:55.739687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:55.739687+0000","last_clean_scrub_stamp":"2026-02-24T19:23:55.739687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:24:23.145148+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,7],"acting":[14,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.2","version":"354'3","reported_seq":681,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:55.216438+0000","last_change":"2026-02-24T19:23:55.216438+0000","last_active":"2026-02-24T19:23:55.216438+0000","last_peered":"2026-02-24T19:23:55.216438+0000","last_clean":"2026-02-24T19:23:55.216438+0000","last_became_active":"2026-02-24T19:17:25.045520+0000","last_became_peered":"2026-02-24T19:17:25.045520+0000","last_unstale":"2026-02-24T19:23:55.216438+0000","last_undegraded":"2026-02-24T19:23:55.216438+0000","last_fullsized":"2026-02-24T19:23:55.216438+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"354'3","last_scrub_stamp":"2026-02-24T19:23:55.212096+0000","last_deep_scrub":"354'3","last_deep_scrub_stamp":"2026-02-24T19:23:55.212096+0000","last_clean_scrub_stamp":"2026-02-24T19:23:55.212096+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:37:43.972655+0000","scrub_duration":145,"objects_trimmed":0,"snaptrim_duration":0.069045234999999996,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,10],"acting":[15,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":655,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:52.433412+0000","last_change":"2026-02-24T19:23:52.433412+0000","last_active":"2026-02-24T19:23:52.433412+0000","last_peered":"2026-02-24T19:23:52.433412+0000","last_clean":"2026-02-24T19:23:52.433412+0000","last_became_active":"2026-02-24T19:18:03.348322+0000","last_became_peered":"2026-02-24T19:18:03.348322+0000","last_unstale":"2026-02-24T19:23:52.433412+0000","last_undegraded":"2026-02-24T19:23:52.433412+0000","last_fullsized":"2026-02-24T19:23:52.433412+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:52.431619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:52.431619+0000","last_clean_scrub_stamp":"2026-02-24T19:23:52.431619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:55:27.698970+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":677,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:51.948253+0000","last_change":"2026-02-24T19:23:51.948253+0000","last_active":"2026-02-24T19:23:51.948253+0000","last_peered":"2026-02-24T19:23:51.948253+0000","last_clean":"2026-02-24T19:23:51.948253+0000","last_became_active":"2026-02-24T19:17:24.834035+0000","last_became_peered":"2026-02-24T19:17:24.834035+0000","last_unstale":"2026-02-24T19:23:51.948253+0000","last_undegraded":"2026-02-24T19:23:51.948253+0000","last_fullsized":"2026-02-24T19:23:51.948253+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:51.946454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:51.946454+0000","last_clean_scrub_stamp":"2026-02-24T19:23:51.946454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:56:33.158427+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0.036343514,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":658,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:53.057782+0000","last_change":"2026-02-24T19:23:53.056979+0000","last_active":"2026-02-24T19:23:53.057782+0000","last_peered":"2026-02-24T19:23:53.057782+0000","last_clean":"2026-02-24T19:23:53.057782+0000","last_became_active":"2026-02-24T19:18:03.450995+0000","last_became_peered":"2026-02-24T19:18:03.450995+0000","last_unstale":"2026-02-24T19:23:53.057782+0000","last_undegraded":"2026-02-24T19:23:53.057782+0000","last_fullsized":"2026-02-24T19:23:53.057782+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:53.054788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:53.054788+0000","last_clean_scrub_stamp":"2026-02-24T19:23:53.054788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:59:42.460181+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,2],"acting":[13,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":677,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:52.174029+0000","last_change":"2026-02-24T19:23:52.174029+0000","last_active":"2026-02-24T19:23:52.174029+0000","last_peered":"2026-02-24T19:23:52.174029+0000","last_clean":"2026-02-24T19:23:52.174029+0000","last_became_active":"2026-02-24T19:17:24.560197+0000","last_became_peered":"2026-02-24T19:17:24.560197+0000","last_unstale":"2026-02-24T19:23:52.174029+0000","last_undegraded":"2026-02-24T19:23:52.174029+0000","last_fullsized":"2026-02-24T19:23:52.174029+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:52.169545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:52.169545+0000","last_clean_scrub_stamp":"2026-02-24T19:23:52.169545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:52:04.602934+0000","scrub_duration":88,"objects_trimmed":0,"snaptrim_duration":0.038521284000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":655,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:51.357136+0000","last_change":"2026-02-24T19:23:51.357136+0000","last_active":"2026-02-24T19:23:51.357136+0000","last_peered":"2026-02-24T19:23:51.357136+0000","last_clean":"2026-02-24T19:23:51.357136+0000","last_became_active":"2026-02-24T19:18:03.998754+0000","last_became_peered":"2026-02-24T19:18:03.998754+0000","last_unstale":"2026-02-24T19:23:51.357136+0000","last_undegraded":"2026-02-24T19:23:51.357136+0000","last_fullsized":"2026-02-24T19:23:51.357136+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:51.356086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:51.356086+0000","last_clean_scrub_stamp":"2026-02-24T19:23:51.356086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:18:15.473408+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"354'2","reported_seq":680,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:56.080230+0000","last_change":"2026-02-24T19:23:56.080230+0000","last_active":"2026-02-24T19:23:56.080230+0000","last_peered":"2026-02-24T19:23:56.080230+0000","last_clean":"2026-02-24T19:23:56.080230+0000","last_became_active":"2026-02-24T19:17:24.838239+0000","last_became_peered":"2026-02-24T19:17:24.838239+0000","last_unstale":"2026-02-24T19:23:56.080230+0000","last_undegraded":"2026-02-24T19:23:56.080230+0000","last_fullsized":"2026-02-24T19:23:56.080230+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"354'2","last_scrub_stamp":"2026-02-24T19:23:56.078559+0000","last_deep_scrub":"354'2","last_deep_scrub_stamp":"2026-02-24T19:23:56.078559+0000","last_clean_scrub_stamp":"2026-02-24T19:23:56.078559+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:44:56.984386+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0.070474251000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"1.0","version":"354'34","reported_seq":720,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:52.572529+0000","last_change":"2026-02-24T19:23:52.572529+0000","last_active":"2026-02-24T19:23:52.572529+0000","last_peered":"2026-02-24T19:23:52.572529+0000","last_clean":"2026-02-24T19:23:52.572529+0000","last_became_active":"2026-02-24T19:17:18.351934+0000","last_became_peered":"2026-02-24T19:17:18.351934+0000","last_unstale":"2026-02-24T19:23:52.572529+0000","last_undegraded":"2026-02-24T19:23:52.572529+0000","last_fullsized":"2026-02-24T19:23:52.572529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"354'34","last_scrub_stamp":"2026-02-24T19:23:52.568578+0000","last_deep_scrub":"354'34","last_deep_scrub_stamp":"2026-02-24T19:23:52.568578+0000","last_clean_scrub_stamp":"2026-02-24T19:23:52.568578+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:29:53.868937+0000","scrub_duration":205,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":655,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:54.148433+0000","last_change":"2026-02-24T19:23:54.148433+0000","last_active":"2026-02-24T19:23:54.148433+0000","last_peered":"2026-02-24T19:23:54.148433+0000","last_clean":"2026-02-24T19:23:54.148433+0000","last_became_active":"2026-02-24T19:18:03.586391+0000","last_became_peered":"2026-02-24T19:18:03.586391+0000","last_unstale":"2026-02-24T19:23:54.148433+0000","last_undegraded":"2026-02-24T19:23:54.148433+0000","last_fullsized":"2026-02-24T19:23:54.148433+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:54.147379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:54.147379+0000","last_clean_scrub_stamp":"2026-02-24T19:23:54.147379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:27:47.422115+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":656,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:51.995813+0000","last_change":"2026-02-24T19:23:51.995813+0000","last_active":"2026-02-24T19:23:51.995813+0000","last_peered":"2026-02-24T19:23:51.995813+0000","last_clean":"2026-02-24T19:23:51.995813+0000","last_became_active":"2026-02-24T19:18:04.535003+0000","last_became_peered":"2026-02-24T19:18:04.535003+0000","last_unstale":"2026-02-24T19:23:51.995813+0000","last_undegraded":"2026-02-24T19:23:51.995813+0000","last_fullsized":"2026-02-24T19:23:51.995813+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:51.994844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:51.994844+0000","last_clean_scrub_stamp":"2026-02-24T19:23:51.994844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:07:56.782207+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,1],"acting":[12,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":655,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:49.325050+0000","last_change":"2026-02-24T19:23:49.325050+0000","last_active":"2026-02-24T19:23:49.325050+0000","last_peered":"2026-02-24T19:23:49.325050+0000","last_clean":"2026-02-24T19:23:49.325050+0000","last_became_active":"2026-02-24T19:18:03.813130+0000","last_became_peered":"2026-02-24T19:18:03.813130+0000","last_unstale":"2026-02-24T19:23:49.325050+0000","last_undegraded":"2026-02-24T19:23:49.325050+0000","last_fullsized":"2026-02-24T19:23:49.325050+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:49.323273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:49.323273+0000","last_clean_scrub_stamp":"2026-02-24T19:23:49.323273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:00:17.422922+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9],"acting":[0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":655,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:55.131991+0000","last_change":"2026-02-24T19:23:55.131991+0000","last_active":"2026-02-24T19:23:55.131991+0000","last_peered":"2026-02-24T19:23:55.131991+0000","last_clean":"2026-02-24T19:23:55.131991+0000","last_became_active":"2026-02-24T19:18:04.175135+0000","last_became_peered":"2026-02-24T19:18:04.175135+0000","last_unstale":"2026-02-24T19:23:55.131991+0000","last_undegraded":"2026-02-24T19:23:55.131991+0000","last_fullsized":"2026-02-24T19:23:55.131991+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:55.130419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:55.130419+0000","last_clean_scrub_stamp":"2026-02-24T19:23:55.130419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:14:40.147483+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":654,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:57.224054+0000","last_change":"2026-02-24T19:23:57.224054+0000","last_active":"2026-02-24T19:23:57.224054+0000","last_peered":"2026-02-24T19:23:57.224054+0000","last_clean":"2026-02-24T19:23:57.224054+0000","last_became_active":"2026-02-24T19:18:03.684548+0000","last_became_peered":"2026-02-24T19:18:03.684548+0000","last_unstale":"2026-02-24T19:23:57.224054+0000","last_undegraded":"2026-02-24T19:23:57.224054+0000","last_fullsized":"2026-02-24T19:23:57.224054+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:57.222461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:57.222461+0000","last_clean_scrub_stamp":"2026-02-24T19:23:57.222461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:49:13.906829+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,13],"acting":[7,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":654,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:56.205634+0000","last_change":"2026-02-24T19:23:56.205634+0000","last_active":"2026-02-24T19:23:56.205634+0000","last_peered":"2026-02-24T19:23:56.205634+0000","last_clean":"2026-02-24T19:23:56.205634+0000","last_became_active":"2026-02-24T19:18:03.879055+0000","last_became_peered":"2026-02-24T19:18:03.879055+0000","last_unstale":"2026-02-24T19:23:56.205634+0000","last_undegraded":"2026-02-24T19:23:56.205634+0000","last_fullsized":"2026-02-24T19:23:56.205634+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:56.204081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:56.204081+0000","last_clean_scrub_stamp":"2026-02-24T19:23:56.204081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:02:45.831373+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,12],"acting":[7,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":655,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:51.437746+0000","last_change":"2026-02-24T19:23:51.437746+0000","last_active":"2026-02-24T19:23:51.437746+0000","last_peered":"2026-02-24T19:23:51.437746+0000","last_clean":"2026-02-24T19:23:51.437746+0000","last_became_active":"2026-02-24T19:18:03.672857+0000","last_became_peered":"2026-02-24T19:18:03.672857+0000","last_unstale":"2026-02-24T19:23:51.437746+0000","last_undegraded":"2026-02-24T19:23:51.437746+0000","last_fullsized":"2026-02-24T19:23:51.437746+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:51.435865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:51.435865+0000","last_clean_scrub_stamp":"2026-02-24T19:23:51.435865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:21:03.758177+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":656,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:53.523687+0000","last_change":"2026-02-24T19:23:53.523687+0000","last_active":"2026-02-24T19:23:53.523687+0000","last_peered":"2026-02-24T19:23:53.523687+0000","last_clean":"2026-02-24T19:23:53.523687+0000","last_became_active":"2026-02-24T19:18:05.049751+0000","last_became_peered":"2026-02-24T19:18:05.049751+0000","last_unstale":"2026-02-24T19:23:53.523687+0000","last_undegraded":"2026-02-24T19:23:53.523687+0000","last_fullsized":"2026-02-24T19:23:53.523687+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:53.522155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:53.522155+0000","last_clean_scrub_stamp":"2026-02-24T19:23:53.522155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:29:48.127254+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":655,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:53.152741+0000","last_change":"2026-02-24T19:23:53.152741+0000","last_active":"2026-02-24T19:23:53.152741+0000","last_peered":"2026-02-24T19:23:53.152741+0000","last_clean":"2026-02-24T19:23:53.152741+0000","last_became_active":"2026-02-24T19:18:03.612739+0000","last_became_peered":"2026-02-24T19:18:03.612739+0000","last_unstale":"2026-02-24T19:23:53.152741+0000","last_undegraded":"2026-02-24T19:23:53.152741+0000","last_fullsized":"2026-02-24T19:23:53.152741+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:53.148000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:53.148000+0000","last_clean_scrub_stamp":"2026-02-24T19:23:53.148000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:24:22.084538+0000","scrub_duration":89,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":659,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.996980+0000","last_change":"2026-02-24T19:23:58.996980+0000","last_active":"2026-02-24T19:23:58.996980+0000","last_peered":"2026-02-24T19:23:58.996980+0000","last_clean":"2026-02-24T19:23:58.996980+0000","last_became_active":"2026-02-24T19:18:03.341693+0000","last_became_peered":"2026-02-24T19:18:03.341693+0000","last_unstale":"2026-02-24T19:23:58.996980+0000","last_undegraded":"2026-02-24T19:23:58.996980+0000","last_fullsized":"2026-02-24T19:23:58.996980+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:58.995348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:58.995348+0000","last_clean_scrub_stamp":"2026-02-24T19:23:58.995348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:54:07.012642+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,4],"acting":[15,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":654,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:55.276707+0000","last_change":"2026-02-24T19:23:55.276707+0000","last_active":"2026-02-24T19:23:55.276707+0000","last_peered":"2026-02-24T19:23:55.276707+0000","last_clean":"2026-02-24T19:23:55.276707+0000","last_became_active":"2026-02-24T19:18:03.401642+0000","last_became_peered":"2026-02-24T19:18:03.401642+0000","last_unstale":"2026-02-24T19:23:55.276707+0000","last_undegraded":"2026-02-24T19:23:55.276707+0000","last_fullsized":"2026-02-24T19:23:55.276707+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:55.271627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:55.271627+0000","last_clean_scrub_stamp":"2026-02-24T19:23:55.271627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:25:29.864436+0000","scrub_duration":88,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,15],"acting":[7,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":652,"reported_epoch":354,"state":"active+clean","last_fresh":"2026-02-24T19:23:54.373092+0000","last_change":"2026-02-24T19:23:54.373092+0000","last_active":"2026-02-24T19:23:54.373092+0000","last_peered":"2026-02-24T19:23:54.373092+0000","last_clean":"2026-02-24T19:23:54.373092+0000","last_became_active":"2026-02-24T19:18:03.706699+0000","last_became_peered":"2026-02-24T19:18:03.706699+0000","last_unstale":"2026-02-24T19:23:54.373092+0000","last_undegraded":"2026-02-24T19:23:54.373092+0000","last_fullsized":"2026-02-24T19:23:54.373092+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:23:54.371656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:23:54.371656+0000","last_clean_scrub_stamp":"2026-02-24T19:23:54.371656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:08:38.767028+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9],"acting":[2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":2,"acting":2,"num_store_stats":2},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":16}],"osd_stats":[{"osd":15,"up_from":21,"seq":90194313301,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33984,"kb_used_data":7024,"kb_used_omap":217,"kb_used_meta":26726,"kb_avail":94337856,"statfs":{"total":96636764160,"available":96601964544,"internally_reserved":0,"allocated":7192576,"data_stored":4514600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":222642,"internal_metadata":27368014},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":21,"seq":90194313301,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33980,"kb_used_data":7020,"kb_used_omap":218,"kb_used_meta":26725,"kb_avail":94337860,"statfs":{"total":96636764160,"available":96601968640,"internally_reserved":0,"allocated":7188480,"data_stored":4514581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":223902,"internal_metadata":27366754},"hb_peers":[0,1,2,3,5,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313301,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33980,"kb_used_data":7020,"kb_used_omap":222,"kb_used_meta":26721,"kb_avail":94337860,"statfs":{"total":96636764160,"available":96601968640,"internally_reserved":0,"allocated":7188480,"data_stored":4514581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":227627,"internal_metadata":27363029},"hb_peers":[0,1,2,3,4,6,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313301,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33980,"kb_used_data":7020,"kb_used_omap":4988,"kb_used_meta":21955,"kb_avail":94337860,"statfs":{"total":96636764160,"available":96601968640,"internally_reserved":0,"allocated":7188480,"data_stored":4514581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5108141,"internal_metadata":22482515},"hb_peers":[1,2,3,4,6,7,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":21,"seq":90194313301,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33980,"kb_used_data":7020,"kb_used_omap":215,"kb_used_meta":26728,"kb_avail":94337860,"statfs":{"total":96636764160,"available":96601968640,"internally_reserved":0,"allocated":7188480,"data_stored":4514581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":220720,"internal_metadata":27369936},"hb_peers":[0,2,3,4,5,6,7,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313301,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34372,"kb_used_data":7412,"kb_used_omap":216,"kb_used_meta":26727,"kb_avail":94337468,"statfs":{"total":96636764160,"available":96601567232,"internally_reserved":0,"allocated":7589888,"data_stored":4912421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":221639,"internal_metadata":27369017},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313302,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33980,"kb_used_data":7020,"kb_used_omap":3019,"kb_used_meta":23924,"kb_avail":94337860,"statfs":{"total":96636764160,"available":96601968640,"internally_reserved":0,"allocated":7188480,"data_stored":4514581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3091562,"internal_metadata":24499094},"hb_peers":[0,1,2,4,5,6,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313301,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33984,"kb_used_data":7024,"kb_used_omap":3009,"kb_used_meta":23934,"kb_avail":94337856,"statfs":{"total":96636764160,"available":96601964544,"internally_reserved":0,"allocated":7192576,"data_stored":4514586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3081227,"internal_metadata":24509429},"hb_peers":[0,1,2,3,5,6,7,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313301,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33980,"kb_used_data":7020,"kb_used_omap":216,"kb_used_meta":26727,"kb_avail":94337860,"statfs":{"total":96636764160,"available":96601968640,"internally_reserved":0,"allocated":7188480,"data_stored":4514581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":222036,"internal_metadata":27368620},"hb_peers":[0,1,2,3,4,6,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":21,"seq":90194313302,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33980,"kb_used_data":7020,"kb_used_omap":3010,"kb_used_meta":23933,"kb_avail":94337860,"statfs":{"total":96636764160,"available":96601968640,"internally_reserved":0,"allocated":7188480,"data_stored":4514581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3082635,"internal_metadata":24508021},"hb_peers":[0,1,2,3,4,5,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":21,"seq":90194313302,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34372,"kb_used_data":7412,"kb_used_omap":216,"kb_used_meta":26727,"kb_avail":94337468,"statfs":{"total":96636764160,"available":96601567232,"internally_reserved":0,"allocated":7589888,"data_stored":4912421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":221714,"internal_metadata":27368942},"hb_peers":[0,1,2,3,5,6,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313301,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33980,"kb_used_data":7020,"kb_used_omap":3024,"kb_used_meta":23919,"kb_avail":94337860,"statfs":{"total":96636764160,"available":96601968640,"internally_reserved":0,"allocated":7188480,"data_stored":4514581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3097551,"internal_metadata":24493105},"hb_peers":[1,3,4,5,6,7,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313302,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33980,"kb_used_data":7020,"kb_used_omap":3024,"kb_used_meta":23919,"kb_avail":94337860,"statfs":{"total":96636764160,"available":96601968640,"internally_reserved":0,"allocated":7188480,"data_stored":4514581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3097174,"internal_metadata":24493482},"hb_peers":[0,1,2,3,4,5,6,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":21,"seq":90194313301,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33984,"kb_used_data":7024,"kb_used_omap":175,"kb_used_meta":26768,"kb_avail":94337856,"statfs":{"total":96636764160,"available":96601964544,"internally_reserved":0,"allocated":7192576,"data_stored":4514600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179931,"internal_metadata":27410725},"hb_peers":[0,1,2,4,5,6,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313301,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33980,"kb_used_data":7020,"kb_used_omap":3026,"kb_used_meta":23917,"kb_avail":94337860,"statfs":{"total":96636764160,"available":96601968640,"internally_reserved":0,"allocated":7188480,"data_stored":4514581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3098761,"internal_metadata":24491895},"hb_peers":[0,1,2,3,4,5,6,7,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313301,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33984,"kb_used_data":7024,"kb_used_omap":218,"kb_used_meta":26725,"kb_avail":94337856,"statfs":{"total":96636764160,"available":96601964544,"internally_reserved":0,"allocated":7192576,"data_stored":4514586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":223359,"internal_metadata":27367297},"hb_peers":[0,1,2,3,4,5,6,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T19:24:15.565 DEBUG:teuthology.orchestra.run.trial014:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-24T19:24:15.631 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.629+0000 7f4050571640 10 monclient: get_monmap_and_config 2026-02-24T19:24:15.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.629+0000 7f4050571640 10 monclient: build_initial_monmap 2026-02-24T19:24:15.632 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.629+0000 7f4050571640 10 monclient: monmap: 2026-02-24T19:24:15.632 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:24:15.632 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:24:15.632 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:24:15.630794+0000 2026-02-24T19:24:15.632 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:24:15.630794+0000 2026-02-24T19:24:15.632 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:15.632 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:24:15.632 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:24:15.632 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:24:15.633 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:24:15.633 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:24:15.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.629+0000 7f4050571640 1 Processor -- start 2026-02-24T19:24:15.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.629+0000 7f4050571640 1 -- start start 2026-02-24T19:24:15.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.629+0000 7f4050571640 10 monclient: init 2026-02-24T19:24:15.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.631+0000 7f4050571640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:15.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.631+0000 7f4050571640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:24:15.635 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.631+0000 7f4050571640 10 monclient(hunting): picked mon.noname-c con 0x7f404815afd0 addr v1:10.20.193.170:6789/0 2026-02-24T19:24:15.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.631+0000 7f4050571640 10 monclient(hunting): picked mon.noname-b con 0x7f404815b3a0 addr v1:10.20.193.44:6789/0 2026-02-24T19:24:15.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.631+0000 7f4050571640 10 monclient(hunting): picked mon.noname-a con 0x7f4048163890 addr v1:10.20.193.14:6789/0 2026-02-24T19:24:15.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.631+0000 7f4050571640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4048162380 con 0x7f4048163890 2026-02-24T19:24:15.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.631+0000 7f4050571640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40480b1c30 con 0x7f404815b3a0 2026-02-24T19:24:15.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.631+0000 7f4050571640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40480b1f10 con 0x7f404815afd0 2026-02-24T19:24:15.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.631+0000 7f4050571640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:15.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.631+0000 7f4050571640 10 monclient(hunting): authenticate will time out at 4030.312233s 2026-02-24T19:24:15.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.631+0000 7f404eae7640 1 --1- >> v1:10.20.193.14:6789/0 conn(0x7f4048163890 0x7f4048164480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.14:6789/0 says I am v1:10.20.193.14:55198/0 (socket says 10.20.193.14:55198) 2026-02-24T19:24:15.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.631+0000 7f404eae7640 1 -- 10.20.193.14:0/146061116 learned_addr learned my addr 10.20.193.14:0/146061116 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:24:15.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.631+0000 7f404d2e4640 1 -- 10.20.193.14:0/146061116 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 373559319 0 0) 0x7f4048162380 con 0x7f4048163890 2026-02-24T19:24:15.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.631+0000 7f404d2e4640 10 monclient(hunting): _negotiate 2026-02-24T19:24:15.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.631+0000 7f404d2e4640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:15.636 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.631+0000 7f404d2e4640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:15.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.631+0000 7f404d2e4640 10 monclient(hunting): my global_id is 30930 2026-02-24T19:24:15.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.631+0000 7f404d2e4640 1 -- 10.20.193.14:0/146061116 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4030003610 con 0x7f4048163890 2026-02-24T19:24:15.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.632+0000 7f404d2e4640 1 -- 10.20.193.14:0/146061116 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2357204326 0 0) 0x7f40480b1c30 con 0x7f404815b3a0 2026-02-24T19:24:15.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.632+0000 7f404d2e4640 10 monclient(hunting): _negotiate 2026-02-24T19:24:15.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.632+0000 7f404d2e4640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:15.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.632+0000 7f404d2e4640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:15.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.632+0000 7f404d2e4640 10 monclient(hunting): my global_id is 29245 2026-02-24T19:24:15.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.632+0000 7f404d2e4640 1 -- 10.20.193.14:0/146061116 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4048162380 con 0x7f404815b3a0 2026-02-24T19:24:15.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.632+0000 7f404d2e4640 1 -- 10.20.193.14:0/146061116 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 201312945 0 0) 0x7f40480b1f10 con 0x7f404815afd0 2026-02-24T19:24:15.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.632+0000 7f404d2e4640 10 monclient(hunting): _negotiate 2026-02-24T19:24:15.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.632+0000 7f404d2e4640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:15.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.632+0000 7f404d2e4640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:15.637 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.632+0000 7f404d2e4640 10 monclient(hunting): my global_id is 28883 2026-02-24T19:24:15.638 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.632+0000 7f404d2e4640 1 -- 10.20.193.14:0/146061116 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40480b1c30 con 0x7f404815afd0 2026-02-24T19:24:15.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.633+0000 7f404d2e4640 1 -- 10.20.193.14:0/146061116 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3006193995 0 0) 0x7f4048162380 con 0x7f404815b3a0 2026-02-24T19:24:15.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.633+0000 7f404d2e4640 1 -- 10.20.193.14:0/146061116 >> v1:10.20.193.170:6789/0 conn(0x7f404815afd0 legacy=0x7f4048059be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:15.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.633+0000 7f404d2e4640 1 -- 10.20.193.14:0/146061116 >> v1:10.20.193.14:6789/0 conn(0x7f4048163890 legacy=0x7f4048164480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:15.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.633+0000 7f404d2e4640 10 monclient: _finish_hunting 0 2026-02-24T19:24:15.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.633+0000 7f404d2e4640 1 monclient: found mon.noname-b 2026-02-24T19:24:15.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.633+0000 7f404d2e4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:15.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.633+0000 7f404d2e4640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.44:6789/0 2026-02-24T19:24:15.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.633+0000 7f404d2e4640 1 -- 10.20.193.14:0/146061116 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40480b21f0 con 0x7f404815b3a0 2026-02-24T19:24:15.643 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.633+0000 7f404d2e4640 10 monclient: _finish_auth 0 2026-02-24T19:24:15.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.633+0000 7f404d2e4640 10 monclient: _check_auth_tickets 2026-02-24T19:24:15.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.633+0000 7f404d2e4640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:15.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.633+0000 7f404d2e4640 1 -- 10.20.193.14:0/146061116 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f403c002df0 con 0x7f404815b3a0 2026-02-24T19:24:15.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.633+0000 7f404d2e4640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:15.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.633+0000 7f404d2e4640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:15.644 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.633+0000 7f404d2e4640 10 monclient: dump: 2026-02-24T19:24:15.644 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:24:15.644 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:24:15.644 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:24:15.644 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:24:15.644 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:15.645 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:24:15.645 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:24:15.645 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:24:15.645 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:24:15.645 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:24:15.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.633+0000 7f4050571640 5 monclient: authenticate success, global_id 29245 2026-02-24T19:24:15.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.633+0000 7f4050571640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:15.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.634+0000 7f404d2e4640 1 -- 10.20.193.14:0/146061116 <== mon.1 v1:10.20.193.44:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f403c002fc0 con 0x7f404815b3a0 2026-02-24T19:24:15.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.634+0000 7f404d2e4640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:15.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.634+0000 7f404d2e4640 1 -- 10.20.193.14:0/146061116 <== mon.1 v1:10.20.193.44:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f403c003400 con 0x7f404815b3a0 2026-02-24T19:24:15.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.634+0000 7f404d2e4640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:15.645 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.634+0000 7f404d2e4640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:15.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.634+0000 7f404d2e4640 10 monclient: dump: 2026-02-24T19:24:15.646 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:24:15.646 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:24:15.646 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:24:15.646 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:24:15.646 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:15.646 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:24:15.646 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:24:15.646 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:24:15.646 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:24:15.646 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:24:15.646 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.634+0000 7f4050571640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:15.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.634+0000 7f4050571640 4 set_mon_vals no callback set 2026-02-24T19:24:15.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.634+0000 7f4050571640 10 monclient: shutdown 2026-02-24T19:24:15.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.634+0000 7f4050571640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:15.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.634+0000 7f4050571640 1 -- 10.20.193.14:0/146061116 >> v1:10.20.193.44:6789/0 conn(0x7f404815b3a0 legacy=0x7f404805d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:15.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.634+0000 7f4050571640 1 -- 10.20.193.14:0/146061116 shutdown_connections 2026-02-24T19:24:15.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.634+0000 7f4050571640 1 -- 10.20.193.14:0/146061116 >> 10.20.193.14:0/146061116 conn(0x7f40480b2f10 msgr2=0x7f40480b32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:15.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.634+0000 7f4050571640 1 -- 10.20.193.14:0/146061116 shutdown_connections 2026-02-24T19:24:15.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.634+0000 7f4050571640 1 -- 10.20.193.14:0/146061116 wait complete. 2026-02-24T19:24:15.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.635+0000 7f4050571640 10 monclient: build_initial_monmap 2026-02-24T19:24:15.647 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.635+0000 7f4050571640 10 monclient: monmap: 2026-02-24T19:24:15.647 INFO:teuthology.orchestra.run.trial014.stderr:epoch 0 2026-02-24T19:24:15.647 INFO:teuthology.orchestra.run.trial014.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:15.647 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 0.000000 2026-02-24T19:24:15.648 INFO:teuthology.orchestra.run.trial014.stderr:created 0.000000 2026-02-24T19:24:15.648 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:15.648 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 1 2026-02-24T19:24:15.648 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.noname-a 2026-02-24T19:24:15.648 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.noname-b 2026-02-24T19:24:15.648 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.noname-c 2026-02-24T19:24:15.648 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:24:15.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.635+0000 7f4050571640 1 librados: starting msgr at 2026-02-24T19:24:15.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.635+0000 7f4050571640 1 librados: starting objecter 2026-02-24T19:24:15.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.635+0000 7f4050571640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:15.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.635+0000 7f4050571640 1 Processor -- start 2026-02-24T19:24:15.648 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.635+0000 7f4050571640 1 -- start start 2026-02-24T19:24:15.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.635+0000 7f4050571640 1 librados: setting wanted keys 2026-02-24T19:24:15.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.635+0000 7f4050571640 1 librados: calling monclient init 2026-02-24T19:24:15.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.635+0000 7f4050571640 10 monclient: init 2026-02-24T19:24:15.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.636+0000 7f4050571640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:15.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.636+0000 7f4050571640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:24:15.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.636+0000 7f4050571640 10 monclient(hunting): picked mon.noname-c con 0x7f404815afd0 addr v1:10.20.193.170:6789/0 2026-02-24T19:24:15.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.636+0000 7f4050571640 10 monclient(hunting): picked mon.noname-b con 0x7f404815b3a0 addr v1:10.20.193.44:6789/0 2026-02-24T19:24:15.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.636+0000 7f4050571640 10 monclient(hunting): picked mon.noname-a con 0x7f4048163890 addr v1:10.20.193.14:6789/0 2026-02-24T19:24:15.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.636+0000 7f4050571640 1 -- --> v1:10.20.193.14:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4048114c70 con 0x7f4048163890 2026-02-24T19:24:15.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.636+0000 7f4050571640 1 -- --> v1:10.20.193.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4048057620 con 0x7f404815b3a0 2026-02-24T19:24:15.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.636+0000 7f4050571640 1 -- --> v1:10.20.193.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4048057900 con 0x7f404815afd0 2026-02-24T19:24:15.649 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.636+0000 7f4050571640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:15.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.636+0000 7f4050571640 10 monclient(hunting): authenticate will time out at 4030.318073s 2026-02-24T19:24:15.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.636+0000 7f404dae5640 1 --1- >> v1:10.20.193.44:6789/0 conn(0x7f404815b3a0 0x7f4048115710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.44:6789/0 says I am v1:10.20.193.14:60746/0 (socket says 10.20.193.14:60746) 2026-02-24T19:24:15.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.636+0000 7f404dae5640 1 -- 10.20.193.14:0/3719207927 learned_addr learned my addr 10.20.193.14:0/3719207927 (peer_addr_for_me v1:10.20.193.14:0/0) 2026-02-24T19:24:15.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.636+0000 7f402effd640 10 client.?.objecter ms_handle_connect 0x7f404815b3a0 2026-02-24T19:24:15.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.636+0000 7f402effd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:15.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.636+0000 7f402effd640 10 client.?.objecter ms_handle_connect 0x7f4048163890 2026-02-24T19:24:15.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.636+0000 7f402effd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:15.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.636+0000 7f402effd640 10 client.?.objecter ms_handle_connect 0x7f404815afd0 2026-02-24T19:24:15.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.636+0000 7f402effd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:15.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.637+0000 7f402effd640 1 -- 10.20.193.14:0/3719207927 <== mon.1 v1:10.20.193.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3573622143 0 0) 0x7f4048057620 con 0x7f404815b3a0 2026-02-24T19:24:15.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.637+0000 7f402effd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:15.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.637+0000 7f402effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:15.650 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.637+0000 7f402effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:15.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.637+0000 7f402effd640 10 monclient(hunting): my global_id is 29248 2026-02-24T19:24:15.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.637+0000 7f402effd640 1 -- 10.20.193.14:0/3719207927 --> v1:10.20.193.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4018003610 con 0x7f404815b3a0 2026-02-24T19:24:15.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.637+0000 7f402effd640 1 -- 10.20.193.14:0/3719207927 <== mon.0 v1:10.20.193.14:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3900732730 0 0) 0x7f4048114c70 con 0x7f4048163890 2026-02-24T19:24:15.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.637+0000 7f402effd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:15.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.637+0000 7f402effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:15.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.637+0000 7f402effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:15.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.637+0000 7f402effd640 10 monclient(hunting): my global_id is 30933 2026-02-24T19:24:15.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.637+0000 7f402effd640 1 -- 10.20.193.14:0/3719207927 --> v1:10.20.193.14:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4048057620 con 0x7f4048163890 2026-02-24T19:24:15.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.638+0000 7f402effd640 1 -- 10.20.193.14:0/3719207927 <== mon.2 v1:10.20.193.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 52501722 0 0) 0x7f4048057900 con 0x7f404815afd0 2026-02-24T19:24:15.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.638+0000 7f402effd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:15.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.638+0000 7f402effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:15.651 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.638+0000 7f402effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:15.652 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.638+0000 7f402effd640 10 monclient(hunting): my global_id is 28886 2026-02-24T19:24:15.652 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.638+0000 7f402effd640 1 -- 10.20.193.14:0/3719207927 --> v1:10.20.193.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4048114c70 con 0x7f404815afd0 2026-02-24T19:24:15.652 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.640+0000 7f402effd640 1 -- 10.20.193.14:0/3719207927 <== mon.1 v1:10.20.193.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1675585417 0 0) 0x7f4018003610 con 0x7f404815b3a0 2026-02-24T19:24:15.652 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.640+0000 7f402effd640 1 -- 10.20.193.14:0/3719207927 --> v1:10.20.193.44:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4048057900 con 0x7f404815b3a0 2026-02-24T19:24:15.652 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.640+0000 7f402effd640 1 -- 10.20.193.14:0/3719207927 <== mon.1 v1:10.20.193.44:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f403c0033d0 con 0x7f404815b3a0 2026-02-24T19:24:15.652 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.640+0000 7f402effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:15.652 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.640+0000 7f402effd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:15.652 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.640+0000 7f402effd640 10 monclient(hunting): dump: 2026-02-24T19:24:15.652 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:24:15.652 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:24:15.652 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:24:15.652 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:24:15.652 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:15.653 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:24:15.653 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:24:15.653 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:24:15.653 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:24:15.653 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:24:15.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.640+0000 7f402effd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:15.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.640+0000 7f402effd640 1 -- 10.20.193.14:0/3719207927 <== mon.0 v1:10.20.193.14:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1545939856 0 0) 0x7f4048057620 con 0x7f4048163890 2026-02-24T19:24:15.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.640+0000 7f402effd640 1 -- 10.20.193.14:0/3719207927 --> v1:10.20.193.14:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4018003610 con 0x7f4048163890 2026-02-24T19:24:15.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.640+0000 7f402effd640 1 -- 10.20.193.14:0/3719207927 <== mon.0 v1:10.20.193.14:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4044003250 con 0x7f4048163890 2026-02-24T19:24:15.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.640+0000 7f402effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:15.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.640+0000 7f402effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:15.653 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.640+0000 7f402effd640 10 monclient(hunting): dump: 2026-02-24T19:24:15.653 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:24:15.654 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:24:15.654 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:24:15.654 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:24:15.654 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:15.654 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:24:15.654 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:24:15.654 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:24:15.654 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:24:15.654 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:24:15.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.640+0000 7f402effd640 1 -- 10.20.193.14:0/3719207927 <== mon.2 v1:10.20.193.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1748508332 0 0) 0x7f4048114c70 con 0x7f404815afd0 2026-02-24T19:24:15.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.640+0000 7f402effd640 1 -- 10.20.193.14:0/3719207927 --> v1:10.20.193.170:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4048057620 con 0x7f404815afd0 2026-02-24T19:24:15.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.640+0000 7f402effd640 1 -- 10.20.193.14:0/3719207927 <== mon.2 v1:10.20.193.170:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f4038003060 con 0x7f404815afd0 2026-02-24T19:24:15.657 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.640+0000 7f402effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:15.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.640+0000 7f402effd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:15.658 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.640+0000 7f402effd640 10 monclient(hunting): dump: 2026-02-24T19:24:15.658 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:24:15.658 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:24:15.658 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:24:15.658 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:24:15.658 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:15.658 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:24:15.658 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:24:15.658 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:24:15.658 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:24:15.658 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:24:15.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.641+0000 7f402effd640 1 -- 10.20.193.14:0/3719207927 <== mon.1 v1:10.20.193.44:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2444723928 0 0) 0x7f4048057900 con 0x7f404815b3a0 2026-02-24T19:24:15.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.641+0000 7f402effd640 1 -- 10.20.193.14:0/3719207927 >> v1:10.20.193.170:6789/0 conn(0x7f404815afd0 legacy=0x7f40481316c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:15.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.641+0000 7f402effd640 1 -- 10.20.193.14:0/3719207927 >> v1:10.20.193.14:6789/0 conn(0x7f4048163890 legacy=0x7f404814a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:15.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.641+0000 7f402effd640 10 monclient: _finish_hunting 0 2026-02-24T19:24:15.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.641+0000 7f402effd640 1 monclient: found mon.b 2026-02-24T19:24:15.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.641+0000 7f402effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:15.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.641+0000 7f402effd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:24:15.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.641+0000 7f402effd640 1 -- 10.20.193.14:0/3719207927 --> v1:10.20.193.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4048057be0 con 0x7f404815b3a0 2026-02-24T19:24:15.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.641+0000 7f402effd640 10 monclient: _finish_auth 0 2026-02-24T19:24:15.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.641+0000 7f402effd640 10 monclient: _check_auth_tickets 2026-02-24T19:24:15.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.641+0000 7f402effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:15.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.641+0000 7f4050571640 5 monclient: authenticate success, global_id 29248 2026-02-24T19:24:15.659 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.641+0000 7f4050571640 10 monclient: _renew_subs 2026-02-24T19:24:15.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.641+0000 7f4050571640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:24:15.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.641+0000 7f4050571640 1 -- 10.20.193.14:0/3719207927 --> v1:10.20.193.44:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4048114f10 con 0x7f404815b3a0 2026-02-24T19:24:15.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.641+0000 7f4050571640 10 client.29248.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:15.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.641+0000 7f4050571640 10 monclient: _renew_subs 2026-02-24T19:24:15.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.641+0000 7f4050571640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:24:15.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.641+0000 7f4050571640 1 -- 10.20.193.14:0/3719207927 --> v1:10.20.193.44:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4048115e20 con 0x7f404815b3a0 2026-02-24T19:24:15.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.641+0000 7f4050571640 1 librados: init done 2026-02-24T19:24:15.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.642+0000 7f4050571640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:15.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.642+0000 7f4050571640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:15.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.642+0000 7f4050571640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:24:15.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.642+0000 7f4050571640 1 -- 10.20.193.14:0/3719207927 --> v1:10.20.193.44:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40481160b0 con 0x7f404815b3a0 2026-02-24T19:24:15.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.646+0000 7f402effd640 1 -- 10.20.193.14:0/3719207927 <== mon.1 v1:10.20.193.44:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f403c002fc0 con 0x7f404815b3a0 2026-02-24T19:24:15.660 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.646+0000 7f402effd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:15.661 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.646+0000 7f404cae3640 4 set_mon_vals no callback set 2026-02-24T19:24:15.661 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.649+0000 7f402effd640 1 -- 10.20.193.14:0/3719207927 <== mon.1 v1:10.20.193.44:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1143709717 0 0) 0x7f403c003b00 con 0x7f404815b3a0 2026-02-24T19:24:15.661 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.649+0000 7f402effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:15.661 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.649+0000 7f402effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:15.661 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.649+0000 7f402effd640 10 monclient: dump: 2026-02-24T19:24:15.661 INFO:teuthology.orchestra.run.trial014.stderr:epoch 1 2026-02-24T19:24:15.661 INFO:teuthology.orchestra.run.trial014.stderr:fsid 829a649b-54c9-463b-96b9-ffa203d49fa7 2026-02-24T19:24:15.661 INFO:teuthology.orchestra.run.trial014.stderr:last_changed 2026-02-24T19:15:58.440615+0000 2026-02-24T19:24:15.661 INFO:teuthology.orchestra.run.trial014.stderr:created 2026-02-24T19:15:58.440615+0000 2026-02-24T19:24:15.661 INFO:teuthology.orchestra.run.trial014.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:15.661 INFO:teuthology.orchestra.run.trial014.stderr:election_strategy: 3 2026-02-24T19:24:15.661 INFO:teuthology.orchestra.run.trial014.stderr:0: v1:10.20.193.14:6789/0 mon.a 2026-02-24T19:24:15.661 INFO:teuthology.orchestra.run.trial014.stderr:1: v1:10.20.193.44:6789/0 mon.b 2026-02-24T19:24:15.662 INFO:teuthology.orchestra.run.trial014.stderr:2: v1:10.20.193.170:6789/0 mon.c 2026-02-24T19:24:15.662 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:24:15.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.650+0000 7f402effd640 1 -- 10.20.193.14:0/3719207927 <== mon.1 v1:10.20.193.44:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 251386383 0 0) 0x7f403c003d20 con 0x7f404815b3a0 2026-02-24T19:24:15.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.651+0000 7f404e2e6640 10 monclient: get_auth_request con 0x7f4018077e20 auth_method 0 2026-02-24T19:24:15.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.651+0000 7f402effd640 10 client.29248.objecter ms_handle_connect 0x7f4018077e20 2026-02-24T19:24:15.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.651+0000 7f402effd640 1 -- 10.20.193.14:0/3719207927 <== mon.1 v1:10.20.193.44:6789/0 8 ==== osd_map(354..354 src has 1..354) ==== 8971+0+0 (unknown 1476400318 0 0) 0x7f403c059460 con 0x7f404815b3a0 2026-02-24T19:24:15.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.651+0000 7f402effd640 10 client.29248.objecter ms_dispatch2 0x7f4048000b90 osd_map(354..354 src has 1..354) 2026-02-24T19:24:15.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.651+0000 7f402effd640 3 client.29248.objecter handle_osd_map got epochs [354,354] > 0 2026-02-24T19:24:15.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.651+0000 7f402effd640 3 client.29248.objecter handle_osd_map decoding full epoch 354 2026-02-24T19:24:15.662 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.651+0000 7f402effd640 20 client.29248.objecter dump_active .. 0 homeless 2026-02-24T19:24:15.738 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.735+0000 7f402effd640 1 -- 10.20.193.14:0/3719207927 <== mon.1 v1:10.20.193.44:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f403c05dbd0 con 0x7f404815b3a0 2026-02-24T19:24:15.738 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.735+0000 7f402effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:15.738 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.735+0000 7f402effd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:15.843 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.841+0000 7f4050571640 10 start_mon_command cmd=[{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-24T19:24:15.844 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.841+0000 7f4050571640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-24T19:24:15.844 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.841+0000 7f4050571640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.44:6789/0 2026-02-24T19:24:15.844 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.841+0000 7f4050571640 1 -- 10.20.193.14:0/3719207927 --> v1:10.20.193.44:6789/0 -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f4048057f00 con 0x7f404815b3a0 2026-02-24T19:24:15.948 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.946+0000 7f402effd640 1 -- 10.20.193.14:0/3719207927 <== mon.1 v1:10.20.193.44:6789/0 10 ==== config(1 keys) ==== 35+0+0 (unknown 2555425225 0 0) 0x7f403c05d4d0 con 0x7f404815b3a0 2026-02-24T19:24:15.948 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.946+0000 7f402effd640 10 monclient: handle_config config(1 keys) 2026-02-24T19:24:15.948 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.946+0000 7f404cae3640 4 set_mon_vals no callback set 2026-02-24T19:24:15.948 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.946+0000 7f404cae3640 10 set_mon_vals mon_health_to_clog = false 2026-02-24T19:24:15.948 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.946+0000 7f402effd640 1 -- 10.20.193.14:0/3719207927 <== mon.1 v1:10.20.193.44:6789/0 11 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v2)=0 v2) ==== 123+0+0 (unknown 691139944 0 0) 0x7f403c062bb0 con 0x7f404815b3a0 2026-02-24T19:24:15.948 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.946+0000 7f402effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-24T19:24:15.948 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.946+0000 7f402effd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:24:15.950 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.948+0000 7f4050571640 10 librados: watch_flush enter 2026-02-24T19:24:15.950 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.948+0000 7f4050571640 10 librados: watch_flush exit 2026-02-24T19:24:15.951 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.948+0000 7f4050571640 20 client.29248.objecter shutdown clearing up homeless session... 2026-02-24T19:24:15.951 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.948+0000 7f4050571640 10 client.29248.objecter successfully canceled tick 2026-02-24T19:24:15.951 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.949+0000 7f4050571640 1 -- 10.20.193.14:0/3719207927 >> v1:10.20.193.14:6800/4014096310 conn(0x7f4018077e20 legacy=0x7f40180982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:15.951 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.949+0000 7f4050571640 10 monclient: shutdown 2026-02-24T19:24:15.951 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.949+0000 7f4050571640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:15.951 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.949+0000 7f4050571640 1 -- 10.20.193.14:0/3719207927 >> v1:10.20.193.44:6789/0 conn(0x7f404815b3a0 legacy=0x7f4048115710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:15.951 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:07:50.212 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:15.952 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.949+0000 7f4050571640 1 -- 10.20.193.14:0/3719207927 shutdown_connections 2026-02-24T19:24:15.952 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.949+0000 7f4050571640 1 -- 10.20.193.14:0/3719207927 >> 10.20.193.14:0/3719207927 conn(0x7f40480b2f10 msgr2=0x7f404805d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:15.952 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.949+0000 7f4050571640 1 -- 10.20.193.14:0/3719207927 shutdown_connections 2026-02-24T19:24:15.952 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.949+0000 7f4050571640 1 -- 10.20.193.14:0/3719207927 wait complete. 2026-02-24T19:24:15.952 INFO:teuthology.orchestra.run.trial014.stderr:2026-02-24T19:24:15.949+0000 7f4050571640 1 librados: shutdown 2026-02-24T19:24:15.959 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-24T19:24:15.960 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-24T19:24:15.960 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-24T19:24:15.960 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:24:15.967 INFO:tasks.ceph.osd.0.trial014.stderr:2026-02-24T19:24:15.961+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0 (PID: 44450) UID: 0 2026-02-24T19:24:15.967 INFO:tasks.ceph.osd.0.trial014.stderr:2026-02-24T19:24:15.962+0000 c765640 -1 osd.0 354 *** Got signal Terminated *** 2026-02-24T19:24:15.976 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:07:50.198 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:15.978 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:07:50.240 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:15.979 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:07:50.200 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:15.988 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:07:50.210 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:15.998 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:07:50.260 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:16.003 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:07:50.262 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:16.005 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:07:50.264 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:16.014 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:07:50.273 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:21.666 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2026-02-24T19:24:22.061 INFO:tasks.ceph.osd.0:Stopped 2026-02-24T19:24:22.062 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2026-02-24T19:24:22.062 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:24:22.068 INFO:tasks.ceph.osd.4.trial014.stderr:2026-02-24T19:24:22.063+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 4 (PID: 44451) UID: 0 2026-02-24T19:24:22.069 INFO:tasks.ceph.osd.4.trial014.stderr:2026-02-24T19:24:22.064+0000 c765640 -1 osd.4 356 *** Got signal Terminated *** 2026-02-24T19:24:28.163 INFO:tasks.ceph.osd.4:Stopped 2026-02-24T19:24:28.163 DEBUG:tasks.ceph.osd.8:waiting for process to exit 2026-02-24T19:24:28.163 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:24:28.169 INFO:tasks.ceph.osd.8.trial014.stderr:2026-02-24T19:24:28.164+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.8.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 8 (PID: 44456) UID: 0 2026-02-24T19:24:28.170 INFO:tasks.ceph.osd.8.trial014.stderr:2026-02-24T19:24:28.165+0000 c765640 -1 osd.8 358 *** Got signal Terminated *** 2026-02-24T19:24:28.576 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2026-02-24T19:24:28.576 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2026-02-24T19:24:34.265 INFO:tasks.ceph.osd.8:Stopped 2026-02-24T19:24:34.265 DEBUG:tasks.ceph.osd.12:waiting for process to exit 2026-02-24T19:24:34.266 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:24:34.273 INFO:tasks.ceph.osd.12.trial014.stderr:2026-02-24T19:24:34.266+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.12.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 12 (PID: 44458) UID: 0 2026-02-24T19:24:34.273 INFO:tasks.ceph.osd.12.trial014.stderr:2026-02-24T19:24:34.267+0000 c765640 -1 osd.12 360 *** Got signal Terminated *** 2026-02-24T19:24:35.390 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.8 is failed for ~0s 2026-02-24T19:24:35.390 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2026-02-24T19:24:35.975 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:08:10.237 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:35.978 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:08:10.239 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:35.991 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:08:10.253 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:36.003 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:08:10.225 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:36.004 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:08:10.263 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:36.006 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:08:10.227 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:36.006 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:08:10.265 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:36.018 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:08:10.239 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:36.018 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:08:10.277 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:40.368 INFO:tasks.ceph.osd.12:Stopped 2026-02-24T19:24:40.369 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-24T19:24:40.369 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:24:40.376 INFO:tasks.ceph.osd.1.trial044.stderr:2026-02-24T19:24:40.370+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1 (PID: 44996) UID: 0 2026-02-24T19:24:40.377 INFO:tasks.ceph.osd.1.trial044.stderr:2026-02-24T19:24:40.371+0000 c765640 -1 osd.1 362 *** Got signal Terminated *** 2026-02-24T19:24:42.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.8 has been restored 2026-02-24T19:24:46.470 INFO:tasks.ceph.osd.1:Stopped 2026-02-24T19:24:46.470 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2026-02-24T19:24:46.470 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:24:46.477 INFO:tasks.ceph.osd.5.trial044.stderr:2026-02-24T19:24:46.471+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 5 (PID: 44999) UID: 0 2026-02-24T19:24:46.478 INFO:tasks.ceph.osd.5.trial044.stderr:2026-02-24T19:24:46.472+0000 c765640 -1 osd.5 364 *** Got signal Terminated *** 2026-02-24T19:24:52.572 INFO:tasks.ceph.osd.5:Stopped 2026-02-24T19:24:52.572 DEBUG:tasks.ceph.osd.9:waiting for process to exit 2026-02-24T19:24:52.572 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:24:52.580 INFO:tasks.ceph.osd.9.trial044.stderr:2026-02-24T19:24:52.572+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.9.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 9 (PID: 45002) UID: 0 2026-02-24T19:24:52.580 INFO:tasks.ceph.osd.9.trial044.stderr:2026-02-24T19:24:52.573+0000 c765640 -1 osd.9 366 *** Got signal Terminated *** 2026-02-24T19:24:58.674 INFO:tasks.ceph.osd.9:Stopped 2026-02-24T19:24:58.675 DEBUG:tasks.ceph.osd.13:waiting for process to exit 2026-02-24T19:24:58.675 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:24:58.682 INFO:tasks.ceph.osd.13.trial044.stderr:2026-02-24T19:24:58.674+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.13.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 13 (PID: 45004) UID: 0 2026-02-24T19:24:58.682 INFO:tasks.ceph.osd.13.trial044.stderr:2026-02-24T19:24:58.675+0000 c765640 -1 osd.13 368 *** Got signal Terminated *** 2026-02-24T19:25:01.006 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:08:35.267 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:01.031 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:08:35.293 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:01.036 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:08:35.294 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:01.037 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:08:35.296 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:01.044 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:08:35.305 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:01.050 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:08:35.308 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:01.057 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:08:35.279 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:01.058 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:08:35.280 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:01.070 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:08:35.292 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:01.532 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.13 is failed for ~0s 2026-02-24T19:25:04.776 INFO:tasks.ceph.osd.13:Stopped 2026-02-24T19:25:04.777 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-24T19:25:04.777 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:25:04.783 INFO:tasks.ceph.osd.2.trial170.stderr:2026-02-24T19:25:04.777+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2 (PID: 44824) UID: 0 2026-02-24T19:25:04.783 INFO:tasks.ceph.osd.2.trial170.stderr:2026-02-24T19:25:04.778+0000 c765640 -1 osd.2 370 *** Got signal Terminated *** 2026-02-24T19:25:07.741 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2026-02-24T19:25:07.741 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.13 has been restored 2026-02-24T19:25:10.879 INFO:tasks.ceph.osd.2:Stopped 2026-02-24T19:25:10.879 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2026-02-24T19:25:10.879 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:25:10.886 INFO:tasks.ceph.osd.6.trial170.stderr:2026-02-24T19:25:10.880+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 6 (PID: 44826) UID: 0 2026-02-24T19:25:10.886 INFO:tasks.ceph.osd.6.trial170.stderr:2026-02-24T19:25:10.880+0000 c765640 -1 osd.6 372 *** Got signal Terminated *** 2026-02-24T19:25:13.951 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2026-02-24T19:25:16.980 INFO:tasks.ceph.osd.6:Stopped 2026-02-24T19:25:16.981 DEBUG:tasks.ceph.osd.10:waiting for process to exit 2026-02-24T19:25:16.981 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:25:16.988 INFO:tasks.ceph.osd.10.trial170.stderr:2026-02-24T19:25:16.982+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.10.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 10 (PID: 44830) UID: 0 2026-02-24T19:25:16.988 INFO:tasks.ceph.osd.10.trial170.stderr:2026-02-24T19:25:16.982+0000 c765640 -1 osd.10 374 *** Got signal Terminated *** 2026-02-24T19:25:21.064 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:08:55.325 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:21.065 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:08:55.327 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:21.077 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:08:55.338 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:21.089 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:08:55.347 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:21.090 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:08:55.349 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:21.091 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:08:55.312 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:21.093 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:08:55.315 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:21.101 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:08:55.360 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:21.104 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:08:55.326 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:23.082 INFO:tasks.ceph.osd.10:Stopped 2026-02-24T19:25:23.082 DEBUG:tasks.ceph.osd.14:waiting for process to exit 2026-02-24T19:25:23.083 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:25:23.090 INFO:tasks.ceph.osd.14.trial170.stderr:2026-02-24T19:25:23.083+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.14.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 14 (PID: 44832) UID: 0 2026-02-24T19:25:23.090 INFO:tasks.ceph.osd.14.trial170.stderr:2026-02-24T19:25:23.084+0000 c765640 -1 osd.14 376 *** Got signal Terminated *** 2026-02-24T19:25:31.974 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.14 is failed for ~0s 2026-02-24T19:25:32.327 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:09:06.589 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:32.329 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:09:06.590 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:32.330 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:09:06.589 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:32.332 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:09:06.591 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:32.338 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:09:06.600 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:32.341 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:09:06.600 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:32.354 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:09:06.575 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:32.355 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:09:06.576 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:32.365 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:09:06.586 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:35.286 INFO:tasks.ceph.osd.14:Stopped 2026-02-24T19:25:35.286 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-24T19:25:35.286 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:25:35.293 INFO:tasks.ceph.osd.3.trial195.stderr:2026-02-24T19:25:35.288+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 3 (PID: 45160) UID: 0 2026-02-24T19:25:35.294 INFO:tasks.ceph.osd.3.trial195.stderr:2026-02-24T19:25:35.288+0000 c765640 -1 osd.3 378 *** Got signal Terminated *** 2026-02-24T19:25:37.781 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2026-02-24T19:25:37.782 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.14 has been restored 2026-02-24T19:25:41.095 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:09:15.356 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:41.096 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:09:15.357 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:41.096 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:09:15.355 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:41.098 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:09:15.357 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:41.102 INFO:tasks.ceph.mon.a.trial014.stderr:==00:00:09:15.364 43987== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:41.103 INFO:tasks.ceph.mon.b.trial044.stderr:==00:00:09:15.362 44761== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:41.118 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:09:15.340 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:41.119 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:09:15.341 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:41.125 INFO:tasks.ceph.mon.c.trial170.stderr:==00:00:09:15.346 44590== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:41.388 INFO:tasks.ceph.osd.3:Stopped 2026-02-24T19:25:41.388 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2026-02-24T19:25:41.388 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:25:41.396 INFO:tasks.ceph.osd.7.trial195.stderr:2026-02-24T19:25:41.389+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 7 (PID: 45163) UID: 0 2026-02-24T19:25:41.396 INFO:tasks.ceph.osd.7.trial195.stderr:2026-02-24T19:25:41.389+0000 c765640 -1 osd.7 378 *** Got signal Terminated *** 2026-02-24T19:25:43.488 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2026-02-24T19:25:43.488 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2026-02-24T19:25:47.489 INFO:tasks.ceph.osd.7:Stopped 2026-02-24T19:25:47.490 DEBUG:tasks.ceph.osd.11:waiting for process to exit 2026-02-24T19:25:47.490 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:25:47.497 INFO:tasks.ceph.osd.11.trial195.stderr:2026-02-24T19:25:47.490+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.11.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 11 (PID: 45167) UID: 0 2026-02-24T19:25:47.497 INFO:tasks.ceph.osd.11.trial195.stderr:2026-02-24T19:25:47.491+0000 c765640 -1 osd.11 378 *** Got signal Terminated *** 2026-02-24T19:25:49.093 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.11 is failed for ~0s 2026-02-24T19:25:49.093 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2026-02-24T19:25:53.592 INFO:tasks.ceph.osd.11:Stopped 2026-02-24T19:25:53.593 DEBUG:tasks.ceph.osd.15:waiting for process to exit 2026-02-24T19:25:53.593 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:25:53.600 INFO:tasks.ceph.osd.15.trial195.stderr:2026-02-24T19:25:53.593+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.15.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 15 (PID: 45169) UID: 0 2026-02-24T19:25:53.600 INFO:tasks.ceph.osd.15.trial195.stderr:2026-02-24T19:25:53.594+0000 c765640 -1 osd.15 378 *** Got signal Terminated *** 2026-02-24T19:25:54.698 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.11 has been restored 2026-02-24T19:25:59.695 INFO:tasks.ceph.osd.15:Stopped 2026-02-24T19:25:59.696 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-24T19:25:59.696 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2026-02-24T19:25:59.696 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:25:59.697 INFO:tasks.ceph.mgr.y.trial014.stderr:2026-02-24T19:25:59.695+0000 7f89982e1640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-mgr -f --cluster ceph -i y (PID: 44035) UID: 0 2026-02-24T19:25:59.697 INFO:tasks.ceph.mgr.y.trial014.stderr:2026-02-24T19:25:59.695+0000 7f89982e1640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2026-02-24T19:25:59.727 INFO:tasks.ceph.mgr.y:Stopped 2026-02-24T19:25:59.727 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-24T19:25:59.727 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:25:59.758 INFO:tasks.ceph.mgr.x:Stopped 2026-02-24T19:25:59.758 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-24T19:25:59.758 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-24T19:25:59.758 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:25:59.776 INFO:tasks.ceph.mon.a.trial014.stderr:2026-02-24T19:25:59.768+0000 add7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 43985) UID: 0 2026-02-24T19:25:59.777 INFO:tasks.ceph.mon.a.trial014.stderr:2026-02-24T19:25:59.769+0000 add7640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-24T19:26:05.204 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2026-02-24T19:26:05.859 INFO:tasks.ceph.mon.a:Stopped 2026-02-24T19:26:05.860 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-24T19:26:05.860 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:26:05.868 INFO:tasks.ceph.mon.b.trial044.stderr:2026-02-24T19:26:05.860+0000 add7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 44759) UID: 0 2026-02-24T19:26:05.869 INFO:tasks.ceph.mon.b.trial044.stderr:2026-02-24T19:26:05.860+0000 add7640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2026-02-24T19:26:10.306 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2026-02-24T19:26:10.306 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2026-02-24T19:26:11.962 INFO:tasks.ceph.mon.b:Stopped 2026-02-24T19:26:11.962 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-24T19:26:11.963 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:26:11.970 INFO:tasks.ceph.mon.c.trial170.stderr:2026-02-24T19:26:11.963+0000 add7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 44588) UID: 0 2026-02-24T19:26:11.971 INFO:tasks.ceph.mon.c.trial170.stderr:2026-02-24T19:26:11.964+0000 add7640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2026-02-24T19:26:15.307 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2026-02-24T19:26:15.307 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2026-02-24T19:26:18.064 INFO:tasks.ceph.mon.c:Stopped 2026-02-24T19:26:18.064 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-24T19:26:18.064 DEBUG:teuthology.orchestra.run.trial014:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'reached quota' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(OBJECT_MISPLACED\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(PG_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v 'OSD bench result' | egrep -v OSD_DOWN | head -n 1 2026-02-24T19:26:18.094 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial014.front.sepia.ceph.com 2026-02-24T19:26:18.094 DEBUG:teuthology.orchestra.run.trial014:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-24T19:26:18.163 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@trial014.front.sepia.ceph.com 2026-02-24T19:26:18.163 DEBUG:teuthology.orchestra.run.trial014:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2026-02-24T19:26:18.231 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-8 on ubuntu@trial014.front.sepia.ceph.com 2026-02-24T19:26:18.232 DEBUG:teuthology.orchestra.run.trial014:> sync && sudo umount -f /var/lib/ceph/osd/ceph-8 2026-02-24T19:26:18.301 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-12 on ubuntu@trial014.front.sepia.ceph.com 2026-02-24T19:26:18.302 DEBUG:teuthology.orchestra.run.trial014:> sync && sudo umount -f /var/lib/ceph/osd/ceph-12 2026-02-24T19:26:18.371 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial044.front.sepia.ceph.com 2026-02-24T19:26:18.371 DEBUG:teuthology.orchestra.run.trial044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-24T19:26:18.404 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@trial044.front.sepia.ceph.com 2026-02-24T19:26:18.404 DEBUG:teuthology.orchestra.run.trial044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2026-02-24T19:26:18.480 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-9 on ubuntu@trial044.front.sepia.ceph.com 2026-02-24T19:26:18.481 DEBUG:teuthology.orchestra.run.trial044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-9 2026-02-24T19:26:18.549 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-13 on ubuntu@trial044.front.sepia.ceph.com 2026-02-24T19:26:18.549 DEBUG:teuthology.orchestra.run.trial044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-13 2026-02-24T19:26:18.629 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial170.front.sepia.ceph.com 2026-02-24T19:26:18.629 DEBUG:teuthology.orchestra.run.trial170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-24T19:26:18.665 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@trial170.front.sepia.ceph.com 2026-02-24T19:26:18.665 DEBUG:teuthology.orchestra.run.trial170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2026-02-24T19:26:18.739 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-10 on ubuntu@trial170.front.sepia.ceph.com 2026-02-24T19:26:18.740 DEBUG:teuthology.orchestra.run.trial170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-10 2026-02-24T19:26:18.814 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-14 on ubuntu@trial170.front.sepia.ceph.com 2026-02-24T19:26:18.814 DEBUG:teuthology.orchestra.run.trial170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-14 2026-02-24T19:26:18.882 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial195.front.sepia.ceph.com 2026-02-24T19:26:18.883 DEBUG:teuthology.orchestra.run.trial195:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-24T19:26:18.938 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@trial195.front.sepia.ceph.com 2026-02-24T19:26:18.938 DEBUG:teuthology.orchestra.run.trial195:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2026-02-24T19:26:18.968 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-11 on ubuntu@trial195.front.sepia.ceph.com 2026-02-24T19:26:18.968 DEBUG:teuthology.orchestra.run.trial195:> sync && sudo umount -f /var/lib/ceph/osd/ceph-11 2026-02-24T19:26:19.044 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-15 on ubuntu@trial195.front.sepia.ceph.com 2026-02-24T19:26:19.044 DEBUG:teuthology.orchestra.run.trial195:> sync && sudo umount -f /var/lib/ceph/osd/ceph-15 2026-02-24T19:26:19.114 INFO:tasks.ceph:Archiving mon data... 2026-02-24T19:26:19.115 DEBUG:teuthology.misc:Transferring archived files from trial014:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68689/data/mon.a.tgz 2026-02-24T19:26:19.115 DEBUG:teuthology.orchestra.run.trial014:> mktemp 2026-02-24T19:26:19.132 INFO:teuthology.orchestra.run.trial014.stdout:/tmp/tmp.7PGCWBCCI3 2026-02-24T19:26:19.132 DEBUG:teuthology.orchestra.run.trial014:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.7PGCWBCCI3 2026-02-24T19:26:19.273 DEBUG:teuthology.orchestra.run.trial014:> sudo chmod 0666 /tmp/tmp.7PGCWBCCI3 2026-02-24T19:26:19.355 DEBUG:teuthology.orchestra.remote:trial014:/tmp/tmp.7PGCWBCCI3 is 612KB 2026-02-24T19:26:19.454 DEBUG:teuthology.orchestra.run.trial014:> rm -fr /tmp/tmp.7PGCWBCCI3 2026-02-24T19:26:19.471 DEBUG:teuthology.misc:Transferring archived files from trial044:/var/lib/ceph/mon/ceph-b to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68689/data/mon.b.tgz 2026-02-24T19:26:19.471 DEBUG:teuthology.orchestra.run.trial044:> mktemp 2026-02-24T19:26:19.489 INFO:teuthology.orchestra.run.trial044.stdout:/tmp/tmp.ICNc8bvSTb 2026-02-24T19:26:19.490 DEBUG:teuthology.orchestra.run.trial044:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.ICNc8bvSTb 2026-02-24T19:26:19.632 DEBUG:teuthology.orchestra.run.trial044:> sudo chmod 0666 /tmp/tmp.ICNc8bvSTb 2026-02-24T19:26:19.713 DEBUG:teuthology.orchestra.remote:trial044:/tmp/tmp.ICNc8bvSTb is 613KB 2026-02-24T19:26:19.809 DEBUG:teuthology.orchestra.run.trial044:> rm -fr /tmp/tmp.ICNc8bvSTb 2026-02-24T19:26:19.825 DEBUG:teuthology.misc:Transferring archived files from trial170:/var/lib/ceph/mon/ceph-c to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68689/data/mon.c.tgz 2026-02-24T19:26:19.826 DEBUG:teuthology.orchestra.run.trial170:> mktemp 2026-02-24T19:26:19.842 INFO:teuthology.orchestra.run.trial170.stdout:/tmp/tmp.IrarpFTNhN 2026-02-24T19:26:19.843 DEBUG:teuthology.orchestra.run.trial170:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.IrarpFTNhN 2026-02-24T19:26:19.984 DEBUG:teuthology.orchestra.run.trial170:> sudo chmod 0666 /tmp/tmp.IrarpFTNhN 2026-02-24T19:26:20.064 DEBUG:teuthology.orchestra.remote:trial170:/tmp/tmp.IrarpFTNhN is 613KB 2026-02-24T19:26:20.160 DEBUG:teuthology.orchestra.run.trial170:> rm -fr /tmp/tmp.IrarpFTNhN 2026-02-24T19:26:20.177 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-24T19:26:20.178 DEBUG:teuthology.orchestra.run.trial014:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-24T19:26:20.180 DEBUG:teuthology.orchestra.run.trial044:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-24T19:26:20.183 DEBUG:teuthology.orchestra.run.trial170:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-24T19:26:20.219 DEBUG:teuthology.orchestra.run.trial195:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-24T19:26:20.308 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2026-02-24T19:26:20.502 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-24T19:26:20.761 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-24T19:26:21.017 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-24T19:26:21.229 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-24T19:26:21.229 INFO:tasks.ceph:Archiving crash dumps... 2026-02-24T19:26:21.231 DEBUG:teuthology.misc:Transferring archived files from trial014:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68689/remote/trial014/crash 2026-02-24T19:26:21.232 DEBUG:teuthology.orchestra.run.trial014:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-24T19:26:21.259 DEBUG:teuthology.misc:Transferring archived files from trial044:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68689/remote/trial044/crash 2026-02-24T19:26:21.260 DEBUG:teuthology.orchestra.run.trial044:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-24T19:26:21.286 DEBUG:teuthology.misc:Transferring archived files from trial170:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68689/remote/trial170/crash 2026-02-24T19:26:21.288 DEBUG:teuthology.orchestra.run.trial170:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-24T19:26:21.314 DEBUG:teuthology.misc:Transferring archived files from trial195:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68689/remote/trial195/crash 2026-02-24T19:26:21.316 DEBUG:teuthology.orchestra.run.trial195:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-24T19:26:21.344 INFO:tasks.ceph:Compressing logs... 2026-02-24T19:26:21.344 DEBUG:teuthology.orchestra.run.trial014:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T19:26:21.347 DEBUG:teuthology.orchestra.run.trial044:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T19:26:21.350 DEBUG:teuthology.orchestra.run.trial170:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T19:26:21.359 DEBUG:teuthology.orchestra.run.trial195:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T19:26:21.384 INFO:teuthology.orchestra.run.trial044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2026-02-24T19:26:21.384 INFO:teuthology.orchestra.run.trial044.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.5.log 2026-02-24T19:26:21.384 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.13.log 2026-02-24T19:26:21.384 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/valgrind/osd.5.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.1.log 2026-02-24T19:26:21.384 INFO:teuthology.orchestra.run.trial044.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.5.log.gz 2026-02-24T19:26:21.384 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/valgrind/osd.13.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.9.log 2026-02-24T19:26:21.384 INFO:teuthology.orchestra.run.trial044.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.13.log.gz 2026-02-24T19:26:21.384 INFO:teuthology.orchestra.run.trial044.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2026-02-24T19:26:21.385 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/valgrind/osd.1.log: 66.0% -- replaced with /var/log/ceph/valgrind/osd.1.log.gz 2026-02-24T19:26:21.385 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/valgrind/osd.9.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-24T19:26:21.385 INFO:teuthology.orchestra.run.trial044.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.9.log.gz 2026-02-24T19:26:21.385 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/valgrind/mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2026-02-24T19:26:21.385 INFO:teuthology.orchestra.run.trial044.stderr: 65.5% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2026-02-24T19:26:21.385 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.13.log 2026-02-24T19:26:21.385 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-24T19:26:21.385 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-osd.13.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-24T19:26:21.385 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.9.log 2026-02-24T19:26:21.385 INFO:teuthology.orchestra.run.trial044.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-osd.9.log: 91.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-24T19:26:21.385 INFO:teuthology.orchestra.run.trial044.stderr: 87.2% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-24T19:26:21.393 INFO:teuthology.orchestra.run.trial170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-24T19:26:21.393 INFO:teuthology.orchestra.run.trial170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2026-02-24T19:26:21.393 INFO:teuthology.orchestra.run.trial170.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.2.log 2026-02-24T19:26:21.393 INFO:teuthology.orchestra.run.trial170.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.6.log 2026-02-24T19:26:21.393 INFO:teuthology.orchestra.run.trial170.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/valgrind/osd.2.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.14.log 2026-02-24T19:26:21.393 INFO:teuthology.orchestra.run.trial170.stderr: 65.7% -- replaced with /var/log/ceph/valgrind/osd.2.log.gz 2026-02-24T19:26:21.393 INFO:teuthology.orchestra.run.trial170.stderr:/var/log/ceph/valgrind/osd.6.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.10.log 2026-02-24T19:26:21.393 INFO:teuthology.orchestra.run.trial170.stderr: 65.9% -- replaced with /var/log/ceph/valgrind/osd.6.log.gz 2026-02-24T19:26:21.393 INFO:teuthology.orchestra.run.trial170.stderr:/var/log/ceph/valgrind/osd.14.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2026-02-24T19:26:21.393 INFO:teuthology.orchestra.run.trial170.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.14.log.gz 2026-02-24T19:26:21.394 INFO:teuthology.orchestra.run.trial170.stderr:/var/log/ceph/valgrind/osd.10.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.10.log 2026-02-24T19:26:21.394 INFO:teuthology.orchestra.run.trial170.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.10.log.gz 2026-02-24T19:26:21.394 INFO:teuthology.orchestra.run.trial170.stderr:/var/log/ceph/valgrind/mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.14.log 2026-02-24T19:26:21.394 INFO:teuthology.orchestra.run.trial170.stderr: 65.5% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2026-02-24T19:26:21.394 INFO:teuthology.orchestra.run.trial170.stderr:/var/log/ceph/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-24T19:26:21.394 INFO:teuthology.orchestra.run.trial170.stderr:/var/log/ceph/ceph-osd.14.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2026-02-24T19:26:21.394 INFO:teuthology.orchestra.run.trial170.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-24T19:26:21.394 INFO:teuthology.orchestra.run.trial170.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph.log: 87.2% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-24T19:26:21.394 INFO:teuthology.orchestra.run.trial170.stderr: 91.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-24T19:26:21.413 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52626.log 2026-02-24T19:26:21.414 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48394.log 2026-02-24T19:26:21.414 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.52626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49599.log 2026-02-24T19:26:21.414 INFO:teuthology.orchestra.run.trial014.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52626.log.gz 2026-02-24T19:26:21.414 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-24T19:26:21.414 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.48394.log: /var/log/ceph/ceph-client.admin.49599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52222.log 2026-02-24T19:26:21.414 INFO:teuthology.orchestra.run.trial014.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48394.log.gz 2026-02-24T19:26:21.414 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-mon.a.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.49599.log.gz 2026-02-24T19:26:21.414 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-24T19:26:21.414 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.52222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48863.log 2026-02-24T19:26:21.414 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48866.log 2026-02-24T19:26:21.414 INFO:teuthology.orchestra.run.trial014.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.52222.log.gz 2026-02-24T19:26:21.414 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.48863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50286.log 2026-02-24T19:26:21.414 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.48866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46367.log 2026-02-24T19:26:21.414 INFO:teuthology.orchestra.run.trial014.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48863.log.gz 2026-02-24T19:26:21.414 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49584.log 2026-02-24T19:26:21.414 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.50286.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48866.log.gz 2026-02-24T19:26:21.414 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.46367.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2026-02-24T19:26:21.414 INFO:teuthology.orchestra.run.trial014.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.50286.log.gz 2026-02-24T19:26:21.415 INFO:teuthology.orchestra.run.trial014.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46367.log.gz 2026-02-24T19:26:21.415 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51830.log 2026-02-24T19:26:21.415 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.49584.log: /var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50107.log 2026-02-24T19:26:21.415 INFO:teuthology.orchestra.run.trial014.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.49584.log.gz 2026-02-24T19:26:21.415 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.51830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50446.log 2026-02-24T19:26:21.415 INFO:teuthology.orchestra.run.trial014.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.51830.log.gz 2026-02-24T19:26:21.415 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.50107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51879.log 2026-02-24T19:26:21.415 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.50446.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.50107.log.gz 2026-02-24T19:26:21.415 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50285.log 2026-02-24T19:26:21.415 INFO:teuthology.orchestra.run.trial014.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.50446.log.gz 2026-02-24T19:26:21.415 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.51879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48443.log 2026-02-24T19:26:21.415 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.50285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52369.log 2026-02-24T19:26:21.415 INFO:teuthology.orchestra.run.trial014.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51879.log.gz 2026-02-24T19:26:21.415 INFO:teuthology.orchestra.run.trial014.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.50285.log.gz 2026-02-24T19:26:21.415 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.48443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52418.log 2026-02-24T19:26:21.415 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.52369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52823.log 2026-02-24T19:26:21.415 INFO:teuthology.orchestra.run.trial014.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48443.log.gz 2026-02-24T19:26:21.415 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.52418.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52369.log.gz 2026-02-24T19:26:21.415 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51144.log 2026-02-24T19:26:21.415 INFO:teuthology.orchestra.run.trial014.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52418.log.gz 2026-02-24T19:26:21.415 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.52823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51634.log 2026-02-24T19:26:21.416 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.51144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48894.log 2026-02-24T19:26:21.416 INFO:teuthology.orchestra.run.trial014.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52823.log.gz 2026-02-24T19:26:21.416 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.51634.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51144.log.gz 2026-02-24T19:26:21.416 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51242.log 2026-02-24T19:26:21.416 INFO:teuthology.orchestra.run.trial014.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51634.log.gz 2026-02-24T19:26:21.416 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.48894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49699.log 2026-02-24T19:26:21.416 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.51242.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48894.log.gz 2026-02-24T19:26:21.416 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51340.log 2026-02-24T19:26:21.416 INFO:teuthology.orchestra.run.trial014.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51242.log.gz 2026-02-24T19:26:21.416 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.49699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49701.log 2026-02-24T19:26:21.416 INFO:teuthology.orchestra.run.trial014.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.49699.log.gz 2026-02-24T19:26:21.416 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.51340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48897.log 2026-02-24T19:26:21.416 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.49701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50893.log 2026-02-24T19:26:21.416 INFO:teuthology.orchestra.run.trial014.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51340.log.gz 2026-02-24T19:26:21.416 INFO:teuthology.orchestra.run.trial014.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.49701.log.gz 2026-02-24T19:26:21.416 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.48897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51683.log 2026-02-24T19:26:21.416 INFO:teuthology.orchestra.run.trial014.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48897.log.gz 2026-02-24T19:26:21.416 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.50893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48891.log 2026-02-24T19:26:21.416 INFO:teuthology.orchestra.run.trial014.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50893.log.gz 2026-02-24T19:26:21.416 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52528.log 2026-02-24T19:26:21.416 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.51683.log: /var/log/ceph/ceph-client.admin.48891.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.0.log 2026-02-24T19:26:21.416 INFO:teuthology.orchestra.run.trial014.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51683.log.gz 2026-02-24T19:26:21.417 INFO:teuthology.orchestra.run.trial014.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48891.log.gz 2026-02-24T19:26:21.417 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.52528.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.12.log 2026-02-24T19:26:21.417 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/valgrind/osd.0.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52528.log.gz 2026-02-24T19:26:21.417 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.8.log 2026-02-24T19:26:21.417 INFO:teuthology.orchestra.run.trial014.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.0.log.gz 2026-02-24T19:26:21.417 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/valgrind/osd.12.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2026-02-24T19:26:21.417 INFO:teuthology.orchestra.run.trial014.stderr: 65.6% -- replaced with /var/log/ceph/valgrind/osd.12.log.gz 2026-02-24T19:26:21.417 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/valgrind/osd.8.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.4.log 2026-02-24T19:26:21.417 INFO:teuthology.orchestra.run.trial014.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.8.log.gz 2026-02-24T19:26:21.417 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/valgrind/mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49700.log 2026-02-24T19:26:21.417 INFO:teuthology.orchestra.run.trial014.stderr: 65.5% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2026-02-24T19:26:21.417 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/valgrind/osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51928.log 2026-02-24T19:26:21.417 INFO:teuthology.orchestra.run.trial014.stderr: 65.6% -- replaced with /var/log/ceph/valgrind/osd.4.log.gz 2026-02-24T19:26:21.417 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.49700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50437.log 2026-02-24T19:26:21.417 INFO:teuthology.orchestra.run.trial014.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.49700.log.gz 2026-02-24T19:26:21.417 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.51928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48896.log 2026-02-24T19:26:21.417 INFO:teuthology.orchestra.run.trial014.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51928.log.gz 2026-02-24T19:26:21.417 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.50437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50631.log 2026-02-24T19:26:21.417 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.48896.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.50437.log.gz 2026-02-24T19:26:21.417 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51536.log 2026-02-24T19:26:21.417 INFO:teuthology.orchestra.run.trial014.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48896.log.gz 2026-02-24T19:26:21.417 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.50631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48885.log 2026-02-24T19:26:21.418 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.51536.log: gzip -5 --verbose -- 85.8% /var/log/ceph/ceph-client.admin.51389.log 2026-02-24T19:26:21.418 INFO:teuthology.orchestra.run.trial014.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50631.log.gz 2026-02-24T19:26:21.418 INFO:teuthology.orchestra.run.trial014.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51536.log.gz 2026-02-24T19:26:21.418 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.48885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48892.log 2026-02-24T19:26:21.418 INFO:teuthology.orchestra.run.trial014.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.48885.log.gz 2026-02-24T19:26:21.418 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.51389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51487.log 2026-02-24T19:26:21.418 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.48892.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51389.log.gz 2026-02-24T19:26:21.418 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50060.log 2026-02-24T19:26:21.418 INFO:teuthology.orchestra.run.trial014.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.48892.log.gz 2026-02-24T19:26:21.418 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.51487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50630.log 2026-02-24T19:26:21.418 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.50060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50756.log 87.6% 2026-02-24T19:26:21.418 INFO:teuthology.orchestra.run.trial014.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51487.log.gz 2026-02-24T19:26:21.418 INFO:teuthology.orchestra.run.trial014.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50060.log.gz 2026-02-24T19:26:21.418 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.50630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44038.log 2026-02-24T19:26:21.418 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.50756.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.50630.log.gz 2026-02-24T19:26:21.418 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52026.log 2026-02-24T19:26:21.418 INFO:teuthology.orchestra.run.trial014.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.50756.log.gz 2026-02-24T19:26:21.418 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.44038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50634.log 2026-02-24T19:26:21.418 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.52026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49596.log 2026-02-24T19:26:21.418 INFO:teuthology.orchestra.run.trial014.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.44038.log.gz 2026-02-24T19:26:21.418 INFO:teuthology.orchestra.run.trial014.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52026.log.gz 2026-02-24T19:26:21.418 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.50634.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.12.log 2026-02-24T19:26:21.419 INFO:teuthology.orchestra.run.trial014.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.50634.log.gz 2026-02-24T19:26:21.419 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48227.log 2026-02-24T19:26:21.419 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.49596.log: /var/log/ceph/ceph-osd.12.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48887.log 2026-02-24T19:26:21.419 INFO:teuthology.orchestra.run.trial014.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.49596.log.gz 2026-02-24T19:26:21.419 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.48227.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2026-02-24T19:26:21.419 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.48887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49337.log 2026-02-24T19:26:21.419 INFO:teuthology.orchestra.run.trial014.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48227.log.gz 2026-02-24T19:26:21.419 INFO:teuthology.orchestra.run.trial014.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48887.log.gz 2026-02-24T19:26:21.419 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44571.log 2026-02-24T19:26:21.419 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.49337.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.37689.log 2026-02-24T19:26:21.419 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.44571.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.49337.log.gz 2026-02-24T19:26:21.419 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51046.log 2026-02-24T19:26:21.419 INFO:teuthology.orchestra.run.trial014.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44571.log.gz 2026-02-24T19:26:21.419 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph.tmp-client.admin.37689.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.37689.log.gzgzip 2026-02-24T19:26:21.419 INFO:teuthology.orchestra.run.trial014.stderr: -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-24T19:26:21.419 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.51046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52271.log 2026-02-24T19:26:21.419 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph.audit.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51046.log.gz 2026-02-24T19:26:21.419 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52075.log 2026-02-24T19:26:21.419 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.52271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49614.log 2026-02-24T19:26:21.419 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.52075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51732.log 2026-02-24T19:26:21.419 INFO:teuthology.orchestra.run.trial014.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52271.log.gz 2026-02-24T19:26:21.419 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.49614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50629.log 87.8% 2026-02-24T19:26:21.419 INFO:teuthology.orchestra.run.trial014.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52075.log.gz 2026-02-24T19:26:21.420 INFO:teuthology.orchestra.run.trial014.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.49614.log.gz 2026-02-24T19:26:21.420 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.51732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51095.log 2026-02-24T19:26:21.420 INFO:teuthology.orchestra.run.trial014.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.51732.log.gz 2026-02-24T19:26:21.420 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.50629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48865.log 2026-02-24T19:26:21.420 INFO:teuthology.orchestra.run.trial014.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.50629.log.gz 2026-02-24T19:26:21.420 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.51095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50942.log 2026-02-24T19:26:21.420 INFO:teuthology.orchestra.run.trial014.stderr: 87.3%/var/log/ceph/ceph-client.admin.48865.log: -- replaced with /var/log/ceph/ceph-client.admin.51095.log.gz 2026-02-24T19:26:21.420 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48857.log 2026-02-24T19:26:21.420 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.50942.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48865.log.gz 2026-02-24T19:26:21.420 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48861.log 2026-02-24T19:26:21.420 INFO:teuthology.orchestra.run.trial014.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50942.log.gz 2026-02-24T19:26:21.420 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.48857.log: 91.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-24T19:26:21.420 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49592.log 2026-02-24T19:26:21.420 INFO:teuthology.orchestra.run.trial014.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48857.log.gz 2026-02-24T19:26:21.420 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.48861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52870.log 2026-02-24T19:26:21.420 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.49592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51438.log 2026-02-24T19:26:21.420 INFO:teuthology.orchestra.run.trial014.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48861.log.gz 2026-02-24T19:26:21.420 INFO:teuthology.orchestra.run.trial014.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.49592.log.gz 2026-02-24T19:26:21.420 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.52870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50412.log 2026-02-24T19:26:21.420 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.51438.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52870.log.gz 2026-02-24T19:26:21.420 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49568.log 2026-02-24T19:26:21.420 INFO:teuthology.orchestra.run.trial014.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51438.log.gz 2026-02-24T19:26:21.420 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.50412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48893.log 2026-02-24T19:26:21.420 INFO:teuthology.orchestra.run.trial014.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.50412.log.gz 2026-02-24T19:26:21.420 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.49568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48061.log 2026-02-24T19:26:21.420 INFO:teuthology.orchestra.run.trial014.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.49568.log.gz 2026-02-24T19:26:21.421 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.48893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48296.log 2026-02-24T19:26:21.421 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.48061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52675.log 2026-02-24T19:26:21.421 INFO:teuthology.orchestra.run.trial014.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48893.log.gz 2026-02-24T19:26:21.421 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.48296.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48061.log.gz 2026-02-24T19:26:21.421 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52773.log 2026-02-24T19:26:21.421 INFO:teuthology.orchestra.run.trial014.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48296.log.gz 2026-02-24T19:26:21.421 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.52675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51291.log 2026-02-24T19:26:21.421 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.52773.log: gzip -5 87.8% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.52675.log.gz /var/log/ceph/ceph-client.admin.44490.log 2026-02-24T19:26:21.421 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:26:21.421 INFO:teuthology.orchestra.run.trial014.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52773.log.gz 2026-02-24T19:26:21.421 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.51291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52724.log 2026-02-24T19:26:21.421 INFO:teuthology.orchestra.run.trial014.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51291.log.gz 2026-02-24T19:26:21.421 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.44490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44144.log 2026-02-24T19:26:21.421 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.52724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51977.log 2026-02-24T19:26:21.421 INFO:teuthology.orchestra.run.trial014.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44490.log.gz 2026-02-24T19:26:21.421 INFO:teuthology.orchestra.run.trial014.stderr: 87.2%/var/log/ceph/ceph-client.admin.44144.log: -- replaced with /var/log/ceph/ceph-client.admin.52724.log.gz 2026-02-24T19:26:21.421 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50844.log 2026-02-24T19:26:21.421 INFO:teuthology.orchestra.run.trial014.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.44144.log.gz 2026-02-24T19:26:21.421 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.51977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49589.log 2026-02-24T19:26:21.421 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.50844.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51977.log.gz 2026-02-24T19:26:21.421 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52173.log 2026-02-24T19:26:21.421 INFO:teuthology.orchestra.run.trial014.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50844.log.gz 2026-02-24T19:26:21.421 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.49589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49597.log 2026-02-24T19:26:21.421 INFO:teuthology.orchestra.run.trial014.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.49589.log.gz 2026-02-24T19:26:21.421 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48862.log 2026-02-24T19:26:21.422 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.52173.log: /var/log/ceph/ceph-client.admin.49597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48130.log 2026-02-24T19:26:21.422 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.48862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49330.log 2026-02-24T19:26:21.422 INFO:teuthology.orchestra.run.trial014.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.49597.log.gz 2026-02-24T19:26:21.422 INFO:teuthology.orchestra.run.trial014.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52173.log.gz 2026-02-24T19:26:21.422 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.48130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48345.log 2026-02-24T19:26:21.422 INFO:teuthology.orchestra.run.trial014.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48862.log.gz 2026-02-24T19:26:21.422 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.49330.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48130.log.gz 2026-02-24T19:26:21.422 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52320.log 2026-02-24T19:26:21.422 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.48345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48200.log 2026-02-24T19:26:21.422 INFO:teuthology.orchestra.run.trial014.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49330.log.gz 2026-02-24T19:26:21.422 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.52320.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-24T19:26:21.422 INFO:teuthology.orchestra.run.trial014.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48345.log.gz 2026-02-24T19:26:21.422 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.48200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50997.log 2026-02-24T19:26:21.422 INFO:teuthology.orchestra.run.trial014.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52320.log.gz 2026-02-24T19:26:21.422 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52124.log 2026-02-24T19:26:21.422 INFO:teuthology.orchestra.run.trial014.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48200.log.gz 2026-02-24T19:26:21.422 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.50997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51193.log 2026-02-24T19:26:21.422 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.52124.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.8.log 2026-02-24T19:26:21.422 INFO:teuthology.orchestra.run.trial014.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.50997.log.gz 2026-02-24T19:26:21.422 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.51193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49571.log 2026-02-24T19:26:21.422 INFO:teuthology.orchestra.run.trial014.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52124.log.gz 2026-02-24T19:26:21.422 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-osd.8.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51193.log.gz 2026-02-24T19:26:21.422 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51585.log 2026-02-24T19:26:21.422 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.49571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49585.log 2026-02-24T19:26:21.423 INFO:teuthology.orchestra.run.trial014.stderr: 87.2% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-24T19:26:21.423 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.51585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52479.log 2026-02-24T19:26:21.423 INFO:teuthology.orchestra.run.trial014.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.49571.log.gz 2026-02-24T19:26:21.423 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.49585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50232.log 2026-02-24T19:26:21.423 INFO:teuthology.orchestra.run.trial014.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51585.log.gz 2026-02-24T19:26:21.423 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.52479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50154.log 2026-02-24T19:26:21.423 INFO:teuthology.orchestra.run.trial014.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49585.log.gz 2026-02-24T19:26:21.423 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.50232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50231.log 2026-02-24T19:26:21.423 INFO:teuthology.orchestra.run.trial014.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52479.log.gz 2026-02-24T19:26:21.423 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.50154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52577.log 2026-02-24T19:26:21.423 INFO:teuthology.orchestra.run.trial014.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50232.log.gz 2026-02-24T19:26:21.423 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.50231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44513.log 2026-02-24T19:26:21.423 INFO:teuthology.orchestra.run.trial014.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50154.log.gz 2026-02-24T19:26:21.423 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.52577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48874.log 2026-02-24T19:26:21.423 INFO:teuthology.orchestra.run.trial014.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50231.log.gz 2026-02-24T19:26:21.423 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.44513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51781.log 2026-02-24T19:26:21.423 INFO:teuthology.orchestra.run.trial014.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52577.log.gz 2026-02-24T19:26:21.423 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.48874.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44513.log.gz 2026-02-24T19:26:21.423 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48895.log 2026-02-24T19:26:21.423 INFO:teuthology.orchestra.run.trial014.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48874.log.gz 2026-02-24T19:26:21.423 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.51781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49570.log 2026-02-24T19:26:21.423 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.48895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50512.log 2026-02-24T19:26:21.423 INFO:teuthology.orchestra.run.trial014.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51781.log.gz 2026-02-24T19:26:21.423 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.49570.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48895.log.gz 2026-02-24T19:26:21.423 INFO:teuthology.orchestra.run.trial014.stderr:/var/log/ceph/ceph-client.admin.50512.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.49570.log.gz 2026-02-24T19:26:21.423 INFO:teuthology.orchestra.run.trial014.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.50512.log.gz 2026-02-24T19:26:21.433 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48867.log 2026-02-24T19:26:21.433 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44574.log 2026-02-24T19:26:21.433 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.48867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44480.log 2026-02-24T19:26:21.433 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.44574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49866.log 2026-02-24T19:26:21.433 INFO:teuthology.orchestra.run.trial195.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.44574.log.gz 2026-02-24T19:26:21.433 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.44480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49483.log 2026-02-24T19:26:21.433 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.49866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48911.log 2026-02-24T19:26:21.433 INFO:teuthology.orchestra.run.trial195.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44480.log.gz 2026-02-24T19:26:21.433 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.49483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51740.log 2026-02-24T19:26:21.433 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48938.log 2026-02-24T19:26:21.433 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.48911.log: /var/log/ceph/ceph-client.admin.51740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58937.log 2026-02-24T19:26:21.433 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.48938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51739.log 2026-02-24T19:26:21.433 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-24T19:26:21.433 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.58937.log: /var/log/ceph/ceph-client.admin.51739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54125.log 2026-02-24T19:26:21.433 INFO:teuthology.orchestra.run.trial195.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.51740.log.gz 2026-02-24T19:26:21.434 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49213.log 2026-02-24T19:26:21.434 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.54125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51177.log 2026-02-24T19:26:21.434 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.49213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49506.log 2026-02-24T19:26:21.434 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51179.log 2026-02-24T19:26:21.434 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.51177.log: /var/log/ceph/ceph-client.admin.49506.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.51739.log.gz 2026-02-24T19:26:21.434 INFO:teuthology.orchestra.run.trial195.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.58937.log.gz 2026-02-24T19:26:21.434 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54126.log 2026-02-24T19:26:21.434 INFO:teuthology.orchestra.run.trial195.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.49506.log.gz 2026-02-24T19:26:21.434 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.51179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51271.log 2026-02-24T19:26:21.434 INFO:teuthology.orchestra.run.trial195.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.54125.log.gz 2026-02-24T19:26:21.434 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.54126.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.48911.log.gz 2026-02-24T19:26:21.434 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49650.log 2026-02-24T19:26:21.434 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.51271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49911.log 2026-02-24T19:26:21.434 INFO:teuthology.orchestra.run.trial195.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49213.log.gz 2026-02-24T19:26:21.434 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.49650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48957.log 2026-02-24T19:26:21.434 INFO:teuthology.orchestra.run.trial195.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.51177.log.gz 2026-02-24T19:26:21.434 INFO:teuthology.orchestra.run.trial195.stderr: 90.5%/var/log/ceph/ceph-client.admin.49911.log: -- replaced with /var/log/ceph/ceph-client.admin.51179.log.gz 2026-02-24T19:26:21.434 INFO:teuthology.orchestra.run.trial195.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49650.log.gz 2026-02-24T19:26:21.434 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49737.log 2026-02-24T19:26:21.434 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54124.log 2026-02-24T19:26:21.434 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.48957.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.54126.log.gz 2026-02-24T19:26:21.434 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.49737.log: gzip -5 --verbose 90.4% -- -- replaced with /var/log/ceph/ceph-client.admin.51271.log.gz /var/log/ceph/ceph-osd.7.log 2026-02-24T19:26:21.434 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:26:21.434 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.54124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44715.log 2026-02-24T19:26:21.434 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49639.log 2026-02-24T19:26:21.434 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.44715.log: gzip 92.2% -- replaced with /var/log/ceph/ceph-client.admin.48957.log.gz -5 2026-02-24T19:26:21.434 INFO:teuthology.orchestra.run.trial195.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44856.log 2026-02-24T19:26:21.434 INFO:teuthology.orchestra.run.trial195.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.49866.log.gz 2026-02-24T19:26:21.434 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.49639.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44715.log.gz 2026-02-24T19:26:21.434 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.7.log 2026-02-24T19:26:21.434 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.44856.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.54124.log.gz 2026-02-24T19:26:21.435 INFO:teuthology.orchestra.run.trial195.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49639.log.gz 2026-02-24T19:26:21.435 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.11.log 2026-02-24T19:26:21.435 INFO:teuthology.orchestra.run.trial195.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44856.log.gz 2026-02-24T19:26:21.435 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/valgrind/osd.7.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.15.log 2026-02-24T19:26:21.435 INFO:teuthology.orchestra.run.trial195.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.7.log.gz 2026-02-24T19:26:21.435 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/valgrind/osd.11.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.3.log 2026-02-24T19:26:21.435 INFO:teuthology.orchestra.run.trial195.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.11.log.gz 2026-02-24T19:26:21.435 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/valgrind/osd.15.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49621.log 2026-02-24T19:26:21.435 INFO:teuthology.orchestra.run.trial195.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.15.log.gz 2026-02-24T19:26:21.435 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/valgrind/osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.11.log 2026-02-24T19:26:21.435 INFO:teuthology.orchestra.run.trial195.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.3.log.gz 2026-02-24T19:26:21.435 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.49621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48896.log 2026-02-24T19:26:21.435 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44328.log 2026-02-24T19:26:21.435 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.48896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51326.log 2026-02-24T19:26:21.435 INFO:teuthology.orchestra.run.trial195.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.48938.log.gz 2026-02-24T19:26:21.435 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.44328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49269.log 2026-02-24T19:26:21.435 INFO:teuthology.orchestra.run.trial195.stderr: 86.7%/var/log/ceph/ceph-client.admin.51326.log: -- replaced with /var/log/ceph/ceph-client.admin.44328.log.gz 2026-02-24T19:26:21.435 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49586.log 2026-02-24T19:26:21.435 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.49269.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.49621.log.gz 2026-02-24T19:26:21.435 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44950.log 2026-02-24T19:26:21.435 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.49586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49707.log 2026-02-24T19:26:21.435 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.44950.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49586.log.gz 2026-02-24T19:26:21.435 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49605.log 2026-02-24T19:26:21.435 INFO:teuthology.orchestra.run.trial195.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44950.log.gz 2026-02-24T19:26:21.435 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.49707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49442.log 2026-02-24T19:26:21.435 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.49605.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.51326.log.gz 2026-02-24T19:26:21.435 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49724.log 2026-02-24T19:26:21.435 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.49442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49025.log 2026-02-24T19:26:21.435 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.49724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49596.log 2026-02-24T19:26:21.435 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.49025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49164.log 2026-02-24T19:26:21.435 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.49596.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49724.log.gz 2026-02-24T19:26:21.435 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51327.log 2026-02-24T19:26:21.435 INFO:teuthology.orchestra.run.trial195.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.49442.log.gz 2026-02-24T19:26:21.436 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.49164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51741.log 2026-02-24T19:26:21.436 INFO:teuthology.orchestra.run.trial195.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.49269.log.gz 2026-02-24T19:26:21.436 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.51327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49076.log 2026-02-24T19:26:21.436 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.51741.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.51327.log.gz 2026-02-24T19:26:21.436 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49139.log 2026-02-24T19:26:21.436 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.49076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45044.log 2026-02-24T19:26:21.436 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.49139.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.49596.log.gz 2026-02-24T19:26:21.436 INFO:teuthology.orchestra.run.trial195.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.49025.log.gz 2026-02-24T19:26:21.436 INFO:teuthology.orchestra.run.trial195.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.49605.log.gz 2026-02-24T19:26:21.436 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51178.log 2026-02-24T19:26:21.436 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.45044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44903.log 2026-02-24T19:26:21.436 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.51178.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.45044.log.gz 2026-02-24T19:26:21.436 INFO:teuthology.orchestra.run.trial195.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44527.log 2026-02-24T19:26:21.436 INFO:teuthology.orchestra.run.trial195.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.51741.log.gz 2026-02-24T19:26:21.436 INFO:teuthology.orchestra.run.trial195.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48867.log.gz 2026-02-24T19:26:21.436 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.44903.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51178.log.gz 2026-02-24T19:26:21.436 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49355.log 2026-02-24T19:26:21.436 INFO:teuthology.orchestra.run.trial195.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.44903.log.gz 2026-02-24T19:26:21.436 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.44527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51270.log 2026-02-24T19:26:21.436 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.49355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49375.log 2026-02-24T19:26:21.436 INFO:teuthology.orchestra.run.trial195.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.44527.log.gz 2026-02-24T19:26:21.436 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.51270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49501.log 2026-02-24T19:26:21.436 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.49375.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.49707.log.gz 2026-02-24T19:26:21.436 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49238.log 2026-02-24T19:26:21.436 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.49501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48981.log 2026-02-24T19:26:21.436 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.49238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54127.log 2026-02-24T19:26:21.436 INFO:teuthology.orchestra.run.trial195.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.49139.log.gz 2026-02-24T19:26:21.436 INFO:teuthology.orchestra.run.trial195.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.51270.log.gz 2026-02-24T19:26:21.436 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.48981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49287.log 2026-02-24T19:26:21.436 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.54127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44621.log 2026-02-24T19:26:21.436 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.49287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49788.log 2026-02-24T19:26:21.436 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.44621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58936.log 2026-02-24T19:26:21.436 INFO:teuthology.orchestra.run.trial195.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49238.log.gz 2026-02-24T19:26:21.437 INFO:teuthology.orchestra.run.trial195.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.49355.log.gz 2026-02-24T19:26:21.437 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.49788.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44621.log.gz 2026-02-24T19:26:21.437 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44809.log 2026-02-24T19:26:21.437 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.58936.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.54127.log.gz 2026-02-24T19:26:21.437 INFO:teuthology.orchestra.run.trial195.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.49164.log.gz 2026-02-24T19:26:21.437 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49327.log 2026-02-24T19:26:21.437 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.44809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44426.log 2026-02-24T19:26:21.437 INFO:teuthology.orchestra.run.trial195.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44809.log.gz 2026-02-24T19:26:21.437 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.49327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48993.log 2026-02-24T19:26:21.437 INFO:teuthology.orchestra.run.trial195.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.49737.log.gz 2026-02-24T19:26:21.437 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.44426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49648.log 2026-02-24T19:26:21.437 INFO:teuthology.orchestra.run.trial195.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.58936.log.gz 2026-02-24T19:26:21.437 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.48993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58935.log 2026-02-24T19:26:21.437 INFO:teuthology.orchestra.run.trial195.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44426.log.gz 2026-02-24T19:26:21.437 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.49648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44375.log 2026-02-24T19:26:21.437 INFO:teuthology.orchestra.run.trial195.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.49375.log.gz 2026-02-24T19:26:21.437 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.58935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49105.log 2026-02-24T19:26:21.437 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.44375.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.49501.log.gz 2026-02-24T19:26:21.437 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49908.log 2026-02-24T19:26:21.437 INFO:teuthology.orchestra.run.trial195.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44375.log.gz 2026-02-24T19:26:21.437 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.49105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49624.log 2026-02-24T19:26:21.437 INFO:teuthology.orchestra.run.trial195.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.49287.log.gz 2026-02-24T19:26:21.437 INFO:teuthology.orchestra.run.trial195.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.49648.log.gz 2026-02-24T19:26:21.437 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.49908.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.48993.log.gz 2026-02-24T19:26:21.437 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44997.log 2026-02-24T19:26:21.437 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.49624.log: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.49483.log.gz 2026-02-24T19:26:21.437 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-24T19:26:21.437 INFO:teuthology.orchestra.run.trial195.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.58935.log.gz 2026-02-24T19:26:21.437 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.44997.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49624.log.gz 2026-02-24T19:26:21.437 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49887.log 2026-02-24T19:26:21.437 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-mgr.x.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44997.log.gz 2026-02-24T19:26:21.437 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44668.log 2026-02-24T19:26:21.437 INFO:teuthology.orchestra.run.trial195.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.49327.log.gz 2026-02-24T19:26:21.437 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.49887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54128.log 2026-02-24T19:26:21.438 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.44668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49845.log 2026-02-24T19:26:21.438 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.54128.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44668.log.gz 2026-02-24T19:26:21.438 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49045.log 2026-02-24T19:26:21.438 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.49845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51269.log 2026-02-24T19:26:21.438 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.49045.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.49105.log.gz 2026-02-24T19:26:21.438 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49837.log 2026-02-24T19:26:21.438 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49590.log 2026-02-24T19:26:21.438 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.51269.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.54128.log.gz/var/log/ceph/ceph-client.admin.49837.log: 2026-02-24T19:26:21.438 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44762.log 2026-02-24T19:26:21.438 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.49590.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.15.log 2026-02-24T19:26:21.438 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-client.admin.44762.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.44762.log.gz 2026-02-24T19:26:21.438 INFO:teuthology.orchestra.run.trial195.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49845.log.gz 2026-02-24T19:26:21.438 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/ceph-osd.15.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.51269.log.gz 2026-02-24T19:26:21.438 INFO:teuthology.orchestra.run.trial195.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.49590.log.gz 2026-02-24T19:26:21.438 INFO:teuthology.orchestra.run.trial195.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-24T19:26:21.438 INFO:teuthology.orchestra.run.trial195.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.49911.log.gz 2026-02-24T19:26:21.439 INFO:teuthology.orchestra.run.trial195.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.49908.log.gz 2026-02-24T19:26:21.439 INFO:teuthology.orchestra.run.trial195.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.49887.log.gz 2026-02-24T19:26:21.439 INFO:teuthology.orchestra.run.trial195.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.49837.log.gz 2026-02-24T19:26:21.439 INFO:teuthology.orchestra.run.trial195.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.49788.log.gz 2026-02-24T19:26:21.442 INFO:teuthology.orchestra.run.trial014.stderr: 89.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2026-02-24T19:26:21.451 INFO:teuthology.orchestra.run.trial195.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.48896.log.gz 2026-02-24T19:26:21.452 INFO:teuthology.orchestra.run.trial195.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.48981.log.gz 2026-02-24T19:26:21.467 INFO:teuthology.orchestra.run.trial195.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.49076.log.gz 2026-02-24T19:26:21.903 INFO:teuthology.orchestra.run.trial195.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.49045.log.gz 2026-02-24T19:26:21.979 INFO:teuthology.orchestra.run.trial170.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2026-02-24T19:26:22.029 INFO:teuthology.orchestra.run.trial044.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2026-02-24T19:26:22.117 INFO:teuthology.orchestra.run.trial044.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-24T19:26:22.129 INFO:teuthology.orchestra.run.trial170.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.14.log.gz 2026-02-24T19:26:22.130 INFO:teuthology.orchestra.run.trial044.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.9.log.gz 2026-02-24T19:26:22.171 INFO:teuthology.orchestra.run.trial195.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-24T19:26:22.171 INFO:teuthology.orchestra.run.trial044.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.13.log.gz 2026-02-24T19:26:22.174 INFO:teuthology.orchestra.run.trial014.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.8.log.gz 2026-02-24T19:26:22.198 INFO:teuthology.orchestra.run.trial014.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.12.log.gz 2026-02-24T19:26:22.203 INFO:teuthology.orchestra.run.trial195.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.11.log.gz 2026-02-24T19:26:22.206 INFO:teuthology.orchestra.run.trial195.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.15.log.gz 2026-02-24T19:26:22.208 INFO:teuthology.orchestra.run.trial014.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-24T19:26:22.215 INFO:teuthology.orchestra.run.trial014.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2026-02-24T19:26:22.242 INFO:teuthology.orchestra.run.trial195.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2026-02-24T19:26:22.244 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T19:26:22.244 INFO:teuthology.orchestra.run.trial195.stderr:real 0m0.843s 2026-02-24T19:26:22.244 INFO:teuthology.orchestra.run.trial195.stderr:user 0m3.747s 2026-02-24T19:26:22.244 INFO:teuthology.orchestra.run.trial195.stderr:sys 0m0.244s 2026-02-24T19:26:22.245 INFO:teuthology.orchestra.run.trial170.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.10.log.gz 2026-02-24T19:26:22.246 INFO:teuthology.orchestra.run.trial170.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2026-02-24T19:26:22.257 INFO:teuthology.orchestra.run.trial170.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-24T19:26:22.259 INFO:teuthology.orchestra.run.trial170.stderr: 2026-02-24T19:26:22.259 INFO:teuthology.orchestra.run.trial170.stderr:real 0m0.888s 2026-02-24T19:26:22.259 INFO:teuthology.orchestra.run.trial170.stderr:user 0m3.766s 2026-02-24T19:26:22.259 INFO:teuthology.orchestra.run.trial170.stderr:sys 0m0.203s 2026-02-24T19:26:22.308 INFO:teuthology.orchestra.run.trial044.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2026-02-24T19:26:22.309 INFO:teuthology.orchestra.run.trial044.stderr: 2026-02-24T19:26:22.309 INFO:teuthology.orchestra.run.trial044.stderr:real 0m0.946s 2026-02-24T19:26:22.309 INFO:teuthology.orchestra.run.trial044.stderr:user 0m3.723s 2026-02-24T19:26:22.309 INFO:teuthology.orchestra.run.trial044.stderr:sys 0m0.186s 2026-02-24T19:26:22.407 INFO:teuthology.orchestra.run.trial014.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-24T19:26:22.408 INFO:teuthology.orchestra.run.trial014.stderr: 2026-02-24T19:26:22.408 INFO:teuthology.orchestra.run.trial014.stderr:real 0m1.047s 2026-02-24T19:26:22.409 INFO:teuthology.orchestra.run.trial014.stderr:user 0m4.217s 2026-02-24T19:26:22.409 INFO:teuthology.orchestra.run.trial014.stderr:sys 0m0.247s 2026-02-24T19:26:22.410 INFO:tasks.ceph:Archiving logs... 2026-02-24T19:26:22.410 DEBUG:teuthology.misc:Transferring archived files from trial014:/var/log/ceph to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68689/remote/trial014/log 2026-02-24T19:26:22.411 DEBUG:teuthology.orchestra.run.trial014:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-24T19:26:22.945 DEBUG:teuthology.misc:Transferring archived files from trial044:/var/log/ceph to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68689/remote/trial044/log 2026-02-24T19:26:22.946 DEBUG:teuthology.orchestra.run.trial044:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-24T19:26:23.294 DEBUG:teuthology.misc:Transferring archived files from trial170:/var/log/ceph to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68689/remote/trial170/log 2026-02-24T19:26:23.295 DEBUG:teuthology.orchestra.run.trial170:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-24T19:26:23.637 DEBUG:teuthology.misc:Transferring archived files from trial195:/var/log/ceph to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68689/remote/trial195/log 2026-02-24T19:26:23.638 DEBUG:teuthology.orchestra.run.trial195:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-24T19:26:24.013 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-24T19:26:24.025 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-24T19:26:24.025 DEBUG:teuthology.orchestra.run.trial014:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-24T19:26:24.027 DEBUG:teuthology.orchestra.run.trial044:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-24T19:26:24.029 DEBUG:teuthology.orchestra.run.trial170:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-24T19:26:24.031 DEBUG:teuthology.orchestra.run.trial195:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-24T19:26:24.283 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-24T19:26:24.292 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-24T19:26:24.292 DEBUG:teuthology.orchestra.run.trial014:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T19:26:24.294 DEBUG:teuthology.orchestra.run.trial044:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T19:26:24.296 DEBUG:teuthology.orchestra.run.trial170:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T19:26:24.297 DEBUG:teuthology.orchestra.run.trial195:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T19:26:24.307 INFO:teuthology.orchestra.run.trial014.stderr:bash: line 1: ntpq: command not found 2026-02-24T19:26:24.310 INFO:teuthology.orchestra.run.trial044.stderr:bash: line 1: ntpq: command not found 2026-02-24T19:26:24.312 INFO:teuthology.orchestra.run.trial170.stderr:bash: line 1: ntpq: command not found 2026-02-24T19:26:24.313 INFO:teuthology.orchestra.run.trial195.stderr:bash: line 1: ntpq: command not found 2026-02-24T19:26:24.337 INFO:teuthology.orchestra.run.trial014.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T19:26:24.337 INFO:teuthology.orchestra.run.trial014.stdout:=============================================================================== 2026-02-24T19:26:24.337 INFO:teuthology.orchestra.run.trial014.stdout:^- 172-233-177-198.ip.linod> 2 6 377 3 -14ms[ -14ms] +/- 93ms 2026-02-24T19:26:24.337 INFO:teuthology.orchestra.run.trial014.stdout:^* nyc2.us.ntp.li 2 9 377 6 -127us[ -518us] +/- 3151us 2026-02-24T19:26:24.337 INFO:teuthology.orchestra.run.trial014.stdout:^- beta.kenyonralph.com 3 6 377 71 -1685us[-2076us] +/- 34ms 2026-02-24T19:26:24.337 INFO:teuthology.orchestra.run.trial014.stdout:^- 216-144-228-179-host.col> 2 9 377 462 +801us[ +412us] +/- 11ms 2026-02-24T19:26:24.339 INFO:teuthology.orchestra.run.trial170.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T19:26:24.339 INFO:teuthology.orchestra.run.trial170.stdout:=============================================================================== 2026-02-24T19:26:24.339 INFO:teuthology.orchestra.run.trial170.stdout:^* time.cloudflare.com 3 9 377 466 +142us[ +189us] +/- 6839us 2026-02-24T19:26:24.339 INFO:teuthology.orchestra.run.trial170.stdout:^- 149.28.61.105.vultruserc> 3 9 377 329 +719us[ +719us] +/- 32ms 2026-02-24T19:26:24.339 INFO:teuthology.orchestra.run.trial170.stdout:^- arm1.maxhost.io 2 9 377 461 +334us[ +334us] +/- 54ms 2026-02-24T19:26:24.339 INFO:teuthology.orchestra.run.trial170.stdout:^- usmoi.meezy.link 2 8 377 199 -1256us[-1256us] +/- 23ms 2026-02-24T19:26:24.344 INFO:teuthology.orchestra.run.trial044.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T19:26:24.344 INFO:teuthology.orchestra.run.trial044.stdout:=============================================================================== 2026-02-24T19:26:24.344 INFO:teuthology.orchestra.run.trial044.stdout:^+ srcf-ntp.stanford.edu 2 9 377 337 +787us[ +518us] +/- 69ms 2026-02-24T19:26:24.344 INFO:teuthology.orchestra.run.trial044.stdout:^+ 73.185.182.209 2 9 377 67 -254us[ -254us] +/- 46ms 2026-02-24T19:26:24.344 INFO:teuthology.orchestra.run.trial044.stdout:^+ lax1.us.ntp.li 2 9 377 206 +1594us[+1594us] +/- 36ms 2026-02-24T19:26:24.344 INFO:teuthology.orchestra.run.trial044.stdout:^* frumentum-zeus.infra.fru> 2 9 377 332 -2224us[-2494us] +/- 24ms 2026-02-24T19:26:24.345 INFO:teuthology.orchestra.run.trial195.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T19:26:24.345 INFO:teuthology.orchestra.run.trial195.stdout:=============================================================================== 2026-02-24T19:26:24.345 INFO:teuthology.orchestra.run.trial195.stdout:^- 170-187-147-56.ip.linode> 2 9 377 465 -7074us[-6820us] +/- 82ms 2026-02-24T19:26:24.345 INFO:teuthology.orchestra.run.trial195.stdout:^+ 44.190.5.123 2 7 377 132 +906us[ +906us] +/- 33ms 2026-02-24T19:26:24.345 INFO:teuthology.orchestra.run.trial195.stdout:^* 108.61.215.221.vultruser> 2 9 377 452 +1134us[+1388us] +/- 25ms 2026-02-24T19:26:24.345 INFO:teuthology.orchestra.run.trial195.stdout:^- 23.186.168.129 2 8 367 254 +153us[ +153us] +/- 55ms 2026-02-24T19:26:24.345 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-24T19:26:24.356 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-24T19:26:24.356 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-24T19:26:24.368 DEBUG:teuthology.orchestra.run.trial014:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-24T19:26:24.432 DEBUG:teuthology.orchestra.run.trial044:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-24T19:26:24.485 DEBUG:teuthology.orchestra.run.trial170:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-24T19:26:24.541 DEBUG:teuthology.orchestra.run.trial195:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-24T19:26:24.597 DEBUG:teuthology.orchestra.run.trial014:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T19:26:24.625 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T19:26:24.625 DEBUG:teuthology.orchestra.run.trial044:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T19:26:24.653 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T19:26:24.654 DEBUG:teuthology.orchestra.run.trial170:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T19:26:24.682 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T19:26:24.682 DEBUG:teuthology.orchestra.run.trial195:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T19:26:24.711 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T19:26:24.712 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-24T19:26:24.725 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-24T19:26:24.739 INFO:teuthology.task.internal:Duration was 3806.528132 seconds 2026-02-24T19:26:24.740 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-24T19:26:24.753 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-24T19:26:24.754 DEBUG:teuthology.orchestra.run.trial014:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-24T19:26:24.757 DEBUG:teuthology.orchestra.run.trial044:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-24T19:26:24.760 DEBUG:teuthology.orchestra.run.trial170:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-24T19:26:24.763 DEBUG:teuthology.orchestra.run.trial195:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-24T19:26:24.792 INFO:teuthology.orchestra.run.trial014.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T19:26:24.795 INFO:teuthology.orchestra.run.trial044.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T19:26:24.797 INFO:teuthology.orchestra.run.trial170.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T19:26:24.800 INFO:teuthology.orchestra.run.trial195.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T19:26:25.290 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-24T19:26:25.290 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial014.front.sepia.ceph.com 2026-02-24T19:26:25.291 DEBUG:teuthology.orchestra.run.trial014:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-24T19:26:25.311 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial044.front.sepia.ceph.com 2026-02-24T19:26:25.311 DEBUG:teuthology.orchestra.run.trial044:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-24T19:26:25.331 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial170.front.sepia.ceph.com 2026-02-24T19:26:25.332 DEBUG:teuthology.orchestra.run.trial170:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-24T19:26:25.350 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial195.front.sepia.ceph.com 2026-02-24T19:26:25.351 DEBUG:teuthology.orchestra.run.trial195:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-24T19:26:25.372 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-24T19:26:25.372 DEBUG:teuthology.orchestra.run.trial014:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T19:26:25.374 DEBUG:teuthology.orchestra.run.trial044:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T19:26:25.377 DEBUG:teuthology.orchestra.run.trial170:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T19:26:25.393 DEBUG:teuthology.orchestra.run.trial195:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T19:26:25.474 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-24T19:26:25.474 DEBUG:teuthology.orchestra.run.trial014:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T19:26:25.477 DEBUG:teuthology.orchestra.run.trial044:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T19:26:25.479 DEBUG:teuthology.orchestra.run.trial170:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T19:26:25.481 DEBUG:teuthology.orchestra.run.trial195:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T19:26:25.497 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T19:26:25.498 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T19:26:25.498 INFO:teuthology.orchestra.run.trial014.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-24T19:26:25.499 INFO:teuthology.orchestra.run.trial014.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T19:26:25.499 INFO:teuthology.orchestra.run.trial014.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-24T19:26:25.500 INFO:teuthology.orchestra.run.trial044.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T19:26:25.501 INFO:teuthology.orchestra.run.trial044.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T19:26:25.501 INFO:teuthology.orchestra.run.trial044.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-24T19:26:25.501 INFO:teuthology.orchestra.run.trial044.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T19:26:25.501 INFO:teuthology.orchestra.run.trial044.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-24T19:26:25.502 INFO:teuthology.orchestra.run.trial170.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T19:26:25.503 INFO:teuthology.orchestra.run.trial170.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T19:26:25.503 INFO:teuthology.orchestra.run.trial170.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T19:26:25.503 INFO:teuthology.orchestra.run.trial170.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-24T19:26:25.503 INFO:teuthology.orchestra.run.trial170.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-24T19:26:25.504 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T19:26:25.505 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T19:26:25.505 INFO:teuthology.orchestra.run.trial195.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-24T19:26:25.505 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T19:26:25.506 INFO:teuthology.orchestra.run.trial195.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-24T19:26:25.509 INFO:teuthology.orchestra.run.trial014.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 83.2% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-24T19:26:25.511 INFO:teuthology.orchestra.run.trial044.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 83.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-24T19:26:25.513 INFO:teuthology.orchestra.run.trial170.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 82.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-24T19:26:25.516 INFO:teuthology.orchestra.run.trial195.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 82.8% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-24T19:26:25.518 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-24T19:26:25.534 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-24T19:26:25.534 DEBUG:teuthology.orchestra.run.trial014:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-24T19:26:25.574 DEBUG:teuthology.orchestra.run.trial044:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-24T19:26:25.599 DEBUG:teuthology.orchestra.run.trial170:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-24T19:26:25.625 DEBUG:teuthology.orchestra.run.trial195:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-24T19:26:25.651 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-24T19:26:25.667 DEBUG:teuthology.orchestra.run.trial014:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-24T19:26:25.670 DEBUG:teuthology.orchestra.run.trial044:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-24T19:26:25.673 DEBUG:teuthology.orchestra.run.trial170:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-24T19:26:25.675 DEBUG:teuthology.orchestra.run.trial195:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-24T19:26:25.691 INFO:teuthology.orchestra.run.trial014.stdout:kernel.core_pattern = core 2026-02-24T19:26:25.695 INFO:teuthology.orchestra.run.trial044.stdout:kernel.core_pattern = core 2026-02-24T19:26:25.697 INFO:teuthology.orchestra.run.trial170.stdout:kernel.core_pattern = core 2026-02-24T19:26:25.715 INFO:teuthology.orchestra.run.trial195.stdout:kernel.core_pattern = core 2026-02-24T19:26:25.733 DEBUG:teuthology.orchestra.run.trial014:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-24T19:26:25.762 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T19:26:25.762 DEBUG:teuthology.orchestra.run.trial044:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-24T19:26:25.778 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T19:26:25.778 DEBUG:teuthology.orchestra.run.trial170:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-24T19:26:25.795 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T19:26:25.796 DEBUG:teuthology.orchestra.run.trial195:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-24T19:26:25.813 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T19:26:25.813 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-24T19:26:25.830 INFO:teuthology.task.internal:Transferring archived files... 2026-02-24T19:26:25.831 DEBUG:teuthology.misc:Transferring archived files from trial014:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68689/remote/trial014 2026-02-24T19:26:25.831 DEBUG:teuthology.orchestra.run.trial014:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-24T19:26:25.868 DEBUG:teuthology.misc:Transferring archived files from trial044:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68689/remote/trial044 2026-02-24T19:26:25.868 DEBUG:teuthology.orchestra.run.trial044:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-24T19:26:25.904 DEBUG:teuthology.misc:Transferring archived files from trial170:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68689/remote/trial170 2026-02-24T19:26:25.905 DEBUG:teuthology.orchestra.run.trial170:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-24T19:26:25.941 DEBUG:teuthology.misc:Transferring archived files from trial195:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68689/remote/trial195 2026-02-24T19:26:25.942 DEBUG:teuthology.orchestra.run.trial195:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-24T19:26:25.990 INFO:teuthology.task.internal:Removing archive directory... 2026-02-24T19:26:25.991 DEBUG:teuthology.orchestra.run.trial014:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-24T19:26:25.994 DEBUG:teuthology.orchestra.run.trial044:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-24T19:26:25.997 DEBUG:teuthology.orchestra.run.trial170:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-24T19:26:25.999 DEBUG:teuthology.orchestra.run.trial195:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-24T19:26:26.028 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-24T19:26:26.049 INFO:teuthology.task.internal:Not uploading archives. 2026-02-24T19:26:26.050 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-24T19:26:26.065 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-24T19:26:26.065 DEBUG:teuthology.orchestra.run.trial014:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-24T19:26:26.068 DEBUG:teuthology.orchestra.run.trial044:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-24T19:26:26.070 DEBUG:teuthology.orchestra.run.trial170:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-24T19:26:26.073 DEBUG:teuthology.orchestra.run.trial195:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-24T19:26:26.082 INFO:teuthology.orchestra.run.trial014.stdout: 917521 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 24 19:26 /home/ubuntu/cephtest 2026-02-24T19:26:26.084 INFO:teuthology.orchestra.run.trial044.stdout: 920834 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 24 19:26 /home/ubuntu/cephtest 2026-02-24T19:26:26.088 INFO:teuthology.orchestra.run.trial170.stdout: 917525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 24 19:26 /home/ubuntu/cephtest 2026-02-24T19:26:26.090 INFO:teuthology.orchestra.run.trial195.stdout: 917525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 24 19:26 /home/ubuntu/cephtest 2026-02-24T19:26:26.091 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-24T19:26:26.107 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-24T19:26:26.145 INFO:teuthology.run:Summary data: description: rados/verify/{centos_latest ceph clusters/fixed-4 d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/{bluestore/{alloc$/{btree} base mem$/{normal-2} onode-segment$/{none} write$/{random/{compr$/{no$/{no}} random}}}} rados read-affinity/balance tasks/rados_api_tests validater/valgrind} duration: 3806.528131723404 flavor: default owner: scheduled_jayaprakash@soko04.front.sepia.ceph.com success: true 2026-02-24T19:26:26.145 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T19:26:26.272 INFO:teuthology.run:pass